← Back to Computation and Language
cs.CL

Can better questions and rubrics improve AI reasoning?

Rongzhi Zhang, Rui Feng, Zhihan Zhang, Jingfeng Yang, Qingyu Yin, Xin Liu, Zixuan Zhang, Priyanka Nigam, Bing Yin, Tuo Zhao, Chao Zhang

June 2, 2026

Training AI systems with rubric-based reinforcement learning hits a wall: vague queries produce vague rubrics, while overly specific ones demand references the model can't satisfy. QUBRIC solves this by jointly refining both. It converts open-ended questions into concrete scenarios, derives rubrics from teacher-policy mismatches, and filters for signal-rich pairs. The result: a 5.5-point gain on ArenaHard, plus strong transfer to reasoning tasks like legal and moral judgment—all without needing human verification of every answer.
Published as QUBRIC: Co-Designing Queries and Rubrics for RL Beyond Verifiable Rewards arXiv:2606.03968
Read the original paper →