跳到正文
arXiv · Machine Learning· Albert Bou, Javier Valdes-Aleman, Jon M. Laurent, Samuel G. Rodriques, Andrew D. White, Michaela Hinks, Siddharth Narayanan·· 8 小时前AI 评分56

RAL:仅凭参考答案学习推理,探索现代大语言模型的对抗式强化学习后训练

Learning to Reason from Reference Samples Alone: Reinforced Adversarial Learning for Modern LLM Post-Training

AI 导读

Albert Bou 等人提出 Reinforced Adversarial Learning(RAL),利用联合训练的 LLM judge 从参考答案中学习奖励信号,仅凭参考答案对推理模型进行 on-policy 后训练。

来源:arXiv · Machine Learning · arxiv.org