arXiv · Machine Learning· Haoyu Zhao, Sitian Tu, Yuxuan Huang, Huichi Zhou, Zhangyue Yin, Jiahao Huang, Jingyuan Xu, Tianmiao Shi, Jin Shi, Nianxi Zhang, Yangmiao Zhang, Zhuolang Chan, Huiyan Hu, Chenchao Sheng, Yaqing Luo, Yue Chen, Huaxiu Yao, Meng Fang, Jun Wang·· 9 小时前AI 评分52
Continual Learning Exam 基准:评测 LLM 智能体的长期 RSI 与经验学习
Continual Learning Exam: Benchmarking Long-Horizon RSI and Experiential Learning in LLM Agents
AI 导读
研究团队提出 Continual Learning Exam(CLE),用于评测 LLM 智能体在长期专业工作流中从经验中持续改进并保留有用既有知识的能力。基准包含120项任务,按五级阶梯组织,共600个关卡,覆盖89种职业角色和12个职业领域。
来源:arXiv · Machine Learning · arxiv.org