cs.AI updates on arXiv.org 10月31日 12:01
Lean4PHYS:基于Lean4的物理问题推理框架
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

本文介绍了Lean4PHYS,一个用于大学物理问题推理的Lean4框架,包含LeanPhysBench和PhysLib,通过基准测试和模型性能分析,验证了其有效性和挑战性。

arXiv:2510.26094v1 Announce Type: new Abstract: We present Lean4PHYS, a comprehensive reasoning framework for college-level physics problems in Lean4. Lean4PHYS includes LeanPhysBench, a college-level benchmark for formal physics reasoning in Lean4, which contains 200 hand-crafted and peer-reviewed statements derived from university textbooks and physics competition problems. To establish a solid foundation for formal reasoning in physics, we also introduce PhysLib, a community-driven repository containing fundamental unit systems and theorems essential for formal physics reasoning. Based on the benchmark and Lean4 repository we composed in Lean4PHYS, we report baseline results using major expert Math Lean4 provers and state-of-the-art closed-source models, with the best performance of DeepSeek-Prover-V2-7B achieving only 16% and Claude-Sonnet-4 achieving 35%. We also conduct a detailed analysis showing that our PhysLib can achieve an average improvement of 11.75% in model performance. This demonstrates the challenging nature of our LeanPhysBench and the effectiveness of PhysLib. To the best of our knowledge, this is the first study to provide a physics benchmark in Lean4.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

Lean4 物理问题推理 基准测试 模型性能 PhysLib
相关文章