alphaXiv 介绍 Embodied First Exam：1156 个任务测试编程智能体控制机器人

AI coding agents could bring the next paradigm shift in robotics by learning to control robots through code.

With that in mind, this paper introduces Embodied First Exam, the first robotics benchmark with 1,156 tasks across 47 robots, testing whether coding agents can directly control robots, write controllers, or train their own policies under different physical-world constraints.

And the results also show how far we still have to go. On 391 matched tasks, the strongest agent, GPT-6 Astra, achieves 77% success with full simulator access and unlimited resets, but only 30% under more realistic constraints.

In real-time evaluations, 63% of tasks remain unsolved by any of the 8 agents tested.

https://www.alphaxiv.org/abs/2611.12177