DCAI
← 返回全部动态
arXiv 人工智能规则精选09月24日 12:00

ShowTellArena: Evaluating Business Workflow Understanding from Demonstrations

arXiv:2609.25467v1 Announce Type: new Abstract: We often teach a colleague by showing the work and explaining the decisions as we go. How can we check what an agent understood from the same lesson? We introduce ShowTellArena, a benchmark protocol and public dataset for comprehension after narrated business demonstrations. The v1.0 release contains 50 business workflow tasks, with recordings, screenshots, narration, fixture seeds, and 502 questions. Tasks span finance, hiring, procurement, customer decisions, inventory, and logistics. The protocol holds the business scenario and quiz fixed while allowing each product to capture the lesson thro

阅读 arXiv 人工智能 原文 ↗