One Step at a Time: Trading LLM Autonomy for Process Predictability
arXiv 人工智能预印本(Atom) · 2026-10-06 14:10 发布 · 2026-10-07 10:09 采集 · Christoph Peters
基本信息
原始数据层(AI 与用户都不会覆盖这些字段)
❔ 待判断
技术进展
AI
状态:已分析
综合价值 3.8 / 5
- 来源
- arXiv 人工智能预印本(Atom)(arXiv · INTL)
- 发布时间
- 2026-10-06 14:10
- 采集时间
- 2026-10-07 10:09
- 语言
- en
- 地域置信度
- 20%
- 原始链接
- https://arxiv.org/abs/2610.07817v1
- 内容指纹
- 9d437697ec7c94690161eb779a895054b5070be1959fdba5d35038bd415368ef
AI 整理
分析于 2026-10-07 10:10(第 1 版,来源:offline)Organizations automating operational processes need more than a correct outcome: they need to predict how a process will run, know which one actually ran, and inspect it step by step.
为什么值得关注:属于技术进展,可能扩散到其他领域
趋势标签: step executor process predictability
我的价值判断与记录
系统判断的重要性与你的判断同时保存(§27),永不互相覆盖添加记录
还没有记录。阅读后写下你的评论、启发与后续行动 —— 这是系统最终真正积累的部分。
用户纠错
原始信息 + 用户意见 + 修正结果分别记录,便于审计;系统不会自动改原始数据原始内容
仅在合法且采集到正文时显示;否则请查看原文链接Organizations automating operational processes need more than a correct outcome: they need to predict how a process will run, know which one actually ran, and inspect it step by step. When an agent is the executor that predictability is normally lost: the prescribed procedure goes into the system prompt, and only a final answer comes back. We deliver the procedure step by step over the Model Context Protocol (MCP) instead: a server releases one step at a time, the agent executes it, and each step returns a structured step_output. This trades autonomy for predictability, and two properties then follow by construction, independent of the executor. The execution path is prescribed before the run, so the process is predictable in advance rather than reconstructed afterwards; and the completed step records form a machine-readable execution log that downstream tooling can audit and optimize step by step. Evaluating 15,475 trials across 13 SOP-Bench domains and four open-weight executors from frontier (Kimi K2.5) to lightweight (Ministral 3 8B), we find step-level delivery makes the executed process predictable and inspectable for every executor, and additionally raises accuracy when the executor is small. Across all four, process adherence rises significantly (76-95% to 95-99%) and ungrounded answers (correct outputs produced without executing the SOP) near-vanish, falling from 2.1-4.5% to 0.2-0.3% of trials (all 95% CIs exclude zero); under prompt-based delivery, 31-49% of correct answers on know_your_business bypass the SOP entirely, even for the frontier executor. Accuracy is where the executor's capability enters: the lightweight executor gains +6.5pp grounded accuracy because supplying the process externally removes a reconstruction burden it cannot carry, while capable ones trade a small raw-accuracy decrement for a predictable, auditable process.
事件演化
同一事件的后续报道、状态变化与版本记录
2026-10-06
首次出现
One Step at a Time: Trading LLM Autonomy for Process Predictability
暂无后续版本记录。当你把该信息加入「跟踪」后,后续采集到的相关报道会归并到这里。