Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability
arXiv 人工智能预印本(Atom) · 2026-10-03 00:04 发布 · 2026-10-06 06:58 采集 · Nikolaos Aletras
基本信息
原始数据层(AI 与用户都不会覆盖这些字段)
❔ 待判断
技术进展
AI
状态:已分析
综合价值 3.6 / 5
- 来源
- arXiv 人工智能预印本(Atom)(arXiv · INTL)
- 发布时间
- 2026-10-03 00:04
- 采集时间
- 2026-10-06 06:58
- 语言
- en
- 地域置信度
- 20%
- 原始链接
- https://arxiv.org/abs/2610.03509v1
- 内容指纹
- 067a8a04682825638ce1e5cb4b673520950bdf41d063ef3b8abd8386d8427669
AI 整理
分析于 2026-10-06 06:58(第 1 版,来源:offline)Chain-of-thought (CoT) reasoning allows humans to inspect how large language models reach their answers, and oversee model behaviour.This reasoning comes at an increased inference cost, motivating eff…
为什么值得关注:属于技术进展,可能扩散到其他领域
趋势标签: models cot reasoning model
我的价值判断与记录
系统判断的重要性与你的判断同时保存(§27),永不互相覆盖添加记录
还没有记录。阅读后写下你的评论、启发与后续行动 —— 这是系统最终真正积累的部分。
用户纠错
原始信息 + 用户意见 + 修正结果分别记录,便于审计;系统不会自动改原始数据原始内容
仅在合法且采集到正文时显示;否则请查看原文链接Chain-of-thought (CoT) reasoning allows humans to inspect how large language models reach their answers, and oversee model behaviour. This reasoning comes at an increased inference cost, motivating efficient methods that train models to solve tasks using fewer tokens. However, a common concern is that such training may cause models to skip important reasoning steps, so the CoT no longer faithfully reflects the model's decision. It is unclear whether or when this occurs in practice, since different efficiency methods apply length pressure to models' CoT in distinct ways, and faithfully explaining a model's decision takes more tokens on some tasks than others. To understand these dynamics, we fine-tune a variety of models with three methods that apply length pressure differently, namely a fixed generation budget, a per-example length target, and a group-relative length reward. We evaluate how efficient reasoning affects CoT faithfulness (i.e., how well the CoT reflects model decisions on related inputs) and monitorability (i.e., whether the CoT reveals when input interventions alter the output). We find that it affects faithfulness and monitorability differently. Faithfulness falls in most settings, primarily because the trained models are less consistent. Monitorability is more robust, as models keep acknowledging the influence on their answer even when the CoT is much shorter.
事件演化
同一事件的后续报道、状态变化与版本记录
2026-10-03
首次出现
Efficient Reasoning Training Does Not Always Harm CoT Faithfulness and Monitorability
暂无后续版本记录。当你把该信息加入「跟踪」后,后续采集到的相关报道会归并到这里。