Knowledge or Calculator? Decomposing the Skill Premium in Verifiable Financial Agent Workflows
arXiv 人工智能预印本(Atom) · 2026-10-03 00:44 发布 · 2026-10-06 06:58 采集 · Zhongtian Sun
基本信息
原始数据层(AI 与用户都不会覆盖这些字段)
❔ 待判断
技术进展
AI
状态:已分析
综合价值 3.6 / 5
- 来源
- arXiv 人工智能预印本(Atom)(arXiv · INTL)
- 发布时间
- 2026-10-03 00:44
- 采集时间
- 2026-10-06 06:58
- 语言
- en
- 地域置信度
- 20%
- 原始链接
- https://arxiv.org/abs/2610.03564v1
- 内容指纹
- 48784e6ccc9cc812c737a02f3c4357998014a0a0dbd80f4b8089d89791bbdcfb
AI 整理
分析于 2026-10-06 06:58(第 1 版,来源:offline)Financial AI agents must do more than retrieve facts: investment workflows require correct quantitative execution, reliable use of procedural resources, and auditable structured outputs.
为什么值得关注:属于技术进展,可能扩散到其他领域
趋势标签: AI across procedural workflows episodes
我的价值判断与记录
系统判断的重要性与你的判断同时保存(§27),永不互相覆盖添加记录
还没有记录。阅读后写下你的评论、启发与后续行动 —— 这是系统最终真正积累的部分。
用户纠错
原始信息 + 用户意见 + 修正结果分别记录,便于审计;系统不会自动改原始数据原始内容
仅在合法且采集到正文时显示;否则请查看原文链接Financial AI agents must do more than retrieve facts: investment workflows require correct quantitative execution, reliable use of procedural resources, and auditable structured outputs. We introduce FinSkillBench, an evaluation suite of 2,603 point in time episodes across 12 subtasks in portfolio construction, risk management, and fundamental analysis, with hidden regenerable ground truth and task specific deterministic verifiers. Executing 17,820 episodes across 9 models and 3 resource conditions, the paired analysis across 8 models shows that curated skill packages raise mean scores by +16.2 points (0.366 to 0.528), whereas skills generated within a single episode add only +0.5 points while consuming more tokens and turns. We then decompose the curated premium by granting human authored procedural documents and executable domain tools separately: documents alone add +5.6 points, tools alone add +19.5 points, and their combination is subadditive. The premium is strongly workflow dependent: executable tools dominate numerically intensive workflows, documentation matters more when procedural or output schema guidance is the bottleneck, and interpretive tasks benefit from both. The effects are sign stable across 10 scoring variants and cluster bootstrap analyses, and an independently implemented second harness reproduces the directional pattern while showing that effect magnitudes depend on how tools and data are exposed. Overall, a measured "skill premium" is a property of the full model, resource, and harness system rather than of the underlying model alone.
事件演化
同一事件的后续报道、状态变化与版本记录
2026-10-03
首次出现
Knowledge or Calculator? Decomposing the Skill Premium in Verifiable Financial Agent Workflows
暂无后续版本记录。当你把该信息加入「跟踪」后,后续采集到的相关报道会归并到这里。