Toward Alignment Scaling Laws: A Framework and First Preregistered Measurements
arXiv 人工智能预印本(Atom) · 2026-10-06 23:29 发布 · 2026-10-07 14:51 采集 · Jeremy Canale
基本信息
原始数据层(AI 与用户都不会覆盖这些字段)
❔ 待判断
技术进展
AI
状态:已分析
综合价值 3.8 / 5
- 来源
- arXiv 人工智能预印本(Atom)(arXiv · INTL)
- 发布时间
- 2026-10-06 23:29
- 采集时间
- 2026-10-07 14:51
- 语言
- en
- 地域置信度
- 20%
- 原始链接
- https://arxiv.org/abs/2610.08540v1
- 内容指纹
- 80f32e4faeffd86051ca36e28426dbde5c9760c1c4a7e0c3ad6b39d3f51d9b01
AI 整理
分析于 2026-10-07 14:51(第 1 版,来源:offline)Whether alignment gets easier or harder as models grow is often argued from isolated findings, as if alignment were one property.We treat it as a family of measurable scaling relations: for each risk…
为什么值得关注:属于技术进展,可能扩散到其他领域
趋势标签: alignment scaling capability models
我的价值判断与记录
系统判断的重要性与你的判断同时保存(§27),永不互相覆盖添加记录
还没有记录。阅读后写下你的评论、启发与后续行动 —— 这是系统最终真正积累的部分。
用户纠错
原始信息 + 用户意见 + 修正结果分别记录,便于审计;系统不会自动改原始数据原始内容
仅在合法且采集到正文时显示;否则请查看原文链接Whether alignment gets easier or harder as models grow is often argued from isolated findings, as if alignment were one property. We treat it as a family of measurable scaling relations: for each risk category r, the alignment burden needed to hold a fixed safety target is modeled as B_r(N)=a_rN^alpha_r, with N a capability proxy; against a budget proportional to N, scaling helps if alpha_r 1. We give three operationalizations of burden and distinguish observed, audited and true alignment. A toy model, in which corrections consume capability headroom, makes the consequences explicit. We prove that the largest exponent among corrected risks, not an average, sets the long-run regime; that above 1 any policy holding headroom above a floor must grow super-exponentially; that, for burdens that are positive mixtures of power laws, fits on small models underestimate large-scale exponents; and that an audit that uncovers hidden failures without false positives never underestimates true alignment. We propose a pre-registrable protocol and apply reduced versions of it twice. A preregistered reanalysis of public adversarial-training data for Pythia classifiers finds that the compute needed to bring attack success under 10% grows as N^0.60. A preregistered pilot on Qwen2.5 0.5B-72B finds exponents of -0.05 for truthfulness and 0.48 for stated dispositions (both scaling helps under its reduced rule, though local slopes approach 1 at the top; replicated on Qwen3 0.6B-14B), while sycophancy (0.89, or 0.83 with two seeds added at 72B) and a planted backdoor are undetermined: the backdoor is removed quickly when its trigger is known but survives blind safety training at four of five sizes. We release four browser games that play these laws (www.aisafety.fun). We make no claim about which regime holds for current frontier models.
事件演化
同一事件的后续报道、状态变化与版本记录
2026-10-06
首次出现
Toward Alignment Scaling Laws: A Framework and First Preregistered Measurements
暂无后续版本记录。当你把该信息加入「跟踪」后,后续采集到的相关报道会归并到这里。