📡 今日研究情报 外部信息 → 筛选 → 阅读 → 价值判断 → 趋势 → 思想

基本信息

原始数据层(AI 与用户都不会覆盖这些字段)
❔ 待判断 技术进展 AI 状态:已分析 综合价值 3.8 / 5
来源
arXiv 人工智能预印本(Atom)(arXiv · INTL)
发布时间
2026-10-06 23:29
采集时间
2026-10-07 14:51
语言
en
地域置信度
20%
原始链接
https://arxiv.org/abs/2610.08540v1
内容指纹
80f32e4faeffd86051ca36e28426dbde5c9760c1c4a7e0c3ad6b39d3f51d9b01

AI 整理

分析于 2026-10-07 14:51(第 1 版,来源:offline)

Whether alignment gets easier or harder as models grow is often argued from isolated findings, as if alignment were one property.We treat it as a family of measurable scaling relations: for each risk…

为什么值得关注:属于技术进展,可能扩散到其他领域

趋势标签: alignment scaling capability models

我的价值判断与记录

系统判断的重要性与你的判断同时保存(§27),永不互相覆盖
详情 原文

添加记录

评论不会自动变成正式思想,需要在「思想输入」页主动确认沉淀(§41)

还没有记录。阅读后写下你的评论、启发与后续行动 —— 这是系统最终真正积累的部分。

用户纠错

原始信息 + 用户意见 + 修正结果分别记录,便于审计;系统不会自动改原始数据

原始内容

仅在合法且采集到正文时显示;否则请查看原文链接
Whether alignment gets easier or harder as models grow is often argued from isolated findings, as if alignment were one property. We treat it as a family of measurable scaling relations: for each risk category r, the alignment burden needed to hold a fixed safety target is modeled as B_r(N)=a_rN^alpha_r, with N a capability proxy; against a budget proportional to N, scaling helps if alpha_r 1. We give three operationalizations of burden and distinguish observed, audited and true alignment. A toy model, in which corrections consume capability headroom, makes the consequences explicit. We prove that the largest exponent among corrected risks, not an average, sets the long-run regime; that above 1 any policy holding headroom above a floor must grow super-exponentially; that, for burdens that are positive mixtures of power laws, fits on small models underestimate large-scale exponents; and that an audit that uncovers hidden failures without false positives never underestimates true alignment. We propose a pre-registrable protocol and apply reduced versions of it twice. A preregistered reanalysis of public adversarial-training data for Pythia classifiers finds that the compute needed to bring attack success under 10% grows as N^0.60. A preregistered pilot on Qwen2.5 0.5B-72B finds exponents of -0.05 for truthfulness and 0.48 for stated dispositions (both scaling helps under its reduced rule, though local slopes approach 1 at the top; replicated on Qwen3 0.6B-14B), while sycophancy (0.89, or 0.83 with two seeds added at 72B) and a planted backdoor are undetermined: the backdoor is removed quickly when its trigger is known but survives blind safety training at four of five sizes. We release four browser games that play these laws (www.aisafety.fun). We make no claim about which regime holds for current frontier models.

事件演化

同一事件的后续报道、状态变化与版本记录
2026-10-06 首次出现
Toward Alignment Scaling Laws: A Framework and First Preregistered Measurements

暂无后续版本记录。当你把该信息加入「跟踪」后,后续采集到的相关报道会归并到这里。

门户首页