ReSI: Recursive Safety Improvement toward Resistant and Resilient AI
arXiv 人工智能预印本(Atom) · 2026-10-09 00:17 发布 · 2026-10-10 13:32 采集 · Xiang Wang
基本信息
原始数据层(AI 与用户都不会覆盖这些字段)
🌍 国际
技术进展
AI
状态:已分析
综合价值 3.7 / 5
- 来源
- arXiv 人工智能预印本(Atom)(arXiv · INTL)
- 发布时间
- 2026-10-09 00:17
- 采集时间
- 2026-10-10 13:32
- 语言
- en
- 地域置信度
- 65%
- 原始链接
- https://arxiv.org/abs/2610.12233v1
- 内容指纹
- 804360877e2b443bf5de78052d37eed178485eeca1acc36203bbde3f7e96f675
AI 整理
分析于 2026-10-10 13:33(第 1 版,来源:offline)Recursive self-improvement, the participation of AI systems in improving their own capabilities, is beginning to move from theoretical prospect to practice, posing both challenges and opportunities fo…
为什么值得关注:属于技术进展,可能扩散到其他领域
趋势标签: AI safety recursive alignment vulnerabilities
我的价值判断与记录
系统判断的重要性与你的判断同时保存(§27),永不互相覆盖添加记录
还没有记录。阅读后写下你的评论、启发与后续行动 —— 这是系统最终真正积累的部分。
用户纠错
原始信息 + 用户意见 + 修正结果分别记录,便于审计;系统不会自动改原始数据原始内容
仅在合法且采集到正文时显示;否则请查看原文链接Recursive self-improvement, the participation of AI systems in improving their own capabilities, is beginning to move from theoretical prospect to practice, posing both challenges and opportunities for safety alignment. Models evolve through frequent updates, and their safety alignment requires continual adaptation to each new checkpoint. Meanwhile, with evolving red-teaming methods exposing new vulnerabilities, safety improvement for each checkpoint needs to mitigate exposed vulnerabilities and generalize to risks not yet revealed. Following R$^2$AI, we term these goals resistance to known threats and resilience to unforeseen risks. Recursive self-improvement, in turn, inspires an approach to both goals: safety alignment could likewise advance through successive rounds of evaluation and update. We therefore introduce ReSI, a recursive safety improvement framework that implements this approach through automated research. In each round, ReSI applies diverse red-teaming methods to identify vulnerabilities in the current target model, develops training recipes, and promotes the update with the largest safety gain among those passing a Pareto gate on capability retention as the next target model. Across four dense and mixture-of-experts models, ReSI matches or exceeds evaluated frontier models on in-distribution and out-of-distribution safety benchmarks, and outperforms alignment baselines on nearly all safety evaluations while largely preserving general capabilities. In particular, ReSI reduces the mean X-Teaming attack success rate across the four models from 86.01% to 31.45%, well below GPT-5.6-Luna's leading frontier result of 56.69%, indicating stronger resilience to attacks unseen during training. These findings support recursive safety improvement as a practical path toward resistant and resilient AI.
事件演化
同一事件的后续报道、状态变化与版本记录
2026-10-09
首次出现
ReSI: Recursive Safety Improvement toward Resistant and Resilient AI
暂无后续版本记录。当你把该信息加入「跟踪」后,后续采集到的相关报道会归并到这里。