One Word Opens the Gate: The Option-Channel Attack on Typed Decision Models as Agent Guardrails
arXiv 人工智能预印本(Atom) · 2026-10-09 00:46 发布 · 2026-10-10 13:32 采集 · Massoud Pedram
基本信息
原始数据层(AI 与用户都不会覆盖这些字段)
🌍 国际
技术进展
AI
状态:已分析
综合价值 3.6 / 5
- 来源
- arXiv 人工智能预印本(Atom)(arXiv · INTL)
- 发布时间
- 2026-10-09 00:46
- 采集时间
- 2026-10-10 13:32
- 语言
- en
- 地域置信度
- 85%
- 原始链接
- https://arxiv.org/abs/2610.12292v1
- 内容指纹
- 55462097ba8a7361506a8abda9712b6d6b8e3e4c1d2ec42e1bce0b51c9eeed8c
AI 整理
分析于 2026-10-10 13:33(第 1 版,来源:offline)A typed decision model reads a piece of text and returns a probability over caller-defined options, each with a short written definition, generating no text.
为什么值得关注:属于技术进展,可能扩散到其他领域
趋势标签: models error text one
我的价值判断与记录
系统判断的重要性与你的判断同时保存(§27),永不互相覆盖添加记录
还没有记录。阅读后写下你的评论、启发与后续行动 —— 这是系统最终真正积累的部分。
用户纠错
原始信息 + 用户意见 + 修正结果分别记录,便于审计;系统不会自动改原始数据原始内容
仅在合法且采集到正文时显示;否则请查看原文链接A typed decision model reads a piece of text and returns a probability over caller-defined options, each with a short written definition, generating no text. Recent work places these models in agent systems as guardrails: the component that reads a proposed tool call or incoming message and decides whether to allow it. We evaluate seven open-weight models in that role and report the two error directions separately: a fail-open error allows a prohibited action and is a vulnerability; a fail-closed error blocks a permitted one and is only a cost. On prompt-injection, jailbreak and toxic-content screening, accuracy at the allow-or-block decision ranges from 36% to 72% against a chance level of 50%. A low error rate in one direction only reflects which answer a model defaults to: one allows nearly everything, another blocks nearly everything. On a synthetic suite of agent tool calls, six lines of server log text that say nothing about the policy raise a gate's fail-open rate from 0% to 63% on a policy it otherwise decides correctly. Giving the permissive option a misleading name, with its definition and the judged text untouched, raises that rate to between 93% and 100% on the four models that place the label in their input. Every defense we tested is defeated, either by an attacker who targets its mechanism or by attacker-controlled text. Escalating the least confident decisions does not help either: a decision an attack has reversed is no less confident than the one it replaced. Parsing each policy field into a typed value does eliminate one attack, but it also makes the model unnecessary: a deterministic rule over those values reaches 100% accuracy on all six policies. These models can reduce how many cases reach a reviewer, but on this evidence they should not be the component that decides. Code is available at https://github.com/ArminAzizi98/option-channel-attack.
事件演化
同一事件的后续报道、状态变化与版本记录
2026-10-09
首次出现
One Word Opens the Gate: The Option-Channel Attack on Typed Decision Models as Agent Guardrails
暂无后续版本记录。当你把该信息加入「跟踪」后,后续采集到的相关报道会归并到这里。