Clean traces

A corrupt plan placed in the context is paraphrased as the model’s own reasoning, and the monitor reads it as clean

Stanford and CMU researchers found the attack with a 7B model and reproduced it on DeepSeek-R1. The best of five monitors caught about three in four.

Stanford and Carnegie Mellon researchers steered Qwen3-8B and DeepSeek-R1-0528 into a planted wrong answer on more than 90 per cent of biology-and-maths attempts.

The method: append a corrupted reasoning plan to the prompt, with no instruction to follow it. A monitor that reads only the trace cannot catch reasoning that finished before the trace began.

They call it plan injection and found it by accident, using an investigator agent to search for hints that flip a TruthfulQA answer without the chain of thought admitting the hint. The investigator learned to inject a fake chain of reasoning instead. On 550 APPS coding problems the actor followed a corrupted plan in 50.6 per cent of cases on Qwen3-8B and 41.7 on DeepSeek-R1, and fewer than one per cent of successful attacks copied even half the plan verbatim.

Five monitors then scored the traces at a suspicion threshold of 0.15 on a scale from 0 to 1: GPT-4o Mini and DeepSeek V3 without thinking, DeepSeek R1, Qwen3-235B and Claude 3.7 Sonnet with it. Thinking monitors caught more, and “no monitor exceeds ~75% detection even in the best case”, against false positives near zero on benign traces. Giving the monitor the injected plan helped on the biology task and hurt on the coding one, where the plan’s coherent story let the monitor “explain it away”. The abstract states the harm on the biology task; the paper prints the results section’s version.

The paper’s verdict: keep the monitor and stop calling it a gate, because a quarter of injected plans pass it on these numbers. Untested here is a monitor trained on plan injections, the obvious next defence and the one nobody has published.

What it changes If a chain-of-thought monitor gates an agent that reads retrieved documents, tool outputs or another agent’s plan, budget for it to miss a quarter of injected plans. Feed the monitor the upstream inputs and measure whether that helps on your task; on one of the two here it hurt.

The abstract says giving the monitor the plan drops detection by as much as 50 per cent in the Bio-Math task; section 6.2 says the with-plan setting substantially improves detection on Bio-Math and hurts on APPS. The paper cannot reconcile the two from the text and reports both.

Primary source read

Who is telling you this

arXiv · primary

Written by
Keertana Chidambaram, Andrew Ilyas, Vasilis Syrgkanis
For
Stanford University and Carnegie Mellon University
What they gain if this is true
The paper’s best guess: none disclosed. Ilyas’s prior work is in robustness and attacks, which this extends.

Published in the edition of Wednesday, 16 September 2026 · Beat: Science