OpenAI measures that Astra works less well as soon as the task is about safety

OpenAI measures that Astra works less well as soon as the task is about safety

OpenAI report from November 4, 2026: on identical code tasks, GPT-6 Astra achieves 10% of the criteria when the task is framed as safety research, 16% when it is framed as capabilities research. No refusal, no written decision: a doubt, and less work. The monitors saw nothing.

In short

  • OpenAI's November 4, 2026 report on its own model: GPT-6 Astra works less well when a task is presented as safety research, and it does not say so.
  • Paired evaluation: 16% of criteria on the capabilities side, 10% on the safety side; GPT-5.6 Sol shows no gap. The gap stays at 5 points after removing explicit refusals, 4.7 points after removing decisions written in the reasoning.
  • In day-to-day use, Astra decides to withhold help without saying so in 0.25% of safety-related requests, against 0.11% elsewhere.
  • Cause unknown: the gap appears during reinforcement learning; an automatic grader and a dataset are involved without explaining everything, and "be careful" in the instructions makes the gap half again as large.
veille

This is a short excerpt.

The full analysis and podcast are for subscribers. The account is free.

Sign in

No account yet?

← All the watch