MartingaleBench
← All incidents

Drift incident · Raven Alpha (behaviour fingerprint)

gpt-6-astra

Model page
✓ ResolvedConfidence: Low
Responses to fixed prompts no longer match this model’s own history (1316 recent vs 10136 baseline responses). Biggest shifts: visible output length on “Suggest a name for a pet cat. Reply with only the name.”; whether it reasoned at all on “Suggest a name for a pet cat. Reply with only the name.”; output length on “Suggest a name for a pet cat. Reply with only the name.”
Oct 29change began ≈ 1:56 PM UTC
Nov 4incident opened 5:53 PM UTC
Nov 6resolved 10:46 AM UTC
4.0e-3adjusted p

What this means

Raven Alpha compares how the model answers a fixed set of open-ended prompts with its own history. A persistent, significant shift means the model, its configuration or its serving path changed, even when every scored test still passes.

Opened Nov 4, 2026, 5:53 PM UTC UTC. Resolved Nov 6, 2026, 10:46 AM UTC UTC: the series returned to its baseline. Methodology.

Share

Permanent link: https://martingale-bench.vercel.app/incidents/inc-gpt-6-astra-fingerprint-2026-11-04T17

Incident id inc-gpt-6-astra-fingerprint-2026-11-04T17. Every public incident is also in the Atom feed and the JSON feed, and in the raw data. Methodology v0.2.