MartingaleBench
← All incidents

Drift incident · Raven Alpha (behaviour fingerprint)

gpt-6-luna

Model page
✓ ResolvedConfidence: Low
Responses to fixed prompts no longer match this model’s own history (1344 recent vs 8742 baseline responses). Biggest shifts: whether it reasoned at all on “all prompts together”; visible output length on “Name one programming language. Reply with only its name.”; whether it reasoned at all on “Name one programming language. Reply with only its name.”
Oct 13change began ≈ 11:12 AM UTC
Oct 15incident opened 1:11 AM UTC
Oct 15resolved 5:39 AM UTC
8.7e-3adjusted p

What this means

Raven Alpha compares how the model answers a fixed set of open-ended prompts with its own history. A persistent, significant shift means the model, its configuration or its serving path changed, even when every scored test still passes.

Opened Oct 15, 2026, 1:11 AM UTC UTC. Resolved Oct 15, 2026, 5:39 AM UTC UTC: the series returned to its baseline. Methodology.

Share

Permanent link: https://martingale-bench.vercel.app/incidents/inc-gpt-6-luna-fingerprint-2026-10-15T01

Incident id inc-gpt-6-luna-fingerprint-2026-10-15T01. Every public incident is also in the Atom feed and the JSON feed, and in the raw data. Methodology v0.2.