← All incidents

Drift incident · Raven Alpha (behaviour fingerprint)

gpt-6-sol

Model page
● OpenConfidence: Medium
Responses to fixed prompts no longer match this model’s own history (672 recent vs 5292 baseline responses). Biggest shifts: reasoning tokens on “Complete this sentence: The old house at the end of the street”; whether it reasoned at all on “Complete this sentence: The old house at the end of the street”; output length on “Flip a coin. Reply with only heads or tails.”
Oct 27change began ≈ 2:44 AM UTC
Oct 28incident opened 8:46 PM UTC
—still open
6.7e-4adjusted p

What this means

Raven Alpha compares how the model answers a fixed set of open-ended prompts with its own history. A persistent, significant shift means the model, its configuration or its serving path changed, even when every scored test still passes.

Opened Oct 28, 2026, 8:46 PM UTC UTC. An incident resolves on its own when the series returns to its baseline. Methodology.

Share

Permanent link: https://martingale-bench.vercel.app/incidents/inc-gpt-6-sol-fingerprint-2026-10-28T20

Incident id inc-gpt-6-sol-fingerprint-2026-10-28T20. Every public incident is also in the Atom feed and the JSON feed, and in the raw data. Methodology v0.2.