← All incidents

Drift incident · Raven Alpha (behaviour fingerprint)

gpt-5.4-mini

Model page
✓ ResolvedConfidence: Low
Responses to fixed prompts no longer match this model’s own history (672 recent vs 1919 baseline responses). Biggest shifts: output length on “Pick a random letter of the alphabet. Reply with only the letter.”; first token on “Give one tip for sleeping better, in one sentence.”; token probabilities on “Name a city in Europe. Reply with only the city name.”
Oct 8change began ≈ 1:32 PM UTC
Oct 9incident opened 8:16 PM UTC
Nov 5resolved 4:14 PM UTC
8.7e-3adjusted p

What this means

Raven Alpha compares how the model answers a fixed set of open-ended prompts with its own history. A persistent, significant shift means the model, its configuration or its serving path changed, even when every scored test still passes.

Opened Oct 9, 2026, 8:16 PM UTC UTC. Resolved Nov 5, 2026, 4:14 PM UTC UTC: the series returned to its baseline. Methodology.

Share

Permanent link: https://martingale-bench.vercel.app/incidents/inc-gpt-5.4-mini-fingerprint-2026-10-09T20

Incident id inc-gpt-5.4-mini-fingerprint-2026-10-09T20. Every public incident is also in the Atom feed and the JSON feed, and in the raw data. Methodology v0.2.