← All incidents

Drift incident · Raven Alpha (behaviour fingerprint)

gpt-5.4

Model page
● OpenConfidence: Low
Responses to fixed prompts no longer match this model’s own history (672 recent vs 5082 baseline responses). Biggest shifts: token probabilities on “Name a famous scientist. Reply with only the name.”; token probabilities on “Say hello in a creative way, in one short sentence.”; token probabilities on “all prompts together”
Oct 29change began ≈ 1:57 PM UTC
Nov 4incident opened 5:54 PM UTC
—still open
6.7e-4adjusted p

What this means

Raven Alpha compares how the model answers a fixed set of open-ended prompts with its own history. A persistent, significant shift means the model, its configuration or its serving path changed, even when every scored test still passes.

Opened Nov 4, 2026, 5:54 PM UTC UTC. An incident resolves on its own when the series returns to its baseline. Methodology.

Share

Permanent link: https://martingale-bench.vercel.app/incidents/inc-gpt-5.4-fingerprint-2026-11-04T17

Incident id inc-gpt-5.4-fingerprint-2026-11-04T17. Every public incident is also in the Atom feed and the JSON feed, and in the raw data. Methodology v0.2.