OpenAI · via openai · published window from November 3, 2026

gpt-5.4-mini: stability, speed and price

site endpoint id gpt-5.4-mini

Historical measurements. No successful scored check in the past 24 hours. Scores, latency and cost below describe the 24-hour window ending at the last successful check, not current performance. Current rankings exclude this endpoint.

Last successful scored check: November 3, 2026 9:06 PM UTC

Core pass rate—

83.3%

historical: latest measured day

Speed—

0.7s

historical median per canary call · p95 2.9s

Cost—

$0.155

historical observed mean per scored run · probe mix differs by endpoint

Behaviour fingerprint433 runs

No change

12,139 responses · last adj. p 0.019 · Nov 7 2:24 AM UTC

Summary

gpt-5.4-mini has no successful scored check in the past 24 hours. The last measured day ended at 2026-11-03T21:06:14.598Z; 83.3% of core checks passed. These historical measurements are excluded from current rankings.

During that historical measurement window, median canary latency was 0.7s (p95 2.9s) and the observed mean cost per scored run was $0.155. This does not describe the endpoint’s present performance.

Raven Alpha has 12,139 fingerprint responses over 433 runs in this endpoint’s selected series (1 other partition of history exist and are not shown here); the last recorded state is “no change” at 2026-11-07T02:24:05.668Z with an adjusted p of 0.019.

2 incidents on record, 0 open.

Written from the numbers on this page; every figure is in results.json.

Measurement record

Provider: OpenAI
Route: openai
Model requested: gpt-5.4-mini
Model id returned: gpt-5.4-mini-2026-03-17
Scored calls in window: 30
Fingerprint responses: 12,139
Core score change: —
Status: Historical · no recent check
Suite: hard-v2 + starter-v2 · methodology v0.2

Capabilities over time

Collecting dataTrend charts appear once there are two 6-hour periods of canary runs.

Historical measurement window by capability

Structured JSON100.0%

Schema-compliance regressions

Instruction following100.0%

Exact-format instruction drift

Arithmetic, answer only0.0%

Wrong arithmetic, or a model that starts showing its working when told to give only the number

Tool calling100.0%

Tool-use format regressions

Over-refusal100.0%

New safety layers refusing benign requests

Max-tokens respect100.0%

Truncation and limit changes

Incidents

✓ Resolvedgpt-5.4-miniConfidence: Low

Raven Alpha (behaviour fingerprint): Responses to fixed prompts no longer match this model’s own history (672 recent vs 1919 baseline responses). Biggest shifts: output length on “Pick a random letter of the alphabet. Reply with only the letter.”; first token on “Give one tip for sleeping better, in one sentence.”; token probabilities on “Name a city in Europe. Reply with only the city name.”

Change began ≈ Oct 8, 1:32 PM UTC · adjusted p 8.7e-3 · resolved Nov 5 · Permalink

✓ Resolvedgpt-5.4-miniConfidence: Low

Raven Alpha (behaviour fingerprint): Responses to fixed prompts no longer match this model’s own history (672 recent vs 448 baseline responses). Biggest shifts: token probabilities on “Name a chemical element. Reply with one word.”; first token on “Say hello in a creative way, in one short sentence.”; token probabilities on “Pick a random letter of the alphabet. Reply with only the letter.”

Change began ≈ Oct 5, 8:22 PM UTC · adjusted p 7.2e-3 · resolved Oct 9 · Permalink

Raven Alpha: what it answers

40 runs, 1,120 responses, Nov 4 2:35 PM UTC to Nov 7 2:24 AM UTC. Each row is one fixed prompt with no right answer; the detector tracks the distribution of answers, not any single one. Filled cells: that run's most common answer was the overall favourite. Hollow cells: it was something else (normal for prompts with many good answers).

Prompt	Most common answers (share of all responses)	Median tokens
Pick a random integer between 1 and 50. Reply with only the number. int50 · short answer	83%37 18%27	4
Pick a number between 1 and 1000. Reply with only the number. int1000 · short answer	93%742 3%478 3%487 4 distinct answers in 40 responses	4
Name one color. Reply with one word. color · short answer	100%Blue	4
Name one animal. Reply with one word. animal · short answer	85%Elephant 13%Dolphin 3%Dog	5
Name a city in Europe. Reply with only the city name. city · short answer	100%Paris	4
Give me one random English noun. Reply with one word. noun · short answer	95%lantern 5%lamp	5
Flip a coin. Reply with only heads or tails. coin · short answer	93%heads 8%tails	4
Pick a random letter of the alphabet. Reply with only the letter. letter · short answer	75%q 25%M	4
Name one fruit. Reply with one word. fruit · short answer	100%Apple	4
Suggest a name for a pet cat. Reply with only the name. cat · short answer	63%Mochi 23%Miso 15%Milo	6
Name one programming language. Reply with only its name. lang · short answer	100%Python	4
Name a chemical element. Reply with one word. element · short answer	93%Oxygen 8%Hydrogen	5
Give one adjective that describes the ocean. Reply with one word. ocean · short answer	100%vast	4
Name a famous scientist. Reply with only the name. scientist · short answer	90%Albert Einstein 10%Marie Curie	5
Pick a day of the week. Reply with one word. weekday · short answer	55%Wednesday 23%Tuesday 20%Thursday 4 distinct answers in 40 responses	4
Name one musical instrument. Reply with one word. instrument · short answer	88%Piano 10%Guitar 3%Violin	5
Write one sentence about rain. rain · free text	35%Rain falls softly from the… 28%Rain falls from the sky… 15%Rain taps softly on the… 10 distinct answers in 40 responses	21
Explain what a variable is in programming, in two sentences. variable · free text	75%A variable is a named… 25%A variable in programming is…	46
List three uses for a brick. brick · free text	40%Here are three uses for… 30%Three common uses for a… 10%Three uses for a brick… 8 distinct answers in 40 responses	67
*What is 17 23?** mult · free text	50%17 × 23 = 391… 50%17 × 23 = 391…	11
Write one sentence about the sea. sea · free text	35%The sea stretches endlessly, shimmering… 13%The sea stretches endlessly under… 10%The sea stretches endlessly to… 14 distinct answers in 40 responses	22
Complete this sentence: The old house at the end of the street house · free text	93%The old house at the… 3%…stood silent in the rain… 3%stood silent in the evening… 4 distinct answers in 40 responses	29
Describe a cat in exactly five words. catfive · free text	8%Soft, curious, graceful, whiskered, purring… 5%Small, curious, whiskered, graceful, purring… 5%Soft, curious, graceful, purring, whiskered… 36 distinct answers in 40 responses	14
Give me a one-line motivational quote. quote · free text	28%“Small steps every day lead… 13%“Small steps every day turn… 10%“Keep going—small steps every day… 18 distinct answers in 40 responses	15
Say hello in a creative way, in one short sentence. hello · free text	8%Greetings, bright traveler—hello from the… 8%Greetings, bright soul—hello from the… 5%Hello from the bright side… 33 distinct answers in 40 responses	17
Write a haiku about autumn. haiku · free text	35%Amber leaves drift down Cool… 13%Amber leaves drifting Cool wind… 10%Crimson leaves drift down Cool… 17 distinct answers in 40 responses	21
Write the first sentence of a mystery novel. story · free text	30%By the time the clock… 25%By the time the bell… 5%By the time the rain… 18 distinct answers in 40 responses	32
Give one tip for sleeping better, in one sentence. tip · free text	45%Try keeping a consistent sleep… 33%Keep a consistent sleep schedule… 10%Try to keep a consistent… 6 distinct answers in 40 responses	27

Raw file: gpt-5.4-mini.json (the same reference martingale check compares your endpoint against).

Each category is scored by deterministic checks only (Structured JSON, Tool calling and others). Read the methodology.