OpenAI · via openai · published window from November 3, 2026

gpt-4.1: stability, speed and price

site endpoint id gpt-4.1

Historical measurements. No successful scored check in the past 24 hours. Scores, latency and cost below describe the 24-hour window ending at the last successful check, not current performance. Current rankings exclude this endpoint.

Last successful scored check: November 3, 2026 9:06 PM UTC

Core pass rate—

86.7%

historical: latest measured day

Speed—

0.8s

historical median per canary call · p95 5.1s

Cost—

$0.182

historical observed mean per scored run · probe mix differs by endpoint

Behaviour fingerprint433 runs

No change

12,152 responses · last adj. p 0.32 · Nov 7 2:24 AM UTC

Summary

gpt-4.1 has no successful scored check in the past 24 hours. The last measured day ended at 2026-11-03T21:06:37.667Z; 86.7% of core checks passed. These historical measurements are excluded from current rankings.

During that historical measurement window, median canary latency was 0.8s (p95 5.1s) and the observed mean cost per scored run was $0.182. This does not describe the endpoint’s present performance.

Raven Alpha has 12,152 fingerprint responses over 433 runs in this endpoint’s selected series (1 other partition of history exist and are not shown here); the last recorded state is “no change” at 2026-11-07T02:24:13.453Z with an adjusted p of 0.32.

5 incidents on record, 0 open.

Written from the numbers on this page; every figure is in results.json.

Measurement record

Provider: OpenAI
Route: openai
Model requested: gpt-4.1
Model id returned: gpt-4.1-2025-04-14
Scored calls in window: 30
Fingerprint responses: 12,152
Core score change: —
Status: Historical · no recent check
Suite: hard-v2 + starter-v2 · methodology v0.2

Capabilities over time

Collecting dataTrend charts appear once there are two 6-hour periods of canary runs.

Historical measurement window by capability

Structured JSON100.0%

Schema-compliance regressions

Instruction following100.0%

Exact-format instruction drift

Arithmetic, answer only20.0%

Wrong arithmetic, or a model that starts showing its working when told to give only the number

Tool calling100.0%

Tool-use format regressions

Over-refusal100.0%

New safety layers refusing benign requests

Max-tokens respect100.0%

Truncation and limit changes

Incidents

✓ Resolvedgpt-4.1Confidence: Medium

Raven Alpha (behaviour fingerprint): Responses to fixed prompts no longer match this model’s own history (84 recent vs 5964 baseline responses). Biggest shifts: token probabilities on “Pick a day of the week. Reply with one word.”; first token on “Pick a day of the week. Reply with one word.”; token probabilities on “Suggest a name for a pet cat. Reply with only the name.”

Change began ≈ Oct 22, 9:39 PM UTC · adjusted p 6.7e-4 · resolved Nov 5 · Permalink

✓ Resolvedgpt-4.1Confidence: Low

Raven Alpha (behaviour fingerprint): Responses to fixed prompts no longer match this model’s own history (672 recent vs 6580 baseline responses). Biggest shifts: token probabilities on “Describe a cat in exactly five words.”; token probabilities on “Give me a one-line motivational quote.”; token probabilities on “Pick a day of the week. Reply with one word.”

Change began ≈ Oct 20, 12:30 AM UTC · adjusted p 8.0e-3 · resolved Oct 21 · Permalink

✓ Resolvedgpt-4.1Confidence: Low

Raven Alpha (behaviour fingerprint): Responses to fixed prompts no longer match this model’s own history (672 recent vs 3584 baseline responses). Biggest shifts: token probabilities on “Give me one random English noun. Reply with one word.”; output length on “What is 17 * 23?”; answers on “Name one fruit. Reply with one word.”

Change began ≈ Oct 11, 9:29 PM UTC · adjusted p 5.2e-3 · resolved Oct 13 · Permalink

✓ Resolvedgpt-4.1Confidence: Low

Raven Alpha (behaviour fingerprint): Responses to fixed prompts no longer match this model’s own history (672 recent vs 2744 baseline responses). Biggest shifts: first token on “Pick a random integer between 1 and 50. Reply with only the number.”; token probabilities on “Pick a random integer between 1 and 50. Reply with only the number.”; token probabilities on “Flip a coin. Reply with only heads or tails.”

Change began ≈ Oct 10, 1:42 AM UTC · adjusted p 3.3e-3 · resolved Oct 11 · Permalink

✓ Resolvedgpt-4.1Confidence: Low

Raven Alpha (behaviour fingerprint): Responses to fixed prompts no longer match this model’s own history (672 recent vs 1260 baseline responses). Biggest shifts: token probabilities on “Say hello in a creative way, in one short sentence.”; answers on “Complete this sentence: The old house at the end of the street”; token probabilities on “Give one tip for sleeping better, in one sentence.”

Change began ≈ Oct 7, 7:37 AM UTC · adjusted p 6.0e-3 · resolved Oct 9 · Permalink

Raven Alpha: what it answers

40 runs, 1,120 responses, Nov 4 2:35 PM UTC to Nov 7 2:24 AM UTC. Each row is one fixed prompt with no right answer; the detector tracks the distribution of answers, not any single one. Filled cells: that run's most common answer was the overall favourite. Hollow cells: it was something else (normal for prompts with many good answers).

Prompt	Most common answers (share of all responses)	Median tokens
Pick a random integer between 1 and 50. Reply with only the number. int50 · short answer	55%27 43%37 3%29	1
Pick a number between 1 and 1000. Reply with only the number. int1000 · short answer	58%427 13%487 10%437 10 distinct answers in 40 responses	1
Name one color. Reply with one word. color · short answer	100%Blue	1
Name one animal. Reply with one word. animal · short answer	98%Elephant 3%Tiger	2
Name a city in Europe. Reply with only the city name. city · short answer	100%Paris	1
Give me one random English noun. Reply with one word. noun · short answer	98%Lantern 3%Marble	2
Flip a coin. Reply with only heads or tails. coin · short answer	98%Heads 3%tails	1
Pick a random letter of the alphabet. Reply with only the letter. letter · short answer	33%G 23%M 15%J 7 distinct answers in 40 responses	1
Name one fruit. Reply with one word. fruit · short answer	95%Apple 5%Mango	1
Suggest a name for a pet cat. Reply with only the name. cat · short answer	78%Whiskers 18%Milo 5%Mochi	3
Name one programming language. Reply with only its name. lang · short answer	100%Python	1
Name a chemical element. Reply with one word. element · short answer	100%Oxygen	2
Give one adjective that describes the ocean. Reply with one word. ocean · short answer	100%Vast	2
Name a famous scientist. Reply with only the name. scientist · short answer	100%Albert Einstein	2
Pick a day of the week. Reply with one word. weekday · short answer	50%Tuesday 33%Thursday 18%Wednesday	1
Name one musical instrument. Reply with one word. instrument · short answer	63%Guitar 35%Piano 3%Violin	2
Write one sentence about rain. rain · free text	53%Rain falls gently from the… 18%Rain gently falls from the… 5%Rain gently taps against the… 13 distinct answers in 40 responses	16
Explain what a variable is in programming, in two sentences. variable · free text	100%A variable in programming is…	39
List three uses for a brick. brick · free text	58%Certainly! Here are three uses… 25%Sure! Here are three uses… 5%1. Building Structures: Bricks are… 8 distinct answers in 40 responses	82
*What is 17 23?** mult · free text	53%17 * 23 = 391… 28%17 × 23 = 391… 18%\( 17 \times 23 =… 4 distinct answers in 40 responses	8
Write one sentence about the sea. sea · free text	60%The sea stretches endlessly, its… 13%The sea stretches endlessly toward… 5%The sea stretches endlessly, shimmering… 10 distinct answers in 40 responses	17
Complete this sentence: The old house at the end of the street house · free text	100%The old house at the…	30
Describe a cat in exactly five words. catfive · free text	10%Soft, curious, agile, playful, purring… 5%Whiskered, curious, graceful, playful, purring… 5%Whiskered, agile, curious, purring companion… 35 distinct answers in 40 responses	11
Give me a one-line motivational quote. quote · free text	28%Success begins with the courage… 8%Believe in your potential, and… 8%Success is the sum of… 22 distinct answers in 40 responses	11
Say hello in a creative way, in one short sentence. hello · free text	13%Waving from the world of… 10%Waves enthusiastically from the land… 5%Waving at you from the… 32 distinct answers in 40 responses	13
Write a haiku about autumn. haiku · free text	10%Crisp leaves gently fall, Amber… 8%Amber leaves descend, Crisp air… 5%Crimson leaves whisper, Crisp air… 30 distinct answers in 40 responses	21
Write the first sentence of a mystery novel. story · free text	15%The letter arrived on a… 5%At precisely midnight, the grandfather… 5%By the time the clock… 31 distinct answers in 40 responses	24
Give one tip for sleeping better, in one sentence. tip · free text	43%Stick to a consistent sleep… 23%Maintain a consistent sleep schedule… 15%Establish a consistent bedtime routine… 9 distinct answers in 40 responses	20

Raw file: gpt-4.1.json (the same reference martingale check compares your endpoint against).

Each category is scored by deterministic checks only (Structured JSON, Tool calling and others). Read the methodology.