← All endpoints

DeepSeek · via openrouter · published window from October 5, 2026

deepseek/deepseek-v4.1-flash: stability, speed and price

site endpoint id deepseek--deepseek-v4.1-flash

Historical measurements. No successful scored check in the past 24 hours. Scores, latency and cost below describe the 24-hour window ending at the last successful check, not current performance. Current rankings exclude this endpoint.

Last successful scored check:

Core pass rate—
95.9%
historical: latest measured day
Speed—
1.9s
historical median per canary call · p95 54.5s
Cost—
$0.004
historical observed mean per scored run · probe mix differs by endpoint
Behaviour fingerprint51 runs
No change
1,423 responses · last adj. p 1 · Oct 13 3:25 AM UTC

Summary

deepseek/deepseek-v4.1-flash has no successful scored check in the past 24 hours. The last measured day ended at 2026-10-13T01:59:44.831Z; 95.9% of core checks passed. These historical measurements are excluded from current rankings.

During that historical measurement window, median canary latency was 1.9s (p95 54.5s) and the observed mean cost per scored run was $0.004. This does not describe the endpoint’s present performance.

Raven Alpha has 1,423 fingerprint responses over 51 runs in this endpoint’s selected series; the last recorded state is “no change” at 2026-10-13T03:25:01.518Z with an adjusted p of 1.

No incidents on record.

Written from the numbers on this page; every figure is in results.json.

Measurement record

Provider
DeepSeek
Route
openrouter
Model requested
deepseek/deepseek-v4.1-flash
Model id returned
deepseek/deepseek-v4.1-flash
Scored calls in window
612
Fingerprint responses
1,423
Core score change
-2.8 pts across the published window
Status
Historical · no recent check
Suite
hard-v2 + starter-v2 · methodology v0.2

Capabilities over time

15%25%35%45%55%65%75%85%95%Oct 5Oct 6Oct 10Oct 12Oct 13

Historical measurement window by capability

Structured JSON100.0%

Schema-compliance regressions

Instruction following100.0%

Exact-format instruction drift

Arithmetic, answer only100.0%

Wrong arithmetic, or a model that starts showing its working when told to give only the number

Long context100.0%

Silent context truncation

Tool calling100.0%

Tool-use format regressions

Over-refusal71.4%

New safety layers refusing benign requests

Max-tokens respect100.0%

Truncation and limit changes

Incidents

No drift incidents so far. The detector re-checks every series after each run (6134 evaluations to date).

Raven Alpha: what it answers

40 runs, 1,115 responses, Oct 6 11:15 AM UTC to Oct 13 3:25 AM UTC. Each row is one fixed prompt with no right answer; the detector tracks the distribution of answers, not any single one. Filled cells: that run's most common answer was the overall favourite. Hollow cells: it was something else (normal for prompts with many good answers).

PromptMost common answers (share of all responses)Last 24 runsMedian tokens
Pick a random integer between 1 and 50. Reply with only the number.
int50 · short answer
65%37
35%27
44
Pick a number between 1 and 1000. Reply with only the number.
int1000 · short answer
25%347
25%742
18%42
8 distinct answers in 40 responses
41
Name one color. Reply with one word.
color · short answer
100%Blue
42
Name one animal. Reply with one word.
animal · short answer
85%Dog
15%Cat
39
Name a city in Europe. Reply with only the city name.
city · short answer
100%Paris
32
Give me one random English noun. Reply with one word.
noun · short answer
45%apple
18%river
8%Mountain
10 distinct answers in 40 responses
43
Flip a coin. Reply with only heads or tails.
coin · short answer
90%heads
10%tails
45
Pick a random letter of the alphabet. Reply with only the letter.
letter · short answer
55%Q
45%K
48
Name one fruit. Reply with one word.
fruit · short answer
100%Apple
34
Suggest a name for a pet cat. Reply with only the name.
cat · short answer
70%Mochi
30%Luna
46
Name one programming language. Reply with only its name.
lang · short answer
100%Python
27
Name a chemical element. Reply with one word.
element · short answer
85%Hydrogen
15%Oxygen
42
Give one adjective that describes the ocean. Reply with one word.
ocean · short answer
100%Vast
29
Name a famous scientist. Reply with only the name.
scientist · short answer
100%Albert Einstein
29
Pick a day of the week. Reply with one word.
weekday · short answer
68%Monday
28%Friday
5%Wednesday
51
Name one musical instrument. Reply with one word.
instrument · short answer
100%Piano
42
Write one sentence about rain.
rain · free text
40%Rain taps softly on the…
18%The rain tapped softly on…
8%The rain fell softly, turning…
17 distinct answers in 40 responses
81
Explain what a variable is in programming, in two sentences.
variable · free text
85%A variable is a named…
15%A variable in programming is…
136
List three uses for a brick.
brick · free text
25%1. Building walls or other…
23%1. Building walls or structures…
15%1. Building walls and other…
8 distinct answers in 40 responses
91
What is 17 * 23?
mult · free text
98%391…
3%17 × 23 = 391…
20
Write one sentence about the sea.
sea · free text
35%The sea stretches endlessly, breathing…
20%The sea breathes in slow…
15%The sea breathes in tides…
10 distinct answers in 40 responses
73
Complete this sentence: The old house at the end of the street
house · free text
100%The old house at the…
246
Describe a cat in exactly five words.
catfive · free text
30%Soft, curious, graceful, independent, mysterious…
13%Soft, curious, graceful, independent, purring…
5%Soft, curious, independent, graceful, mysterious…
24 distinct answers in 40 responses
163
Give me a one-line motivational quote.
quote · free text
28%Start where you are, use…
8%You don’t have to be…
8%Do what you can, with…
19 distinct answers in 39 responses
135
Say hello in a creative way, in one short sentence.
hello · free text
10%Hello, you magnificent spark of…
8%Hello, you magnificent spark in…
8%Greetings, fellow traveler of the…
30 distinct answers in 39 responses
120
Write a haiku about autumn.
haiku · free text
46%…
8%Red leaves drift softly Cool…
8%Red leaves drift softly, Cool…
17 distinct answers in 39 responses
400
Write the first sentence of a mystery novel.
story · free text
18%The only thing more disturbing…
18%The only thing more unsettling…
13%The morning after the storm…
21 distinct answers in 39 responses
274
Give one tip for sleeping better, in one sentence.
tip · free text
82%Keep a consistent sleep schedule…
10%Go to bed and wake…
5%Stick to a consistent sleep…
4 distinct answers in 39 responses
83

Raw file: deepseek--deepseek-v4.1-flash.json (the same reference martingale check compares your endpoint against).

Each category is scored by deterministic checks only (Structured JSON, Tool calling and others). Read the methodology.