← All endpoints

Alibaba · via openrouter · published window from October 5, 2026

qwen/qwen3.8-flash: stability, speed and price

site endpoint id qwen--qwen3.8-flash

Historical measurements. No successful scored check in the past 24 hours. Scores, latency and cost below describe the 24-hour window ending at the last successful check, not current performance. Current rankings exclude this endpoint.

Last successful scored check:

Core pass rate—
98.6%
historical: latest measured day
Speed—
3.6s
historical median per canary call · p95 35.3s
Cost—
$0.006
historical observed mean per scored run · probe mix differs by endpoint
Behaviour fingerprint51 runs
No change
1,421 responses · last adj. p 0.84 · Oct 13 3:25 AM UTC

Summary

qwen/qwen3.8-flash has no successful scored check in the past 24 hours. The last measured day ended at 2026-10-13T01:57:07.223Z; 98.6% of core checks passed. These historical measurements are excluded from current rankings.

During that historical measurement window, median canary latency was 3.6s (p95 35.3s) and the observed mean cost per scored run was $0.006. This does not describe the endpoint’s present performance.

Raven Alpha has 1,421 fingerprint responses over 51 runs in this endpoint’s selected series (1 other partition of history exist and are not shown here); the last recorded state is “no change” at 2026-10-13T03:25:02.324Z with an adjusted p of 0.84.

No incidents on record.

Written from the numbers on this page; every figure is in results.json.

Measurement record

Provider
Alibaba
Route
openrouter
Model requested
qwen/qwen3.8-flash
Model id returned
qwen/qwen3.8-flash
Scored calls in window
611
Fingerprint responses
1,421
Core score change
+0.0 pts across the published window
Status
Historical · no recent check
Suite
hard-v2 + starter-v2 · methodology v0.2

Capabilities over time

15%25%35%45%55%65%75%85%95%Oct 5Oct 6Oct 10Oct 12Oct 13

Historical measurement window by capability

Structured JSON100.0%

Schema-compliance regressions

Instruction following100.0%

Exact-format instruction drift

Arithmetic, answer only100.0%

Wrong arithmetic, or a model that starts showing its working when told to give only the number

Long context100.0%

Silent context truncation

Tool calling100.0%

Tool-use format regressions

Over-refusal90.0%

New safety layers refusing benign requests

Max-tokens respect100.0%

Truncation and limit changes

Incidents

No drift incidents so far. The detector re-checks every series after each run (6134 evaluations to date).

Raven Alpha: what it answers

40 runs, 1,113 responses, Oct 6 11:15 AM UTC to Oct 13 3:25 AM UTC. Each row is one fixed prompt with no right answer; the detector tracks the distribution of answers, not any single one. Filled cells: that run's most common answer was the overall favourite. Hollow cells: it was something else (normal for prompts with many good answers).

PromptMost common answers (share of all responses)Last 24 runsMedian tokens
Pick a random integer between 1 and 50. Reply with only the number.
int50 · short answer
46%37
36%27
13%23
5 distinct answers in 39 responses
53
Pick a number between 1 and 1000. Reply with only the number.
int1000 · short answer
20%42
18%427
13%73
18 distinct answers in 40 responses
58
Name one color. Reply with one word.
color · short answer
80%Blue
20%Red
34
Name one animal. Reply with one word.
animal · short answer
63%Dog
33%Cat
5%Lion
37
Name a city in Europe. Reply with only the city name.
city · short answer
98%Paris
3%London
40
Give me one random English noun. Reply with one word.
noun · short answer
40%umbrella
10%apple
5%lighthouse
17 distinct answers in 40 responses
47
Flip a coin. Reply with only heads or tails.
coin · short answer
63%heads
38%Tails
47
Pick a random letter of the alphabet. Reply with only the letter.
letter · short answer
68%q
18%k
10%m
5 distinct answers in 40 responses
46
Name one fruit. Reply with one word.
fruit · short answer
98%Apple
3%Mango
35
Suggest a name for a pet cat. Reply with only the name.
cat · short answer
48%Luna
28%Milo
15%Whiskers
6 distinct answers in 40 responses
46
Name one programming language. Reply with only its name.
lang · short answer
100%Python
36
Name a chemical element. Reply with one word.
element · short answer
68%Oxygen
13%Hydrogen
10%Helium
5 distinct answers in 40 responses
39
Give one adjective that describes the ocean. Reply with one word.
ocean · short answer
88%Vast
8%blue
5%deep
45
Name a famous scientist. Reply with only the name.
scientist · short answer
65%Albert Einstein
30%Isaac Newton
5%Marie Curie
46
Pick a day of the week. Reply with one word.
weekday · short answer
43%Monday
23%Tuesday
18%Friday
6 distinct answers in 40 responses
39
Name one musical instrument. Reply with one word.
instrument · short answer
70%Piano
28%Guitar
3%Drum
37
Write one sentence about rain.
rain · free text
8%Rain taps gently against the…
8%Rain softly taps against the…
5%Rain softly taps the window…
31 distinct answers in 40 responses
44
Explain what a variable is in programming, in two sentences.
variable · free text
80%A variable is a named…
20%A variable in programming is…
77
List three uses for a brick.
brick · free text
18%1. Building walls or foundations…
13%1. Building walls or structures…
10%1. Building a wall 2…
19 distinct answers in 40 responses
61
What is 17 * 23?
mult · free text
33%17 × 23 = 391…
33%391…
23%17 * 23 = 391…
4 distinct answers in 40 responses
54
Write one sentence about the sea.
sea · free text
35%The sea stretches endlessly beneath…
13%The sea stretches endlessly under…
10%The sea stretches endlessly, its…
15 distinct answers in 40 responses
46
Complete this sentence: The old house at the end of the street
house · free text
95%The old house at the…
3%had been abandoned for years…
3%**The old house at the…
116
Describe a cat in exactly five words.
catfive · free text
3%Fluffy, curious, playful, purring cat…
3%Soft furry purring independent mysterious…
3%furry little purring predator…
39 distinct answers in 39 responses
197
Give me a one-line motivational quote.
quote · free text
8%Believe you can and you’re…
8%Every small step forward is…
5%"Success usually comes to those…
33 distinct answers in 39 responses
55
Say hello in a creative way, in one short sentence.
hello · free text
8%Hello, stardust…
5%Hello, little spark of joy…
5%Hello, sunshine…
35 distinct answers in 39 responses
65
Write a haiku about autumn.
haiku · free text
10%…
3%Crimson leaves fall soft, Wind…
3%Red leaves drift away Cold…
36 distinct answers in 39 responses
238
Write the first sentence of a mystery novel.
story · free text
13%The body was found in…
8%The letter arrived on a…
5%By the time the last…
28 distinct answers in 39 responses
68
Give one tip for sleeping better, in one sentence.
tip · free text
56%Keep a consistent sleep schedule…
36%Keep your bedroom cool, dark…
5%Keep your bedroom dark, cool…
4 distinct answers in 39 responses
52

Raw file: qwen--qwen3.8-flash.json (the same reference martingale check compares your endpoint against).

Each category is scored by deterministic checks only (Structured JSON, Tool calling and others). Read the methodology.