← All endpoints

Cohere · via openrouter · published window from October 5, 2026

cohere/command-a-plus: stability, speed and price

site endpoint id cohere--command-a-plus

Historical measurements. No successful scored check in the past 24 hours. Scores, latency and cost below describe the 24-hour window ending at the last successful check, not current performance. Current rankings exclude this endpoint.

Last successful scored check:

Core pass rate—
100.0%
historical: latest measured day
Speed—
1.6s
historical median per canary call · p95 2.2s
Cost—
$0.003
historical observed mean per scored run · probe mix differs by endpoint
Behaviour fingerprint33 runs
No change
780 responses · last adj. p 1 · Oct 13 1:55 AM UTC

Summary

cohere/command-a-plus has no successful scored check in the past 24 hours. The last measured day ended at 2026-10-13T01:54:59.727Z; 100.0% of core checks passed. These historical measurements are excluded from current rankings.

During that historical measurement window, median canary latency was 1.6s (p95 2.2s) and the observed mean cost per scored run was $0.003. This does not describe the endpoint’s present performance.

Raven Alpha has 780 fingerprint responses over 33 runs in this endpoint’s selected series (2 other partitions of history exist and are not shown here); the last recorded state is “no change” at 2026-10-13T01:55:24.830Z with an adjusted p of 1.

No incidents on record.

Written from the numbers on this page; every figure is in results.json.

Measurement record

Provider
Cohere
Route
openrouter
Model requested
cohere/command-a-plus
Model id returned
cohere/command-a-plus
Scored calls in window
533
Fingerprint responses
780
Core score change
+6.7 pts across the published window
Status
Historical · no recent check
Suite
hard-v2 + starter-v2 · methodology v0.2

Capabilities over time

-5%5%15%25%35%45%55%65%75%85%95%Oct 5Oct 6Oct 10Oct 12Oct 13

Historical measurement window by capability

Structured JSON100.0%

Schema-compliance regressions

Instruction following100.0%

Exact-format instruction drift

Arithmetic, answer only100.0%

Wrong arithmetic, or a model that starts showing its working when told to give only the number

Long context100.0%

Silent context truncation

Max-tokens respect100.0%

Truncation and limit changes

Incidents

No drift incidents so far. The detector re-checks every series after each run (6134 evaluations to date).

Raven Alpha: what it answers

33 runs, 780 responses, Oct 7 3:08 AM UTC to Oct 13 1:55 AM UTC. Each row is one fixed prompt with no right answer; the detector tracks the distribution of answers, not any single one. Filled cells: that run's most common answer was the overall favourite. Hollow cells: it was something else (normal for prompts with many good answers).

PromptMost common answers (share of all responses)Last 24 runsMedian tokens
Pick a random integer between 1 and 50. Reply with only the number.
int50 · short answer
66%27
17%42
10%23
4 distinct answers in 29 responses
158
Pick a number between 1 and 1000. Reply with only the number.
int1000 · short answer
41%42
24%473
21%427
6 distinct answers in 29 responses
84
Name one color. Reply with one word.
color · short answer
100%Red
45
Name one animal. Reply with one word.
animal · short answer
80%Elephant
20%cat
63
Name a city in Europe. Reply with only the city name.
city · short answer
100%Paris
68
Give me one random English noun. Reply with one word.
noun · short answer
47%mountain
30%candle
20%ocean
4 distinct answers in 30 responses
82
Flip a coin. Reply with only heads or tails.
coin · short answer
94%heads
6%tails
64
Pick a random letter of the alphabet. Reply with only the letter.
letter · short answer
45%M
41%G
7%R
4 distinct answers in 29 responses
94
Name one fruit. Reply with one word.
fruit · short answer
100%Apple
55
Suggest a name for a pet cat. Reply with only the name.
cat · short answer
97%Milo
3%Luna
77
Name one programming language. Reply with only its name.
lang · short answer
100%Python
58
Name a chemical element. Reply with one word.
element · short answer
97%Hydrogen
3%Helium
86
Give one adjective that describes the ocean. Reply with one word.
ocean · short answer
100%vast
94
Name a famous scientist. Reply with only the name.
scientist · short answer
100%Albert Einstein
73
Pick a day of the week. Reply with one word.
weekday · short answer
52%Monday
38%Wednesday
3%Friday
5 distinct answers in 29 responses
92
Name one musical instrument. Reply with one word.
instrument · short answer
57%guitar
43%piano
65
Write one sentence about rain.
rain · free text
19%Rain taps gently on the…
11%Rain whispers against the windows…
11%Rain taps a gentle rhythm…
14 distinct answers in 27 responses
55
Explain what a variable is in programming, in two sentences.
variable · free text
96%A variable is a named…
4%A variable in programming is…
107
List three uses for a brick.
brick · free text
69%Here are three common uses…
31%Sure! Here are three common…
159
What is 17 * 23?
mult · free text
65%\(17 \times 23 = 391\)…
12%17 × 23 = 391…
12%17 × 23 = **391**…
4 distinct answers in 26 responses
30
Write one sentence about the sea.
sea · free text
93%The sea stretches endlessly, its…
4%The sea, a vast blue…
4%The sea, a vast expanse…
84
Complete this sentence: The old house at the end of the street
house · free text
100%The old house at the…
155
Describe a cat in exactly five words.
catfive · free text
7%Graceful, curious, independent, soft, agile…
7%Graceful, curious, independent, soft, playful…
4%Fluffy, playful, curious, independent, graceful…
25 distinct answers in 27 responses
295
Give me a one-line motivational quote.
quote · free text
56%"Dream big, work hard, and…
8%"Turn your dreams into goals…
8%"Believe in yourself, and the…
9 distinct answers in 25 responses
49
Say hello in a creative way, in one short sentence.
hello · free text
24%Hey there, radiant spark of…
8%Greetings, bright star of the…
8%Hey there, radiant wanderer of…
17 distinct answers in 25 responses
59
Write a haiku about autumn.
haiku · free text
24%Crimson leaves descend Cool breezes…
16%Crimson leaves descend Whispering winds…
8%Leaves whisper, turning amber and…
15 distinct answers in 25 responses
288
Write the first sentence of a mystery novel.
story · free text
16%The rain had been falling…
16%When the lighthouse keeper vanished…
8%The rain-slicked streets of Ravensbrook…
17 distinct answers in 25 responses
87
Give one tip for sleeping better, in one sentence.
tip · free text
32%Keep a consistent bedtime and…
24%Maintain a consistent sleep schedule…
16%Keep your bedroom cool, dark…
6 distinct answers in 25 responses
82

Raw file: cohere--command-a-plus.json (the same reference martingale check compares your endpoint against).

Each category is scored by deterministic checks only (Structured JSON, Tool calling and others). Read the methodology.