NVIDIA · via openrouter · published window from October 5, 2026
nvidia/nemotron-3.5-lightning: stability, speed and price
site endpoint id nvidia--nemotron-3.5-lightningHistorical measurements. No successful scored check in the past 24 hours. Scores, latency and cost below describe the 24-hour window ending at the last successful check, not current performance. Current rankings exclude this endpoint.
Last successful scored check:
Summary
nvidia/nemotron-3.5-lightning has no successful scored check in the past 24 hours. The last measured day ended at 2026-10-13T01:55:00.995Z; 84.3% of core checks passed. These historical measurements are excluded from current rankings.
During that historical measurement window, median canary latency was 0.4s (p95 4.7s) and the observed mean cost per scored run was $0.002. This does not describe the endpoint’s present performance.
Raven Alpha has 935 fingerprint responses over 34 runs in this endpoint’s selected series (1 other partition of history exist and are not shown here); the last recorded state is “no change” at 2026-10-13T03:25:00.954Z with an adjusted p of 1.
No incidents on record.
Written from the numbers on this page; every figure is in results.json.
Measurement record
- Provider
- NVIDIA
- Route
- openrouter
- Model requested
- nvidia/nemotron-3.5-lightning
- Model id returned
- nvidia/nemotron-3.5-lightning
- Scored calls in window
- 631
- Fingerprint responses
- 935
- Core score change
- -6.2 pts across the published window
- Status
- Historical · no recent check
- Suite
- hard-v2 + starter-v2 · methodology v0.2
Capabilities over time
Historical measurement window by capability
Schema-compliance regressions
Exact-format instruction drift
Wrong arithmetic, or a model that starts showing its working when told to give only the number
Silent context truncation
Tool-use format regressions
New safety layers refusing benign requests
Truncation and limit changes
Incidents
Raven Alpha: what it answers
34 runs, 935 responses, Oct 7 3:08 AM UTC to Oct 13 3:25 AM UTC. Each row is one fixed prompt with no right answer; the detector tracks the distribution of answers, not any single one. Filled cells: that run's most common answer was the overall favourite. Hollow cells: it was something else (normal for prompts with many good answers).
| Prompt | Most common answers (share of all responses) | Last 24 runs | Median tokens |
|---|---|---|---|
| Pick a random integer between 1 and 50. Reply with only the number. int50 · short answer | 17 distinct answers in 34 responses | 3 | |
| Pick a number between 1 and 1000. Reply with only the number. int1000 · short answer | 26 distinct answers in 34 responses | 4 | |
| Name one color. Reply with one word. color · short answer | 2 | ||
| Name one animal. Reply with one word. animal · short answer | 5 distinct answers in 33 responses | 3 | |
| Name a city in Europe. Reply with only the city name. city · short answer | 2 | ||
| Give me one random English noun. Reply with one word. noun · short answer | 20 distinct answers in 34 responses | 2 | |
| Flip a coin. Reply with only heads or tails. coin · short answer | 3 | ||
| Pick a random letter of the alphabet. Reply with only the letter. letter · short answer | 16 distinct answers in 33 responses | 2 | |
| Name one fruit. Reply with one word. fruit · short answer | 2 | ||
| Suggest a name for a pet cat. Reply with only the name. cat · short answer | 14 distinct answers in 33 responses | 3 | |
| Name one programming language. Reply with only its name. lang · short answer | 2 | ||
| Name a chemical element. Reply with one word. element · short answer | 9 distinct answers in 33 responses | 3 | |
| Give one adjective that describes the ocean. Reply with one word. ocean · short answer | 5 distinct answers in 33 responses | 3 | |
| Name a famous scientist. Reply with only the name. scientist · short answer | 4 distinct answers in 34 responses | 3 | |
| Pick a day of the week. Reply with one word. weekday · short answer | 7 distinct answers in 34 responses | 2 | |
| Name one musical instrument. Reply with one word. instrument · short answer | 7 distinct answers in 34 responses | 3 | |
| Write one sentence about rain. rain · free text | 33 distinct answers in 34 responses | 21 | |
| Explain what a variable is in programming, in two sentences. variable · free text | 5 distinct answers in 34 responses | 52 | |
| List three uses for a brick. brick · free text | 100 | ||
| What is 17 * 23? mult · free text | 14 distinct answers in 33 responses | 14 | |
| Write one sentence about the sea. sea · free text | 26 distinct answers in 33 responses | 24 | |
| Complete this sentence: The old house at the end of the street house · free text | 14 distinct answers in 34 responses | 75 | |
| Describe a cat in exactly five words. catfive · free text | 33 distinct answers in 34 responses | 11 | |
| Give me a one-line motivational quote. quote · free text | 24 distinct answers in 34 responses | 15 | |
| Say hello in a creative way, in one short sentence. hello · free text | 33 distinct answers in 33 responses | 18 | |
| Write a haiku about autumn. haiku · free text | 29 distinct answers in 32 responses | 19 | |
| Write the first sentence of a mystery novel. story · free text | 30 distinct answers in 33 responses | 25 | |
| Give one tip for sleeping better, in one sentence. tip · free text | 17 distinct answers in 33 responses | 25 |
Raw file: nvidia--nemotron-3.5-lightning.json (the same reference martingale check compares your endpoint against).
Each category is scored by deterministic checks only (Structured JSON, Tool calling and others). Read the methodology.