gpt-6-astraeffort: highOpenAI · 3 Oct 2026
7.5 / 10Quality v1 · 8/8 pages
Time3h 31m
Output tokens322k
Cost≈$31.69API price, est.
Home › Videos › DeepSeek V4.1 Flash 1017 vs GPT-6 Astra: Same Score for 9 Cents a Test
17 Oct 2026 · 6 runs · 6 models
DeepSeek V4.1 Flash 1017 vs GPT-6 Astra: Same Score for 9 Cents a Test
DeepSeek updated V4.1 Flash on 17 October, so I ran the 1017 snapshot through OpenRouter at high effort on release day. It scored 7.50 on eight tests, second of 18 models, 0.01 behind GPT-6 Astra and ahead of Opus 5.5 and Sonnet 5.5. All eight tests cost 71 cents on my OpenRouter bill, about 9 cents a test, against about $3.77 for Astra and $5.18 for Opus on the same tests. Visually, Opus and Sonnet are still ahead.
The results
The same scores as the leaderboard: a test that failed is left out of its run's score, not counted as zero. Time, tokens and cost cover each whole run, wildcards included.
Ranking
Quality v1 over measured non-wildcard pages. Different workloads: browse the outputs and coverage before comparing models.
0510
Score against output tokens
Quality v1 against full-run tokens. Different workloads and hardware affect this comparison.
Claude HaikuClaude OpusClaude SonnetDeepseek FlashGPT AstraGPT Luna
Output tokens include the model's thinking. Like the time, tokens and cost table, it counts every test the model took, wildcards included. A hollow dot is not an exact count: some tests reported none, or the count was worked out from the length of the output. The score axis is zoomed to the data.
Score against time
Quality v1 against full-run time. Different workloads and hardware affect this comparison.
Claude HaikuClaude OpusClaude SonnetDeepseek FlashGPT AstraGPT Luna
Time is how long the model took to answer, added up over its tests; judging is not counted. Like the time, tokens and cost table, it counts every test the model took, wildcards included. A hollow dot is a lower bound: some tests have no time recorded. The score axis is zoomed to the data.
Where each model is strong and weak
One row per model, one column per test and per scoring criterion.
| By test | By what the judges scored | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Aero Lab | Jet Odyssey | Blast Island | Launch Day | Alex Optics | Afterburner | Hangar Ops | Hangar Planner | Rotor Rampage | Working behaviour | Visual quality | Engineering quality | Usability / accessibility | |
| gpt-6-astraeffort: high | 7.8 | 7.6 | 7.0 | 7.1 | 7.8 | 7.8 | — | 7.3 | 7.8 | 8.2 | 8.2 | 6.7 | 6.3 | |
| deepseek/deepseek-v4.1-flash-1017effort: high | 7.4best of 2 | 7.8best of 2 | 7.2best of 2 | 6.9best of 2 | 8.0best of 2 | 7.9best of 2 | — | 7.5best of 2 | 7.5best of 2 | 8.1 | 8.0 | 7.2 | 6.2 | |
| claude-opus-5-5effort: high | 7.7 | 7.0 | 7.5 | 7.7 | 6.0 | 8.3 | 7.4 | — | 7.9 | 8.0 | 8.0 | 6.9 | 6.2 | |
| claude-sonnet-5-5effort: high | 7.8best of 2 | 7.8 | 4.1 | 7.7best of 2 | 8.4 | 7.7 | — | 7.2 | 7.7 | 7.6 | 8.0 | 6.9 | 6.1 | |
| gpt-6-lunaeffort: max | 7.3 | 7.3 | 1.4 | 5.8 | 7.7 | 7.0 | 7.5 | — | 5.7 | 6.5 | 6.7 | 6.0 | 5.2 | |
| claude-haiku-5-5effort: high | 6.9best of 4 | 1.4best of 3 | 6.8best of 3 | 7.1best of 2 | 7.8 | 7.0best of 2 | — | 7.2 | 4.7best of 2 | 6.3 | 6.6 | 6.2 | 5.0 | |
Violet is strong, orange is weak, on the same 0–10 scale in every cell.Different prompts and protocols: no best-in-column verdict.
Time, tokens and cost
What each model used across all its tests, wildcards included.
| Model | Tests | Time | Output tokens | Speed | Cost | Subscription used |
|---|---|---|---|---|---|---|
| gpt-6-astraeffort: highOpenAI | 9 | 3h 31m | 322k75k of it thinking | 25.4 tok/s | ≈$31.69API price, est. | — |
| deepseek/deepseek-v4.1-flash-1017effort: highDeepSeek | 8 | 1h 30m | ≥971k511k of it thinking | 179.4 tok/s | ≥≈$0.71API price, est. | — |
| claude-opus-5-5effort: highAnthropic | 8 | 3h 29m | 1.30M753k of it thinking | 103.0 tok/s | $36.60API price | 5-hour window not comparable7-day window +2 pts |
| claude-sonnet-5-5effort: highAnthropic | 9 | 4h 49m | ≥1.99M1.29M of it thinking | 130.5 tok/s | ≥$33.72API price | — |
| gpt-6-lunaeffort: maxOpenAI | 8 | 3h 38m | 577k321k of it thinking | 43.9 tok/s | ≈$0.85API price, est. | 7-day window +5 pts |
| claude-haiku-5-5effort: highAnthropic | 9 | ≥4h 14m | ≥2.58M2.15M of it thinking | 222.3 tok/s | ≥$3.79mixed | — |
≈ An estimate: the provider reported no count, so it is worked out from the length of the output (about 4 characters a token).
— Not measured.
Cost says how it was worked out: charged by the provider, at API prices (for a subscription), or no API charge on local hardware. ≥ means some tests had no price.
Read from the account's usage window in whole percentage points, so a short run can show 0 points. It counts everything the account did in that time, not only this run.
Runs in this video
Every run behind the numbers. Scores name their comparison basis.
Model
Score / basis
Time
Output tokens
Cost
deepseek/deepseek-v4.1-flash-1017effort: highDeepSeek · 17 Oct 2026
7.5 / 10Quality v1 · 8/8 pages
Time1h 30m
Output tokens≥971k
Cost≥≈$0.71API price, est.
claude-opus-5-5effort: highAnthropic · 3 Oct 2026
7.4 / 10Quality v1 · 8/8 pages
Time3h 29m
Output tokens1.30M
Cost$36.60API price
claude-sonnet-5-5effort: highAnthropic · 5 Oct 2026
7.3 / 10Quality v1 · 8/8 pages
Time4h 49m
Output tokens≥1.99M
Cost≥$33.72API price
gpt-6-lunaeffort: maxOpenAI · 2 Oct 2026
6.2 / 10Quality v1 · 8/8 pages
Time3h 38m
Output tokens577k
Cost≈$0.85API price, est.
claude-haiku-5-5effort: highAnthropic · 7 Oct 2026
6.1 / 10Quality v1 · 8/8 pages
Time≥4h 14m
Output tokens≥2.58M
Cost≥$3.79mixed
The pages each model made
Choose a model to see its pages.
gpt-6-astraeffort: high
OpenAI · 7.5 / 10 · Quality v1 · 8/8 pages · 3h 31m · ≈$31.69
7.8
Aero Lab
gpt-6-astra · effort: high
24m 35s · 36k tokens · ≈$4.30
Quality v1 · Working behaviour 8.5 · Visual quality 8.5 · Engineering quality 7.0 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1e8e809e8caeb2ba
Open the pageDetails
Earlier evaluations
6.0/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.6
Jet Odyssey
gpt-6-astra · effort: high
32m 29s · 48k tokens · ≈$6.16
Quality v1 · Working behaviour 8.0 · Visual quality 8.5 · Engineering quality 6.5 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt eaf6eace42027b11
Open the pageDetails
Earlier evaluations
6.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.0
Blast Island
gpt-6-astra · effort: high
23m 42s · 35k tokens · ≈$4.04
Quality v1 · Working behaviour 8.0 · Visual quality 8.0 · Engineering quality 5.5 · Usability / accessibility 5.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 28ba22cd0f56ca1e
Open the pageDetails
Earlier evaluations
6.7/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.1
Launch Day
gpt-6-astra · effort: high
38m 12s · 56k tokens · ≈$7.01
Quality v1 · Working behaviour 8.0 · Visual quality 8.0 · Engineering quality 6.0 · Usability / accessibility 5.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d1e76d48a7ac8eb6
Open the pageDetails
Earlier evaluations
5.8/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.8
Alex Optics
gpt-6-astra · effort: high
23m 34s · 35k tokens · ≈$2.33
Quality v1 · Working behaviour 8.0 · Visual quality 8.3 · Engineering quality 7.4 · Usability / accessibility 7.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt de7c304e41dd3505
Open the pageDetails
Earlier evaluations
7.5/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.8
Afterburner
gpt-6-astra · effort: high
29m 39s · 34k tokens · ≈$2.39
Quality v1 · Working behaviour 8.5 · Visual quality 8.5 · Engineering quality 7.0 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e08d0617005c33f9
Open the pageDetails
Earlier evaluations
8.2/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.3
Hangar Planner
gpt-6-astra · effort: high
8m 07s · 23k tokens · ≈$1.65
Quality v1 · Working behaviour 8.0 · Visual quality 7.0 · Engineering quality 8.0 · Usability / accessibility 6.0Fixed 16 of 16 bugs · 14 of 14 features still work · 545 lines changedscored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 14deca81c8b3a6c9
Open the pageDetails
Earlier evaluations
9.0/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.8
Rotor Rampage
gpt-6-astra · effort: high
22m 30s · 33k tokens · ≈$2.28
Quality v1 · Working behaviour 8.5 · Visual quality 8.7 · Engineering quality 6.5 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d196c18e5127f818
Open the pageDetails
Earlier evaluations
7.2/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.4
Unzip the Desertwildcard
gpt-6-astra · effort: high
8m 53s · 24k tokens · ≈$1.55
Quality v1 · Working behaviour 8.0 · Visual quality 8.3 · Engineering quality 6.3 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 8a3d9f5098d4145f
Open the pageDetails
Earlier evaluations
6.9/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
deepseek/deepseek-v4.1-flash-1017effort: high
DeepSeek · 7.5 / 10 · Quality v1 · 8/8 pages · 1h 30m · ≥≈$0.71
7.4
Aero Labbest of 2
deepseek/deepseek-v4.1-flash-1017 · effort: high
17m 45s · 143k tokens · ≈$0.11
Quality v1 · Working behaviour 8.0 · Visual quality 8.0 · Engineering quality 7.0 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1e8e809e8caeb2ba
Open the pageDetails
7.8
Jet Odysseybest of 2
deepseek/deepseek-v4.1-flash-1017 · effort: high
12m 29s · 124k tokens · ≈$0.09
Quality v1 · Working behaviour 8.5 · Visual quality 8.3 · Engineering quality 6.8 · Usability / accessibility 6.8scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1ce617b6d67089b2
Open the pageDetails
7.2
Blast Islandbest of 2
deepseek/deepseek-v4.1-flash-1017 · effort: high
9m 37s · 130k tokens · ≈$0.10
Quality v1 · Working behaviour 7.5 · Visual quality 8.0 · Engineering quality 7.0 · Usability / accessibility 5.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 28ba22cd0f56ca1e
Open the pageDetails
6.9
Launch Daybest of 2
deepseek/deepseek-v4.1-flash-1017 · effort: high
18m 33s · 211k tokens · ≈$0.15
Quality v1 · Working behaviour 7.5 · Visual quality 7.0 · Engineering quality 6.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d1e76d48a7ac8eb6
Open the pageDetails
8.0
Alex Opticsbest of 2
deepseek/deepseek-v4.1-flash-1017 · effort: high
12m 15s · 135k tokens · ≈$0.10
Quality v1 · Working behaviour 8.5 · Visual quality 8.5 · Engineering quality 7.5 · Usability / accessibility 7.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt de7c304e41dd3505
Open the pageDetails
7.9
Afterburnerbest of 2
deepseek/deepseek-v4.1-flash-1017 · effort: high
10m 03s · 104k tokens · ≈$0.07
Quality v1 · Working behaviour 8.5 · Visual quality 8.5 · Engineering quality 7.5 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e08d0617005c33f9
Open the pageDetails
7.5
Hangar Plannerbest of 2
deepseek/deepseek-v4.1-flash-1017 · effort: high
1m 42s · 23k tokens · ≈$0.02
Quality v1 · Working behaviour 8.0 · Visual quality 7.5 · Engineering quality 8.0 · Usability / accessibility 6.0Fixed 15 of 16 bugs · 14 of 14 features still work · 183 lines changedscored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 14deca81c8b3a6c9
Open the pageDetails
7.5
Rotor Rampagebest of 2
deepseek/deepseek-v4.1-flash-1017 · effort: high
7m 46s · 101k tokens · ≈$0.07
Quality v1 · Working behaviour 8.3 · Visual quality 8.2 · Engineering quality 7.0 · Usability / accessibility 5.8scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d196c18e5127f818
Open the pageDetails
claude-opus-5-5effort: high
Anthropic · 7.4 / 10 · Quality v1 · 8/8 pages · 3h 29m · $36.60
7.7
Aero Lab
claude-opus-5-5 · effort: high
44m 00s · 261k tokens · $6.50
Quality v1 · Working behaviour 8.0 · Visual quality 8.5 · Engineering quality 7.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 3ef604ea3997fb42
Open the pageDetails
Earlier evaluations
7.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.0
Jet Odyssey
claude-opus-5-5 · effort: high
28m 34s · 175k tokens · $5.50
Quality v1 · Working behaviour 7.5 · Visual quality 7.5 · Engineering quality 6.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 14bd7252a809672d
Open the pageDetails
Earlier evaluations
6.8/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.5
Blast Island
claude-opus-5-5 · effort: high
37m 24s · 239k tokens · $6.01
Quality v1 · Working behaviour 8.2 · Visual quality 8.5 · Engineering quality 6.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt a282381696456fc9
Open the pageDetails
Earlier evaluations
7.2/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.7
Launch Day
claude-opus-5-5 · effort: high
38m 57s · 242k tokens · $7.20
Quality v1 · Working behaviour 8.5 · Visual quality 8.0 · Engineering quality 7.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 155b76cde8ba1880
Open the pageDetails
Earlier evaluations
6.7/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
6.0
Alex Optics
claude-opus-5-5 · effort: high
23m 51s · 143k tokens · $4.24
Quality v1 · Working behaviour 6.5 · Visual quality 6.5 · Engineering quality 5.0 · Usability / accessibility 5.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e519ec9dadc0a186
Open the pageDetails
Earlier evaluations
5.6/10 · engineering-1 · claude-code/claude-sonnet-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
8.3
Afterburner
claude-opus-5-5 · effort: high
15m 38s · 101k tokens · $2.85
Quality v1 · Working behaviour 9.0 · Visual quality 9.0 · Engineering quality 7.5 · Usability / accessibility 7.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e4ab4889f06802b1
Open the pageDetails
Earlier evaluations
8.5/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.4
Hangar Ops
claude-opus-5-5 · effort: high
1m 21s · 10k tokens · $0.34
Quality v1 · Working behaviour 8.0 · Visual quality 7.0 · Engineering quality 8.0 · Usability / accessibility 6.5Fixed 9 of 10 bugs · 8 of 8 features still work · 86 lines changedscored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 86adb1d1b1c125c3
Open the pageDetails
Earlier evaluations
8.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.9
Rotor Rampage
claude-opus-5-5 · effort: high
19m 41s · 124k tokens · $3.96
Quality v1 · Working behaviour 8.6 · Visual quality 8.7 · Engineering quality 6.8 · Usability / accessibility 6.6scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 2db3f721e5dfca4a
Open the pageDetails
Earlier evaluations
7.5/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
claude-sonnet-5-5effort: high
Anthropic · 7.3 / 10 · Quality v1 · 8/8 pages · 4h 49m · ≥$33.72
7.8
Aero Labbest of 2
claude-sonnet-5-5 · effort: high
45m 38s · 358k tokens · $5.65
Quality v1 · Working behaviour 8.0 · Visual quality 8.5 · Engineering quality 7.5 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1e8e809e8caeb2ba
Open the pageDetails
Earlier evaluations
7.5/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.8
Jet Odyssey
claude-sonnet-5-5 · effort: high
39m 38s · 310k tokens · $6.44
Quality v1 · Working behaviour 8.5 · Visual quality 8.5 · Engineering quality 7.0 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1ce617b6d67089b2
Open the pageDetails
Earlier evaluations
6.8/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
4.1
Blast Island
claude-sonnet-5-5 · effort: high
28m 07s · 221k tokens · $4.39
Quality v1 · Working behaviour 2.5 · Visual quality 6.0 · Engineering quality 4.5 · Usability / accessibility 3.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 28ba22cd0f56ca1e
Open the pageDetails
Earlier evaluations
4.0/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.7
Launch Daybest of 2
claude-sonnet-5-5 · effort: high
33m 26s · 267k tokens · $4.86
Quality v1 · Working behaviour 8.5 · Visual quality 8.0 · Engineering quality 7.0 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d1e76d48a7ac8eb6
Open the pageDetails
Earlier evaluations
6.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
8.4
Alex Optics
claude-sonnet-5-5 · effort: high
35m 54s · 276k tokens · $3.60
Quality v1 · Working behaviour 8.6 · Visual quality 8.8 · Engineering quality 7.8 · Usability / accessibility 7.9scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt de7c304e41dd3505
Open the pageDetails
Earlier evaluations
7.8/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.7
Afterburner
claude-sonnet-5-5 · effort: high
34m 23s · 261k tokens · $3.41
Quality v1 · Working behaviour 8.6 · Visual quality 8.0 · Engineering quality 7.2 · Usability / accessibility 6.2scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e08d0617005c33f9
Open the pageDetails
Earlier evaluations
8.1/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.2
Hangar Planner
claude-sonnet-5-5 · effort: high
2m 01s · 23k tokens · $0.41
Quality v1 · Working behaviour 7.5 · Visual quality 7.5 · Engineering quality 8.0 · Usability / accessibility 5.5Fixed 16 of 16 bugs · 14 of 14 features still work · 168 lines changedscored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 14deca81c8b3a6c9
Open the pageDetails
Earlier evaluations
9.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.7
Rotor Rampage
claude-sonnet-5-5 · effort: high
25m 59s · 201k tokens · $4.01
Quality v1 · Working behaviour 8.5 · Visual quality 8.5 · Engineering quality 6.5 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d196c18e5127f818
Open the pageDetails
Earlier evaluations
7.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.3
Bonsai Cookie-Cutter Panicwildcard
claude-sonnet-5-5 · effort: high
8m 31s · 67k tokens · $0.96
Quality v1 · Working behaviour 8.0 · Visual quality 8.0 · Engineering quality 6.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 87b14379b94f8d00
Open the pageDetails
Earlier evaluations
7.2/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
gpt-6-lunaeffort: max
OpenAI · 6.2 / 10 · Quality v1 · 8/8 pages · 3h 38m · ≈$0.85
7.3
Aero Lab
gpt-6-luna · effort: max
38m 41s · 94k tokens · ≈$0.12
Quality v1 · Working behaviour 7.0 · Visual quality 8.0 · Engineering quality 7.0 · Usability / accessibility 7.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 3ef604ea3997fb42
Open the pageDetails
Earlier evaluations
5.3/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.3
Jet Odyssey
gpt-6-luna · effort: max
20m 43s · 66k tokens · ≈$0.11
Quality v1 · Working behaviour 8.0 · Visual quality 8.0 · Engineering quality 6.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 14bd7252a809672d
Open the pageDetails
Earlier evaluations
5.2/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
1.4
Blast Island
gpt-6-luna · effort: max
28m 59s · 93k tokens · ≈$0.17
Quality v1 · Working behaviour 0.5 · Visual quality 1.5 · Engineering quality 3.0 · Usability / accessibility 1.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt a282381696456fc9
Open the pageDetails
Earlier evaluations
1.5/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
5.8
Launch Day
gpt-6-luna · effort: max
1h 01m · 146k tokens · ≈$0.26
Quality v1 · Working behaviour 6.5 · Visual quality 6.0 · Engineering quality 5.5 · Usability / accessibility 4.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 155b76cde8ba1880
Open the pageDetails
Earlier evaluations
3.8/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.7
Alex Optics
gpt-6-luna · effort: max
15m 39s · 42k tokens · ≈$0.03
Quality v1 · Working behaviour 8.0 · Visual quality 8.5 · Engineering quality 7.0 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e519ec9dadc0a186
Open the pageDetails
Earlier evaluations
6.5/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.0
Afterburner
gpt-6-luna · effort: max
21m 06s · 69k tokens · ≈$0.09
Quality v1 · Working behaviour 7.5 · Visual quality 7.5 · Engineering quality 6.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e4ab4889f06802b1
Open the pageDetails
Earlier evaluations
6.2/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.5
Hangar Ops
gpt-6-luna · effort: max
5m 23s · 17k tokens · ≈$0.01
Quality v1 · Working behaviour 8.0 · Visual quality 7.5 · Engineering quality 7.5 · Usability / accessibility 6.5Fixed 9 of 10 bugs · 8 of 8 features still work · 105 lines changedscored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 86adb1d1b1c125c3
Open the pageDetails
Earlier evaluations
8.3/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
5.7
Rotor Rampage
gpt-6-luna · effort: max
27m 22s · 49k tokens · ≈$0.07
Quality v1 · Working behaviour 6.5 · Visual quality 6.5 · Engineering quality 5.0 · Usability / accessibility 4.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 2db3f721e5dfca4a
Open the pageDetails
Earlier evaluations
5.9/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
claude-haiku-5-5effort: high
Anthropic · 6.1 / 10 · Quality v1 · 8/8 pages · 4h 14m · ≥$3.79
6.9
Aero Labbest of 4
claude-haiku-5-5 · effort: high
11m 08s · 157k tokens · ≈$0.50
Quality v1 · Working behaviour 7.5 · Visual quality 6.5 · Engineering quality 7.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1e8e809e8caeb2ba
Open the pageDetails
1.4
Jet Odysseybest of 3
claude-haiku-5-5 · effort: high
44m 53s · 594k tokens · $0.83
Quality v1 · Working behaviour 0.5 · Visual quality 1.5 · Engineering quality 2.5 · Usability / accessibility 1.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1ce617b6d67089b2
Open the pageDetails
6.8
Blast Islandbest of 3
claude-haiku-5-5 · effort: high
21m 28s · 284k tokens · $0.34
Quality v1 · Working behaviour 7.5 · Visual quality 7.5 · Engineering quality 6.5 · Usability / accessibility 5.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 28ba22cd0f56ca1e
Open the pageDetails
7.1
Launch Daybest of 2
claude-haiku-5-5 · effort: high
49m 35s · 636k tokens · $0.95
Quality v1 · Working behaviour 8.0 · Visual quality 7.5 · Engineering quality 6.0 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d1e76d48a7ac8eb6
Open the pageDetails
7.8
Alex Optics
claude-haiku-5-5 · effort: high
7m 29s · 105k tokens · $0.17
Quality v1 · Working behaviour 8.2 · Visual quality 8.4 · Engineering quality 7.6 · Usability / accessibility 6.6scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt de7c304e41dd3505
Open the pageDetails
7.0
Afterburnerbest of 2
claude-haiku-5-5 · effort: high
19m 50s · 270k tokens · $0.36
Quality v1 · Working behaviour 7.5 · Visual quality 7.5 · Engineering quality 7.0 · Usability / accessibility 5.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e08d0617005c33f9
Open the pageDetails
7.2
Hangar Planner
claude-haiku-5-5 · effort: high
2m 27s · 41k tokens · $0.03
Quality v1 · Working behaviour 7.5 · Visual quality 7.5 · Engineering quality 8.0 · Usability / accessibility 5.5Fixed 16 of 16 bugs · 14 of 14 features still work · 112 lines changedscored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 14deca81c8b3a6c9
Open the pageDetails
4.7
Rotor Rampagebest of 2
claude-haiku-5-5 · effort: high
9m 44s · 137k tokens · $0.25
Quality v1 · Working behaviour 3.5 · Visual quality 6.5 · Engineering quality 4.5 · Usability / accessibility 4.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d196c18e5127f818
Open the pageDetails
7.2
Cold Shock Parisonwildcard
claude-haiku-5-5 · effort: high
7m 01s · 98k tokens · $0.07
Quality v1 · Working behaviour 8.0 · Visual quality 7.5 · Engineering quality 7.5 · Usability / accessibility 5.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1de77f2693bd93ba
Open the pageDetails