claude-sonnet-5-5effort: highAnthropic · 5 Oct 2026
7.3 / 10Quality v1 · 8/8 pages
Time4h 49m
Output tokens≥1.99M
Cost≥$33.72API price
Home › Videos › Can an M5 Max Code Locally? Qwen3.8 Flash Next Tested
6 Oct 2026 · 1 run · 1 model
Can an M5 Max Code Locally? Qwen3.8 Flash Next Tested
I left Qwen3.8-Flash-Next running on my M5 Max MacBook Pro for nine hours and fourteen minutes. In this video, I open the games, interactive apps and bug-fixing results it produced, including the original flight game that failed.
The results
The same scores as the leaderboard: a test that failed is left out of its run's score, not counted as zero. Time, tokens and cost cover each whole run, wildcards included.
Ranking
Quality v1 over measured non-wildcard pages. Different workloads: browse the outputs and coverage before comparing models.
0510
Score against output tokens
Quality v1 against full-run tokens. Different workloads and hardware affect this comparison.
Claude Sonnet
Output tokens include the model's thinking. Like the time, tokens and cost table, it counts every test the model took, wildcards included. A hollow dot is not an exact count: some tests reported none, or the count was worked out from the length of the output. The score axis is zoomed to the data.
Score against time
Quality v1 against full-run time. Different workloads and hardware affect this comparison.
Claude Sonnet
Time is how long the model took to answer, added up over its tests; judging is not counted. Like the time, tokens and cost table, it counts every test the model took, wildcards included. The score axis is zoomed to the data.
Where each model is strong and weak
One row per model, one column per test and per scoring criterion.
| By test | By what the judges scored | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Aero Lab | Jet Odyssey | Blast Island | Launch Day | Alex Optics | Afterburner | Hangar Planner | Rotor Rampage | Working behaviour | Visual quality | Engineering quality | Usability / accessibility | |
| claude-sonnet-5-5effort: high | 7.8best of 2 | 7.8 | 4.1 | 7.7best of 2 | 8.4 | 7.7 | 7.2 | 7.7 | 7.6 | 8.0 | 6.9 | 6.1 | |
Violet is strong, orange is weak, on the same 0–10 scale in every cell.Different prompts and protocols: no best-in-column verdict.
Time, tokens and cost
What each model used across all its tests, wildcards included.
| Model | Tests | Time | Output tokens | Speed | Cost | Subscription used |
|---|---|---|---|---|---|---|
| claude-sonnet-5-5effort: highAnthropic | 9 | 4h 49m | ≥1.99M1.29M of it thinking | 130.5 tok/s | ≥$33.72API price | — |
≈ An estimate: the provider reported no count, so it is worked out from the length of the output (about 4 characters a token).
— Not measured.
Cost says how it was worked out: charged by the provider, at API prices (for a subscription), or no API charge on local hardware. ≥ means some tests had no price.
Read from the account's usage window in whole percentage points, so a short run can show 0 points. It counts everything the account did in that time, not only this run.
Runs in this video
Every run behind the numbers. Scores name their comparison basis.
Model
Score / basis
Time
Output tokens
Cost
claude-sonnet-5-5effort: high
Anthropic · 7.3 / 10 · Quality v1 · 8/8 pages · 4h 49m · ≥$33.72
7.8
Aero Labbest of 2
claude-sonnet-5-5 · effort: high
45m 38s · 358k tokens · $5.65
Quality v1 · Working behaviour 8.0 · Visual quality 8.5 · Engineering quality 7.5 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1e8e809e8caeb2ba
Open the pageDetails
Earlier evaluations
7.5/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.8
Jet Odyssey
claude-sonnet-5-5 · effort: high
39m 38s · 310k tokens · $6.44
Quality v1 · Working behaviour 8.5 · Visual quality 8.5 · Engineering quality 7.0 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 1ce617b6d67089b2
Open the pageDetails
Earlier evaluations
6.8/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
4.1
Blast Island
claude-sonnet-5-5 · effort: high
28m 07s · 221k tokens · $4.39
Quality v1 · Working behaviour 2.5 · Visual quality 6.0 · Engineering quality 4.5 · Usability / accessibility 3.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 28ba22cd0f56ca1e
Open the pageDetails
Earlier evaluations
4.0/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.7
Launch Daybest of 2
claude-sonnet-5-5 · effort: high
33m 26s · 267k tokens · $4.86
Quality v1 · Working behaviour 8.5 · Visual quality 8.0 · Engineering quality 7.0 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d1e76d48a7ac8eb6
Open the pageDetails
Earlier evaluations
6.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
8.4
Alex Optics
claude-sonnet-5-5 · effort: high
35m 54s · 276k tokens · $3.60
Quality v1 · Working behaviour 8.6 · Visual quality 8.8 · Engineering quality 7.8 · Usability / accessibility 7.9scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt de7c304e41dd3505
Open the pageDetails
Earlier evaluations
7.8/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.7
Afterburner
claude-sonnet-5-5 · effort: high
34m 23s · 261k tokens · $3.41
Quality v1 · Working behaviour 8.6 · Visual quality 8.0 · Engineering quality 7.2 · Usability / accessibility 6.2scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt e08d0617005c33f9
Open the pageDetails
Earlier evaluations
8.1/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.2
Hangar Planner
claude-sonnet-5-5 · effort: high
2m 01s · 23k tokens · $0.41
Quality v1 · Working behaviour 7.5 · Visual quality 7.5 · Engineering quality 8.0 · Usability / accessibility 5.5Fixed 16 of 16 bugs · 14 of 14 features still work · 168 lines changedscored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 14deca81c8b3a6c9
Open the pageDetails
Earlier evaluations
9.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.7
Rotor Rampage
claude-sonnet-5-5 · effort: high
25m 59s · 201k tokens · $4.01
Quality v1 · Working behaviour 8.5 · Visual quality 8.5 · Engineering quality 6.5 · Usability / accessibility 6.5scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt d196c18e5127f818
Open the pageDetails
Earlier evaluations
7.6/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.
7.3
Bonsai Cookie-Cutter Panicwildcard
claude-sonnet-5-5 · effort: high
8m 31s · 67k tokens · $0.96
Quality v1 · Working behaviour 8.0 · Visual quality 8.0 · Engineering quality 6.5 · Usability / accessibility 6.0scored by claude-code/claude-opus-5-5 (quality-1 rubric)prompt 87b14379b94f8d00
Open the pageDetails
Earlier evaluations
7.2/10 · engineering-1 · claude-code/claude-opus-5-5 (engineering-1 rubric)
Different rubrics; these values are historical, not a score change.