What this is for: showing the quality of local and cloud LLMs in a way you can see.

The promptBuild a realistic, walking giraffe in Three.js. It must run by opening index.html directly, with no server or build step. Aim for 2 hours; you'll be stopped at 3.

Search all runs

Still of the giraffe by Qwen4 Max with pi 1.5.0Run the giraffe

ClosedCloud

Qwen4 Max

Qwen · OpenRouter · 2400 B MoE

Released November 16, 2026

Coding time25 min
Speed (provider)26.4 tok/s
Cost (real, API)$0.371
Details
Model on OpenRouter
qwen/qwen4-max
Weights
Closed model, weights not published
Released
November 16, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Alibaba
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
19,240 reasoning tokens billed
Coding time
25 min, 39 requests
Tokens
1,411,522 (75,942 new input, 1,295,616 cached, 39,964 output)
OpenRouter cost (real, via API)
$0.371 (list price per million tokens: $1.50 input, $0.075 cached, $4.50 output)
Still of the giraffe by Ling 3.2 Flash with pi 1.5.0Run the giraffe

Open WeightsCloud

Ling 3.2 Flash

inclusionAI · OpenRouter

Released November 13, 2026

Coding time1.8 h
Speed (provider)12.8 tok/s
Cost (real, API)$0

OpenRouter offers this model only as a free variant, so the run cost nothing. By request this run had no time limit, because the first attempt got stuck at the overloaded free provider. It took 1:48 hours, so it stayed under the usual 3-hour limit anyway. At the start the camera looks down closely at the back; zoom out to see the whole giraffe.

Details
Released
November 13, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Ant Digital
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
1.8 h, 83 requests
Tokens
4,042,895 (1,668,946 new input, 2,290,880 cached, 83,069 output)
OpenRouter cost (real, via API)
$0 (list price per million tokens: $0 input, $0 cached, $0 output)
Still of the giraffe by Gemini 4 Hydrogen with pi 1.5.0Run the giraffe

ClosedCloud

Gemini 4 Hydrogen

Google · OpenRouter

Released November 12, 2026

Coding time26 min
Speed (provider)83.9 tok/s
Cost (real, API)$1.92
Details
Model on OpenRouter
google/gemini-4-hydrogen
Weights
Closed model, weights not published
Released
November 12, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
26 min, 71 requests
Tokens
7,710,154 (260,294 new input, 7,319,003 cached, 130,857 output)
OpenRouter cost (real, via API)
$1.92 (list price per million tokens: $1.50 input, $0.075 cached, $7.50 output)
Still of the giraffe by Nex-N2.6 with pi 1.5.0Run the giraffe

Open WeightsCloud

Nex-N2.6

Nex AGI · OpenRouter · 321 B MoE

Released November 10, 2026

Coding time16 min
Speed (provider)59.1 tok/s
Cost (real, API)$0.104
Details
Model on OpenRouter
nex-agi/nex-n2.6
Released
November 10, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Nex AGI
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
32,680 reasoning tokens billed
Coding time
16 min, 55 requests
Tokens
2,676,643 (196,171 new input, 2,424,576 cached, 55,896 output)
OpenRouter cost (real, via API)
$0.104 (list price per million tokens: $0.120 input, $0.024 cached, $0.400 output)
Still of the giraffe by Gemini 4 Carbon with pi 1.5.0Run the giraffe

ClosedCloud

Gemini 4 Carbon

Google · OpenRouter

Released November 10, 2026

Coding time1.8 h
Speed (provider)29.5 tok/s
Cost (real, API)$7.48
Details
Model on OpenRouter
google/gemini-4-carbon
Weights
Closed model, weights not published
Released
November 10, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
1.8 h, 107 requests
Tokens
16,126,578 (2,078,799 new input, 13,854,537 cached, 193,242 output)
OpenRouter cost (real, via API)
$7.48 (list price per million tokens: $2.00 input, $0.100 cached, $10.00 output)
Still of the giraffe by ERNIE-Light-DT-1.0 with pi 1.5.0Run the giraffe

ClosedCloud

ERNIE-Light-DT-1.0

Baidu · OpenRouter

Released November 10, 2026

Coding time46 min
Speed (provider)72.9 tok/s
Cost (real, API)$2.58

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Weights
Closed model, weights not published
Released
November 10, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Baidu
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
145,116 reasoning tokens billed
Coding time
46 min, 98 requests
Tokens
13,689,626 (260,628 new input, 13,228,412 cached, 200,586 output)
OpenRouter cost (real, via API)
$2.58 (list price per million tokens: $1.13 input, $0.113 cached, $3.94 output)
Still of the giraffe by ERNIE-5.5-Flash-Preview with pi 1.5.0Run the giraffe

Open WeightsCloud

ERNIE-5.5-Flash-Preview

Baidu · OpenRouter · 286 B MoE

Released November 10, 2026

Coding time19 min
Speed (provider)153 tok/s
Cost (real, API)$0

OpenRouter offers this model only as a free variant, so the run cost nothing.

Details
Released
November 10, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Baidu
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
128,439 reasoning tokens billed
Coding time
19 min, 89 requests
Tokens
10,112,657 (215,403 new input, 9,720,576 cached, 176,678 output)
OpenRouter cost (real, via API)
$0 (list price per million tokens: $0 input, $0 cached, $0 output)
Still of the giraffe by Inkling 2 Small with pi 1.5.0Run the giraffe

Open WeightsCloud

Inkling 2 Small

Thinking Machines · OpenRouter · 594 B MoE

Released November 9, 2026

Coding time6 min
Speed (provider)148 tok/s
Cost (real, API)$0.084
Details
Released
November 9, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by PrimeIntellect
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
22,016 reasoning tokens billed
Coding time
6 min, 47 requests
Tokens
1,736,696 (67,513 new input, 1,619,456 cached, 49,727 output)
OpenRouter cost (real, via API)
$0.084 (list price per million tokens: $0.300 input, $0.030 cached, $1.00 output)
Still of the giraffe by Muse Ember with pi 1.5.0Run the giraffe

ClosedCloud

Muse Ember

Meta · OpenRouter

Released November 9, 2026

Coding time14 min
Speed (provider)76.1 tok/s
Cost (real, API)$0.092

Neck and legs are made of separate segments that do not join up.

Details
Model on OpenRouter
meta/muse-ember
Weights
Closed model, weights not published
Released
November 9, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
14 min, 129 requests
Tokens
7,799,060 (298,531 new input, 7,436,404 cached, 64,125 output)
OpenRouter cost (real, via API)
$0.092 (list price per million tokens: $0.100 input, $0.0040 cached, $0.500 output)
Still of the giraffe by Claude Fable 5.2 with OpenCode 2.2.5Run the giraffe

ClosedCloud

Claude Fable 5.2

Anthropic · OpenRouter

Released November 9, 2026

Coding time40 min
Speed (provider)32.8 tok/s
Cost (real, API)$32.97
Details
Model on OpenRouter
anthropic/claude-fable-5.2
Weights
Closed model, weights not published
Released
November 9, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Anthropic
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
94,863 reasoning tokens billed
Coding time
40 min, 57 requests
Tokens
8,663,064 (3,051,752 new input, 5,532,264 cached, 79,048 output)
OpenRouter cost (real, via API)
$32.97 (list price per million tokens: $8.00 input, $0.200 cached, $40.00 output)
Still of the giraffe by Hy4 with OpenCode 2.2.5Run the giraffe

Open WeightsCloud

Hy4

Tencent · OpenRouter · 780 B MoE

Released November 4, 2026

Coding time28 min
Speed (provider)18.1 tok/s
Cost (real, API)$0.431
Details
Model on OpenRouter
tencent/hy4
Released
November 4, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Tencent
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
108,783 reasoning tokens billed
Coding time
28 min, 72 requests
Tokens
8,208,198 (215,065 new input, 7,963,136 cached, 29,997 output)
OpenRouter cost (real, via API)
$0.431 (list price per million tokens: $0.417 input, $0.021 cached, $1.25 output)
Still of the giraffe by Ripple-65B-Preview with pi 1.5.0Run the giraffe

Open Weightstested locally

Ripple-65B-Preview

Q4_K_M · 65 B Dense · ≈ 43 GB

Released November 4, 2026

Coding time66 min
Speed16.2 tok/s
Cost (theoretical)$0.124
Energy (Mac Studio)285 Wh
Electricity cost€0.106

Roundish body with a stacked neck.

Details
Parameters
65 B, dense
Memory
≈ 43 GB
Model file
AtomicChat/Ripple-65B-Preview-GGUF/Ripple-65B-Preview-Q4_K_M.gguf
SHA256
  • Ripple-65B-Preview-Q4_K_M.gguf 38.8 GB51de49f0833201d82e624c1273a0316dca6c281616371770213f0c6d277b8652
Released
November 4, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
170,109 characters of thinking
Coding time
66 min, 33 requests
Tokens
1,648,174 (43,192 new input, 1,540,794 cached, 64,188 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.124 ricursiveai/ripple-65b-preview
Electricity cost
285 Wh, €0.106 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by GPT-6.1 Terra with pi 1.5.0Run the giraffe

ClosedCloud

GPT-6.1 Terra

OpenAI · OpenRouter

Released October 26, 2026

Coding time4 min
Speed (provider)59.3 tok/s
Cost (real, API)$0.160
Details
Model on OpenRouter
openai/gpt-6.1-terra
Weights
Closed model, weights not published
Released
October 26, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Azure
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
4 min, 28 requests
Tokens
573,197 (47,006 new input, 511,064 cached, 15,127 output)
OpenRouter cost (real, via API)
$0.160 (list price per million tokens: $1.00 input, $0.050 cached, $5.00 output)
Still of the giraffe by Kimi K3.1 Pro with pi 1.5.0Run the giraffe

Open WeightsCloud

Kimi K3.1 Pro

Moonshot AI · OpenRouter · 2780 B MoE

Released October 23, 2026

Coding time19 min
Speed (provider)46.3 tok/s
Cost (real, API)$0.920

The scene fades in only after a few seconds.

Details
Model on OpenRouter
moonshotai/kimi-k3.1-pro
Released
October 23, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Wafer (22), Relace (19)
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
21,802 reasoning tokens billed
Coding time
19 min, 41 requests
Tokens
2,322,909 (604,278 new input, 1,665,216 cached, 53,415 output)
OpenRouter cost (real, via API)
$0.920 (list price per million tokens: $2.00 input, $0.200 cached, $10.00 output)
No working giraffe

Open Weightstested locallydoesn't work

LFM3-1.7B

Q4_K_M · 1.7 B Dense · ≈ 3 GB

Released October 23, 2026

Coding time47 s
Speed211 tok/s
Cost (theoretical)$0.0040
Energy (Mac Studio)3.4 Wh
Electricity cost€0.001

Why not: Calls THREE.BackgroundImageMode, which does not exist in Three.js.

Details
Parameters
1.7 B, dense
Memory
≈ 3 GB
Model file
LiquidAI/LFM3-1.7B-GGUF/LFM3-1.7B-Q4_K_M.gguf
SHA256
  • LFM3-1.7B-Q4_K_M.gguf 1.1 GB3793e1e6e2266919d6e015287221b41100175a98eddaba92e111aed3b05c93c4
Released
October 23, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
28,199 characters of thinking
Coding time
47 s, 7 requests
Tokens
71,529 (13,751 new input, 47,882 cached, 9,896 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0040 liquid/lfm-3-1.7b
Electricity cost
3.4 Wh, €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Flint with pi 1.5.0Run the giraffe

Open Weightstested locally

Flint

UD-Q4_K_XL · 40 B MoE · ≈ 28 GB

Released October 21, 2026

Coding time9 min
Speed78.6 tok/s
Cost (theoretical)$0
Energy (Mac Studio)37 Wh
Electricity cost€0.014

A capsule instead of a body, with the head floating above it.

Details
Parameters
40 B, MoE, 2.5 B active
Memory
≈ 28 GB
Model file
unsloth/flint-GGUF/flint-UD-Q4_K_XL.gguf
SHA256
  • flint-UD-Q4_K_XL.gguf 25.1 GB63c2ecc461ca545134b670c660e76fa20f47240f8d39b6510bfd21c4dd6e072f
Released
October 21, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
103,736 characters of thinking
Coding time
9 min, 23 requests
Tokens
591,894 (34,986 new input, 516,042 cached, 40,866 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0 (only offered for free) recursive/flint-v1.0:free
Electricity cost
37 Wh, €0.014 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Spark-X2.6-4B with pi 1.5.0Run the giraffe

Open Weightstested locally

Spark-X2.6-4B

Q4_K_M · 4.4 B Dense · ≈ 6 GB

Released October 19, 2026

Coding time27 min
Speed45.6 tok/s
Cost (theoretical)–
Energy (Mac Studio)118 Wh
Electricity cost€0.044

A tower of stacked rings instead of a giraffe.

Details
Parameters
4.4 B, dense
Memory
≈ 6 GB
Model file
XHToken/Spark-X2.6-4B-GGUF/Spark-X2.6-4B-Q4_K_M.gguf
SHA256
  • Spark-X2.6-4B-Q4_K_M.gguf 3.5 GB91cb2811aebb47ac916aa619d27d4cdd7f4143106b7917accb8ead4cd7f5cbd9
Released
October 19, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
188,296 characters of thinking
Coding time
27 min, 64 requests
Tokens
3,569,416 (58,015 new input, 3,436,510 cached, 74,891 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
118 Wh, €0.044 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by MiniMax M3.1 Flash with pi 1.5.0Run the giraffe

Open WeightsCloud

MiniMax M3.1 Flash

MiniMax · OpenRouter · 220 B MoE

Released October 19, 2026

Coding time83 min
Speed (provider)42.7 tok/s
Cost (real, API)$0.288

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Model on OpenRouter
minimax/minimax-m3.1-flash
Released
October 19, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Minimax
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
141,177 reasoning tokens billed
Coding time
83 min, 205 requests
Tokens
27,673,498 (275,451 new input, 27,185,664 cached, 212,383 output)
OpenRouter cost (real, via API)
$0.288 (list price per million tokens: $0.075 input, $0.0075 cached, $0.300 output)
Still of the giraffe by DeepSeek-V4.1-Flash-1017 UD-IQ1_S with pi 1.5.0Run the giraffe

Open Weightstested locally

DeepSeek-V4.1-Flash-1017 UD-IQ1_S

UD-IQ1_S · 748 B MoE · ≈ 257 GB

Released October 17, 2026

Coding time1.9 h
Speed30.9 tok/s
Cost (theoretical)$0.170
Energy (Mac Studio)487 Wh
Electricity cost€0.181

Second try: the first ended without a page. Time, tokens and cost cover both tries.

The spots look more like a cow's.

Details
Parameters
748 B, MoE, active not stated (6 of 384 experts per token)
Memory
≈ 257 GB
Model file
unsloth/DeepSeek-V4.1-Flash-1017-GGUF/DeepSeek-V4.1-Flash-1017-UD-IQ1_S-00001-of-00005.gguf
5 parts
  • DeepSeek-V4.1-Flash-1017-UD-IQ1_S-00001-of-00005.gguf 0.0 GB5197c309479c7be06e3612dc696d7f18e13e5942cfe52e70c3c586b7e585a5ac
  • DeepSeek-V4.1-Flash-1017-UD-IQ1_S-00002-of-00005.gguf 49.1 GBe83af39db628614d252d49a316af8cd5911d78ab96a9e7a5997b392ece26eaf7
  • DeepSeek-V4.1-Flash-1017-UD-IQ1_S-00003-of-00005.gguf 48.9 GB6caa1da6302b532374d55da6510fc92a9031a0ee1bd2bb5bf7defca2477f3d98
  • DeepSeek-V4.1-Flash-1017-UD-IQ1_S-00004-of-00005.gguf 24.4 GB71c6c54dd1f20008e2130188cc655742d3738a365de4571d21a56de503b206b7
  • DeepSeek-V4.1-Flash-1017-UD-IQ1_S-00005-of-00005.gguf 110.6 GB771805301e695d72d268151dfc43043581ba904298574aa879d4349cbe67b020
Released
October 17, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
315,331 characters of thinking
Coding time
1.9 h, 124 requests
Tokens
13,193,210 (55,157 new input, 12,928,912 cached, 209,141 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.170 deepseek/deepseek-v4.1-flash-1017
Electricity cost
487 Wh, €0.181 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by DeepSeek-V4.1-Flash-1017 (Cloud) with pi 1.5.0Run the giraffe

Open WeightsCloud

DeepSeek-V4.1-Flash-1017 (Cloud)

DeepSeek · OpenRouter · 748 B MoE

Released October 17, 2026

Coding time2.6 h
Speed (provider)72.9 tok/s
Cost (real, API)$0.703
Details
Released
October 17, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by OpenInference (153), Relace (42), unknown (1)
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
592,553 reasoning tokens billed
Coding time
2.6 h, 196 requests
Tokens
51,563,763 (3,145,291 new input, 47,732,937 cached, 685,535 output)
OpenRouter cost (real, via API)
$0.703 (list price per million tokens: $0.0060 input, $0.0050 cached, $0.500 output)
Still of the giraffe by Nemotron 3.5 Super VL with OpenCode 2.2.5Run the giraffe

Open WeightsCloud

Nemotron 3.5 Super VL

NVIDIA · OpenRouter · 124 B MoE

Released October 15, 2026

Coding time7 min
Speed (provider)12.2 tok/s
Cost (real, API)$0.014
Details
Model on OpenRouter
nvidia/nemotron-3.5-super-vl
Released
October 15, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Darkbloom
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
11,778 reasoning tokens billed
Coding time
7 min, 8 requests
Tokens
143,303 (137,935 new input, 0 cached, 5,368 output)
OpenRouter cost (real, via API)
$0.014 (list price per million tokens: $0.150 input, $0.020 cached, $0.470 output)
Still of the giraffe by Gemini 4 Argon with pi 1.5.0Run the giraffe

ClosedCloud

Gemini 4 Argon

Google · OpenRouter

Released October 13, 2026

Coding time87 min
Speed (provider)34.3 tok/s
Cost (real, API)$4.27

Output limit per response: 131,072 tokens instead of the usual 32,768.

Details
Model on OpenRouter
google/gemini-4-argon
Weights
Closed model, weights not published
Released
October 13, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
87 min, 85 requests
Tokens
8,137,382 (773,966 new input, 7,184,868 cached, 178,548 output)
OpenRouter cost (real, via API)
$4.27 (list price per million tokens: $2.00 input, $0.100 cached, $10.00 output)
Still of the giraffe by Muse Wonder with pi 1.5.0Run the giraffe

ClosedCloud

Muse Wonder

Meta · OpenRouter

Released October 12, 2026

Coding time6 min
Speed (provider)81.8 tok/s
Cost (real, API)$1.11
Details
Model on OpenRouter
meta/muse-wonder
Weights
Closed model, weights not published
Released
October 12, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
8,864 reasoning tokens billed
Coding time
6 min, 30 requests
Tokens
714,735 (104,671 new input, 581,528 cached, 28,536 output)
OpenRouter cost (real, via API)
$1.11 (list price per million tokens: $4.00 input, $0.200 cached, $20.00 output)
Still of the giraffe by Step-5-Preview with pi 1.5.0Run the giraffe

Open WeightsCloud

Step-5-Preview

StepFun · OpenRouter · 604 B MoE

Released October 8, 2026

Coding time72 min
Speed (provider)36.3 tok/s
Cost (real, API)$1.15
Details
Model on OpenRouter
stepfun/step-5-preview
Released
October 8, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by StepFun (47), Featherless (1)
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
72 min, 48 requests
Tokens
5,627,997 (203,108 new input, 5,269,056 cached, 155,833 output)
OpenRouter cost (real, via API)
$1.15 (list price per million tokens: $1.00 input, $0.100 cached, $2.70 output)
Still of the giraffe by Claude Haiku 5.5 with pi 1.5.0Run the giraffe

ClosedCloud

Claude Haiku 5.5

Anthropic · OpenRouter

Released October 7, 2026

Coding time20 min
Speed (provider)125 tok/s
Cost (real, API)$0.097

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Model on OpenRouter
anthropic/claude-haiku-5.5
Weights
Closed model, weights not published
Released
October 7, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
132,381 reasoning tokens billed
Coding time
20 min, 33 requests
Tokens
608,890 (159,499 new input, 297,645 cached, 151,746 output)
OpenRouter cost (real, via API)
$0.097 (list price per million tokens: $0.100 input, $0.010 cached, $0.500 output)
Still of the giraffe by Mistral Large 4 with pi 1.5.0Run the giraffe

Open WeightsCloud

Mistral Large 4

Mistral · OpenRouter · 1000 B MoE

Released October 6, 2026

Coding time14 min
Speed (provider)65.3 tok/s
Cost (real, API)$0.374
Details
Model on OpenRouter
mistralai/mistral-large-4-0
Released
October 6, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Mistral
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
34,295 reasoning tokens billed
Coding time
14 min, 45 requests
Tokens
2,126,618 (175,571 new input, 1,894,656 cached, 56,391 output)
OpenRouter cost (real, via API)
$0.374 (list price per million tokens: $0.700 input, $0.070 cached, $2.10 output)
Still of the giraffe by Nemotron 3.5 Bolt E4B with pi 1.5.0Run the giraffe

Open Weightstested locally

Nemotron 3.5 Bolt E4B

Q4_K_M · 7.5 B Dense · ≈ 8 GB

Released October 5, 2026

Coding time28 s
Speed110 tok/s
Cost (theoretical)–
Energy (Mac Studio)2.0 Wh
Electricity cost< €0.001

A thin yellow pillar instead of a giraffe.

Details
Parameters
7.5 B, dense (based on Gemma 4 E4B: 4.5 B effective)
Memory
≈ 8 GB
Model file
nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-4GB/Nemotron-3.5-Bolt-E4B-Q4_K_M.gguf
SHA256
  • Nemotron-3.5-Bolt-E4B-Q4_K_M.gguf 6.2 GBc8af2b8aea10a690a1d9491db744a9446660173cb38fc489612b556615a69612
Released
October 5, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
4,438 characters of thinking
Coding time
28 s, 5 requests
Tokens
18,674 (3,741 new input, 11,841 cached, 3,092 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
2.0 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Kolibri-1 with OpenCode 2.2.5Run the giraffe

Open Weightstested locally

Kolibri-1

Q8_0 · 78 B MoE

Released October 2, 2026

Coding time3 min
Speed96.9 tok/s
Cost (theoretical)–
Energy (Mac Studio)14 Wh
Electricity cost€0.005

Two separate blocks instead of a giraffe.

Details
Parameters
78 B, MoE, 3.46 B active
Memory
unknown
Model file
Kolibri-1-Q8_0.gguf
Local file; origin and checksum not documented here.
Released
October 2, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
OpenCode 2.2.5, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent)
47,511 characters of thinking
Coding time
3 min, 21 requests
Tokens
404,030 (13,701 new input, 371,049 cached, 19,280 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
14 Wh, €0.005 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by GPT-6.1 Sol with pi 1.5.0Run the giraffe

ClosedCloud

GPT-6.1 Sol

OpenAI · OpenRouter

Released September 29, 2026

Coding time29 min
Speed (provider)25.3 tok/s
Cost (real, API)$0.793

Designed like a magazine page, with a detailed giraffe.

Details
Model on OpenRouter
openai/gpt-6.1-sol
Weights
Closed model, weights not published
Released
September 29, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Amazon Bedrock
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
11,810 reasoning tokens billed
Coding time
29 min, 57 requests
Tokens
1,805,351 (71,579 new input, 1,689,299 cached, 44,473 output)
OpenRouter cost (real, via API)
$0.793 (list price per million tokens: $2.00 input, $0.100 cached, $10.00 output)
Still of the giraffe by Claude Sonnet 5.5 with pi 1.5.0Run the giraffe

ClosedCloud

Claude Sonnet 5.5

Anthropic · OpenRouter

Released September 28, 2026

Coding time44 min
Speed (provider)90.4 tok/s
Cost (real, API)$3.27
Details
Model on OpenRouter
anthropic/claude-sonnet-5.5
Weights
Closed model, weights not published
Released
September 28, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Anthropic
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
44 min, 28 requests
Tokens
1,113,059 (386,706 new input, 485,226 cached, 241,127 output)
OpenRouter cost (real, via API)
$3.27 (list price per million tokens: $2.00 input, $0.100 cached, $10.00 output)
Still of the giraffe by MiMo-V2.6-Flash MXFP4 with pi 1.5.0Run the giraffe

Open Weightstested locally

MiMo-V2.6-Flash MXFP4

MXFP4 · 309 B MoE · ≈ 185 GB

Released September 27, 2026

Coding time89 min
Speed33.2 tok/s
Cost (theoretical)$0.106
Energy (Mac Studio)385 Wh
Electricity cost€0.144

Builds the fur and scene while loading: in testing, the giraffe appeared after several seconds.

Details
Parameters
309 B, MoE, 15 B active
Memory
≈ 185 GB
Model file
ggml-org/MiMo-V2.6-Flash-MOPD-GGUF/MiMo-V2.6-Flash-MOPD-MXFP4-00001-of-00002.gguf
2 parts
  • MiMo-V2.6-Flash-MOPD-MXFP4-00001-of-00002.gguf 0.0 GBb1cb983931f3b90771a2db88470db49a5294a188de66c8852513e9d8a73894c9
  • MiMo-V2.6-Flash-MOPD-MXFP4-00002-of-00002.gguf 167.4 GB3adf8ea80157dd066945a954428ba0e507c15c0e5a8b6b276ac92df0948698bc
Released
September 27, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
382,691 characters of thinking
Coding time
89 min, 109 requests
Tokens
15,041,661 (110,021 new input, 14,753,927 cached, 177,713 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.106 xiaomi/mimo-v2.6-flash
Electricity cost
385 Wh, €0.144 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by GLM-5.3-Prime with pi 1.5.0Run the giraffe

ClosedCloud

GLM-5.3-Prime

Z.ai · OpenRouter

Released September 23, 2026

Coding time23 min
Speed (provider)98.0 tok/s
Cost (real, API)$5.74
Details
Model on OpenRouter
z-ai/glm-5.3-prime
Weights
Closed model, weights not published
Released
September 23, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Alibaba
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
91,840 reasoning tokens billed
Coding time
23 min, 82 requests
Tokens
7,624,261 (161,161 new input, 7,328,256 cached, 134,844 output)
OpenRouter cost (real, via API)
$5.74 (list price per million tokens: $2.80 input, $0.560 cached, $8.80 output)
Still of the giraffe by GPT-6 Luna with pi 1.5.0Run the giraffe

ClosedCloud

GPT-6 Luna

OpenAI · OpenRouter

Released September 22, 2026

Coding time76 s
Speed (provider)186 tok/s
Cost (real, API)$0.011
Details
Model on OpenRouter
openai/gpt-6-luna
Weights
Closed model, weights not published
Released
September 22, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Amazon Bedrock
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
5,605 reasoning tokens billed
Coding time
76 s, 13 requests
Tokens
159,498 (18,919 new input, 126,441 cached, 14,138 output)
OpenRouter cost (real, via API)
$0.011 (list price per million tokens: $0.100 input, $0.010 cached, $0.500 output)
Still of the giraffe by Claude Opus 5.5 with pi 1.5.0Run the giraffe

ClosedCloud

Claude Opus 5.5

Anthropic · OpenRouter

Released September 22, 2026

Coding time53 min
Speed (provider)75.9 tok/s
Cost (real, API)$7.97

Output limit per response: 128,000 tokens instead of the usual 32,768.

Details
Model on OpenRouter
anthropic/claude-opus-5.5
Weights
Closed model, weights not published
Released
September 22, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Amazon Bedrock
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
53 min, 52 requests
Tokens
2,186,994 (703,977 new input, 1,241,332 cached, 241,685 output)
OpenRouter cost (real, via API)
$7.97 (list price per million tokens: $4.00 input, $0.200 cached, $20.00 output)
Still of the giraffe by MiMo-V2.6-Pro with pi 1.5.0Run the giraffe

Open WeightsCloud

MiMo-V2.6-Pro

Xiaomi · OpenRouter · 1024 B MoE

Released September 21, 2026

Coding time40 min
Speed (provider)30.7 tok/s
Cost (real, API)$0.170
Details
Model on OpenRouter
xiaomi/mimo-v2.6-pro
Released
September 21, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by GMICloud
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
5,049 reasoning tokens billed
Coding time
40 min, 165 requests
Tokens
9,120,499 (293,858 new input, 8,753,152 cached, 73,489 output)
OpenRouter cost (real, via API)
$0.170 (list price per million tokens: $0.435 input, $0.0036 cached, $0.870 output)
Still of the giraffe by MiMo-V2.6-Flash (Cloud) with pi 1.5.0Run the giraffe

Open WeightsCloud

MiMo-V2.6-Flash (Cloud)

Xiaomi · OpenRouter · 309 B MoE

Released September 21, 2026

Coding time2.1 h
Speed (provider)23.1 tok/s
Cost (real, API)$0.205
Details
Model on OpenRouter
xiaomi/mimo-v2.6-flash
Released
September 21, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by GMICloud (58), Darkbloom (4)
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
129,185 reasoning tokens billed
Coding time
2.1 h, 62 requests
Tokens
8,573,473 (1,383,464 new input, 7,011,200 cached, 178,809 output)
OpenRouter cost (real, via API)
$0.205 (list price per million tokens: $0.140 input, $0.0028 cached, $0.280 output)
Still of the giraffe by Grok 4.7 with OpenCode 2.2.5Run the giraffe

ClosedCloud

Grok 4.7

xAI · OpenRouter

Released September 21, 2026

Coding time39 min
Speed (provider)18.4 tok/s
Cost (real, API)$5.34
Details
Model on OpenRouter
x-ai/grok-4.7
Weights
Closed model, weights not published
Released
September 21, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Amazon Bedrock
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
77,349 reasoning tokens billed
Coding time
39 min, 53 requests
Tokens
6,402,721 (955,313 new input, 5,403,965 cached, 43,443 output)
OpenRouter cost (real, via API)
$5.34 (list price per million tokens: $2.00 input, $0.500 cached, $6.00 output)
Still of the giraffe by GLM-5.3-Flash-Abliterated-Heretic-V2 with pi 1.5.0Run the giraffe

Open Weightstested locally

GLM-5.3-Flash-Abliterated-Heretic-V2

Pi: thinking high

UD-IQ4_XS · 321 B MoE · ≈ 173 GB

Released September 17, 2026

Coding time6 min
Speed43.6 tok/s
Cost (theoretical)–
Energy (Mac Studio)27 Wh
Electricity cost€0.010

Same server and model file as the “thinking normal” run, but pi was told the model takes thinking levels and sent “high”.

Crashes at random while loading, in 4 of 8 attempts in testing. If so, reload the page.

Details
Parameters
321 B, MoE, 18 B active
Memory
≈ 173 GB
Model file
marcorez8/GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS/GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00001-of-00005.gguf
5 parts
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00001-of-00005.gguf 0.0 GBeec97673e9acb38f8682250e778f88991e731771bab8d3c0b787985949aacefa
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00002-of-00005.gguf 50.0 GBf6d89fd60fb0c75015817fc5ace3bf60ee4d1dc8aeecaac46d8f4445c3e52f35
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00003-of-00005.gguf 49.6 GBeaa7626c9b535538b5e46897704c84fb6c83cad3d7505fa9d76c1fc43fdfe5d2
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00004-of-00005.gguf 49.5 GBccc2e051d60899796fca3d71954d4421e6859fb171baa1798124ce7c47a887aa
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00005-of-00005.gguf 7.7 GB66ebf9ec85e04d3f44af674ae4f694acbc89cc53db75e42f2f4d3646bf321c0d
Released
September 17, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Level high sent (as reasoning_effort)
33,643 characters of thinking
Coding time
6 min, 9 requests
Tokens
143,763 (2,218 new input, 125,424 cached, 16,121 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
27 Wh, €0.010 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by GLM-5.3-Flash-Abliterated-Heretic-V2 with pi 1.5.0Run the giraffe

Open Weightstested locally

GLM-5.3-Flash-Abliterated-Heretic-V2

Pi: thinking normal

UD-IQ4_XS · 321 B MoE · ≈ 173 GB

Released September 17, 2026

Coding time23 min
Speed42.7 tok/s
Cost (theoretical)–
Energy (Mac Studio)101 Wh
Electricity cost€0.038
Details
Parameters
321 B, MoE, 18 B active
Memory
≈ 173 GB
Model file
marcorez8/GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS/GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00001-of-00005.gguf
5 parts
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00001-of-00005.gguf 0.0 GBeec97673e9acb38f8682250e778f88991e731771bab8d3c0b787985949aacefa
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00002-of-00005.gguf 50.0 GBf6d89fd60fb0c75015817fc5ace3bf60ee4d1dc8aeecaac46d8f4445c3e52f35
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00003-of-00005.gguf 49.6 GBeaa7626c9b535538b5e46897704c84fb6c83cad3d7505fa9d76c1fc43fdfe5d2
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00004-of-00005.gguf 49.5 GBccc2e051d60899796fca3d71954d4421e6859fb171baa1798124ce7c47a887aa
  • GLM-5.3-Flash-Abliterated-Heretic-V2-UD-IQ4_XS-00005-of-00005.gguf 7.7 GB66ebf9ec85e04d3f44af674ae4f694acbc89cc53db75e42f2f4d3646bf321c0d
Released
September 17, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Model default (nothing sent; pi's level off stayed internal)
151,591 characters of thinking
Coding time
23 min, 24 requests
Tokens
1,316,694 (46,632 new input, 1,210,152 cached, 59,910 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
101 Wh, €0.038 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Huihui-Qwen3.8-Flash-Next-abliterated UD-Q4_K_XL with pi 1.5.0Run the giraffe

Open Weightstested locally

Huihui-Qwen3.8-Flash-Next-abliterated UD-Q4_K_XL

UD-Q4_K_XL · 177 B MoE · ≈ 123 GB

Released September 6, 2026

Coding time79 min
Speed34.3 tok/s
Cost (theoretical)–
Energy (Mac Studio)339 Wh
Electricity cost€0.127
Details
Parameters
177 B, MoE, 6 B active (125 B plus 51 B n-gram embeddings and 4 B MTP)
Memory
≈ 123 GB
Model file
huihui-ai/Huihui-Qwen3.8-Flash-Next-abliterated-GGUF/Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf
4 parts
  • Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 0.0 GB4448186216b3af4cc558bbce2c3213f01608f8f8b2e5267a9767971dd3ec8082
  • Qwen3.8-Flash-Next-UD-Q4_K_XL-00002-of-00004.gguf 49.9 GBb6b52d0c156217efc06bcf06c6906e93b552eb24327abb076a90e02397820432
  • Qwen3.8-Flash-Next-UD-Q4_K_XL-00003-of-00004.gguf 49.4 GBab7d9af2f3b824218fe460de0703b6b349ea83fe51f480f48e0107beb986b0a7
  • Qwen3.8-Flash-Next-UD-Q4_K_XL-00004-of-00004.gguf 12.1 GBb8cc1e386c6dc8e92b3e420f839239c2a595598518b179b7a88a4c430b3fc973
Released
September 6, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Model default (nothing sent; pi's level off stayed internal)
322,938 characters of thinking
Coding time
79 min, 120 requests
Tokens
15,303,147 (82,182 new input, 15,059,003 cached, 161,962 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
339 Wh, €0.127 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

Open Weightstested locallydoesn't work

MiniCPM5-2B

Q4_K_M · 2 B Dense · ≈ 4 GB

Released September 6, 2026

Coding time2 min
Speed164 tok/s
Cost (theoretical)–
Energy (Mac Studio)9.9 Wh
Electricity cost€0.004

Why not: Syntax error in the script; the scene does not start.

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Parameters
2 B, dense
Memory
≈ 4 GB
Model file
openbmb/MiniCPM5-2B-GGUF/MiniCPM5-2B-Q4_K_M.gguf
SHA256
  • MiniCPM5-2B-Q4_K_M.gguf 1.6 GBec2d5801640099e97d8d7e8003ad4d81f336e757811f03a26173dddf386602fd
Released
September 6, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
2,617 characters of thinking
Coding time
2 min, 31 requests
Tokens
371,259 (16,155 new input, 332,448 cached, 22,656 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
9.9 Wh, €0.004 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by GPT-6 Astra with pi 1.5.0Run the giraffe

ClosedCloud

GPT-6 Astra

OpenAI · OpenRouter

Released September 4, 2026

Coding time7 min
Speed (provider)62.3 tok/s
Cost (real, API)$2.26
Details
Model on OpenRouter
openai/gpt-6-astra
Weights
Closed model, weights not published
Released
September 4, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Amazon Bedrock
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
4,610 reasoning tokens billed
Coding time
7 min, 20 requests
Tokens
553,538 (44,705 new input, 484,398 cached, 24,435 output)
OpenRouter cost (real, via API)
$2.26 (list price per million tokens: $10.00 input, $1.00 cached, $50.00 output)
Still of the giraffe by Qwen3.8-Max-0902 with pi 1.5.0Run the giraffe

ClosedCloud

Qwen3.8-Max-0902

Qwen · OpenRouter

Released September 3, 2026

Coding time49 min
Speed (provider)28.8 tok/s
Cost (real, API)$2.00
Details
Model on OpenRouter
qwen/qwen3.8-max-0902
Weights
Closed model, weights not published
Released
September 3, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Alibaba
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
50,821 reasoning tokens billed
Coding time
49 min, 62 requests
Tokens
4,710,027 (186,428 new input, 4,438,144 cached, 85,455 output)
OpenRouter cost (real, via API)
$2.00 (list price per million tokens: $2.00 input, $0.250 cached, $6.00 output)
Still of the giraffe by Muse Spark 1.3 with pi 1.5.0Run the giraffe

ClosedCloud

Muse Spark 1.3

Meta · OpenRouter

Released September 2, 2026

Coding time3 min
Speed (provider)97.6 tok/s
Cost (real, API)$0.123
Details
Model on OpenRouter
meta/muse-spark-1.3
Weights
Closed model, weights not published
Released
September 2, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Meta
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
3,602 reasoning tokens billed
Coding time
3 min, 8 requests
Tokens
93,194 (42,694 new input, 35,464 cached, 15,036 output)
OpenRouter cost (real, via API)
$0.123 (list price per million tokens: $1.25 input, $0.150 cached, $4.25 output)
Still of the giraffe by Gemini 3.8 Flash with pi 1.5.0Run the giraffe

ClosedCloud

Gemini 3.8 Flash

Google · OpenRouter

Released September 2, 2026

Coding time31 min
Speed (provider)121 tok/s
Cost (real, API)$2.05

Camera so close that the giraffe is cut off; control panels cover a lot.

Details
Model on OpenRouter
google/gemini-3.8-flash
Weights
Closed model, weights not published
Released
September 2, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google AI Studio
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
50,398 reasoning tokens billed
Coding time
31 min, 93 requests
Tokens
12,728,061 (395,178 new input, 12,106,464 cached, 226,419 output)
OpenRouter cost (real, via API)
$2.05 (list price per million tokens: $0.825 input, $0.083 cached, $4.12 output)
Still of the giraffe by GLM-5.3-Flash (Cloud) with OpenCode 2.2.5Run the giraffe

Open WeightsCloud

GLM-5.3-Flash (Cloud)

Z.ai · OpenRouter · 321 B MoE

Released August 26, 2026

Coding time8 min
Speed (provider)37.1 tok/s
Cost (real, API)$0.045
Details
Model on OpenRouter
z-ai/glm-5.3-flash
Released
August 26, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Wafer (20), Relace (11)
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
19,325 reasoning tokens billed
Coding time
8 min, 30 requests
Tokens
1,207,469 (293,988 new input, 896,320 cached, 17,161 output)
OpenRouter cost (real, via API)
$0.045 (list price per million tokens: $0.150 input, $0.030 cached, $0.500 output)
Still of the giraffe by Qwen3.8-Flash (Cloud) with pi 1.5.0Run the giraffe

Open WeightsCloud

Qwen3.8-Flash (Cloud)

Qwen · OpenRouter · 180 B MoE

Released August 26, 2026

Coding time2.0 h
Speed (provider)41.2 tok/s
Cost (real, API)$0.666

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Model on OpenRouter
qwen/qwen3.8-flash
Released
August 26, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Alibaba
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
157,815 reasoning tokens billed
Coding time
2.0 h, 150 requests
Tokens
29,025,585 (515,079 new input, 28,219,392 cached, 291,114 output)
OpenRouter cost (real, via API)
$0.666 (list price per million tokens: $0.150 input, $0.016 cached, $0.470 output)
Still of the giraffe by GLM-5.3-Flash UD-Q4_K_XL with pi 1.5.0Run the giraffe

Open Weightstested locally

GLM-5.3-Flash UD-Q4_K_XL

Pi: thinking high

UD-Q4_K_XL · 321 B MoE · ≈ 220 GB

Released August 25, 2026

Coding time14 min
Speed33.7 tok/s
Cost (theoretical)$0.034
Energy (Mac Studio)61 Wh
Electricity cost€0.023

Same server and model file as the “thinking normal” run, but pi was told the model takes thinking levels and sent “high”.

Details
Parameters
321 B, MoE, 18 B active
Memory
≈ 220 GB
Model file
unsloth/GLM-5.3-Flash-GGUF/GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf
6 parts
  • GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf 0.0 GBb59c030090f012b38213bc8c4f78ce10767f2693d730d0dbcd3dc16a5f69e2bc
  • GLM-5.3-Flash-UD-Q4_K_XL-00002-of-00006.gguf 49.2 GBd3ecb6ff3957a99878f9a0352676a0913748a431a9a4a1b1ffa5ade9b8947a74
  • GLM-5.3-Flash-UD-Q4_K_XL-00003-of-00006.gguf 50.0 GB328073c004e7c5395b208247feed26089db247b94dd8fa4ab0f2569d86c1d770
  • GLM-5.3-Flash-UD-Q4_K_XL-00004-of-00006.gguf 48.7 GB6803ab7effa6da4a0b02c9c7865952fdd6c5b2e10e53903348da369e90bd13f9
  • GLM-5.3-Flash-UD-Q4_K_XL-00005-of-00006.gguf 49.0 GB852f3df9dacde3d196796f9fe738468e80c8701555ff0a8c30bc010fb8974dd8
  • GLM-5.3-Flash-UD-Q4_K_XL-00006-of-00006.gguf 2.8 GBc6ba510fafc1e12cc0addbc361a329c0c592ab96980098e7e25e107d8faa983e
Released
August 25, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Level high sent (as reasoning_effort)
52,452 characters of thinking
Coding time
14 min, 42 requests
Tokens
1,079,453 (19,643 new input, 1,031,230 cached, 28,580 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.034 z-ai/glm-5.3-flash
Electricity cost
61 Wh, €0.023 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by GLM-5.3-Flash UD-Q4_K_XL with pi 1.5.0Run the giraffe

Open Weightstested locally

GLM-5.3-Flash UD-Q4_K_XL

Pi: thinking normal

UD-Q4_K_XL · 321 B MoE · ≈ 220 GB

Released August 25, 2026

Coding time3.0 h
Speed6.5 tok/s
Cost (theoretical)$0.146
Energy (Mac Studio)777 Wh
Electricity cost€0.290

Stopped at the 3-hour limit.

Details
Parameters
321 B, MoE, 18 B active
Memory
≈ 220 GB
Model file
unsloth/GLM-5.3-Flash-GGUF/GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf
6 parts
  • GLM-5.3-Flash-UD-Q4_K_XL-00001-of-00006.gguf 0.0 GBb59c030090f012b38213bc8c4f78ce10767f2693d730d0dbcd3dc16a5f69e2bc
  • GLM-5.3-Flash-UD-Q4_K_XL-00002-of-00006.gguf 49.2 GBd3ecb6ff3957a99878f9a0352676a0913748a431a9a4a1b1ffa5ade9b8947a74
  • GLM-5.3-Flash-UD-Q4_K_XL-00003-of-00006.gguf 50.0 GB328073c004e7c5395b208247feed26089db247b94dd8fa4ab0f2569d86c1d770
  • GLM-5.3-Flash-UD-Q4_K_XL-00004-of-00006.gguf 48.7 GB6803ab7effa6da4a0b02c9c7865952fdd6c5b2e10e53903348da369e90bd13f9
  • GLM-5.3-Flash-UD-Q4_K_XL-00005-of-00006.gguf 49.0 GB852f3df9dacde3d196796f9fe738468e80c8701555ff0a8c30bc010fb8974dd8
  • GLM-5.3-Flash-UD-Q4_K_XL-00006-of-00006.gguf 2.8 GBc6ba510fafc1e12cc0addbc361a329c0c592ab96980098e7e25e107d8faa983e
Released
August 25, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Model default (nothing sent; pi's level off stayed internal)
142,294 characters of thinking
Coding time
3.0 h, 79 requests
Tokens
4,742,674 (41,182 new input, 4,631,584 cached, 69,908 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.146 z-ai/glm-5.3-flash
Electricity cost
777 Wh, €0.290 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Qwen3.8-Flash-Next Q8_0 with pi 1.5.0Run the giraffe

Open Weightstested locally

Qwen3.8-Flash-Next Q8_0

Q8_0 · 177 B MoE · ≈ 208 GB

Released August 24, 2026

Coding time58 min
Speed40.1 tok/s
Cost (theoretical)–
Energy (Mac Studio)249 Wh
Electricity cost€0.093
Details
Parameters
177 B, MoE, 6 B active (125 B plus 51 B n-gram embeddings and 4 B MTP)
Memory
≈ 208 GB
Model file
unsloth/Qwen3.8-Flash-Next-GGUF/Qwen3.8-Flash-Next-Q8_0-00001-of-00006.gguf
6 parts
  • Qwen3.8-Flash-Next-Q8_0-00001-of-00006.gguf 0.0 GB2dabcbb53ca537a7947bc7d20414fd464eeaf4d66d43021b5b2556cc87544ad2
  • Qwen3.8-Flash-Next-Q8_0-00002-of-00006.gguf 0.7 GB494ca4ed3dbf97bc28da88af3890b8877b9032f909812d00c0526a9ca5e91d2e
  • Qwen3.8-Flash-Next-Q8_0-00003-of-00006.gguf 54.4 GB34efd79a80a1ce540a517a5d56171924b66ce1c38b04c904f17ad6d8ef17cf20
  • Qwen3.8-Flash-Next-Q8_0-00004-of-00006.gguf 49.4 GBbfa634025fabbd2658bf7694bc80b90e571699c768723f844c934c7ef06c691a
  • Qwen3.8-Flash-Next-Q8_0-00005-of-00006.gguf 49.7 GB232a8f14cc0fa4262e7efe8593774b136fe40909e39c7a020342ddaa27259a97
  • Qwen3.8-Flash-Next-Q8_0-00006-of-00006.gguf 34.0 GB538a93bca918064983409a41187ad4c68640f9aced6f29564da8f551bf86d7a5
Released
August 24, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Model default (nothing sent; pi's level off stayed internal)
231,070 characters of thinking
Coding time
58 min, 74 requests
Tokens
7,827,218 (31,507 new input, 7,657,010 cached, 138,701 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
249 Wh, €0.093 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Qwen3.8-Flash-Next UD-Q4_K_XL with pi 1.5.0Run the giraffe

Open Weightstested locally

Qwen3.8-Flash-Next UD-Q4_K_XL

UD-Q4_K_XL · 177 B MoE · ≈ 123 GB

Released August 24, 2026

Coding time2.4 h
Speed34.4 tok/s
Cost (theoretical)–
Energy (Mac Studio)618 Wh
Electricity cost€0.231
Details
Parameters
177 B, MoE, 6 B active (125 B plus 51 B n-gram embeddings and 4 B MTP)
Memory
≈ 123 GB
Model file
unsloth/Qwen3.8-Flash-Next-GGUF/Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf
4 parts
  • Qwen3.8-Flash-Next-UD-Q4_K_XL-00001-of-00004.gguf 0.0 GBacc44040f74d0e55fb89c3967056cce5dbda1bcc52e909c3ba6fc72b5e9c0858
  • Qwen3.8-Flash-Next-UD-Q4_K_XL-00002-of-00004.gguf 49.7 GB45792ae869072d8229384c51c7c73dd959e191505252b41dd71852d9746f5ce4
  • Qwen3.8-Flash-Next-UD-Q4_K_XL-00003-of-00004.gguf 32.8 GB8c76e79d444b16a663d9c8db54e585ed3b1da13eebd2619c37b0c355da803c82
  • Qwen3.8-Flash-Next-UD-Q4_K_XL-00004-of-00004.gguf 28.8 GB5de8b5dbf89409acc39468decafd4a4a95b13c29d88a14b0356107897829ec36
Released
August 24, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Model default (nothing sent; pi's level off stayed internal)
609,944 characters of thinking
Coding time
2.4 h, 229 requests
Tokens
25,987,726 (147,663 new input, 25,544,843 cached, 295,220 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
618 Wh, €0.231 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by GLM-5.3 with pi 1.5.0Run the giraffe

Open WeightsCloud

GLM-5.3

Z.ai · OpenRouter · 753 B MoE

Released August 18, 2026

Coding time7 min
Speed (provider)82.4 tok/s
Cost (real, API)$0.081

The body is a box.

Details
Model on OpenRouter
z-ai/glm-5.3
Released
August 18, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Wafer
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
15,452 reasoning tokens billed
Coding time
7 min, 18 requests
Tokens
514,916 (17,498 new input, 463,552 cached, 33,866 output)
OpenRouter cost (real, via API)
$0.081 (list price per million tokens: $0.070 input, $0.069 cached, $1.40 output)
No working giraffe

Open Weightstested locallydoesn't work

Ornith-1.5-9B

Q4_K_M · 9.2 B Dense · ≈ 8 GB

Released August 18, 2026

Coding time71 s
Speed115 tok/s
Cost (theoretical)–
Energy (Mac Studio)5.1 Wh
Electricity cost€0.002

Why not: Creates a mesh without valid geometry; Three.js aborts while loading.

Details
Parameters
9.2 B, dense
Memory
≈ 8 GB
Model file
ornith-ai/Ornith-1.5-9B-GGUF/Ornith-1.5-9B-Q4_K_M.gguf
SHA256
  • Ornith-1.5-9B-Q4_K_M.gguf 5.8 GB70c112196e0b7023803c9762752e46d29e612a92c83f995bc3ba1ceb07e8fab6
Released
August 18, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
5,523 characters of thinking
Coding time
71 s, 14 requests
Tokens
113,750 (3,173 new input, 102,399 cached, 8,178 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
5.1 Wh, €0.002 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Ornith-1.5-35B-A3B with pi 1.5.0Run the giraffe

Open Weightstested locally

Ornith-1.5-35B-A3B

Q4_K_M · 36 B MoE · ≈ 24 GB

Released August 18, 2026

Coding time83 s
Speed132 tok/s
Cost (theoretical)–
Energy (Mac Studio)6.0 Wh
Electricity cost€0.002

A chain of spheres, more caterpillar than giraffe.

Details
Parameters
36 B, MoE, 3 B active
Memory
≈ 24 GB
Model file
ornith-ai/Ornith-1.5-35B-A3B-GGUF/Ornith-1.5-35B-Q4_K_M.gguf
SHA256
  • Ornith-1.5-35B-Q4_K_M.gguf 21.7 GB42739874cc2ccfdb8523b23fbe52e29b2a7555c8176737ca9ca0b5d59859d41f
Released
August 18, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
8,857 characters of thinking
Coding time
83 s, 14 requests
Tokens
145,718 (10,070 new input, 124,678 cached, 10,970 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
6.0 Wh, €0.002 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Ling-3.0-tiny with pi 1.5.0Run the giraffe

Open Weightstested locally

Ling-3.0-tiny

Q4_K_M · 7.9 B MoE · ≈ 7 GB

Released August 10, 2026

Coding time9 min
Speed95.5 tok/s
Cost (theoretical)$0.0098
Energy (Mac Studio)41 Wh
Electricity cost€0.015

Just a capsule floating above the ground.

Details
Parameters
7.9 B, MoE, 1.3 B active
Memory
≈ 7 GB
Model file
inclusionAI/Ling-3.0-tiny-GGUF/Ling-3.0-tiny-Q4_K_M.gguf
SHA256
  • Ling-3.0-tiny-Q4_K_M.gguf 4.8 GB246d67d45f5b0c7447ca0ce0bdb8b46b8a47b593c5068635dc16422c051d7be9
Released
August 10, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
73,997 characters of thinking
Coding time
9 min, 44 requests
Tokens
2,244,351 (66,728 new input, 2,123,456 cached, 54,167 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0098 inclusionai/ling-3.0-tiny
Electricity cost
41 Wh, €0.015 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

Open Weightstested locallydoesn't work

Granite 4.2 3B

Q4_K_M · 3 B Dense · ≈ 4 GB

Released August 7, 2026

Coding time16 min
Speed56.8 tok/s
Cost (theoretical)–
Energy (Mac Studio)68 Wh
Electricity cost€0.026

Why not: Imports “three” without an import map; the browser cannot resolve the module.

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Parameters
3 B, dense
Memory
≈ 4 GB
Model file
ibm-granite/granite-4.2-3b-GGUF/granite-4.2-3b-Q4_K_M.gguf
SHA256
  • granite-4.2-3b-Q4_K_M.gguf 2.2 GBe0406663965846ae22a403456eb826ccce5f450840491f71952f18a7cb78e7d5
Released
August 7, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
5,261 characters of thinking
Coding time
16 min, 58 requests
Tokens
2,039,724 (51,444 new input, 1,934,177 cached, 54,103 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
68 Wh, €0.026 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Qwen3.8-27B UD-Q4_K_M (Unsloth Dynamic 3.1) with pi 1.5.0Run the giraffe

Open Weightstested locally

Qwen3.8-27B UD-Q4_K_M (Unsloth Dynamic 3.1)

UD-Q4_K_M · 27 B Dense · ≈ 19 GB

Released August 5, 2026

Coding time46 min
Speed45.9 tok/s
Cost (theoretical)$0.551
Energy (Mac Studio)200 Wh
Electricity cost€0.074

Small, pale and crudely built.

Details
Parameters
27 B, dense
Memory
≈ 19 GB
Model file
unsloth/Qwen3.8-27B-GGUF/Qwen3.8-27B-UD-Q4_K_M.gguf
SHA256
  • Qwen3.8-27B-UD-Q4_K_M.gguf 16.6 GB1bce504dfecd84153666928a41d8a66706f0158d3a317bc5196b72819d7dc529
Released
August 5, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-cb44fdb
Thinking
Switched on (enable_thinking, no level)
266,694 characters of thinking
Coding time
46 min, 85 requests
Tokens
8,371,601 (31,682 new input, 8,212,628 cached, 127,291 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.551 qwen/qwen3.8-27b
Electricity cost
200 Wh, €0.074 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))

18 more variants in the quant comparison →

No working giraffe

Open Weightstested locallydoesn't work

LFM2.5-2.6B

Q4_K_M · 2.6 B Dense · ≈ 4 GB

Released July 28, 2026

Coding time20 s
Speed240 tok/s
Cost (theoretical)$0.0058
Energy (Mac Studio)1.4 Wh
Electricity cost< €0.001

Why not: Loads Three.js from an address that does not exist.

Details
Parameters
2.6 B, dense
Memory
≈ 4 GB
Model file
LiquidAI/LFM2.5-2.6B-GGUF/LFM2.5-2.6B-Q4_K_M.gguf
SHA256
  • LFM2.5-2.6B-Q4_K_M.gguf 1.7 GB02a8b7e17487d326e46d68ce0ba24211e1b80a14c4cd0597fa73c1cd697f52ed
Released
July 28, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
7,172 characters of thinking
Coding time
20 s, 6 requests
Tokens
34,980 (7,182 new input, 22,989 cached, 4,809 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0058 liquid/lfm-2.5-2.6b
Electricity cost
1.4 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Claude Opus 5 with pi 1.5.0Run the giraffe

ClosedCloud

Claude Opus 5

Anthropic · OpenRouter

Released July 24, 2026

Coding time2.0 h
Speed (provider)34.6 tok/s
Cost (real, API)$48.79
Details
Model on OpenRouter
anthropic/claude-opus-5
Weights
Closed model, weights not published
Released
July 24, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Claude Platform on AWS
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
116,480 reasoning tokens billed
Coding time
2.0 h, 226 requests
Tokens
29,689,499 (6,037,522 new input, 23,398,027 cached, 253,950 output)
OpenRouter cost (real, via API)
$48.79 (list price per million tokens: $5.00 input, $0.500 cached, $25.00 output)
No working giraffe

Open Weightstested locallydoesn't work

Nanbeige4.2-3B

Q4_K_M · 3 B Dense · ≈ 5 GB

Released July 21, 2026

Coding time93 s
Speed95.2 tok/s
Cost (theoretical)–
Energy (Mac Studio)6.7 Wh
Electricity cost€0.002

Why not: Imports “three” without an import map; the browser cannot resolve the module.

Details
Parameters
3 B, dense
Memory
≈ 5 GB
Model file
gkraker04/Nanbeige4.2-3B-GGUF/Nanbeige4.2-3B-Q4_K_M.gguf
SHA256
  • Nanbeige4.2-3B-Q4_K_M.gguf 2.6 GB71aac47bfe4b1f3e8b18e595726d6dce21281ac294830b39343057d2736ac190
Released
July 21, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
3,840 characters of thinking
Coding time
93 s, 6 requests
Tokens
59,546 (10,815 new input, 39,882 cached, 8,849 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
6.7 Wh, €0.002 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Inkling with pi 1.5.0Run the giraffe

Open WeightsCloud

Inkling

Thinking Machines · OpenRouter · 952 B MoE

Released July 18, 2026

Coding time49 s
Speed (provider)127 tok/s
Cost (real, API)$0.060

A giraffe made of a few boxes.

Details
Model on OpenRouter
thinkingmachines/inkling
Released
July 18, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Together
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
651 reasoning tokens billed
Coding time
49 s, 11 requests
Tokens
74,242 (28,487 new input, 39,552 cached, 6,203 output)
OpenRouter cost (real, via API)
$0.060 (list price per million tokens: $1.00 input, $0.170 cached, $4.05 output)
Still of the giraffe by GPT-5.6 Sol with pi 1.5.0Run the giraffe

ClosedCloud

GPT-5.6 Sol

OpenAI · OpenRouter

Released July 9, 2026

Coding time75 s
Speed (provider)79.5 tok/s
Cost (real, API)$0.177
Details
Model on OpenRouter
openai/gpt-5.6-sol
Weights
Closed model, weights not published
Released
July 9, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Amazon Bedrock
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
1,096 reasoning tokens billed
Coding time
75 s, 10 requests
Tokens
61,426 (7,735 new input, 47,725 cached, 5,966 output)
OpenRouter cost (real, via API)
$0.177 (list price per million tokens: $4.00 input, $0.400 cached, $20.00 output)
Still of the giraffe by GPT-5.6 Luna with OpenCode 2.2.5Run the giraffe

ClosedCloud

GPT-5.6 Luna

OpenAI · OpenRouter

Released July 9, 2026

Coding time29 s
Speed (provider)175 tok/s
Cost (real, API)$0.010

Camera almost inside the animal; neck and legs stick out of the body as loose rods.

Details
Model on OpenRouter
openai/gpt-5.6-luna
Weights
Closed model, weights not published
Released
July 9, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Amazon Bedrock
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
611 reasoning tokens billed
Coding time
29 s, 6 requests
Tokens
52,772 (10,388 new input, 37,313 cached, 5,071 output)
OpenRouter cost (real, via API)
$0.010 (list price per million tokens: $0.200 input, $0.020 cached, $1.20 output)
Still of the giraffe by Claude Sonnet 5 with pi 1.5.0Run the giraffe

ClosedCloud

Claude Sonnet 5

Anthropic · OpenRouter

Released June 30, 2026

Coding time63 min
Speed (provider)27.9 tok/s
Cost (real, API)$9.75

Neck stretched forward at a slant, legs splayed.

Details
Model on OpenRouter
anthropic/claude-sonnet-5
Weights
Closed model, weights not published
Released
June 30, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Anthropic
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
63 min, 153 requests
Tokens
10,999,458 (3,562,988 new input, 7,331,436 cached, 105,034 output)
OpenRouter cost (real, via API)
$9.75 (list price per million tokens: $2.00 input, $0.200 cached, $10.00 output)
Still of the giraffe by Nemotron 3 Ultra with pi 1.5.0Run the giraffe

Open WeightsCloud

Nemotron 3 Ultra

NVIDIA · OpenRouter · 561 B MoE

Released June 4, 2026

Coding time57 s
Speed (provider)227 tok/s
Cost (real, API)$0.044

A stack of brown spheres; finished in under a minute.

Details
Released
June 4, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by BaseTen
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
717 reasoning tokens billed
Coding time
57 s, 9 requests
Tokens
104,147 (3,758 new input, 87,424 cached, 12,965 output)
OpenRouter cost (real, via API)
$0.044 (list price per million tokens: $0.600 input, $0.120 cached, $2.40 output)
Still of the giraffe by MiniMax-M3 UD-IQ4_XS with pi 1.5.0Run the giraffe

Open Weightstested locally

MiniMax-M3 UD-IQ4_XS

UD-IQ4_XS · 426 B MoE · ≈ 230 GB

Released June 2, 2026

Coding time1.7 h
Speed15.3 tok/s
Cost (theoretical)$1.28
Energy (Mac Studio)451 Wh
Electricity cost€0.168

Output limit per response: 131,072 tokens instead of the usual 32,768.

Long neck this time, but dark and with thin legs.

Details
Parameters
426 B, MoE, 23 B active
Memory
≈ 230 GB
Model file
unsloth/MiniMax-M3-GGUF/MiniMax-M3-UD-IQ4_XS-00001-of-00006.gguf
6 parts
  • MiniMax-M3-UD-IQ4_XS-00001-of-00006.gguf 0.9 GB2a1a1942c34dfca4cc04e14f788d452d41befc2296c88a46b75d1ddb0cd62d5e
  • MiniMax-M3-UD-IQ4_XS-00002-of-00006.gguf 49.5 GBc8f17d5ba00e37224905c74cbb751391e263b3c30cdc25878ae0f47c3d4af02d
  • MiniMax-M3-UD-IQ4_XS-00003-of-00006.gguf 49.5 GB98fe5882a43aa2cfa21e0312b66ef63b24eabbf00051d6fa30486269f9623328
  • MiniMax-M3-UD-IQ4_XS-00004-of-00006.gguf 49.5 GB99fc164cadb73f31e545c870beb75afe0faf92550a247aa4e974b7cd8ff1fb98
  • MiniMax-M3-UD-IQ4_XS-00005-of-00006.gguf 49.0 GB78b574bbf4a2274b02e9b68ff0bdc5450b1851c52a8d8e147123e22aa36e95e6
  • MiniMax-M3-UD-IQ4_XS-00006-of-00006.gguf 10.0 GB64f3d120a85528b58e1f2b1f1c069017cfddc738badaecfff814e361c040e9f6
Released
June 2, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
153,661 characters of thinking
Coding time
1.7 h, 219 requests
Tokens
19,254,552 (54,874 new input, 19,103,463 cached, 96,215 output)
OpenRouter cost (theoretical, model ran on local hardware)
$1.28 minimax/minimax-m3
Electricity cost
451 Wh, €0.168 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by MiniMax-M3 (Cloud) with pi 1.5.0Run the giraffe

Open WeightsCloud

MiniMax-M3 (Cloud)

MiniMax · OpenRouter · 426 B MoE

Released May 31, 2026

Coding time10 min
Speed (provider)123 tok/s
Cost (real, API)$0.382
Details
Model on OpenRouter
minimax/minimax-m3
Released
May 31, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by CoreWeave
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
46,439 reasoning tokens billed
Coding time
10 min, 65 requests
Tokens
5,436,474 (230,262 new input, 5,130,624 cached, 75,588 output)
OpenRouter cost (real, via API)
$0.382 (list price per million tokens: $0.300 input, $0.060 cached, $1.20 output)
Still of the giraffe by Gemma 4 12B with pi 1.5.0Run the giraffe

Open Weightstested locally

Gemma 4 12B

Q4_0 (QAT) · 12 B Dense · ≈ 9 GB

Released May 23, 2026

Coding time39 s
Speed151 tok/s
Cost (theoretical)–
Energy (Mac Studio)2.8 Wh
Electricity cost€0.001

More a lump with a neck than a giraffe.

Details
Parameters
12 B, dense
Memory
≈ 9 GB
Model file
google/gemma-4-12B-it-qat-q4_0-gguf/gemma-4-12b-it-qat-q4_0.gguf
SHA256
  • gemma-4-12b-it-qat-q4_0.gguf 7.0 GB93567e57a8fe10b23569b9d9ec38cd005deedf71e29477c421a4b83f418a538b
Released
May 23, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Switched on (enable_thinking, no level)
2,726 characters of thinking
Coding time
39 s, 6 requests
Tokens
51,847 (9,571 new input, 36,377 cached, 5,899 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
2.8 Wh, €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

Open Weightstested locallydoesn't work

MiniCPM5-1B

Q4_K_M · 1 B Dense · ≈ 3 GB

Released May 21, 2026

Coding time7 s
Speed312 tok/s
Cost (theoretical)–
Energy (Mac Studio)0.5 Wh
Electricity cost< €0.001

Why not: No page: the model only wrote that it could not run code and used no tools. The second attempt stayed empty too.

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Parameters
1 B, dense
Memory
≈ 3 GB
Model file
openbmb/MiniCPM5-1B-GGUF/MiniCPM5-1B-Q4_K_M.gguf
SHA256
  • MiniCPM5-1B-Q4_K_M.gguf 0.7 GB81b64d05a23b17b34c475f42b3e72fbde62d4b92cc34541f7a8031d0752deafa
Released
May 21, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
4,223 characters of thinking
Coding time
7 s, 2 requests
Tokens
5,134 (1,477 new input, 1,475 cached, 2,182 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
0.5 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by GPT-5.5 with pi 1.5.0Run the giraffe

ClosedCloud

GPT-5.5

OpenAI · OpenRouter

Released April 24, 2026

Coding time110 s
Speed (provider)93.3 tok/s
Cost (real, API)$0.412

Sausage-shaped body, the neck sticks out of the frame.

Details
Model on OpenRouter
openai/gpt-5.5
Weights
Closed model, weights not published
Released
April 24, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Azure
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
2,428 reasoning tokens billed
Coding time
110 s, 9 requests
Tokens
81,691 (15,105 new input, 56,320 cached, 10,266 output)
OpenRouter cost (real, via API)
$0.412 (list price per million tokens: $5.00 input, $0.500 cached, $30.00 output)
Still of the giraffe by DeepSeek-V4-Pro-0423 with pi 1.5.0Run the giraffe

Open WeightsCloud

DeepSeek-V4-Pro-0423

DeepSeek · OpenRouter · 1599 B MoE

Released April 24, 2026

Coding time7 min
Speed (provider)109 tok/s
Cost (real, API)$0.181
Details
Model on OpenRouter
deepseek/deepseek-v4-pro
Released
April 24, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Relace
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
20,289 reasoning tokens billed
Coding time
7 min, 13 requests
Tokens
440,230 (21,509 new input, 372,992 cached, 45,729 output)
OpenRouter cost (real, via API)
$0.181 (list price per million tokens: $0.955 input, $0.080 cached, $1.91 output)
No working giraffe

Open Weightstested locallydoesn't work

Qwen3.6-27B

Q4_K_M · 27 B Dense · ≈ 19 GB

Released April 21, 2026

Coding time16 min
Speed34.1 tok/s
Cost (theoretical)$0.267
Energy (Mac Studio)68 Wh
Electricity cost€0.025

Why not: Stops with a script error because it tries to overwrite an object's position; the picture stays black.

Details
Parameters
27 B, dense
Memory
≈ 19 GB
Model file
unsloth/Qwen3.6-27B-GGUF/Qwen3.6-27B-Q4_K_M.gguf
SHA256
  • Qwen3.6-27B-Q4_K_M.gguf 16.8 GB5ed60d0af4650a854b1755bd392f9aef4872643dc25a254bc68043fa638392a0
Released
April 21, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Switched on (enable_thinking, no level)
10,031 characters of thinking
Coding time
16 min, 19 requests
Tokens
541,862 (4,166 new input, 505,264 cached, 32,432 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.267 qwen/qwen3.6-27b
Electricity cost
68 Wh, €0.025 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Qwen3.6-35B-A3B with pi 1.5.0Run the giraffe

Open Weightstested locally

Qwen3.6-35B-A3B

UD-Q4_K_M · 35 B MoE · ≈ 25 GB

Released April 15, 2026

Coding time32 min
Speed5.6 tok/s
Cost (theoretical)$0.011
Energy (Mac Studio)136 Wh
Electricity cost€0.051
Details
Parameters
35 B, MoE, 3 B active
Memory
≈ 25 GB
Model file
unsloth/Qwen3.6-35B-A3B-GGUF/Qwen3.6-35B-A3B-UD-Q4_K_M.gguf
SHA256
  • Qwen3.6-35B-A3B-UD-Q4_K_M.gguf 22.1 GBac0e2c1189e055faa36eff361580e79c5bd6f8e76bffb4ce547f167d53e31a61
Released
April 15, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Model default (nothing sent; pi's level off stayed internal)
2,226 characters of thinking
Coding time
32 min, 7 requests
Tokens
76,467 (2,688 new input, 63,163 cached, 10,616 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.011 qwen/qwen3.6-35b-a3b
Electricity cost
136 Wh, €0.051 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Mistral Medium 3.5 with pi 1.5.0Run the giraffe

Open Weightstested locally

Mistral Medium 3.5

Q4_K_M · 125 B Dense · ≈ 83 GB

Released March 31, 2026

Coding time14 min
Speed11.7 tok/s
Cost (theoretical)$0.298
Energy (Mac Studio)62 Wh
Electricity cost€0.023

Neck and spots float apart from the body; the ground shows as a black bar.

Details
Parameters
125 B, dense
Memory
≈ 83 GB
Model file
unsloth/Mistral-Medium-3.5-128B-GGUF/Mistral-Medium-3.5-128B-Q4_K_M-00001-of-00003.gguf
3 parts
  • Mistral-Medium-3.5-128B-Q4_K_M-00001-of-00003.gguf 0.0 GB94bf2dd90d80f41b1dfb1f94b569d11fd78fd302a79ae9fdf828f8082d1dfeaa
  • Mistral-Medium-3.5-128B-Q4_K_M-00002-of-00003.gguf 49.9 GB8396392f4b9eafac69e59355b569b6603f42d103505988e26939db7f5bfecb95
  • Mistral-Medium-3.5-128B-Q4_K_M-00003-of-00003.gguf 25.0 GB3f4ddc0284d522e6f1a020eaa731eaf851d6708a26431773de7bba504227c2e5
Released
March 31, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
no thinking text
Coding time
14 min, 15 requests
Tokens
158,295 (3,158 new input, 145,065 cached, 10,072 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.298 mistralai/mistral-medium-3-5
Electricity cost
62 Wh, €0.023 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Gemma 4 31B with pi 1.5.0Run the giraffe

Open Weightstested locally

Gemma 4 31B

Q4_0 (QAT) · 31 B Dense · ≈ 20 GB

Released March 11, 2026

Coding time117 s
Speed52.9 tok/s
Cost (theoretical)$0.0096
Energy (Mac Studio)8.4 Wh
Electricity cost€0.003

The head floats above the neck.

Details
Parameters
31 B, dense
Memory
≈ 20 GB
Model file
google/gemma-4-31B-it-qat-q4_0-gguf/gemma-4-31B_q4_0-it.gguf
SHA256
  • gemma-4-31B_q4_0-it.gguf 17.7 GB179cfb99212709597eae5929112cfca677e1bbf566178b479ae1da0c4772874b
Released
March 11, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Switched on (enable_thinking, no level)
4,153 characters of thinking
Coding time
117 s, 5 requests
Tokens
41,983 (9,344 new input, 26,447 cached, 6,192 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0096 google/gemma-4-31b-it
Electricity cost
8.4 Wh, €0.003 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Gemma 4 26B A4B with pi 1.5.0Run the giraffe

Open Weightstested locally

Gemma 4 26B A4B

UD-Q4_K_M · 25 B MoE · ≈ 19 GB

Released March 11, 2026

Coding time48 s
Speed190 tok/s
Cost (theoretical)$0.0051
Energy (Mac Studio)3.5 Wh
Electricity cost€0.001
Details
Parameters
25 B, MoE, 3.8 B active
Memory
≈ 19 GB
Model file
unsloth/gemma-4-26B-A4B-it-GGUF/gemma-4-26B-A4B-it-UD-Q4_K_M.gguf
SHA256
  • gemma-4-26B-A4B-it-UD-Q4_K_M.gguf 16.9 GBf2c28b3dc4776931ac6f879e11f203dec637ea0f14267a86ec8f6165f63f293f
Released
March 11, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
6,938 characters of thinking
Coding time
48 s, 7 requests
Tokens
78,482 (14,285 new input, 55,094 cached, 9,103 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0051 google/gemma-4-26b-a4b-it
Electricity cost
3.5 Wh, €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

Open Weightstested locallydoesn't work

Mistral Small 4

UD-Q4_K_M · 119 B MoE · ≈ 82 GB

Released March 3, 2026

Coding time5 min
Speed71.8 tok/s
Cost (theoretical)$0.019
Energy (Mac Studio)22 Wh
Electricity cost€0.008

Why not: Loads Three.js from an address that no longer exists in this version.

Details
Parameters
119 B, MoE, 6.5 B active
Memory
≈ 82 GB
Model file
unsloth/Mistral-Small-4-119B-2603-GGUF/Mistral-Small-4-119B-2603-UD-Q4_K_M-00001-of-00003.gguf
3 parts
  • Mistral-Small-4-119B-2603-UD-Q4_K_M-00001-of-00003.gguf 0.0 GBfd3cc46082e4e64eb623eea4611b02583d1de4c20a59411bf1820925d5117dfe
  • Mistral-Small-4-119B-2603-UD-Q4_K_M-00002-of-00003.gguf 49.3 GBf357d8dc029824fa4515ae60d7a8b7e108546763614f16c00a1b4ea0cd94145c
  • Mistral-Small-4-119B-2603-UD-Q4_K_M-00003-of-00003.gguf 24.5 GB9dc960d67fb1ef23029d24878b4cf6c63b743ab26cf9137402549591bd770c50
Released
March 3, 2026 (Month taken from the model name (2603); the repository itself is dated January.)
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
no thinking text
Coding time
5 min, 24 requests
Tokens
380,153 (4,438 new input, 354,026 cached, 21,689 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.019 mistralai/mistral-small-2603
Electricity cost
22 Wh, €0.008 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Gemma 4 E4B with pi 1.5.0Run the giraffe

Open Weightstested locally

Gemma 4 E4B

Q4_K_M · 7.5 B Dense · ≈ 7 GB

Released March 2, 2026

Coding time19 s
Speed150 tok/s
Cost (theoretical)–
Energy (Mac Studio)1.4 Wh
Electricity cost< €0.001

A pillar instead of a giraffe, with the head floating above it.

Details
Parameters
7.5 B, dense (4.5 B effective, 8 B with embeddings)
Memory
≈ 7 GB
Model file
unsloth/gemma-4-E4B-it-GGUF/gemma-4-E4B-it-Q4_K_M.gguf
SHA256
  • gemma-4-E4B-it-Q4_K_M.gguf 5.0 GB85a896a047553e842f25297ee5b031d64ff30147d9c4af17b1e4b394cd1fab87
Released
March 2, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Switched on (enable_thinking, no level)
3,461 characters of thinking
Coding time
19 s, 4 requests
Tokens
13,412 (3,393 new input, 7,175 cached, 2,844 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
1.4 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Gemma 4 E2B with OpenCode 2.2.5Run the giraffe

Open Weightstested locally

Gemma 4 E2B

Q4_K_M · 4.6 B Dense · ≈ 5 GB

Released March 2, 2026

Coding time15 s
Speed194 tok/s
Cost (theoretical)–
Energy (Mac Studio)1.1 Wh
Electricity cost< €0.001

The camera sits inside the model; only dark surfaces are in view.

Details
Parameters
4.6 B, dense (2.3 B effective, 5.1 B with embeddings)
Memory
≈ 5 GB
Model file
unsloth/gemma-4-E2B-it-GGUF/gemma-4-E2B-it-Q4_K_M.gguf
SHA256
  • gemma-4-E2B-it-Q4_K_M.gguf 3.1 GB740185b21d22ceb83a11c3aa62ad5842ef32c70f6096d756bbee85a1e4ec34b8
Released
March 2, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
OpenCode 2.2.5, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent)
4,273 characters of thinking
Coding time
15 s, 3 requests
Tokens
22,393 (7,222 new input, 12,267 cached, 2,904 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
1.1 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

Open Weightstested locallydoesn't work

Qwen3.5-0.8B

Q4_K_M · 0.8 B Dense · ≈ 3 GB

Released February 28, 2026

Coding time25 s
Speed251 tok/s
Cost (theoretical)–
Energy (Mac Studio)1.8 Wh
Electricity cost< €0.001

Why not: Loads its own scripts as ES modules; when the file is opened directly, the browser blocks them.

Details
Parameters
0.8 B, dense
Memory
≈ 3 GB
Model file
unsloth/Qwen3.5-0.8B-GGUF/Qwen3.5-0.8B-Q4_K_M.gguf
SHA256
  • Qwen3.5-0.8B-Q4_K_M.gguf 0.5 GBbd258782e35f7f458f8aced1adc053e6e92e89bc735ba3be89d38a06121dc517
Released
February 28, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
1,445 characters of thinking
Coding time
25 s, 12 requests
Tokens
104,282 (9,350 new input, 88,650 cached, 6,282 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
1.8 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Qwen3.5-9B with pi 1.5.0Run the giraffe

Open Weightstested locally

Qwen3.5-9B

Q4_K_M · 9.2 B Dense · ≈ 8 GB

Released February 27, 2026

Coding time41 s
Speed160 tok/s
Cost (theoretical)$0.0086
Energy (Mac Studio)2.9 Wh
Electricity cost€0.001

A tall, thin trunk instead of a giraffe.

Details
Parameters
9.2 B, dense
Memory
≈ 8 GB
Model file
unsloth/Qwen3.5-9B-MTP-GGUF/Qwen3.5-9B-Q4_K_M.gguf
SHA256
  • Qwen3.5-9B-Q4_K_M.gguf 5.9 GBe8dd94817e95d6c0939102049d068418269978377b13616c4726235e232841fe
Released
February 27, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
3,426 characters of thinking
Coding time
41 s, 7 requests
Tokens
47,737 (2,096 new input, 39,081 cached, 6,560 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0086 qwen/qwen3.5-9b
Electricity cost
2.9 Wh, €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

Open Weightstested locallydoesn't work

Qwen3.5-4B

Q4_K_M · 4.3 B Dense · ≈ 5 GB

Released February 27, 2026

Coding time27 s
Speed188 tok/s
Cost (theoretical)–
Energy (Mac Studio)1.9 Wh
Electricity cost< €0.001

Why not: The animation accesses a leg that was never created and aborts.

Details
Parameters
4.3 B, dense
Memory
≈ 5 GB
Model file
unsloth/Qwen3.5-4B-MTP-GGUF/Qwen3.5-4B-Q4_K_M.gguf
SHA256
  • Qwen3.5-4B-Q4_K_M.gguf 2.8 GB3874209241c9a397e2f62cd3f70f80fd2dfbf0dfccb6838416bdb48a714e8630
Released
February 27, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal)
2,462 characters of thinking
Coding time
27 s, 7 requests
Tokens
41,066 (6,298 new input, 29,702 cached, 5,066 output)
OpenRouter cost (theoretical, model ran on local hardware)
not on OpenRouter
Electricity cost
1.9 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Qwen3.5-27B with OpenCode 2.2.5Run the giraffe

Open Weightstested locally

Qwen3.5-27B

Q4_K_M · 27 B Dense · ≈ 19 GB

Released February 24, 2026

Coding time3 min
Speed32.5 tok/s
Cost (theoretical)$0.025
Energy (Mac Studio)13 Wh
Electricity cost€0.005

Camera too close: all you see is a spotted column on two legs.

Details
Parameters
27 B, dense
Memory
≈ 19 GB
Model file
unsloth/Qwen3.5-27B-GGUF/Qwen3.5-27B-Q4_K_M.gguf
SHA256
  • Qwen3.5-27B-Q4_K_M.gguf 16.7 GB84b5f7f112156d63836a01a69dc3f11a6ba63b10a23b8ca7a7efaf52d5a2d806
Released
February 24, 2026
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
OpenCode 2.2.5, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent)
2,027 characters of thinking
Coding time
3 min, 4 requests
Tokens
43,672 (6,111 new input, 31,871 cached, 5,690 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.025 qwen/qwen3.5-27b
Electricity cost
13 Wh, €0.005 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Gemini 3.1 Pro Preview with OpenCode 2.2.5Run the giraffe

ClosedCloud

Gemini 3.1 Pro Preview

Google · OpenRouter

Released February 19, 2026

Coding time3 min
Speed (provider)25.3 tok/s
Cost (real, API)$0.289
Details
Weights
Closed model, weights not published
Released
February 19, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
14,333 reasoning tokens billed
Coding time
3 min, 2 requests
Tokens
32,303 (27,423 new input, 0 cached, 4,880 output)
OpenRouter cost (real, via API)
$0.289 (list price per million tokens: $2.00 input, $0.200 cached, $12.00 output)
Still of the giraffe by Qwen3.5-397B-A17B with pi 1.5.0Run the giraffe

Open WeightsCloud

Qwen3.5-397B-A17B

Qwen · OpenRouter · 403 B MoE

Released February 16, 2026

Coding time2 min
Speed (provider)58.6 tok/s
Cost (real, API)$0.033
Details
Model on OpenRouter
qwen/qwen3.5-397b-a17b
Released
February 16, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Alibaba
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
285 reasoning tokens billed
Coding time
2 min, 5 requests
Tokens
44,849 (37,052 new input, 0 cached, 7,797 output)
OpenRouter cost (real, via API)
$0.033 (list price per million tokens: $0.600 input, $0.120 cached, $3.60 output)
Still of the giraffe by Claude Opus 4.6 with pi 1.5.0Run the giraffe

ClosedCloud

Claude Opus 4.6

Anthropic · OpenRouter

Released February 4, 2026

Coding time7 min
Speed (provider)67.4 tok/s
Cost (real, API)$1.27
Details
Model on OpenRouter
anthropic/claude-opus-4.6
Weights
Closed model, weights not published
Released
February 4, 2026 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Claude Platform on AWS
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
7 min, 26 requests
Tokens
682,579 (46,054 new input, 609,017 cached, 27,508 output)
OpenRouter cost (real, via API)
$1.27 (list price per million tokens: $5.00 input, $0.500 cached, $25.00 output)
Still of the giraffe by GPT-5.2 with pi 1.5.0Run the giraffe

ClosedCloud

GPT-5.2

OpenAI · OpenRouter

Released December 10, 2025

Coding time3 min
Speed (provider)78.0 tok/s
Cost (real, API)$0.210

Ball-shaped body on thin legs.

Details
Model on OpenRouter
openai/gpt-5.2
Weights
Closed model, weights not published
Released
December 10, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Azure
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
2,304 reasoning tokens billed
Coding time
3 min, 10 requests
Tokens
79,880 (12,886 new input, 54,272 cached, 12,722 output)
OpenRouter cost (real, via API)
$0.210 (list price per million tokens: $1.75 input, $0.175 cached, $14.00 output)
Still of the giraffe by DeepSeek-V3.2 with pi 1.5.0Run the giraffe

Open WeightsCloud

DeepSeek-V3.2

DeepSeek · OpenRouter · 685 B MoE

Released December 1, 2025

Coding time1.6 h
Speed (provider)56.4 tok/s
Cost (real, API)$0.684

The follow camera starts behind a tree, so the giraffe is mostly hidden; the “side” button shows it.

Details
Model on OpenRouter
deepseek/deepseek-v3.2
Released
December 1, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by GMICloud (222), SiliconFlow (4)
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
198,683 reasoning tokens billed
Coding time
1.6 h, 223 requests
Tokens
18,314,548 (692,243 new input, 17,297,408 cached, 324,897 output)
OpenRouter cost (real, via API)
$0.684 (list price per million tokens: $0.260 input, $0.130 cached, $0.380 output)
Still of the giraffe by Claude Opus 4.5 with pi 1.5.0Run the giraffe

ClosedCloud

Claude Opus 4.5

Anthropic · OpenRouter

Released November 24, 2025

Coding time5 min
Speed (provider)87.7 tok/s
Cost (real, API)$0.922

Barrel-shaped body.

Details
Model on OpenRouter
anthropic/claude-opus-4.5
Weights
Closed model, weights not published
Released
November 24, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Claude Platform on AWS
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
5 min, 11 requests
Tokens
197,444 (38,197 new input, 134,091 cached, 25,156 output)
OpenRouter cost (real, via API)
$0.922 (list price per million tokens: $5.00 input, $0.500 cached, $25.00 output)
No working giraffe

ClosedClouddoesn't work

Claude Haiku 4.5

Anthropic · OpenRouter

Released October 15, 2025

Coding time67 s
Speed (provider)103 tok/s
Cost (real, API)$0.062

Why not: The giraffe never walks into view: its position is computed from the time since 1970 and lies millions of units beside the camera.

Details
Model on OpenRouter
anthropic/claude-haiku-4.5
Weights
Closed model, weights not published
Released
October 15, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Azure
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
67 s, 14 requests
Tokens
104,310 (16,749 new input, 80,669 cached, 6,892 output)
OpenRouter cost (real, via API)
$0.062 (list price per million tokens: $1.00 input, $0.100 cached, $5.00 output)
Still of the giraffe by Claude Sonnet 4.5 with pi 1.5.0Run the giraffe

ClosedCloud

Claude Sonnet 4.5

Anthropic · OpenRouter

Released September 29, 2025

Coding time7 min
Speed (provider)73.3 tok/s
Cost (real, API)$0.894
Details
Model on OpenRouter
anthropic/claude-sonnet-4.5
Weights
Closed model, weights not published
Released
September 29, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Claude Platform on AWS
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
7 min, 47 requests
Tokens
1,088,276 (34,571 new input, 1,023,203 cached, 30,502 output)
OpenRouter cost (real, via API)
$0.894 (list price per million tokens: $3.00 input, $0.300 cached, $15.00 output)
Still of the giraffe by GPT-5 nano with pi 1.5.0Run the giraffe

ClosedCloud

GPT-5 nano

OpenAI · OpenRouter

Released August 7, 2025

Coding time58 s
Speed (provider)135 tok/s
Cost (real, API)$0.0036

Loose parts: a box, a ball, scattered cylinders.

Details
Model on OpenRouter
openai/gpt-5-nano
Weights
Closed model, weights not published
Released
August 7, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Azure
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
3,690 reasoning tokens billed
Coding time
58 s, 7 requests
Tokens
35,172 (5,834 new input, 21,504 cached, 7,834 output)
OpenRouter cost (real, via API)
$0.0036 (list price per million tokens: $0.050 input, $0.0050 cached, $0.400 output)
No working giraffe

ClosedClouddoesn't work

GPT-5

OpenAI · OpenRouter

Released August 7, 2025

Coding time3 min
Speed (provider)72.6 tok/s
Cost (real, API)$0.168

Why not: Empty page: OrbitControls from the CDN import "three" by its bare name, and without an import map the browser cannot resolve it.

Details
Model on OpenRouter
openai/gpt-5
Weights
Closed model, weights not published
Released
August 7, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Azure
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
5,376 reasoning tokens billed
Coding time
3 min, 7 requests
Tokens
141,898 (35,492 new input, 95,232 cached, 11,174 output)
OpenRouter cost (real, via API)
$0.168 (list price per million tokens: $1.25 input, $0.125 cached, $10.00 output)
Still of the giraffe by gpt-oss-20b with pi 1.5.0Run the giraffe

Open Weightstested locally

gpt-oss-20b

Q4_K_M · 21 B MoE · ≈ 14 GB

Released August 4, 2025

Coding time60 s
Speed78.0 tok/s
Cost (theoretical)$0.0014
Energy (Mac Studio)4.3 Wh
Electricity cost€0.002

A yellow block on legs. The camera controls do not load.

Details
Parameters
21 B, MoE, 3.6 B active
Memory
≈ 14 GB
Model file
unsloth/gpt-oss-20b-GGUF/gpt-oss-20b-Q4_K_M.gguf
SHA256
  • gpt-oss-20b-Q4_K_M.gguf 11.6 GBc27536640e410032865dc68781d80a08b98f8db5e93575919af8ccc0568aeb4f
Released
August 4, 2025
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal; the gpt-oss chat template then uses medium)
12,257 characters of thinking
Coding time
60 s, 9 requests
Tokens
32,070 (3,165 new input, 24,225 cached, 4,680 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0014 openai/gpt-oss-20b
Electricity cost
4.3 Wh, €0.002 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

Open Weightstested locallydoesn't work

gpt-oss-120b

Q4_K_M · 117 B MoE · ≈ 70 GB

Released August 4, 2025

Coding time31 s
Speed91.4 tok/s
Cost (theoretical)$0.0004
Energy (Mac Studio)2.2 Wh
Electricity cost< €0.001

Why not: Loads the camera controls from an address that does not exist in this version; the script aborts.

Details
Parameters
117 B, MoE, 5.1 B active
Memory
≈ 70 GB
Model file
unsloth/gpt-oss-120b-GGUF/gpt-oss-120b-Q4_K_M-00001-of-00002.gguf
2 parts
  • gpt-oss-120b-Q4_K_M-00001-of-00002.gguf 49.6 GBb1d7474caa92717b8a7f75e3c1d1006eb40f3bd3591522e5a2b095f36b12757d
  • gpt-oss-120b-Q4_K_M-00002-of-00002.gguf 13.1 GBb7cc4f7dd8dfd252900d79ab462abc0ad4bf06e4bcf0e59e491b6625bfee36e6
Released
August 4, 2025
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent; pi's level medium stayed internal; the gpt-oss chat template then uses medium)
3,926 characters of thinking
Coding time
31 s, 7 requests
Tokens
20,304 (4,042 new input, 13,428 cached, 2,834 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0004 openai/gpt-oss-120b
Electricity cost
2.2 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Qwen3-Coder-480B-A35B with pi 1.5.0Run the giraffe

Open WeightsCloud

Qwen3-Coder-480B-A35B

Qwen · OpenRouter · 480 B MoE

Released July 23, 2025

Coding time2 min
Speed (provider)140 tok/s
Cost (real, API)$0.038

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Model on OpenRouter
qwen/qwen3-coder
Released
July 23, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by DeepInfra
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
2 min, 21 requests
Tokens
191,105 (16,991 new input, 156,576 cached, 17,538 output)
OpenRouter cost (real, via API)
$0.038 (list price per million tokens: $0.300 input, $0.100 cached, $1.00 output)
Still of the giraffe by Kimi K2 with pi 1.5.0Run the giraffe

Open WeightsCloud

Kimi K2

Moonshot AI · OpenRouter · 1026 B MoE

Released July 11, 2025

Coding time3 min
Speed (provider)35.4 tok/s
Cost (real, API)$0.032
Details
Model on OpenRouter
moonshotai/kimi-k2
Released
July 11, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Novita
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
56 reasoning tokens billed
Coding time
3 min, 7 requests
Tokens
39,814 (20,723 new input, 13,568 cached, 5,523 output)
OpenRouter cost (real, via API)
$0.032 (list price per million tokens: $0.570 input, $0.570 cached, $2.30 output)
Still of the giraffe by Gemini 2.5 Pro with pi 1.5.0Run the giraffe

ClosedCloud

Gemini 2.5 Pro

Google · OpenRouter

Released June 17, 2025

Coding time2 min
Speed (provider)97.8 tok/s
Cost (real, API)$0.239

Blocky giraffe, the head sticks out of the frame.

Details
Model on OpenRouter
google/gemini-2.5-pro
Weights
Closed model, weights not published
Released
June 17, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google AI Studio
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
2,235 reasoning tokens billed
Coding time
2 min, 24 requests
Tokens
270,152 (64,902 new input, 191,845 cached, 13,405 output)
OpenRouter cost (real, via API)
$0.239 (list price per million tokens: $1.25 input, $0.125 cached, $10.00 output)
Still of the giraffe by Gemini 2.5 Flash with pi 1.5.0Run the giraffe

ClosedCloud

Gemini 2.5 Flash

Google · OpenRouter

Released June 17, 2025

Coding time39 s
Speed (provider)214 tok/s
Cost (real, API)$0.026

Blocky giraffe without a spot pattern.

Details
Model on OpenRouter
google/gemini-2.5-flash
Weights
Closed model, weights not published
Released
June 17, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Google AI Studio
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
39 s, 11 requests
Tokens
71,167 (14,024 new input, 48,815 cached, 8,328 output)
OpenRouter cost (real, via API)
$0.026 (list price per million tokens: $0.300 input, $0.030 cached, $2.50 output)
Still of the giraffe by DeepSeek-R1-0528 with pi 1.5.0Run the giraffe

Open WeightsCloud

DeepSeek-R1-0528

DeepSeek · OpenRouter · 685 B MoE

Released May 28, 2025

Coding time7 min
Speed (provider)24.3 tok/s
Cost (real, API)$0.027

More table than giraffe: a box on four legs with a floating plank.

Details
Model on OpenRouter
deepseek/deepseek-r1-0528
Released
May 28, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by SiliconFlow
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
7,998 reasoning tokens billed
Coding time
7 min, 3 requests
Tokens
19,333 (5,304 new input, 3,584 cached, 10,445 output)
OpenRouter cost (real, via API)
$0.027 (list price per million tokens: $0.500 input, $0.350 cached, $2.15 output)
Still of the giraffe by Qwen3-32B with pi 1.5.0Run the giraffe

Open Weightstested locally

Qwen3-32B

Q4_K_M · 32 B Dense · ≈ 22 GB

Released April 29, 2025

Coding time84 s
Speed32.0 tok/s
Cost (theoretical)$0.0013
Energy (Mac Studio)6.0 Wh
Electricity cost€0.002

Almost black picture with two red balls.

Details
Parameters
32 B, dense
Memory
≈ 22 GB
Model file
unsloth/Qwen3-32B-GGUF/Qwen3-32B-Q4_K_M.gguf
SHA256
  • Qwen3-32B-Q4_K_M.gguf 19.8 GB8df67573b2c23484e02ec7af295e39bed7ee774f3771d5fda2978265b59370e7
Released
April 29, 2025
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Switched on (enable_thinking, no level)
5,292 characters of thinking
Coding time
84 s, 3 requests
Tokens
9,850 (1,440 new input, 5,721 cached, 2,689 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0013 qwen/qwen3-32b
Electricity cost
6.0 Wh, €0.002 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
Still of the giraffe by Qwen3-14B with pi 1.5.0Run the giraffe

Open Weightstested locally

Qwen3-14B

Q4_K_M · 14 B Dense · ≈ 11 GB

Released April 27, 2025

Coding time32 s
Speed59.0 tok/s
Cost (theoretical)$0.0010
Energy (Mac Studio)2.3 Wh
Electricity cost< €0.001

An upright pillar on four legs.

Details
Parameters
14 B, dense
Memory
≈ 11 GB
Model file
Qwen/Qwen3-14B-GGUF/Qwen3-14B-Q4_K_M.gguf
SHA256
  • Qwen3-14B-Q4_K_M.gguf 9.0 GB500a8806e85ee9c83f3ae08420295592451379b4f8cf2d0f41c15dffeb6b81f0
Released
April 27, 2025
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-13ec8f6
Thinking
Switched on (enable_thinking, no level)
3,753 characters of thinking
Coding time
32 s, 2 requests
Tokens
6,243 (1,431 new input, 2,923 cached, 1,889 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0010 qwen/qwen3-14b
Electricity cost
2.3 Wh, < €0.001 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

ClosedClouddoesn't work

o3

OpenAI · OpenRouter

Released April 16, 2025

Coding time28 s
Speed (provider)123 tok/s
Cost (real, API)$0.045

Why not: Empty sky: OrbitControls are loaded from a CDN path that no longer exists in that Three.js version, so the script stops.

Details
Model on OpenRouter
openai/o3
Weights
Closed model, weights not published
Released
April 16, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by OpenAI
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
896 reasoning tokens billed
Coding time
28 s, 6 requests
Tokens
23,456 (4,791 new input, 15,232 cached, 3,433 output)
OpenRouter cost (real, via API)
$0.045 (list price per million tokens: $2.00 input, $0.500 cached, $8.00 output)
No working giraffe

ClosedClouddoesn't work

GPT-4.1

OpenAI · OpenRouter

Released April 14, 2025

Coding time32 s
Speed (provider)84.8 tok/s
Cost (real, API)$0.031

Why not: Loads OrbitControls from a path that no longer exists in this Three.js version; the script stops and the picture stays empty.

Details
Model on OpenRouter
openai/gpt-4.1
Weights
Closed model, weights not published
Released
April 14, 2025 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Azure
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
32 s, 2 requests
Tokens
7,498 (4,785 new input, 0 cached, 2,713 output)
OpenRouter cost (real, via API)
$0.031 (list price per million tokens: $2.00 input, $0.500 cached, $8.00 output)
No working giraffe

Open Weightstested locallydoesn't work

Gemma 3 27B

Q4_K_M · 27 B Dense · ≈ 19 GB

Released March 12, 2025

Coding time57 s
Speed46.3 tok/s
Cost (theoretical)$0.0013
Energy (Mac Studio)4.1 Wh
Electricity cost€0.002

Why not: No page: the model only wrote the code into the chat instead of creating a file with the tool.

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Parameters
27 B, dense
Memory
≈ 19 GB
Model file
unsloth/gemma-3-27b-it-GGUF/gemma-3-27b-it-Q4_K_M.gguf
SHA256
  • gemma-3-27b-it-Q4_K_M.gguf 16.5 GBf1b699659942c777bd3ec0bcb527d6ebf34ae14ca76e3af103d58d0c9cbdadee
Released
March 12, 2025
Hardware
Mac Studio M5 Ultra, 256 GB
Harness
pi 1.5.0, llama.cpp b1-3ed7284
Thinking
Model default (nothing sent)
no thinking text
Coding time
57 s, 2 requests
Tokens
3,985 (677 new input, 667 cached, 2,641 output)
OpenRouter cost (theoretical, model ran on local hardware)
$0.0013 google/gemma-3-27b-it
Electricity cost
4.1 Wh, €0.002 (259 W under load over the coding time, at 37.3 euro cents per kWh (German household average 2026, BDEW))
No working giraffe

Open WeightsClouddoesn't work

DeepSeek-V3

DeepSeek · OpenRouter · 684 B MoE

Released December 26, 2024

Coding time3 min
Speed (provider)10.9 tok/s
Cost (real, API)$0.0055

Why not: Blank page: Three.js is loaded from a CDN address that does not exist (r146 on cdnjs).

Details
Model on OpenRouter
deepseek/deepseek-chat
Released
December 26, 2024 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by DeepInfra
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
3 min, 4 requests
Tokens
13,329 (11,209 new input, 0 cached, 2,120 output)
OpenRouter cost (real, via API)
$0.0055 (list price per million tokens: $0.320 input, $0.320 cached, $0.890 output)
No working giraffe

Open WeightsClouddoesn't work

Qwen2.5-72B-Instruct

Qwen · OpenRouter · 72.7 B Dense

Released September 19, 2024

Coding time2 min
Speed (provider)31.9 tok/s
Cost (real, API)$0.0055

Why not: Black screen: the code uses GLTFLoader without ever loading it.

Second try: the first ended without a page. Time, tokens and cost cover both tries.

Details
Model on OpenRouter
qwen/qwen-2.5-72b-instruct
Released
September 19, 2024 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by DeepInfra
Harness
pi 1.5.0
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
2 min, 4 requests
Tokens
14,869 (10,814 new input, 0 cached, 4,055 output)
OpenRouter cost (real, via API)
$0.0055 (list price per million tokens: $0.360 input, $0.360 cached, $0.400 output)
Still of the giraffe by GPT-4o mini with OpenCode 2.2.5Run the giraffe

ClosedCloud

GPT-4o mini

OpenAI · OpenRouter

Released July 18, 2024

Coding time18 s
Speed (provider)49.8 tok/s
Cost (real, API)$0.0017

A box column with the head floating above it, on a black background.

Details
Model on OpenRouter
openai/gpt-4o-mini
Weights
Closed model, weights not published
Released
July 18, 2024 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by OpenAI (2), Azure (1)
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
18 s, 2 requests
Tokens
10,641 (4,497 new input, 5,248 cached, 896 output)
OpenRouter cost (real, via API)
$0.0017 (list price per million tokens: $0.150 input, $0.075 cached, $0.600 output)
Still of the giraffe by GPT-4o with OpenCode 2.2.5Run the giraffe

ClosedCloud

GPT-4o

OpenAI · OpenRouter

Released May 13, 2024

Coding time8 s
Speed (provider)101 tok/s
Cost (real, API)$0.033

A yellow pillar with a head, but it moves.

Details
Model on OpenRouter
openai/gpt-4o
Weights
Closed model, weights not published
Released
May 13, 2024 (date the model was added to OpenRouter)
Hardware
Cloud via OpenRouter, served by Azure
Harness
OpenCode 2.2.5
Thinking
Model default (pi and OpenCode sent no thinking setting to OpenRouter, so the model default applied)
no reasoning tokens billed
Coding time
8 s, 2 requests
Tokens
10,383 (4,584 new input, 4,992 cached, 807 output)
OpenRouter cost (real, via API)
$0.033 (list price per million tokens: $2.50 input, $1.25 cached, $10.00 output)
Open in new tab