WoW AI benchmark

Human baseline

i
Reference pace · Reference time · Not a recorded harness result

02:00:00

Reference · Level 10

GPT-6.1 Sol · round 2

i
Notes and tools reused · Web and advisor permitted · Earlier setup · 26 deaths

Tokens and cost not yet verified.

17:18:51

Finished · Level 10

26

Grok Bot

i
Protocol v1 + extension · Guided between sessions · Different conditions

Tokens and cost not yet verified.

23:29:07

Finished · Level 10

GPT-6.1 Sol · round 1

i
Started at zero · No guides, web or advisor · Earlier setup · 35 deaths

Tokens and cost not yet verified.

26:04:53

Finished · Level 10

35

Claude Opus 5.5

i
Stopped at level 4 · Rate limits · 25 Oct 2026 · +1,367 XP

Tokens and cost not yet verified.

02:13:55

Stopped · Level 4

Gemini 3.8 Flash

i
Clean v2 · Medium effort · In progress · Snapshot 26 Oct 2026, 04:09 UTC · +1,049 XP
275.2M tokens$26.99 API equiv.

09:06:00

Running · Level 4

Gemini 4 Argon

i
Stopped after weekly quota limit · Preserved to start Flash · Automatic retry cancelled · 25 Oct 2026 · 1 death · +814 XP
92.57M tokens$13.72 API equiv.

04:37:21

Stopped · Level 3

1
Tokens & pricing Gemini 3.8 Flash · snapshot

· 2,097 requests

Gemini 3.8 Flash: token counts and Standard API-equivalent cost in US dollars
TokensCountUSD / 1MCost
Fresh input7,543,035$0.75$5.66
Cached input267,316,771$0.075$20.05
Output341,061$3.75$1.28
Total275,200,867$26.99

Discounts included: 50% introductory pricing through 31 Dec 2026; cached input is a further 90% cheaper than fresh input.

Standard interactive API equivalent, not an invoice or subscription charge. No Batch or Flex discount applied. Tokens include repeated cached context; output includes reported thinking without counting it twice.

Rates checked 2026-10-26: Google pricing · Introductory & caching discounts. Other runs’ usage is not yet verified.

Tokens & pricing Gemini 4 Argon · snapshot

· 691 requests

Gemini 4 Argon: token counts and Standard API-equivalent cost in US dollars
TokensCountUSD / 1MCost
Fresh input2,042,186$2.00$4.08
Cached input90,470,691$0.10$9.05
Output58,747$10.00$0.59
Total92,571,624$13.72

Discounts included: 50% introductory pricing through 30 Nov 2026; cached input is a further 95% cheaper than fresh input.

Standard interactive API equivalent, not an invoice or subscription charge. No Batch or Flex discount applied. Tokens include repeated cached context; output includes reported thinking without counting it twice.

Rates checked 2026-10-25: Google pricing · Introductory & caching discounts. Other runs’ usage is not yet verified.

How to read it

What’s being measured?

Orc warrior. Level 1 → 10. /played is time logged in, including thinking and troubleshooting. Level 10 time is the score; unfinished runs show their last level.

Newer clean v2 runs use WotLK 3.3.5a AzerothCore x1. Legacy runs had different controls.

Conditions differ. The human baseline is a reference, not a controlled trial.

Source video

Watch the runs unfold.

Two GPT-6.1 Sol attempts, from the first step to level 10.

Open on YouTube