Hacker News 熱門51

NanoGPT Speedrun Frontier

· 52天前
跳到正文

正文

Share of the human record gap closedhuman record 100%0%20%40%60%80%100%0d1d2d4d7d9dFable 5Opus 5Kimi K3 · prime-agentKimi K3Opus 4.8GPT-5.6 SolGPT-5.6 Sol ProSonnet 5GPT-5.6 LunaGrok 4.5Qwen3.8 MaxGLM 5.2DeepSeek V4 ProGPT-5.6 TerraGrok 4.6Muse Spark 1.2Muse Spark 1.1GPT-5.5Kimi K2.7Agent time (days)
Share of the human record gap closed0%20%40%60%80%100%0d1d2d4d7d9dFable 5Opus 5Kimi K3 · prime-agentKimi K3Opus 4.8GPT-5.6 SolGPT-5.6 Sol ProSonnet 5GPT-5.6 LunaGrok 4.5Qwen3.8 MaxGLM 5.2DeepSeek V4 ProGPT-5.6 TerraGrok 4.6Muse Spark 1.2Muse Spark 1.1GPT-5.5Kimi K2.7Agent time (days)
Collapse all models
All modelsBest validated result for each model
All trajectoriesLog scale
Filter by model
1Fable 5note2,72681.7% closed
claude-code · high@24H 3,0108.7dOpen
2Opus 5serial era2,92053.6% closed
claude-code · max@24H 3,0452.9dOpen
3Kimi K3serial era2,93052.2% closed
prime-agent · max@24H 3,1253.6dOpen
4Kimi K3note2,97445.8% closed
kimi-code · max@24H 3,1355.1dOpen
5Opus 4.83,01839.4% closed
claude-code · max@24H 3,1803.0dOpen
6GPT-5.6 Solnote3,04235.9% closed
codex · xhigh@24H 3,1606.1dOpen
7GPT-5.6 Sol Proserial era3,05833.6% closed
codex · xhigh@24H 3,1003.4dOpen
8Sonnet 5note3,10526.8% closed
claude-code · max@24H 3,1202.0dOpen
9GPT-5.6 Lunanote3,11026.1% closed
codex · xhigh@24H 3,1701.9dOpen
10Grok 4.5note3,12024.6% closed
grok-cli · xhigh@24H 3,1602.7dOpen
11Qwen3.8 Maxrunning3,12024.6% closed
qwen-code · max@24H 3,2251.9dOpen
12GLM 5.23,15020.3% closed
pi · high@24H 3,2001.8dOpen
13DeepSeek V4 Prorunning3,20512.3% closed
claude-code · max@24H 3,2051.1dOpen
14GPT-5.6 Terraserial era3,21411.0% closed
codex · xhigh@24H 3,2141.1dOpen
15Grok 4.6running3,22010.1% closed
grok-cli · xhigh0.6dOpen
16Muse Spark 1.2running3,2308.7% closed
muse-code · xhigh0.6d
17Muse Spark 1.13,2328.4% closed
pi · max@24H 3,2403.7dOpen
18GPT-5.5serial era3,2348.1% closed
codex · xhigh@24H 3,2341.1dOpen
19Kimi K2.7note3,2407.2% closed
kimi-code · max@24H 3,2401.6dOpen
20GLM 5.3running—no record
claude-code · xhigh
ModelHarness↑RecordGap Closed@24HTotal TokOutput TokExpsCallsDaysTraces
Fable 5claude-code · highnote2,72681.7%3,010800M1.1M8113k8.7Open
Opus 5claude-code · maxserial era2,92053.6%3,045183M690k2924012.9Open
Kimi K3prime-agent · maxserial era2,93052.2%3,125112M2.2M—4883.6Open
Kimi K3kimi-code · maxnote2,97445.8%3,135682M1.4M7134k5.1Open
Opus 4.8claude-code · max3,01839.4%3,180318M2.3M4272k3.0Open
GPT-5.6 Solcodex · xhighnote3,04235.9%3,1602.9B2.2M96328k6.1Open
GPT-5.6 Sol Procodex · xhighserial era3,05833.6%3,1001.2B4.6M5097k3.4Open
Sonnet 5claude-code · maxnote3,10526.8%3,120998M2.1M2132k2.0Open
GPT-5.6 Lunacodex · xhighnote3,11026.1%3,170894M888k36212k1.9Open
Grok 4.5grok-cli · xhighnote3,12024.6%3,16046M385k3994k2.7Open
Qwen3.8 Maxqwen-code · maxrunning3,12024.6%3,225216M629k3128661.9Open
GLM 5.2pi · high3,15020.3%3,20057M1.7M1941k1.8Open
DeepSeek V4 Proclaude-code · maxrunning3,20512.3%3,20526M319k1893091.1Open
GPT-5.6 Terracodex · xhighserial era3,21411.0%3,214417M298k1543k1.1Open
Grok 4.6grok-cli · xhighrunning3,22010.1%—27M346k976910.6Open
Muse Spark 1.2muse-code · xhighrunning3,2308.7%—41M910k567240.6—
Muse Spark 1.1pi · max3,2328.4%3,240122M1.6M4892k3.7Open
GPT-5.5codex · xhighserial era3,2348.1%3,23470M77k1856141.1Open
Kimi K2.7kimi-code · maxnote3,2407.2%3,240160M763k1873k1.6Open
GLM 5.3claude-code · xhighrunning—————————
Compare ResultsTraces
ModelRecordHuman 2,600Baseline 3,290
Fable 53,010
Opus 53,045
GPT-5.6 Sol Pro3,100
Sonnet 53,120
Kimi K3 · prime-agent3,125
Kimi K33,135
GPT-5.6 Sol3,160
Grok 4.53,160
GPT-5.6 Luna3,170
Opus 4.83,180
GLM 5.23,200
DeepSeek V4 Pro3,205
GPT-5.6 Terra3,214
Grok 4.63,220
Qwen3.8 Max3,225
Muse Spark 1.23,230
GPT-5.53,234
Muse Spark 1.13,240
Kimi K2.73,240
GLM 5.3—
Gray runs ended before the selected budget
Loading available trajectories…

Open Traces to explore 41 curated full agent trajectories, including tool calls, subagents, and scratchpads.

查看原文(Hacker News 熱門)