Hacker News 熱門精选83

Claude Sonnet 5.5

Claude Sonnet 5.5

· 15天前
跳到正文

精选理由

了解新一代 Claude 的能力与行业影响

AI 摘要

文章 URL: https://www.anthropic.com/claude-sonnet-5-5 评论 URL: https://news.ycombinator.com/item?id=49881850 积分:71 评论数:26

正文

Introducing Claude Sonnet 5.5, the second model in the Claude 5.5 family. It’s a clear upgrade over Claude Sonnet 5, runs 30%+ faster, and costs up to 30% less for most work.

Sonnet 5.5 is a faster, lower-cost complement to Claude Opus 5.5. Where Opus 5.5 is built for complex work requiring careful judgment, Sonnet 5.5 is strongest at well-scoped everyday tasks, fixing bugs, and creating polished documents, slides, and spreadsheets. It’s also got a sharp eye for design. Claude Haiku 5.5, built for high-volume and cost-sensitive applications, will join the Claude 5.5 family in the coming weeks.

Sonnet 5.5 improves over Sonnet 5 on:

Performance. Sonnet 5.5 scores 70.6% on Terminal-Bench 4.0, an agentic coding evaluation, compared to Sonnet 5’s 10.3%. It scores two points below Opus 5.5 on GDPval-AA, a test of real-world work across a variety of occupations. And it’s strong on long-horizon work and image understanding—it’s the first Sonnet model to beat Pokémon Red working only from screenshots.

Collaboration. Like Opus 5.5, Sonnet 5.5 writes more clearly than our previous generation of models; early testers described it as a better partner for collaboration than Sonnet 5. Its speed also makes it well suited to fast iteration on less complex tasks.

Cost. Sonnet 5.5 is priced the same as Sonnet 5 at $2 per million input tokens, $10 per million output tokens, and $0.20 per million tokens for cache reads, but it typically needs far fewer tokens to do the same work. In our testing, it costs up to 30% less per task than its predecessor.

Speed. Sonnet 5.5 generates outputs 30%+ faster than Sonnet 5, making it our fastest Sonnet model to date.

Alignment and safety. On our automated behavioral audit, Sonnet 5.5 improves on or matches Sonnet 5 on most measures of alignment. Because its cybersecurity capabilities are comparable to Opus 5’s, it’s the first Sonnet model to launch with cyber safeguards and fallbacks like those we’ve developed for our most capable models. Its biology safeguards are the same as Sonnet 5’s. Both safeguards target a narrow set of high-risk requests; routine software development and most life sciences work are unaffected.

Performance

Sonnet 5.5 improves on Sonnet 5 across domains—in some cases dramatically. On several evaluations, Sonnet 5.5 at Max effort even performs comparably to Opus 5.5. However, benchmark scores capture only one facet of a model’s capabilities; in our own testing, and in that of external testers, Opus 5.5 remains clearly stronger at complex, open-ended work requiring sustained judgment.

Sonnet 5.5Sonnet 5Opus 5.5GPT-6 Sol
Agentic codingTerminal-Bench 4.0
Agentic codingTerminal-Bench 4.070.6%10.3%66.4%¹—
Agentic codingFrontierCode 1.1 (Main)
Agentic codingFrontierCode 1.1 (Main)46.2%Max²42.4%54.4%49.3%
52.1%Xhigh
Agentic codingCursorBench 4.0
Agentic codingCursorBench 4.055.5%34.1%57.8%—
Knowledge workGDPval-AA v2.1³
Knowledge workGDPval-AA v2.1³1844144918461487⁴
Knowledge workAA-Briefcase v1.1³
Knowledge workAA-Briefcase v1.1³1811135918221483⁴
Multidisciplinary reasoningHumanity’s Last Exam
Multidisciplinary reasoningHumanity’s Last Exam64.5%with tools54.9%with tools67.7%with tools—
Computer useOSWorld 2.1
Computer useOSWorld 2.180.1%partial57.0%partial81.8%partial—
Visual chart recognitionChartography
Visual chart recognitionChartography61.6%no tools15.6%no tools64.4%no tools53.6%⁴no tools

For details on how we run our evaluations, see the Sonnet 5.5 System Card.

The charts below plot each model’s score against its cost per task at every effort level. As effort goes up, models typically work for longer, leading to a higher cost per task but generally also a higher score. The closer a point is to the top left of the chart, the more capability it delivers per dollar.

On several benchmarks, Sonnet 5.5 at Low or Medium effort beats Sonnet 5’s best score for about a tenth of the cost per task. It complements Opus 5.5 best when running at lower effort settings, where it costs less per task. At higher settings, it can perform comparably at a similar cost.

Agentic terminal codingAgentic coding: FrontierCodeAgentic coding: CursorBenchKnowledge work: AA-Briefcase
Agentic terminal codingAgentic coding: FrontierCodeAgentic coding: CursorBenchKnowledge work: AA-Briefcase
Terminal-Bench 4.0Accuracy vs. cost
  • Sonnet 5.5
  • Opus 5.5
  • Sonnet 5
  • GPT-5.6 Sol
010203040506070Score (%)12510Cost per attempt (USD, log scale)LowMedHighXhighMax

Terminal-Bench 4.0 measures how well a model can complete complex, multi-step professional tasks within a command-line interface. At Medium effort, the default in the Claude apps, Sonnet 5.5 far exceeds Sonnet 5’s best score for less than a tenth of the cost per task.

Terminal-Bench and OpenAI did not report GPT-6 Sol performance publicly, so we report GPT-5.6 Sol here.

FrontierCode v1.1, main setAccuracy vs. cost
  • Sonnet 5.5
  • Opus 5.5
  • Sonnet 5
  • GPT-6 Sol
3035404550550Score (%)0.250.501251020Cost per task (USD, log scale)LowMedHighXhighMax

FrontierCode measures whether an agent’s code changes would be merged. At High effort, the default on the Claude Platform, Sonnet 5.5 matches GPT-6 Sol’s best score for about a fifth of the cost per task.²

CursorBench 4.0Accuracy vs. cost
  • Sonnet 5.5
  • Opus 5.5
  • Sonnet 5
  • GPT-5.6 Sol
20304050600Score (%)0.5012510Cost per task (USD, log scale)LowMedHighXhighMax

CursorBench evaluates coding agents on ambiguous, multi-file tasks taken from real Cursor sessions. Sonnet 5.5 at Low effort exceeds Sonnet 5’s best score for less than a tenth of the cost per task.

CursorBench 4.0 does not report GPT-6 Sol performance publicly, so we report GPT-5.6 Sol here.

AA-Briefcase v1.1Accuracy vs. cost
  • Sonnet 5.5
  • Opus 5.5
  • Sonnet 5
  • GPT-6 Sol
900110013001500170019000Elo0.100.200.501251020Cost per task (USD, log scale)LowMedHighXhighMax

On AA-Briefcase, a new benchmark of long-horizon knowledge work, Sonnet 5.5 at Medium effort bests Sonnet 5’s best score for about one ninth of the cost per task.³

Coding

Sonnet 5.5’s jump in performance is particularly noticeable in coding. At High effort on FrontierCode, it scores 10 points higher than Sonnet 5 at the same setting, at about one fifteenth of the cost per task. On CursorBench, which tests models on tasks from real Cursor coding sessions, its best score is within about two points of Opus 5.5.

Early testers appreciated how quickly Sonnet 5.5 can understand a codebase. They were also struck by its efficiency: in head-to-head runs, it batched tool calls together more than Sonnet 5, leading to fewer steps and lower costs.

Epic GamesEveryCodeRabbitSpaceXAIBase44UnityCreator
Epic GamesEveryCodeRabbitSpaceXAIBase44UnityCreator
Quote

“In Epic’s early testing, Claude Sonnet 5.5 cleared the same quality bar you’d expect from a higher-tier model, holding up on a system design audit and a data flow review. The new model managed tens of thousands of lines of code for gameplay system architecture, kept responses snappy, handled multi-hour tasks, and delivered with less prescriptive prompting.”

CompanyEpic Games
AuthorDaniel Vogel, Chief Operating Officer
查看原文(Hacker News 熱門)