Hacker News 熱門精选63

我查看了 30 张前沿模型卡。以下是各实验室报告的基准测试

I checked 30 frontier model cards. Here are the benchmarks labs report

· 59天前
跳到正文

精选理由

汇总30个前沿模型卡的基准,方便快速比较各家性能。

AI 摘要

文章 URL: https://koutian.is-a.dev/benchmark-radar/?view=leaderboard 评论 URL: https://news.ycombinator.com/item?id=49316791 点数:4 评论数:0

正文

Daily briefing

Questions for today

Matching observations

Show more results

What the two layers say

Stated findings

Reporting over time

Benchmark adoption frontier

All tracked benchmarks

Three readings on one time axis. Each orange diamond marks an organization's first report of this benchmark, which is the only event that raises the cumulative count. The rug beneath it puts one tick per dated model card, so later cards from an organization already counted appear as gray ticks and leave the staircase flat. A card with no publication date cannot be placed on the timeline and is absent from both bands, though it is still counted in the totals above. A long flat run is reporting saturation observed within this curated registry, not a claim about benchmark score saturation.

The score track below it is a separate reading: every value that could be read verbatim from a cited document, connected only where the instrument and protocol are identical. A flat score tail usually means no newer number could be read, which is why the gap is marked rather than drawn through.

Frontier milestones

Benchmarks by model card adoption

Each model card counts once per benchmark. A card reporting AIME in four configurations counts the same as a card reporting it once, so a long appendix cannot outweigh a different vendor. Organizations breaks the tie: the same count from six vendors is a shared standard, from one vendor a house style.

Audit the counts Model cards in the registry

The curated source list this ranking is computed from. Expand any card to see every benchmark it reports, grouped the way the source document groups them, so our data can be checked line by line against the original.

New by domain

Daily evidence and attention volume

Category tags overlap. Each bar is an independent count, not a part of a stacked total.

Releases only Excludes records re-announced as an update to something already surfaced.

Daily ledger

Source mix counts ranked evidence after scoring. Fetch health counts raw records returned before scoring, so a source can be ok and still empty.

Date Coverage (UTC) Evidence Source mix Categories Events Attention Fetch health

Dashboard unavailable

The validated data file could not be loaded.

Try refreshing, or inspect the latest daily Issue while the dashboard rebuilds.

Open daily Issues ↗
查看原文(Hacker News 熱門)