ai.theaggregate/the-aggregate

up checked 2026-11-11T11:38:49.311Z

Unclaimed · Unverified

Publisher-provided title

The Aggregate — LLM benchmark aggregate

Publisher-provided description

LLM rankings from public benchmarks, model comparisons and source-linked results. Updated daily.

Summary by lookupd

Look up LLM rankings, head-to-head model comparisons, and benchmark details from public leaderboards, with source-linked results updated…

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http the-aggregate https://theaggregate.ai/mcp

Codex, remote (streamable-http)

codex mcp add the-aggregate --url https://theaggregate.ai/mcp

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "the-aggregate": {
      "url": "https://theaggregate.ai/mcp"
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Publisher-provided text

get_leaderboard Top of the cross-benchmark aggregate ranking: published Aggregate Ratings combine public benchmark evidence on one scale (call about_the_aggregate for the curre
search_models Find ranked models by (partial) name or provider. Returns rank, Aggregate Rating and the model page URL. One row per model by default, fused across reasoning-ef
get_model One model in depth: aggregate rank, Aggregate Rating with standard error, provider, what it is, cost per task where known, and its most notable benchmark result
compare_models Head-to-head between 2-4 models: aggregate ranks, rating gap with a significance note based on the standard errors, and notable benchmarks they share.
search_benchmarks Find benchmarks in the aggregate by (partial) name. Returns model coverage, difficulty on the rating scale, and the benchmark page URL.
get_benchmark One benchmark in depth: what it measures, the original source leaderboard URL, IRT stats (difficulty, noise, model coverage), skill weights, and the current top
get_prediction_duel Guesswork — the public prediction duel: every day frontier LLMs and The Aggregate's own IRT model predict newly scraped benchmark scores before seeing them, and
about_the_aggregate What this data is: the published rating method, current coverage counts, update cadence, and how to cite it.

Shows this live status and links here; updates hourly.

[![lookupd status](https://lookupd.com/badge/ai.theaggregate/the-aggregate.svg)](https://lookupd.com/servers/ai.theaggregate/the-aggregate)