io.aimrank/aimrank
up checked
Unclaimed · Unverified
Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.
Publisher-provided title
AimRank
Publisher-provided description
Read public pairwise-preference rankings and their statistical quality evidence. No API key.
Summary by lookupd
Browse public pairwise preference rankings, leaderboards, and statistical agreement metrics for AI evaluation, with no API key needed.
Install
Claude Code, remote (streamable-http)
claude mcp add --transport http aimrank https://app.aimrank.io/mcp/public
Codex, remote (streamable-http)
codex mcp add aimrank --url https://app.aimrank.io/mcp/public
Cursor, remote (streamable-http) → .cursor/mcp.json
{
"mcpServers": {
"aimrank": {
"url": "https://app.aimrank.io/mcp/public"
}
}
}Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.
Tools (21 tools)
Publisher-provided text
aimrank_get_daily_pairFetch today's Daily Pair — the trending matchup chosen at 00:00 UTC. Pairs with the `vote_of_the_day` agent template. Returns the challenge + a fresh matchup.aimrank_get_rankingFetch a ranking's metadata + its top 25 entities. Entities carry a Bradley-Terry rating with a 95% interval (ci_95) and a tie-aware rank: entities whose intervaimrank_get_leaderboardGet the top N entities of a ranking with honest uncertainty. Ratings come from a Bradley-Terry fit over the counted votes, each with a 95% interval (ci_95). `raimrank_get_matchupGet the next pair of entities to evaluate. Strategies: adaptive (default), swiss, balanced, random, uncertainty, explore, information_gain -- the same selectioaimrank_search_entitiesFind entities by name substring within a ranking. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.aimrank_create_share_cardReturn share-ready URLs + embed snippets for a ranking. Formats: "all" (default — everything), "twitter", "linkedin", "embed_leaderboard", "embed_vote", "badgeaimrank_predict_matchup_winnerPredict a matchup's winner from the current ratings -- for analysis. Uses Glicko-2 win probability under the same formula matchmaking uses internally. Use it taimrank_discover_public_rankingsBrowse public rankings — agent equivalent of surfing aimrank.io. Filters: category, media_type ("text" | "image" | "audio" | "video"), sort ("trending" | "receaimrank_list_domain_entitiesList all entities in a domain's pool sorted by rating. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.aimrank_get_domainGet domain details including entity pool and competition list. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.aimrank_list_competitionsList all competitions (open voting + brackets) in a domain. api_key is optional on the public endpoint; on /mcp/mcp a missing key is refused.aimrank_get_data_cardAuto data card — Layer 7. Provenance + IAA + coverage + per-annotator quality + transitivity + qualification stats in one synthesized markdown audit artefact.aimrank_get_agreementInter-annotator agreement — Layer 4. Returns Cohen's κ (n=2 raters), Fleiss' κ, Krippendorff's α, Scott's π + Landis-Koch interpretation, plus the multi-rater caimrank_get_ceilingPairwise-κ ceiling from qualification attempts. The upper bound any judge / RM can credibly hit on this domain — used to pin the L3 pilot refund clause (refundaimrank_get_plackett_lucePlackett-Luce listwise ranking aggregation — OFFLINE AUDIT ONLY. Reported post-hoc; it NEVER writes ratings, and setting it as a ranking's algorithm returns 40aimrank_get_crowd_btCrowdBT — joint fit of entity scores + per-annotator reliability η. Surfaces noisy / anti-correlated raters explicitly. Methodology audit, not a live engine. aaimrank_list_public_judgesBrowse public judge-prompt artifacts shared by other users. Filter by ``category`` (free-text), ``domain_id``, or both. Sort options: ``fork_count`` (default —aimrank_find_similar_domainsFind public domains most similar to a query or a known domain. Use ``query`` for free-text search ("pharma evaluation") OR ``domain_id`` to find domains similaaimrank_predictiCOMPLY contract: pairwise prediction with provenance fields. Returns the engine's predicted winner + probability shaped so iCOMPLY's Annex IV section-4 generaaimrank_explainiCOMPLY contract: explain a prediction in features + narrative. Returns the Glicko-2 μ/φ inputs for both entities + a deterministic narrative. No LLM-synthesisaimrank_healthcheckiCOMPLY contract: liveness + DB-connectivity probe.
Details
- Version: 4.12.0
- Transports: streamable-http
- Uptime (7 days): 100%
- Median latency: 742 ms
- First indexed:
- Last seen in registry:
- Website: https://app.aimrank.io/help
Badge for your README
Shows this live status and links here; updates hourly.
[](https://lookupd.com/servers/io.aimrank/aimrank)
- 62141 servers
- Last crawl: 2026-11-11T18:39:04.612Z
- API base:
https://api.lookupd.com - MCP URL:
https://api.lookupd.com/mcp