io.github.scarrico/mlreferee

up checked 2026-11-11T04:38:45.914Z

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided title

ML Referee

Publisher-provided description

Evaluate ML features beyond a baseline and test bounded feature repairs. Invite-only beta.

Summary by lookupd

Evaluates ML features against a baseline, uploads private datasets, and retrieves audit results and receipts; invite-only beta access.

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http mlreferee https://api.mlreferee.com/mcp

Codex, remote (streamable-http)

codex mcp add mlreferee --url https://api.mlreferee.com/mcp

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "mlreferee": {
      "url": "https://api.mlreferee.com/mcp"
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Tools (26 tools)

Publisher-provided text

• describe_referee Discover capabilities, privacy, and the approved public catalog.
• list_verticals List the three supported evaluation profiles and their discovery tags.
• get_referee_readiness Report connection, credential, audit-credit, and submission readiness with the next action.
• get_referee_usage Read aggregate, privacy-preserving Referee activity and outcome evidence for the selected audience.
• get_input_schema Get neutral column roles and validation defaults for a vertical.
• get_repair_schema Get the feature-only contract for diagnosing degradation and testing bounded repairs.
• upload_private_dataset Encrypt a de-identified CSV/JSON payload for a short tenant-private retention window.
• upload_campaign_shard Encrypt one of up to 64 private feature shards for a large campaign; retain for at least 4,200 seconds.
• upload_repair_matrix Encrypt one complete de-identified repair matrix of up to 100 MB and 1,000 diagnostic features.
• preflight_dataset Validate a tenant-private upload and its baseline evidence/row identity without spending a credit.
• preflight_repair Validate a tenant-private feature-repair matrix without spending a credit.
• quote_audit Create a contract-bound quote for one audit credit; baseline mode and evidence cannot be substituted.
• quote_repair Preflight and quote label-based feature repair; large jobs return a measured ETA and credit requirement.
• quote_campaign Preflight all private feature shards, time a pilot, and quote credits and ETA for up to 1,000 candidates in one corrected search family.
• get_credits Read beta or paid audit-credit availability and usage.
• redeem_beta_invite Redeem one operator-issued invite for free beta audit credits before January 1, 2027.
• request_beta_access Request operator-reviewed beta access without purchasing or granting credits.
• get_beta_request_status Read the authenticated tenant's beta-access request status.
• submit_audit Accept a quote and atomically reserve its disclosed audit credits.
• record_audit_followup Record whether a completed audit changed a decision or was confirmed prospectively.
• get_audit_status Read the state of an audit owned by the authenticated tenant.
• get_audit_result Read a completed tenant-private result and signed output manifest.
• get_audit_receipt Read a tenant-private report fingerprint retained after report expiry or deletion. Older reports may have no record. This does not retrieve report contents.
• verify_audit_report Compare a locally computed SHA-256 with the retained tenant-private receipt. Use the exact downloaded result JSON bytes (not the API envelope), or UTF-8 result.
• delete_audit Delete retained inputs and results for an audit owned by this tenant.
• delete_upload Delete a tenant-private upload that is no longer needed.

Details

• Version: 1.1.0
• Transports: streamable-http
• Uptime (7 days): 100%
• Median latency: 706 ms
• First indexed: 2026-11-01T09:54:05.559Z
• Last seen in registry: 2026-11-01T09:54:05.559Z
• Website: https://mlreferee.com

Badge for your README

Shows this live status and links here; updates hourly.

[![lookupd status](https://lookupd.com/badge/io.github.scarrico/mlreferee.svg)](https://lookupd.com/servers/io.github.scarrico/mlreferee)

• 62071 servers
• Last crawl: 2026-11-11T16:39:06.253Z
• API base: https://api.lookupd.com
• MCP URL: https://api.lookupd.com/mcp