ai.openmark/openmark

up checked 2026-11-11T13:37:45.884Z

Unclaimed · Unverified

Agent searches it appeared in, last 30 days: 0. Run this server? Claim the listing: verified label, uptime alerts and analytics.

Publisher-provided title

OpenMark

Publisher-provided description

Benchmark your own prompt on 100+ LLMs with real API calls; pick the cheapest model that passes.

Summary by lookupd

Benchmarks a user's prompt across many LLMs using real API calls, reporting scores, cost and latency to find the cheapest passing model.

Install

Claude Code, remote (streamable-http)

claude mcp add --transport http openmark https://openmark.ai/mcp

Codex, remote (streamable-http)

codex mcp add openmark --url https://openmark.ai/mcp

Cursor, remote (streamable-http) → .cursor/mcp.json

{
  "mcpServers": {
    "openmark": {
      "url": "https://openmark.ai/mcp"
    }
  }
}

Other clients: docs. Or tell your agent: Set up lookupd for me: read https://lookupd.com/agent.md and follow it.

Tools (10 tools)

Publisher-provided text

• get_task_format How to write an OpenMark task: the YAML structure, all 18 scoring modes, and tips. Call this before writing a task. Pass a topic for the full detail on one subj
• validate_task Check a task YAML the way OpenMark will before running it: structure, scoring settings, and the test limit of the user's plan. Free, saves nothing. Returns the
• list_models Current OpenMark model ids with list prices ($ per 1M tokens), as text and as a structured list. Use these ids in run_benchmark. Append @low, @medium or @high t
• prepare_attachments Get an upload_uid and a one-hour upload link (no API key needed) for images, PDFs or text documents, with the exact curl command. Upload the files, reference th
• estimate_cost Credits a run_benchmark call would use, before spending anything: the expected total, the split per model, the balance needed to start, the worst case, and the
• run_benchmark Save a task (YAML, see get_task_format) to the user's OpenMark account and run it on the given models with real API calls. Returns a job_id and the expected cos
• get_results Status of a benchmark job, and once completed the ranked results (score, stability, cost per run, latency), the tests each model missed with its answer, a recom
• export_openclaw_csv A completed job's results as the CSV the OpenMark Router plugin for OpenClaw reads (the same file as the app's Export > OpenClaw). Save it in the plugin's bench
• get_account The user's plan, credit balance and limits, and what a credit pack, Pro or Expert would unlock. Use it before large runs, or when a run is refused for credits o
• watch_task Watch the task of a completed job: when new or cheaper models ship, OpenMark re-tests up to 4 of them next to the user's pick and emails the user only when one

Details

• Version: 1.0.0
• Transports: streamable-http
• Uptime (7 days): 100%
• Median latency: 853 ms
• First indexed: 2026-11-01T08:50:39.710Z
• Last seen in registry: 2026-11-01T08:50:39.710Z
• Website: https://openmark.ai/mcp

Badge for your README

Shows this live status and links here; updates hourly.

[![lookupd status](https://lookupd.com/badge/ai.openmark/openmark.svg)](https://lookupd.com/servers/ai.openmark/openmark)

• 62033 servers
• Last crawl: 2026-11-11T15:38:39.561Z
• API base: https://api.lookupd.com
• MCP URL: https://api.lookupd.com/mcp