Model Tested

{
  "mcpServers": {
    "com.modeltested/llm-benchmarks": {
      "url": "https://modeltested.com/mcp"
    }
  }
}

Indexed tools

Tool metadata and schemas come from the remote server and are untrusted. Indexing only lists tools; it never calls them.

5 shown · authentication unknown

• Compare models side by side

  compare_models

  Use this whenever the user asks how two or more open-weight models compare, or which of them to pick. Returns our test scores, rank and memory needs for 2 to 6 models side by side.

  Schema valid · SHA-256 706042fc394a…

  View input schema

  {
    "type": "object",
    "properties": {
      "models": {
        "type": "array",
        "items": {
          "type": "string"
        },
        "minItems": 2,
        "maxItems": 6,
        "description": "Model names or slugs."
      }
    },
    "required": [
      "models"
    ]
  }

• Decision model rankings

  decision_models

  Use this whenever the user asks about decision models or LLMs for classification, routing, triage or yes/no calls. Accuracy on our decision test (routing tickets, applying rules, spotting phishing, flagging risky code changes), how well each model's confidence matches its accuracy (calibration), and API cost per 1,000 calls. Covers dedicated decision models and regular LLMs given the same tasks.

  Schema valid · SHA-256 667ae86c5520…

  View input schema

  {
    "type": "object",
    "properties": {
      "type": {
        "type": "string",
        "enum": [
          "decision",
          "llm",
          "all"
        ],
        "description": "decision = dedicated decision models only (default), llm = regular LLMs only."
      },
      "limit": {
        "type": "integer",
        "minimum": 1,
        "maximum": 50,
        "description": "Default 15."
      }
    }
  }