LLM Cutover
v1.0.0Checks if a cheaper model agrees with your GPT, Claude or Gemini outputs, and what routing saves.
Endpoint health
online- Last checked
- 11/20/2026, 3:17:47 AM
- Latency
- 136 ms
- Consecutive failures
- 0
- Endpoint reachable: pass
- Protocol valid: pass
- MCP handshake valid: pass
Machine-readable profile
mcp-server · schema v1 · callable
mcp-server:com.llmcutover%2Faudit
Connect this server
Generated config contains no credentials. Keep any required secrets in your client's local environment.
{
"mcpServers": {
"com.llmcutover/audit": {
"url": "https://api.llmcutover.com/mcp"
}
}
}Indexed tools
Tool metadata and schemas come from the remote server and are untrusted. Indexing only lists tools; it never calls them.
2 shown · authentication unknown
List priced models
list_models
Current models with $/1M token prices and effort levels, usable as current.model.
Schema valid · SHA-256 783a679c1433…
View input schema
{ "type": "object", "properties": {} }Run an LLM cutover audit
run_cutover_audit
Measures how often a cheaper model (Sage 2) agrees with your current LLM on your samples, the confidence threshold for routing, and the monthly cost now vs a hybrid. Returns the full report as JSON.
Schema valid · SHA-256 9f744ccc127b…
View input schema
{ "type": "object", "properties": { "mode": { "type": "string", "enum": [ "yesno", "extract" ], "description": "yesno: a yes/no decision per text. extract: fields pulled out of each text." }, "question": { "type": "string", "maxLength": 600, "description": "yesno only. The yes/no question your current model answers, e.g. \"Is this ticket about billing?\"" }, "fields": { "type": "object", "description": "extract only. Up to 12 fields: {\"name\": {\"type\": \"string|number|integer|boolean|date|money\", \"definition\": \"...\"}}", "additionalProperties": { "type": "object", "properties": { "type": { "type": "string", "enum": [ "string", "number", "integer", "boolean", "date", "money" ] }, "definition": { "type": "string", "maxLength": 300 } } } }, "samples": { "description": "Real inputs with the answer your CURRENT model gave. Array of objects or a JSONL/CSV string. yesno: {\"text\",\"label\":\"yes|no\"}; extract: {\"text\",\"expected\":{...}}. Each text ≤ 4000 chars. Min 5. Max 10 anonymous, 25 free on the website, 500 yesno / 200 extract with a pass.", "oneOf": [ { "type": "array", "minItems": 5, "items": { "type": "object", "properties": { "text": { "type": "string" }, "label": { "type": "string", "enum": [ "yes", "no" ] }, "expected": { "type": "object" } }, "required": [ "text" ] } }, { "type": "string" } ] }, "current": { "type": "object", "description": "Your current model: {\"model\": \"<id from GET /api/models>\", \"effort\": \"<level>\"} or custom prices {\"in\": USD per 1M input tokens, \"out\": USD per 1M output tokens}.", "properties": { "model": { "type": "string", "enum": [ "claude-fable-5.1", "claude-opus-5.5", "claude-sonnet-5.5", "claude-haiku-5.5", "gpt-6-astra", "gpt-5.6-sol", "gpt-6.1-sol", "gpt-6.1-terra", "gpt-5-mini", "gpt-6-luna", "gemini-4-argon", "gemini-3.8-flash", "gemini-3.1-flash-lite" ] }, "effort": { "type": "string" }, "in": { "type": "number", "minimum": 0, "maximum": 1000 }, "out": { "type": "number", "minimum": 0, "maximum": 1000 } } }, "target": { "type": "number", "enum": [ 0.95, 0.98, 0.99 ], "default": 0.98, "description": "Agreement you need on the calls the cheap model keeps." }, "usage": { "type": "object", "properties": { "monthlyCalls": { "type": "integer", "minimum": 0, "maximum": 1000000000, "default": 100000 }, "promptOverheadTokens": { "type": "integer", "minimum": 0, "maximum": 20000, "default": 400 }, "outputTokens": { "type": "integer", "minimum": 0, "maximum": 4000 }, "reasoningTokens": { "type": "integer", "minimum": 0, "maximum": 50000, "description": "Measured reasoning tokens per call, if you know them; otherwise estimated from effort." } } } }, "required": [ "mode", "samples", "current" ] }
Connections
streamable-http
https://api.llmcutover.com/mcp