MCP Selection Lab
v0.5.2Benchmark MCP tool selection with metadata-only routing, collision, abstention, and holdout checks.
Endpoint health
online- Last checked
- 11/20/2026, 9:17:21 AM
- Latency
- 118 ms
- Consecutive failures
- 0
- Endpoint reachable: pass
- Protocol valid: pass
- MCP handshake valid: pass
Machine-readable profile
mcp-server · schema v1 · callable
mcp-server:io.github.ChanghuLiu%2Fmcp-selection-lab
Connect this server
Generated config contains no credentials. Keep any required secrets in your client's local environment.
{
"mcpServers": {
"io.github.ChanghuLiu/mcp-selection-lab": {
"url": "https://agenttrustlab.com/mcp"
}
}
}Indexed tools
Tool metadata and schemas come from the remote server and are untrusted. Indexing only lists tools; it never calls them.
3 shown · authentication unknown
get_selection_report
Read and agent-enrich an existing public scan report by id; no new target request or model call.
Schema valid · SHA-256 2746baff1b9e…
View input schema
{ "type": "object", "properties": { "report_id": { "pattern": "^[0-9a-f]{16}$", "title": "Report Id", "type": "string" } }, "required": [ "report_id" ], "title": "get_selection_reportArguments" }scan_mcp_metadata
Create a free public report of MCP tool-description routing collisions. Reads discovery metadata (initialize/tools/list) only; never calls target business tools or spends funds. Use a public HTTP(S) URL without credentials, query or fragment. Results use at most 12 tools and 24 generated cases, not a real-model evaluation. The returned report is enriched with agent_plan candidate description-only edits and a machine-readable rerun instruction. Candidate edits are not untouched-holdout proof. Reports persist and are public by link. For an existing report use get_selection_report. Set internal_test=true for owner/CI validation so it is excluded from public scans. source is a self-reported referral bucket, not identity verification.
Schema valid · SHA-256 3c908cf21310…
View input schema
{ "type": "object", "properties": { "mcp_url": { "maxLength": 2048, "minLength": 8, "title": "Mcp Url", "type": "string" }, "source": { "default": "other", "maxLength": 32, "title": "Source", "type": "string" }, "internal_test": { "default": false, "title": "Internal Test", "type": "boolean" } }, "required": [ "mcp_url" ], "title": "scan_mcp_metadataArguments" }
Connections
streamable-http
https://agenttrustlab.com/mcp