agentcheck
v0.1.1Synthetic checks, nightly regression replay and model-drift alerts for AI agents
Endpoint health
online- Last checked
- 11/20/2026, 3:17:54 AM
- Latency
- 90 ms
- Consecutive failures
- 0
- Endpoint reachable: pass
- Protocol valid: pass
- MCP handshake valid: pass
Machine-readable profile
mcp-server · schema v1 · callable
mcp-server:io.github.agentwares%2Fagentcheck
Connect this server
Generated config contains no credentials. Keep any required secrets in your client's local environment.
{
"mcpServers": {
"io.github.agentwares/agentcheck": {
"url": "https://agentwares-agentcheck.vercel.app/api/mcp"
}
}
}Indexed tools
Tool metadata and schemas come from the remote server and are untrusted. Indexing only lists tools; it never calls them.
11 shown · authentication unknown
agentcheck_add_check
Add a check to one of your targets. A check runs an input (http path/prompt, mcp tool call, a2a message) on a schedule and judges the answer with a golden: exact, contains, regex and json_schema cost nothing; rubric and baseline use the LLM judge (baseline = same outcome as the last known-good answer). Returns the check id. Requires an API key.
Schema valid · SHA-256 116b884f87dd…
View input schema
{ "type": "object", "properties": { "name": { "type": "string", "minLength": 1, "maxLength": 120, "description": "short name shown on the status page" }, "kind": { "type": "string", "enum": [ "http", "mcp_tools_list", "mcp_tool_call", "a2a_task", "custom" ], "description": "what to run: http (GET path or POST prompt), mcp_tools_list, mcp_tool_call (tool + args), a2a_task (message)" }, "input": { "default": {}, "description": "http: { path?, method?, body?, prompt? } · mcp_tool_call: { tool, args } · a2a_task: { message }", "type": "object", "propertyNames": { "type": "string" }, "additionalProperties": {} }, "golden": { "type": "object", "properties": { "kind": { "type": "string", "enum": [ "exact", "contains", "regex", "json_schema", "rubric", "baseline" ], "description": "how the answer is judged; exact/contains/regex/json_schema cost nothing, rubric/baseline use the LLM judge" }, "value": { "description": "exact / contains: the expected text", "type": "string" }, "pattern": { "description": "regex: pattern source without slashes", "type": "string" }, "caseInsensitive": { "type": "boolean" }, "schema": { "description": "json_schema: JSON Schema (draft 2020-12 subset)", "type": "object", "propertyNames": { "type": "string" }, "additionalProperties": {} }, "rubric": { "description": "rubric: what a passing answer must do, in plain language", "type": "string" }, "expected": { "description": "rubric: a reference answer, when there is one", "type": "string" }, "tools": { "description": "expected tool-call sequence (replay checks)", "type": "array", "items": { "type": "string" } } }, "required": [ "kind" ], "description": "how the answer is judged. exact / contains / regex / json_schema are free and deterministic; rubric and baseline call the LLM judge, and baseline compares against the last known-good answer." }, "intervalSec": { "default": 3600, "description": "seconds between runs; the tier's interval is the floor (Free hourly, Starter+ 5 min)", "type": "integer", "minimum": 60, "maximum": 604800 }, "targetId": { "type": "string", "minLength": 1, "description": "id from agentcheck_create_target or GET /api/v1/targets" } }, "required": [ "name", "kind", "golden", "targetId" ], "$schema": "https://json-schema.org/draft/2020-12/schema", "additionalProperties": false }
Connections
streamable-http
https://agentwares-agentcheck.vercel.app/api/mcp