IA-QA — 152 QA & Dev Tools for AI Agents
v1.1.1152 free QA tools for agents: injection scan, evals, RAG, web audits. Smaller packs: /mcp/{pack}.
Endpoint health
online- Last checked
- 11/20/2026, 4:17:31 AM
- Latency
- 242 ms
- Consecutive failures
- 0
- Endpoint reachable: pass
- Protocol valid: pass
- MCP handshake valid: pass
Machine-readable profile
mcp-server · schema v1 · callable
mcp-server:io.github.JcJamet%2Fia-qa-toolbox
Connect this server
Generated config contains no credentials. Keep any required secrets in your client's local environment.
{
"mcpServers": {
"io.github.JcJamet/ia-qa-toolbox": {
"url": "https://www.ia-qa.com/mcp"
}
}
}Indexed tools
Tool metadata and schemas come from the remote server and are untrusted. Indexing only lists tools; it never calls them.
25 shown · authentication unknown
ab_test_report
Generate an A/B test report comparing two prompts or model configurations. Accepts arrays of scores and returns mean, median, std deviation, improvement percentage, and a Welch t-test at 95 %: `winner` names a variant only when the difference is significant — otherwise "no_significant_difference", or "insufficient_samples" under 2 scores per variant.
Schema valid · SHA-256 c0dd6f225cbb…
View input schema
{ "type": "object", "properties": { "variant_a": { "type": "object", "description": "First variant configuration with name and score array", "properties": { "name": { "type": "string", "description": "Name/label for variant A" }, "scores": { "type": "array", "items": { "type": "number" }, "description": "Array of scores (0-100)" } } }, "variant_b": { "type": "object", "description": "Second variant configuration with name and score array", "properties": { "name": { "type": "string", "description": "Name/label for variant B" }, "scores": { "type": "array", "items": { "type": "number" }, "description": "Array of scores (0-100)" } } } }, "required": [ "variant_a", "variant_b" ], "examples": [ { "variant_a": { "name": "A", "scores": [ 70, 71, 69 ] }, "variant_b": { "name": "B", "scores": [ 70, 71, 69 ] } } ] }agent_checkout_eval
Judges a shopping agent's run in Sandbox Bazaar, a fictional shop whose scenarios hide known traps (injected instructions, last-step fees, pre-checked subscription, fake discount, cheaper listing, look-alike merchant, forced substitute). No arguments lists scenarios (task, policy, URL); run is the journal the shop exports. Deterministic, no model. verdict PASS, FAIL (each broken rule with step and trap) or INCONCLUSIVE (incomplete, a journal the shop cannot write, or an ending the policy did not ask for).
Connections
streamable-http
https://www.ia-qa.com/mcp