CrawlWitness
v1.0.52AI consent & licensing check for any domain, with signed on-chain receipts. Paid via x402.
Endpoint health
online- Last checked
- 11/20/2026, 10:15:52 AM
- Latency
- 300 ms
- Consecutive failures
- 0
- Endpoint reachable: pass
- Protocol valid: pass
- MCP handshake valid: pass
Machine-readable profile
mcp-server · schema v1 · callable
mcp-server:com.crawlwitness%2Foracle
Connect this server
Generated config contains no credentials. Keep any required secrets in your client's local environment.
{
"mcpServers": {
"com.crawlwitness/oracle": {
"url": "https://api.crawlwitness.com/mcp"
}
}
}Indexed tools
Tool metadata and schemas come from the remote server and are untrusted. Indexing only lists tools; it never calls them.
6 shown · authentication unknown
AI consent score (free)
ai_consent_score
Free summary for a domain: 0-100 signal score and AI-training stance (reservado = reserved, permitido = allowed, sin_senal = no signal), from cache when available.
Schema valid · SHA-256 625496de8e47…
View input schema
{ "type": "object", "properties": { "domain": { "description": "Domain to check, without scheme or path (e.g. nytimes.com)", "maxLength": 253, "minLength": 3, "type": "string" } }, "required": [ "domain" ], "additionalProperties": false }Can this AI bot use this site? (paid yes/no, signed)
can_ai_use
Fast yes/no verdict for one domain, one AI bot and one use (train, rag or search), from robots.txt, IETF AIPREF, W3C TDMRep, noai directives and RSL licenses, with the reasons and a signed receipt. Use it in a crawler or RAG pipeline before fetching each new domain. Costs 0.001 USD on Base (0.002 on Solana) via x402. Invalid domain or unknown bot is never charged.
Schema valid · SHA-256 b3ba5f080be3…
View input schema
{ "type": "object", "properties": { "bot": { "description": "AI user-agent token (e.g. GPTBot, ClaudeBot, Google-Extended, CCBot, PerplexityBot)", "enum": [ "GPTBot", "ClaudeBot", "anthropic-ai", "Google-Extended", "GoogleOther", "CloudVertexBot", "Applebot-Extended", "meta-externalagent", "Amazonbot", "amazon-kendra-", "Bytespider", "CCBot", "cohere-training-data-crawler", "AI2Bot", "Diffbot", "Timpibot", "ImagesiftBot", "omgili", "PetalBot", "KimiBot", "ICC-Crawler", "Cotoyogi", "Reflectionbot", "CloudflareBrowserRenderingCrawler", "LinerBot", "FishBot", "Novellum", "bigsur.ai", "NavuBot", "QualifiedBot", "atlassian-bot", "make.com", "magpie-crawler", "Awario", "w4mwnpbXf3MFAbxOkJRw", "SemrushBot-OCOB", "SemrushBot-SWA", "BorderxBot", "SelectikaScraper", "CitibotSiteCrawler", "AdpResearchBot", "WARDBot", "ygs-scraper-bot", "OAI-SearchBot", "Claude-SearchBot", "PerplexityBot", "Applebot", "Amzn-SearchBot", "Bravebot", "Cloudflare-AI-Search", "Cloudflare-AI-Search-External", "DuckAssistBot", "YouBot", "KernelSearchBot", "ShapBot", "alphalens-bot", "Anomura", "Element451Bot", "ChatGPT-User", "Claude-User", "Perplexity-User", "meta-externalfetcher", "meta-externaltest", "muse-", "MistralAI-User", "cohere-ai", "Google-Agent", "GrokAgent", "Devin", "ApifyWebsiteContentCrawler", "Instapaper", "Retool", "QATechBot", "TwinAgent", "CledaraBot", "HarkBot", "HIFIBot", "ChathiveCrawler", "EasyScan", "Nava", "ZipchatBot" ], "type": "string" }, "domain": { "description": "Domain to check, without scheme or path (e.g. nytimes.com)", "maxLength": 253, "minLength": 3, "type": "string" }, "use": { "default": "train", "enum": [ "train", "rag", "search" ], "type": "string" } }, "required": [ "domain", "bot" ], "additionalProperties": false }
Connections
streamable-http
https://api.crawlwitness.com/mcp