{"data":{"name":"io.github.aidatatools-dev/data-quality-gate","title":"Data Quality Gate - deterministic post-scrape cleaner + verdict","description":"Post-scrape data cleaner, no LLM: repairs mojibake, HTML, invisible chars. Plus a verdict.","version":"0.3.0","websiteUrl":"https://www.aidatatools.dev/llms.txt","repositoryUrl":null,"remotes":[{"url":"https://www.aidatatools.dev/api/mcp_server","type":"streamable-http"}],"packages":[],"status":"active","isLatest":true,"publishedAt":"2026-08-12T07:23:32.533Z","updatedAt":"2026-08-12T07:23:32.533Z","source":"official-registry","verification":"official","confidence":100,"stars":null,"sources":[{"stars":null,"title":"Data Quality Gate - deterministic post-scrape cleaner + verdict","source":"official-registry","sourceId":"io.github.aidatatools-dev/data-quality-gate","updatedAt":"2026-08-12T07:23:32.533Z","confidence":100,"websiteUrl":"https://www.aidatatools.dev/llms.txt","description":"Post-scrape data cleaner, no LLM: repairs mojibake, HTML, invisible chars. Plus a verdict.","verification":"official","repositoryUrl":null}],"toolIndex":{"tools":[{"serverName":"io.github.aidatatools-dev/data-quality-gate","endpointFingerprint":"708b5f71665c313f3c53a5319cd7cc23b66e14568ad8f308bb9fe43a621ff2f9","name":"check_dataset_quality","title":null,"description":"Call this before using any dataset. Returns a deterministic quality verdict (RELIABLE / USABLE_WITH_CLEANING / UNRELIABLE) with exact facts: completeness, nulls, type consistency, impossible values, duplicates, outliers, and (on financial/trading data) cross-source price divergence. 100% deterministic, no LLM. Free -- this MCP endpoint runs the engine directly; POST /api (plain REST, same engine) is x402-gated at $0.01/call instead. Input: rawJson (a JSON array of row objects, or a single object); datasetId is accepted but not resolvable on this deployment -- pass rawJson instead.","inputSchema":{"type":"object","properties":{"rawJson":{"description":"The dataset: a JSON array of row objects, or a single object."},"datasetId":{"type":"string","description":"An Apify dataset id. Not resolvable on this deployment; pass rawJson instead."}}},"annotations":null,"definitionHash":"0b48269311a070ea45d3fa1c59e3cacb75caa66f6efe1bec6a1f2a7a328f1984","schemaStatus":"valid","origin":"official-registry","observedAt":"2026-11-18T18:47:06.491Z","metadataTrust":"untrusted"},{"serverName":"io.github.aidatatools-dev/data-quality-gate","endpointFingerprint":"708b5f71665c313f3c53a5319cd7cc23b66e14568ad8f308bb9fe43a621ff2f9","name":"clean_scraped_data","title":null,"description":"PAID TIER, CALLED FROM A FREE ENDPOINT -- READ THIS FIRST: this tool does NOT return your cleaned data, and its response has NO `data` key. It returns {\"status\": \"payment_required\", \"what_we_found_in_your_data\": {...}, \"get_the_repaired_data\": {...}}. Do not treat its output as cleaned data and do not write it back into your dataset.\nWHAT YOU GET HERE, FREE: an exact inventory of the defects in YOUR data -- which repair rules would fire, how many values each would change, and which cases cannot be repaired safely and need your decision.\nHOW TO GET THE REPAIRED DATA: make the one call named in `get_the_repaired_data` -- POST https://www.aidatatools.dev/api/clean, $0.04 via x402, no account, no API key, no signup. That response body IS the cleaned dataset, in the shape you posted it.\nWHY THE SPLIT: detection is free on this endpoint and always has been (check_dataset_quality reports the same defects). The repaired artifact is the paid product, because it is re-bought on every extraction run rather than cached like a verdict.\nWHAT THE PAID CALL DOES: removes leftover HTML tags and entities, decodes mojibake ('CafÃ©' -> 'Café'), strips invisible characters (zero-width, BOM, soft hyphen), normalises non-breaking spaces and trims values -- across nested objects and arrays too. 100% deterministic, no LLM: the same input always yields byte-identical output, and cleaning twice equals cleaning once. It repairs how data was ENCODED, never what it SAYS: masked placeholders ('N/A', 'None'), near-duplicate rows and failed extractions ('access denied', 'captcha', which mean that record must be re-scraped) are reported with a proposal, never silently deleted or rewritten. The full boundary -- 7 rules applied automatically, 5 needing an explicit opt-in, 8 only ever reported -- is at GET https://www.aidatatools.dev/api/clean.","inputSchema":{"type":"object","properties":{"rawJson":{"description":"The scraper output: a JSON array of row objects, a single object, or a CSV/plain-text string. The format is detected and the output mirrors the shape you sent."},"options":{"type":"object","description":"All optional. Every default is the safe one: with no options, the row count, every value's type, and the schema are all guaranteed unchanged.","properties":{"placeholder_policy":{"type":"string","enum":["flag","null_high_confidence","null_all"],"description":"What to do with masked-missing strings. 'flag' (default) reports them and changes nothing. 'null_high_confidence' nulls only tokens that cannot be real data ('N/A', 'null', 'undefined') and never the ambiguous ones ('None' is a surname, 'NA' is Namibia, '-' is a real value). 'null_all' nulls the ambiguous ones too -- only choose this if you know the domain."},"drop_exact_duplicates":{"type":"boolean","description":"Remove rows byte-identical to an earlier row, compared AFTER cleaning. Off by default because it changes the row count; duplicates are reported either way."},"coerce_numeric_text":{"type":"boolean","description":"Turn 'US $5.59' into 5.59. Per field, all-or-nothing, and only where every value is unambiguous -- a lone ',' or a mixed currency disqualifies the whole field rather than being guessed at."},"repair_keys":{"type":"boolean","description":"Also repair dict KEYS (the classic '\\ufeffsku' first column of a BOM-prefixed CSV export). Off by default: a key is a contract with everything downstream."},"trim_whitespace":{"type":"boolean","description":"Default true."},"detect_duplicates":{"type":"boolean","description":"Default true. Set false to skip duplicate detection on very large input."}}}},"required":["rawJson"]},"annotations":null,"definitionHash":"85f0686b5bebce382cd2664d18a84f16c13475ed6e886c29d6ddc651aeaaf9c6","schemaStatus":"valid","origin":"official-registry","observedAt":"2026-11-18T18:47:06.491Z","metadataTrust":"untrusted"},{"serverName":"io.github.aidatatools-dev/data-quality-gate","endpointFingerprint":"708b5f71665c313f3c53a5319cd7cc23b66e14568ad8f308bb9fe43a621ff2f9","name":"clean_scraped_data_audited","title":null,"description":"PAID TIER, CALLED FROM A FREE ENDPOINT -- READ THIS FIRST: this tool does NOT return your cleaned data, and its response has NO `data` key. It returns {\"status\": \"payment_required\", \"what_we_found_in_your_data\": {...}, \"get_the_repaired_data\": {...}}. Do not treat its output as cleaned data and do not write it back into your dataset.\nWHAT YOU GET HERE, FREE: an exact inventory of the defects in YOUR data -- which repair rules would fire, how many values each would change, and which cases cannot be repaired safely and need your decision.\nHOW TO GET THE REPAIRED DATA: make the one call named in `get_the_repaired_data` -- POST https://www.aidatatools.dev/api/clean/audit, $0.12 via x402, no account, no API key, no signup. That response body IS the cleaned dataset, in the shape you posted it.\nWHY THE SPLIT: detection is free on this endpoint and always has been (check_dataset_quality reports the same defects). The repaired artifact is the paid product, because it is re-bought on every extraction run rather than cached like a verdict.\nWHAT THE PAID CALL DOES: the same repair as clean_scraped_data, plus a complete audit trail: every transformation with its path, rule, before and after value, a replay_id, and input/output SHA-256. The ledger is a full inverse patch -- applying it in reverse reconstructs your original input byte for byte. Use it when you must be able to PROVE later what changed and why.","inputSchema":{"type":"object","properties":{"rawJson":{"description":"The scraper output: a JSON array of row objects, a single object, or a CSV/plain-text string. The format is detected and the output mirrors the shape you sent."},"options":{"type":"object","description":"All optional. Every default is the safe one: with no options, the row count, every value's type, and the schema are all guaranteed unchanged.","properties":{"placeholder_policy":{"type":"string","enum":["flag","null_high_confidence","null_all"],"description":"What to do with masked-missing strings. 'flag' (default) reports them and changes nothing. 'null_high_confidence' nulls only tokens that cannot be real data ('N/A', 'null', 'undefined') and never the ambiguous ones ('None' is a surname, 'NA' is Namibia, '-' is a real value). 'null_all' nulls the ambiguous ones too -- only choose this if you know the domain."},"drop_exact_duplicates":{"type":"boolean","description":"Remove rows byte-identical to an earlier row, compared AFTER cleaning. Off by default because it changes the row count; duplicates are reported either way."},"coerce_numeric_text":{"type":"boolean","description":"Turn 'US $5.59' into 5.59. Per field, all-or-nothing, and only where every value is unambiguous -- a lone ',' or a mixed currency disqualifies the whole field rather than being guessed at."},"repair_keys":{"type":"boolean","description":"Also repair dict KEYS (the classic '\\ufeffsku' first column of a BOM-prefixed CSV export). Off by default: a key is a contract with everything downstream."},"trim_whitespace":{"type":"boolean","description":"Default true."},"detect_duplicates":{"type":"boolean","description":"Default true. Set false to skip duplicate detection on very large input."}}}},"required":["rawJson"]},"annotations":null,"definitionHash":"b6db52235fed9aba4a1e4c91fd6c01c6bd3ac999c6ebd039c965b737edaa02a2","schemaStatus":"valid","origin":"official-registry","observedAt":"2026-11-18T18:47:06.491Z","metadataTrust":"untrusted"}],"endpoints":[{"endpointFingerprint":"708b5f71665c313f3c53a5319cd7cc23b66e14568ad8f308bb9fe43a621ff2f9","protocol":"streamable-http","status":"indexed","toolCount":3,"observedAt":"2026-11-18T18:47:06.491Z"}],"authentication":"unknown"},"connectionConfigurations":{"status":"ready","authentication":"not embedded","clients":{"Claude Desktop":{"mcpServers":{"io.github.aidatatools-dev/data-quality-gate":{"url":"https://www.aidatatools.dev/api/mcp_server"}}},"Cursor":{"mcpServers":{"io.github.aidatatools-dev/data-quality-gate":{"url":"https://www.aidatatools.dev/api/mcp_server"}}},"VS Code":{"servers":{"io.github.aidatatools-dev/data-quality-gate":{"type":"http","url":"https://www.aidatatools.dev/api/mcp_server"}}}}},"resourceType":"mcp-server","callable":true,"runtime":{"callable":true,"protocols":["mcp"]},"interfaces":[{"protocol":"mcp","transport":"streamable-http","url":"https://www.aidatatools.dev/api/mcp_server"}],"profile":{"apiVersion":"1","schemaVersion":"1","id":"mcp-server:io.github.aidatatools-dev%2Fdata-quality-gate","resourceType":"mcp-server","canonicalUrl":"https://www.agentsjunction.com/api/v1/servers/io.github.aidatatools-dev%2Fdata-quality-gate","name":"io.github.aidatatools-dev/data-quality-gate","description":"Post-scrape data cleaner, no LLM: repairs mojibake, HTML, invisible chars. Plus a verdict.","interfaces":[{"protocol":"mcp","transport":"streamable-http","url":"https://www.aidatatools.dev/api/mcp_server"}],"capabilities":[],"identity":{"source":"official-registry","websiteUrl":"https://www.aidatatools.dev/llms.txt","repositoryUrl":null,"version":"0.3.0"},"verification":{"state":"official","confidence":100},"operations":{"resourceType":"mcp-server","name":"io.github.aidatatools-dev/data-quality-gate","status":"online","lastCheckedAt":"2026-11-20T09:16:42.238Z","lastSuccessfulCheck":"2026-11-20T09:16:42.238Z","latencyMs":54,"consecutiveFailures":0,"isStale":false,"checks":{"endpointReachable":true,"protocolValid":true,"agentCardValid":null,"mcpHandshakeValid":true},"lastSeen":null,"lastSuccessfulInteraction":null,"lastHealthCheck":"2026-11-20T09:16:42.238Z","source":{"type":"health-check","url":null},"observedAt":"2026-11-20T09:16:42.238Z"},"security":null,"timestamps":{"createdAt":"2026-08-12T07:23:32.533Z","updatedAt":"2026-08-12T07:23:32.533Z","observedAt":"2026-11-20T09:16:42.238Z"},"compatibility":{"serverVersion":"0.3.0","protocolVersions":[{"protocol":"mcp","version":null}]}}}}