AI Crawlability Check · Effective 19 Nov 2026

Privacy and terms

AI Crawlability Check is a free MCP server at https://mcp.milan-novotny.com/mcp. It stores none of the URLs or text you send it, needs no account and sets no cookies.

Privacy policy

Who runs it. The server is run by Milan Novotný as a personal project. Contact: [email protected].

What the server receives. When your AI client calls a tool, the server receives the tool name and its inputs: a URL, an optional keyword, or a rubric name. It does not receive your conversation, your identity or your files.

What it does with them. For a URL it requests that page and the same site's robots.txt, llms.txt, llms-full.txt and up to 5 XML sitemap files, computes the result and returns it. The requests carry the user agent milan-novotny-mcp/1.0.

What it stores. Nothing. The server has no database, no file storage, no accounts and no cookies. Tool inputs and results are held in memory for the length of one request and are not written anywhere.

Logs. The server runs on Cloudflare Workers. Cloudflare records standard request metadata for operation and abuse prevention, such as time, IP address, response status and duration. Request bodies, which hold the tool inputs, are not logged. Cloudflare acts as the hosting provider under its own privacy policy.

Sharing. No data is sold or shared. The only third parties involved are Cloudflare, as host, and the websites you ask the server to check, which see an ordinary request from Cloudflare's network.

Personal data. Do not submit URLs that contain personal data in the address. If you believe personal data reached the server and want to raise it, write to the contact address.

Your AI client. Your AI client and its provider handle your conversation under their own terms. This policy covers only this server.

Changes. Changes are published on this page with a new effective date.

Terms of use

  1. Free and as is. The server is provided free of charge, without warranty of any kind and without a guaranteed uptime.
  2. Informational results. Scores and fixes are automated measurements, not professional advice. Check important findings yourself before acting on them.
  3. Fair use. Use it to check pages you have a legitimate interest in. Do not use it to load-test, scrape at volume or attack other sites. Requests may be rate limited or blocked.
  4. Public pages only. The server refuses private, local and non-standard addresses.
  5. Third-party names. Crawler and product names belong to their owners and are used to describe them. The server is not affiliated with or endorsed by any of them.
  6. Liability. To the extent the law allows, the operator is not liable for loss arising from use of the server or reliance on its results.
  7. Changes and withdrawal. The tools may change, and the server may be withdrawn at any time.

Contact and support

Questions, bug reports and removal requests: [email protected]. Documentation: AI Crawlability Check.