One bad deploy can copy staging's noindex to production or point every canonical at the wrong host. CrawlSentry checks your key pages every hour, for Google and for AI search engines like ChatGPT and Perplexity, and emails you a plain before → after diff the moment something changes.
No card required. Hourly checks. Email alerts only when something actually changes.
We fetch each page the way a crawler does — raw HTTP, no JavaScript — parse what matters, and compare it to the last snapshot.
In the HTML or the HTTP header. Adding noindex is flagged critical.
Line-by-line diff, plus whether Googlebot, or the AI search crawlers behind ChatGPT, Perplexity and Claude, are now blocked from your URL.
Canonical removed, duplicated, pointed off-host or no longer self-referencing; hreflang alternates removed or re-pointed.
Rewritten by a CMS plugin, emptied by a template change, or replaced with "Staging".
Final URL and status code. A page that suddenly 404s or redirects elsewhere is critical.
Expiry warnings at 30, 14, 7, 3 and 1 day (once per threshold), and an alert if your XML sitemap disappears or loses half its URLs.
ChatGPT search, Perplexity and Claude can only cite pages their crawlers are allowed to fetch and can read without JavaScript. That access breaks as silently as noindex does.
Get an alert when robots.txt starts blocking OAI-SearchBot, ChatGPT-User, PerplexityBot or Claude-SearchBot from your URL.
A 0–100 score per URL covering AI bot rules, CDN blocks, content without JavaScript, structured data and llms.txt.
A robots.txt group that lets AI search in while keeping training bots out, a JSON-LD starter and an llms.txt draft.
Try it on any page: free AI visibility checker.
Monthly, cancel anytime. Prices in EUR, VAT may apply.
Comparable monitors start around £25/month for 20 URLs.
No sign-up needed.
Paste a URL: noindex, X-Robots-Tag, robots.txt, canonical, redirects, title, SSL & domain expiry.
toolIs this URL blocked for Googlebot, Bingbot or GPTBot? See the exact deciding rule.
tool · GEOCan ChatGPT search, Perplexity and Claude reach and cite a page? AI bot rules, CDN blocks, JS-only content, schema.
Also: the AI robots.txt generator. Plus technical SEO guides: accidental noindex, the invisible X-Robots-Tag, canonicals pointing to staging, and a site migration checklist.
Not a rank tracker, not a site crawler, not a 24/7 uptime pager. Hourly is plenty for config drift, and a single failed fetch is retried quietly instead of waking you up.