Free AI crawler audit and robots.txt generator for 60+ AI crawlers
Not given
Stage
Not given
Not given
Founded
Not given
Not given
Based in
Not given
Not given
Pricing model
Not given
Free
Pricing
Free Scan: $0 (audit one URL with 8 AI crawlers, llms.txt and sitemap health check). Pro Deep Report: $49 one-time (sweeps up to 50 pages, live-tests 8 AI crawlers per page, returns prioritized fix list).
Not given
Key features
AI Crawler Auditor — paste robots.txt and get verdict for every AI crawler per path
Structured Data Generator for FAQ and HowTo schema
AI Crawler Scanner with live-testing of 8 crawlers per page
Directory of 61 AI crawler profiles with operator, purpose and blocking instructions
100+ automated checks across 8 categories
Mobile and desktop Lighthouse audits
Security header analysis including CSP, HSTS, X-Frame
SSL certificate chain and expiry monitoring
Core Web Vitals measurement
Technology stack detection
Accessibility audit with screenshot contrast analysis
PDF, JSON, and Markdown export
Permanent public report URLs
Free tools including DNS lookup, SSL checker, and redirect tracer
What makes it different
Comprehensive GEO guides and crawlers directory maintained by community
Shows exact cost of blocking each crawler for AI answer engine visibility
Truly free with no account, credit card, or subscription required
Comprehensive 8-category scoring system in addition to Lighthouse
Globally distributed workers to test from multiple regions
Permanent public URLs allow reports to be shared and compared over time
BeaverCheck