Free tool · AI visibilityDecide which AI may read your website
Select the AI services that may read your content and copy the finished robots.txt.
Which AI services may read your website?
Your robots.txt
The file belongs in the root directory of your website. If you block AI crawlers, you will be cited less often as a source in ChatGPT and others.
Allow or block AI crawlers?
If you want to appear as a source in ChatGPT, Perplexity or Google's AI answers, you should allow these services' search crawlers. Some companies, on the other hand, block the crawlers that collect content for training AI models.
robots.txt is a request, not a technical barrier. Reputable providers comply with it. After a change, check whether your important pages are still accessible to Google.
More free tools
More tools for your website and your marketing.
Website check
15 checks on technology, SEO and AI visibility, with a report by email.
Use for freeGoogle AdsGoogle Ads calculator
Calculate budget, inquiries, cost per lead and revenue potential.
Use for freeSEOSnippet preview
Test page titles and descriptions live, measured in pixels.
Use for freeFree initial consultation
Where are you losing customers today?
In 30 minutes we show you the three biggest levers for more inquiries, without obligation, and even if we don't end up working together.