Gruppe Digital

Free tool · AI visibilityDecide which AI may read your website

Select the AI services that may read your content and copy the finished robots.txt.

Which AI services may read your website?

Your robots.txt


The file belongs in the root directory of your website. If you block AI crawlers, you will be cited less often as a source in ChatGPT and others.

Allow or block AI crawlers?

If you want to appear as a source in ChatGPT, Perplexity or Google's AI answers, you should allow these services' search crawlers. Some companies, on the other hand, block the crawlers that collect content for training AI models.

robots.txt is a request, not a technical barrier. Reputable providers comply with it. After a change, check whether your important pages are still accessible to Google.

Free initial consultation

Where are you losing customers today?

In 30 minutes we show you the three biggest levers for more inquiries, without obligation, and even if we don't end up working together.

Berke, your contact person+49 761 5572 1816 · Reply within 24 hours on business days

Let’s talk

We will get back to you within 24 hours on working days.

Inquiry received!

Thank you for your trust. We will get back to you shortly, within 24 hours at the latest. A confirmation is on its way to your inbox.