Machine Access
Search engines and AI assistants can open every page of your site and read all of it.
Your site answers on one address instead of four. The instructions at your site's front door are written to welcome the AI crawlers by name — GPTBot and OAI-SearchBot, PerplexityBot, ClaudeBot, Google-Extended, Bingbot, Applebot and Amazonbot — instead of quietly turning them away, which is the default on a surprising number of hosts and security services. Then we test that they actually receive the full page, because a blocked crawler looks identical to a working site from the front end. And crucially, the assistants do not all read the same index: Google's AI answers run on Google, ChatGPT and Copilot lean on Bing, Claude searches through Brave, and Perplexity runs its own crawler entirely. Being in one is not being in all four — so we file your site with every surface that accepts a submission, and prove crawler access for the ones that don't.
Every tierHow this works →