FaroBot
FaroBot is Faro's website scanner
Faro scores how easily AI agents like ChatGPT, Claude and Gemini can find, read and use a website. FaroBot is the program that fetches a site to work out that score. It reads public pages and files only: it never logs in, fills in forms or buys anything.
Why FaroBot visited your site
FaroBot visits a site for one of these reasons:
- Someone scanned the site on byfaro.ai, or through Faro's API or MCP server.
- A Faro customer monitors the site, and FaroBot re-checks it once a week.
- The site is listed in Faro's public Score Index, and its score is being refreshed.
A scan reads your robots.txt first, then your homepage, sitemap, llms.txt and a short list of standard files AI agents look for (for example /.well-known/ files). It is paced, and it follows any Crawl-delay in your robots.txt. Faro keeps the score and what each check found, not copies of your pages.
User agent
FaroBot identifies itself with this user agent:
FaroBot/1.0 (AI-agent-readiness-scanner; +https://byfaro.ai/farobot)One exception: on sites behind Cloudflare, a scan also asks for the homepage twice using GPTBot's and ClaudeBot's user agents. That tests whether Cloudflare's AI-bot blocking would stop ChatGPT and Claude from reaching the site, which is part of the score. Those two requests come from Faro, not from OpenAI or Anthropic.
Blocking FaroBot with robots.txt
FaroBot respects robots.txt. To stop it scanning your site, add this to your robots.txt:
User-agent: FaroBot
Disallow: /FaroBot reads robots.txt before anything else. When a rule naming FaroBot blocks your whole site, the scan stops there and nothing is scored or recorded. Whoever asked for the scan is told your site asked FaroBot not to visit.
Rules for all bots (User-agent: *) are part of what Faro measures, because they decide whether AI agents can reach you. To opt out of Faro, name FaroBot.
Verifying FaroBot
Anyone can copy a user agent. FaroBot uses Web Bot Auth, the open standard for bots to prove who they are with a cryptographic signature. Its public key is published here:
https://byfaro.ai/.well-known/http-message-signatures-directory
Contact
If FaroBot is causing a problem on your site, or you have a question about it, email hello@byfaro.ai. Include your domain and roughly when you saw it. A person reads every message.