FaroBot

FaroBot is Faro's website scanner

Faro scores how easily AI agents like ChatGPT, Claude and Gemini can find, read and use a website. FaroBot is the program that fetches a site to work out that score. It reads public pages and files only: it never logs in, fills in forms or buys anything.

Why FaroBot visited your site

FaroBot visits a site for one of these reasons:

A scan reads your robots.txt first, then your homepage, sitemap, llms.txt and a short list of standard files AI agents look for (for example /.well-known/ files). It is paced, and it follows any Crawl-delay in your robots.txt. Faro keeps the score and what each check found, not copies of your pages.

User agent

FaroBot identifies itself with this user agent:

FaroBot/1.0 (AI-agent-readiness-scanner; +https://byfaro.ai/farobot)

One exception: on sites behind Cloudflare, a scan also asks for the homepage twice using GPTBot's and ClaudeBot's user agents. That tests whether Cloudflare's AI-bot blocking would stop ChatGPT and Claude from reaching the site, which is part of the score. Those two requests come from Faro, not from OpenAI or Anthropic.

Blocking FaroBot with robots.txt

FaroBot respects robots.txt. To stop it scanning your site, add this to your robots.txt:

User-agent: FaroBot Disallow: /

FaroBot reads robots.txt before anything else. When a rule naming FaroBot blocks your whole site, the scan stops there and nothing is scored or recorded. Whoever asked for the scan is told your site asked FaroBot not to visit.

Rules for all bots (User-agent: *) are part of what Faro measures, because they decide whether AI agents can reach you. To opt out of Faro, name FaroBot.

Verifying FaroBot

Anyone can copy a user agent. FaroBot uses Web Bot Auth, the open standard for bots to prove who they are with a cryptographic signature. Its public key is published here:

https://byfaro.ai/.well-known/http-message-signatures-directory

Contact

If FaroBot is causing a problem on your site, or you have a question about it, email hello@byfaro.ai. Include your domain and roughly when you saw it. A person reads every message.