Knowledge base v2.13.0 · Community edition · data through 2 October 2026
Thing · Report
The Search Console report that shows the robots.txt files Google found for a site, when it fetched them and any parsing errors.
Glossary · robots.txt report
A Search Console report that shows the robots.txt file as Google last fetched it, with a version history and the errors and successes of each fetch. Google said it uses Google's open-source robots.txt parser.
Documented in
Search Console's robots.txt report shows the robots.txt files Google found for the top 20 hosts of a Domain property, with their fetch status, warnings and errors; to test whether a specific URL is blocked, Google's help page points to the URL Inspection tool and to Google's open-source robots.txt library.
Google Search Console Help · Day 1 · How Google interprets robots.txt
Google's robots.txt guide says its crawlers update their cached copy of a site's robots.txt every 24 hours, and that the Request a recrawl option in Search Console's robots.txt report refreshes it faster.
Google Search Central, Google Search Console Help · Day 3 · How long does it take to..?
Slide and stage claims that name it, the ones Google’s documentation does not cover first.
Google said the robots.txt report helps catch CDNs that update a site's robots.txt without the owner's knowledge, and hosts that cloak the robots.txt file, which happens more often than people think.
Google said the robots.txt report uses the parser Google open-sourced at github.com/google/robotstxt.
Search Console's robots.txt report shows the robots.txt file as Google last fetched it, with a version history and the errors and successes of each fetch.
Kit items about robots.txt report: their own words name it, or several of the claims they rest on do.
Rests on 20 claims, 3 of them naming robots.txt report; its own words name robots.txt report
Do not put Content-Signal or other non-standard lines between user-agent lines
Rests on 6 claims, 2 of them naming robots.txt report
Also inglossary term robots.txt report
Things named in the same claim, with the number of claims they share.