Robots.txt Tester
Test whether a URL path is allowed or blocked for Googlebot Bingbot or another crawler.
Fetch robots.txt and test whether a path is allowed for a selected user-agent.
Full result
About this tool
Robots.txt Tester is a single-purpose utility on instant.tw, a free toolbox of calculators, converters, generators, and quick lookups. Everything works in your browser — nothing is uploaded, nothing is stored on a server unless explicitly noted.
Category: Developer Tools — Advanced. Browse more Developer Tools — Advanced tools.