Parsing is local — no live site fetch claimed.
WebToolMage
Robots.txt tester
Validate pasted robots.txt syntax locally.
Does not claim remote crawl status unless a live fetch is performed (not in these pilots).
Method
inspectUrl uses the URL constructor. robots validator checks User-agent/Disallow/Allow/Sitemap lines.
Assumptions
- URL API parsing.
- Robots line rules.
- No paid network API.
Questions
Does this fetch my site?
Not in these pilots. Paste content instead.
Is robots crawl advice legal advice?
No. It is syntax validation only.