Robots.txt Generator
Generate robots.txt files to control search engine crawling of your website.
User-agent: * Allow: / Disallow: /admin/ Disallow: /private/ Sitemap: https://example.com/sitemap.xml
How to use
1
Configure rules
2
Add sitemap URL
3
Generate
4
Download
Use cases
•SEO management
•Crawler control