Robots.txt Generator Create a valid `robots.txt` file by configuring the rules below. General Rules Default Policy (for all robots) Allow All Disallow All Crawl-Delay (in seconds) Sitemap URL (optional) Specific Bot Rules Select the bots you want to add specific rules for. For multiple paths, separate them with a comma (e.g., /admin/, /private/). Generate File Generated robots.txt Copy Copied to clipboard!