Create a properly formatted robots.txt file
Generate a standard robots.txt with sitemap reference for your domain.
Your domain URL — used to build robots.txt and sitemap line.
Back to all tools
Get a free instant audit — check Speed, SEO, Security & Lead Conversion. Find out what's stopping your business from growing online.
Takes only 30 seconds. No credit card needed.