Robots.txt Generator

🤖 Robots.txt Generator

Build a robots.txt file to control search engine crawlers.

Default Rule Sitemap URL Block these paths (one per line)

About the Robots.txt Generator

The Robots.txt Generator creates a robots.txt file that tells search engine crawlers which parts of your site they may or may not access. It's the first file Google looks for.

A correct robots.txt keeps private areas out of search while letting your important pages be crawled.

How to use it

Choose which crawlers and paths to allow or block.
Add your sitemap URL.
Copy the file and upload it to your site root.

Every tool on SEOKeyMaster is 100% free, works right in your browser, and requires no signup or API key. Your data never leaves your device.

Frequently Asked Questions

Where does robots.txt go? ▼

In the root of your domain, e.g. yoursite.com/robots.txt.

Does blocking a page hide it from Google? ▼

It stops crawling, but for guaranteed removal use a noindex tag instead.