Robots.txt Generator

Build a clean, search-engine-friendly robots.txt file in seconds.

Allow all search engines to crawl the entire site

Disallow paths (one per line, leave blank if none) Sitemap URL Generated robots.txt

Configure the options above and click Generate.

How to use this tool

Decide whether to allow all crawlers or block specific folders.
List any paths you want to keep out of search results, one per line.
Add your XML sitemap URL so search engines can find it automatically.
Copy the result and upload it as /robots.txt at the root of your domain.

Frequently asked questions

Where do I upload robots.txt?

It must live at the root of your domain, e.g. https://bloggingsecret.com/robots.txt — not inside a subfolder.

Can robots.txt hide a page from Google entirely?

Not reliably. Use a noindex meta tag for that. Robots.txt only tells crawlers which URLs not to fetch.

Keep Going

Related tools

Word & Character Counter

Count words, characters, sentences and reading time instantly as you type.

Meta Tag Generator

Generate title, description and Open Graph meta tags ready to paste into your .

Keyword Density Checker

Find your top keywords and phrase density to avoid keyword stuffing.