Crawler access
Leave the crawl delay at 0 to omit it. Google ignores this directive; Bing and Yandex honour it.
One path per line, each starting with a slash.
Upload the file to the root of your site, so it answers at /robots.txt. In cPanel that is the public_html folder.
Good to know
How to get robots.txt right
1
It's a request, not a wall
Well-behaved crawlers follow it and malicious ones ignore it. Anything truly private needs a password, not a Disallow line.
2
Blocking isn't de-indexing
A blocked page can still show up in results if other sites link to it. Put a noindex meta tag on pages you want out of the index.
3
Never block your assets
If you disallow CSS or JS directories, search engines can't render your pages properly, and that hurts more than it helps.
4
Check it after upload
Open the file in a browser at your domain, then validate it in Google Search Console before you assume it's live.
More free tools
Free to use, and none of them need an account.
IP checkerYour public IP and what it revealsOpen the tool
Password generatorStrong passwords, generated in your browserOpen the tool
Word countWords, characters and reading timeOpen the tool
Lorem ipsumPlaceholder copy by paragraph or wordOpen the tool
HTML minifierStrip comments and whitespace from markupOpen the tool
CSS minifierShrink stylesheets before you shipOpen the tool
JS minifierRemove comments and dead whitespaceOpen the tool