This site is for sale, Learn More
robots.txt Creator FAQ
Robots File Questions & Answers
Why Such A Simple Creator?
Most sites don't need to block individual robots so we decided to keep our creator simple by blocking all robots.
How Can I Test My robots.txt?
After installing your robots.txt file you can test it with our robots.txt tester
Security and robots.txt: Hiding Files & robots.txt
The robots.txt file has to be "world-readable" which means that anyone with a browser can read your robots.txt file looking for the location of sensitive files.
If you have files you want to keep hidden you should take them off of the server or at least protect them with passwords. This will also protect them from search engines which don't obey the robots.txt standard.
Where Can I Learn More About robots.txt Files?
Here are some useful sources of robots.txt information:
The robots.txt creator Helped Me, How Can I Thank You?
We are glad you found it useful, please thank us by linking to searchenginepromotionhelp.com
Search Engine Promotion Help