I created a robots.txt but was not sure whether the syntax was correct or not. I searched and found this nice online tool that checks the validity of robots.txt file:
http://tool.motoricerca.info/robots-checker.phtml
Very easy to use.
I created a robots.txt but was not sure whether the syntax was correct or not. I searched and found this nice online tool that checks the validity of robots.txt file:
http://tool.motoricerca.info/robots-checker.phtml
Very easy to use.