I created a robots.txt but was not sure whether the syntax was correct or not. I searched and found this nice online tool that checks the validity of robots.txt file:
http://tool.motoricerca.info/robots-checker.phtml
Very easy to use.
robots.txt validator (checker)
July 16th, 2008
Tweet