About seven hours ago Dr. Andy Farnell released an interesting new article about robots.txt files and how raiders that wear ...