Comment: Validate Robots.Txt == lame RRS feed

  • General discussion

  • Hi, sorry for bluntness in the subject line again but your robots.txt validator is not helpful to me at all.

    The tool should (a) auto-validate the currently selected site's robots.txt (b) show which pages would be not be indexed (c) provide the ability for me to make adjustments and (d) safely view the impact if I were to make adjustments to the robots.txt file.

    At a minimum, WLWMT should provide a green checkmark on a dashboard page indicating no errors found for a site's robots.txt file.  Thanks.

    Tuesday, November 20, 2007 4:59 PM

All replies


    I agree. I (embarrassingly) struggled with the UI until I realized that I had to cut/paste my robots.txt contents into the gray window.


    C'mon now, how about a simple "Upload from website" button for starters!


    Wednesday, November 21, 2007 1:03 AM