locked
Robots.txt validation - Error message cached? RRS feed

  • Question

  • Hi -

    Our robots.txt file can be found at http://www.boorah.com/robots.txt
    When I try to validate our robots.txt file, it throws an error which seems mostly cached

    Line #1: http://www.boorah.com/robots.txt
    Error: 'user-agent' -  should be the first tag.
    **************************************************
    Warning: 'sitemap' - tag isn't specified.
    **************************************************

    I have tried multiple variations of the file but can't seem to get the error message resolved. For each of the sitemap files referenced in the file, I've gone ahead and validated using the XML-Sitemaps Validator?

    Let me know if you see anything wrong with how we've defined the robots.txt or the sitemap file. Thanks in advance for the help

    -Nagaraju
    Sunday, March 16, 2008 3:06 AM

Answers