locked
Unablet To Validate Robots.txt RRS feed

  • Question

  • I am new to the Live Search webmaster tools. I am not really sure how this should be done, but when I try to validate my robots.txt file it return the following message:

    Warning: 'sitemap' - tag isn't specified.
    **************************************************

    I have only these 2 line in my robots.txt :

    User-Agent: *
    Allow: /

    Am I setting up my robots.txt correctly? Please advise. Thanks.
    Monday, May 5, 2008 2:15 PM

Answers

  •  

    Please review robotstxt.org for help setting up your robots.txt file. "Allow" is not a proper command. Also, your sitemap tag on robots.txt should look like:

     

    Sitemap: http://domain.com

    Monday, May 5, 2008 5:49 PM

All replies

  •  

    Please review robotstxt.org for help setting up your robots.txt file. "Allow" is not a proper command. Also, your sitemap tag on robots.txt should look like:

     

    Sitemap: http://domain.com

    Monday, May 5, 2008 5:49 PM
  • Thanks Brett, I managed to validate the file. Further question, what is the difference between this two sitemap tags:

    Sitemap: http://domain.com
    Compare to:

    Sitemap: http://domain.com/sitemap.xml

    Are they totally the same?

    Tuesday, May 6, 2008 12:51 AM