Sign in
Microsoft.com
 
Resources for IT Professionals
 
 
 
Resources for IT Professionals > Forums Home > Webmaster Forums > Sitemap Protocol > About the Robots.txt
Ask a questionAsk a question
Search Forums:
 

AnswerAbout the Robots.txt

  • Thursday, January 08, 2009 4:55 AMLand Guo Users MedalsUsers MedalsUsers MedalsUsers MedalsUsers Medals
     
    Sign In to Vote
    0
    Sign In to Vote

    Hi, I have creat my  robots.txt file like this :

     

    # Robots.txt file from http://www.dfdsolar.com
    # All robots will spider the domain
    User-agent: *
    Disallow:

     

    And i use the Live Robots.txt validation tool to evaluate my Robots.txt file, the result showed like this:

    Warning: 'sitemap' - tag isn't specified.
    **************************************************

    What that mean?

    And how can i correct my robots.txt

     

     

       

Answers

  • Tuesday, January 13, 2009 6:24 PMBrett Yount Users MedalsUsers MedalsUsers MedalsUsers MedalsUsers Medals
     Answer
    Sign In to Vote
    0
    Sign In to Vote

    Hi Land,

     

    Your robots.txt is fine. That warning was referencing the fact that you do not have a sitemap location specified.

    (sitemap: http://www.example/sitemap.xml) I suggest looking at robotstxt.org or sitemaps.org for more information.

     

     

    Brett

     

       

All Replies

  • Tuesday, January 13, 2009 6:24 PMBrett Yount Users MedalsUsers MedalsUsers MedalsUsers MedalsUsers Medals
     Answer
    Sign In to Vote
    0
    Sign In to Vote

    Hi Land,

     

    Your robots.txt is fine. That warning was referencing the fact that you do not have a sitemap location specified.

    (sitemap: http://www.example/sitemap.xml) I suggest looking at robotstxt.org or sitemaps.org for more information.

     

     

    Brett