Sign in
Microsoft.com
 
Microsoft
 
 
 
Note: Forums will be making significant UX changes to address key usability improvements surrounding search, discoverability and navigation. To learn more about these changes please visit the announcement which can be found HERE.
Microsoft >
> 
> 
> 
About the Robots.txt

Locked About the Robots.txt

  • Thursday, January 08, 2009 4:55 AM
     
     
    Sign In to Vote
    0

    Hi, I have creat my  robots.txt file like this :

     

    # Robots.txt file from http://www.dfdsolar.com
    # All robots will spider the domain
    User-agent: *
    Disallow:

     

    And i use the Live Robots.txt validation tool to evaluate my Robots.txt file, the result showed like this:

    Warning: 'sitemap' - tag isn't specified.
    **************************************************

    What that mean?

    And how can i correct my robots.txt

     

     

       

    All Replies

    • Tuesday, January 13, 2009 6:24 PM
       
       Answered
      Sign In to Vote
      0

      Hi Land,

       

      Your robots.txt is fine. That warning was referencing the fact that you do not have a sitemap location specified.

      (sitemap: http://www.example/sitemap.xml) I suggest looking at robotstxt.org or sitemaps.org for more information.

       

       

      Brett