locked
MSNBOT and WebMaster Tools RRS feed

  • Question

  • Congratulations on the webmaster tools thingy, I hope live search will get some more share of the SE searches market. But, let's get to the nitty gritty.

    I noticed that MSNBOT does a pretty well job of indexing my site, but in the webmaster tools it show: 3 pages indexed only! What does it do with the rest of the indexed pages? Smile

    Here's a copy/past from one of bot's visits:

    /robots.txt
        Http Code: 200     Date: Feb 11 07:49:40     Http Version: HTTP/1.1     Size in Bytes: 127
        Referer: -
        Agent: msnbot/1.1 (+http://search.msn.com/msnbot.htm)
       
    /index.htm
        Http Code: 200     Date: Feb 11 07:49:41     Http Version: HTTP/1.1     Size in Bytes: 11436
        Referer: -
        Agent: msnbot/1.1 (+http://search.msn.com/msnbot.htm)
       
    /hosting_article11.htm
        Http Code: 200     Date: Feb 11 10:14:25     Http Version: HTTP/1.1     Size in Bytes: 13035
        Referer: -
        Agent: msnbot/1.1 (+http://search.msn.com/msnbot.htm)
       
    /hosting_article34.htm
        Http Code: 200     Date: Feb 11 11:06:16     Http Version: HTTP/1.1     Size in Bytes: 14571
        Referer: -
        Agent: msnbot/1.1 (+http://search.msn.com/msnbot.htm)
       
    /hosting_article23.htm
        Http Code: 200     Date: Feb 11 11:06:18     Http Version: HTTP/1.1     Size in Bytes: 9701
        Referer: -
        Agent: msnbot/1.1 (+http://search.msn.com/msnbot.htm)


    As you can see, only in this visit, the bot indexed more than 3 pages ...
    Monday, February 11, 2008 9:27 PM

Answers

All replies

  • I would first try all the basic stuff, such as:

    • Create a new XML sitemap and verify it.
    • Verify your robots.txt file
    • Ping Live.com and notify of the new sitemap

    You can ping Live.com with the following URL example:

    http://webmaster.live.com/ping.aspx?siteMap=http://www.YourDomainName.com/sitemap.xml

     

    In a few days, check your pages indexed in Webmaster Tools.

     

    Doc Matthias

    Friday, February 15, 2008 9:13 AM
  • Done, done and ... done. The sitemap was the first thing I did, well maybe the second ... the first was signing for webmaster tools Smile

    Anyway, seems the links are crawled now because it shows: Indexed pages: 77

    Thing is that I only have 49 pages on my website. Also with a link popularity tool, 80% of my incoming links are from adsense ads. Didn't they fix that?
    Saturday, February 16, 2008 4:30 AM