locked
site not being crawled RRS feed

  • Question

  • Our site has been live for years but gets very little crawl traffic from MSNBOT.  I see in this forum that Brett Yount often submits sites using an internal tool.  Will you please do the same for us?  We followed the FAQ of course, and we're not blocked.

    http://www.zimbio.com/
    http://www.zimbio.com/sitemap_index.xml

    If you have any other advice, it would be great to hear.

    Thanks,
    Bruce

    Friday, February 6, 2009 10:07 PM

Answers

  • I do believe it is an index size issue then. Unfortunately, that is something I cannot fix.


    Brett
    Program Manager, Live Search Webmaster Tools
    • Marked as answer by Brett Yount Wednesday, February 25, 2009 4:56 PM
    Wednesday, February 25, 2009 4:55 PM

All replies

  • Hi Bruce,

    how long has it been since you were last crawled. I show that, although we don't have nearly as many pages as Google or Yahoo, you still have 17k+ results. It is possible that it might be an index size issue on our side, but let me know when you were last crawled and I will take a look.


    Thanks,

    Brett
    Program Manager, Live Search Webmaster Tools
    Wednesday, February 11, 2009 11:26 PM
  • Hi Brett,

    Yes, msnbot crawls us a little every day.  It's just worrying that it only crawls a few hundred pages a day rather than many thousands.

    Thanks for looking into it!
    Bruce
    Tuesday, February 17, 2009 11:40 PM
  • I do believe it is an index size issue then. Unfortunately, that is something I cannot fix.


    Brett
    Program Manager, Live Search Webmaster Tools
    • Marked as answer by Brett Yount Wednesday, February 25, 2009 4:56 PM
    Wednesday, February 25, 2009 4:55 PM
  • hi, i've the same problem, google and yahoo has benn crawled all my site (www.clubdownload.com.ar) but MSN bot dont craw anything. 
    Thursday, February 26, 2009 6:30 PM
  • my problem still, i trie to find www.club-download.com and www.club-download.com/webmal  in msn search and dont found any results
    Admin of: HTTP://www.clubdownload.com.ar & http://www.leonardosasso.com.ar MCP & Developer
    Wednesday, April 1, 2009 8:02 PM