locked
Be able to request a 'crawl' of a verified site. RRS feed

  • Question

  •  

    A feature I would like to see is to be able to request a 'crawl' of a verified site in your site list if it never been crawled or haven't been crawled in a certain time span.
    Tuesday, August 12, 2008 12:08 AM

Answers

  • @ODC Hostmaster - thank you for your feedback. While we cannot provide any deeper or more freqent crawling of a site simply because they are using our webmaster tools, there may be some scenrario where we'll be able to provide you with the ability request an initial crawl of your site, or a re-evaluation of specific URLs in your site if you have addressed a quality issue that caused your site to be blocked.

    Monday, August 18, 2008 7:07 PM

All replies

  • @ODC Hostmaster - thank you for your feedback. While we cannot provide any deeper or more freqent crawling of a site simply because they are using our webmaster tools, there may be some scenrario where we'll be able to provide you with the ability request an initial crawl of your site, or a re-evaluation of specific URLs in your site if you have addressed a quality issue that caused your site to be blocked.

    Monday, August 18, 2008 7:07 PM
  •  

    Nathan Buggia - Microsoft: "There may be some scenario where we'll be able to provide you with the ability request an initial crawl of your site"
     
    That is what I was basically asking about. Even if it is just a link to where you can submit a site to the MSN search engine crawl queue like the other search engines do.
     
    As for the "re-evaluation of specific URLs in your site if you have addressed a quality issue that caused your site to be blocked", maybe having a 'status' indicator or email alert of when there is a 'quality issue' with your site/domain and it actually tells you what the problem is, then we would be able to effectively deal with it. As it is now, I have no idea if the MSN bot/spider has a problem with my site or if it just hasn't figured out that it even exists yet?
     
    Which brings me to the original request.
     
    Oops, sorry, OK the summary page does provide such information (blocked, score, etc.) if your web actually gets spidered... as it is my stats still are all at N/A and 'No data is available' So really we are back were we started, how do we get the MSN bot/spider to crawl our site?
     
    PS - The alert idea still stands if there is a bad thing going on at your site and your idea about letting the MSN bot/spider know when it is fixed. Perhaps a better idea is a separate test bot/spider that we can send to our site, before the real one gets there or after we make changes. Of course it won't index our site however it could give us an idea of how our pages would rank and/or it could tell us if there is a problem that needs attention. If we did take this idea further and the test bot/spider did index your site and output the results to an XML file that you can download, it could become a real good tool to make a site map page for the real MSN bot/spider.
    Monday, August 18, 2008 10:42 PM
  • Okay,that's helpful, thank you for the clarification.

     

    We do have a tool you can use to request an initial crawl of your website, you can try it here: http://search.msn.com/docs/submit.aspx

    Saturday, October 11, 2008 2:10 AM