locked
MSN won't crawl my site RRS feed

  • Question

  • Hi there,

     

    I've had the website http://www.callanswering.org.uk for about 6 months now. Both google and yahoo have indexed it numerous times (we're top on yahoo for term "call answering" and just about front page for google) but I simply can't get MSN to even look at it.

     

    I've submitted it to MSN manually a number of times, have used webmaster tools to look at backlinks (which it does have and MSN webmaster tells me it has) yet still I can't get it to even acknowledge on a search that the site exists.

     

    HELP!

     

    Any suggestions anyone?

     

    Wednesday, November 12, 2008 10:57 AM

Answers

  • Hi Nicky,

     

    We base part of our crawl rate on rank and currently you are ranking very low. One thing that will help almost immediately is cannonicalizing your site so that you don't split link popularity between the www and non-www versions of your site. Most people miss the importance of using h1 and h2 tags, but I see you are covered there. You might also want to increase your relevant backlinks.

     

    Some Ideas for generating high quality inbound links include:

    1.       Start a blog – and write content that will give people a reason to link to your website

    2.       Join a reputable industry association – often times they will list their members and provide links to their websites. Examples could be a local rotary club, or a professional association like the American Medical Association.

    3.       Get involved with your community – participating with your community through blogs, forums and other online resources may give you legitimate reasons to provide links to your site.

    4.       Talk to a reporter – is there a potential story around your business? Or do you have helpful tips about your business people might be interested in? Pitch a story to a reporter or journalist, and they might give you a link.

    5.       Press Releases – if your company has a significant event, consider doing a press release through a site like http://prweb.com.

    6.       Suppliers and partners – ask your business partners if they would add a section to their website describing your partnership, with a link to your website. Or, if your suppliers have a website, perhaps they have a page where they recommend local distributers of their products.

    7.       Evangelize your site in the real world – with business cards, magnets, USB keys and other fun collectables

     

    Brett  

    Friday, November 21, 2008 8:34 PM

All replies

  • On a sidenote, when I check my backlinks on Google for my website (see above) I see that google have actually indexed this page ( http://forums.microsoft.com/webmaster/ShowPost.aspx?PostID=4116602&SiteID=79 ) already!

     

    Still no reply from MSN.

     

    BTW my robots file is:

     

    User-agent: *
    Disallow:
    Sitemap: http://callanswering.org.uk/sitemap.xml

     

    - any problems with that? Anyone?

    Thursday, November 13, 2008 12:19 PM
  •  nickywalker77 wrote:

    On a sidenote, when I check my backlinks on Google for my website (see above) I see that google have actually indexed this page ( http://forums.microsoft.com/webmaster/ShowPost.aspx?PostID=4116602&SiteID=79 ) already!

     

    Still no reply from MSN.

     

    BTW my robots file is:

     

    User-agent: *
    Disallow:
    Sitemap: http://callanswering.org.uk/sitemap.xml

     

    - any problems with that? Anyone?


    As a general note, search engines wont index sitemap.xml files. Why put that in your robots.txt file?

    Some basic SEO points:
    1. Include an html link to a sitemap.html page from the home page. This page should have html links to the top 3 level pages in your site.
    2. include a robots meta tag to follow and index the pages you want followed and indexed.
    3. In order of importance, your first three meta tags should be title, description, and keywords.

    Emo

    Affordable SEO solutions
    Sunday, November 16, 2008 11:38 PM
  • Emodx,

     

    Adding a link to the sitemap in the robots.txt file is suggested by all SEs. This gives webmasters an opportunity to list out multiple sitemap files and where to find them if they have them. It is also okay to include every URL in your domain.  Please review our blog post on the joint sitemap protocol.

     

     

    Also,

     

    You don't need robots meta tags for pages you want indexed

    You don't need a keywords meta tag as very few crawlers use them for relevancy due to abuse in the past

    Description tags are good to have, but we also take clips from the readable text as well

    A sitemap.html page is good for human visitors, but is redundant for crawlers if you have a sitemap.xml file and a link to it in your robots.txt file.

     

     

    Brett

    Friday, November 21, 2008 8:21 PM
  • Hi Nicky,

     

    We base part of our crawl rate on rank and currently you are ranking very low. One thing that will help almost immediately is cannonicalizing your site so that you don't split link popularity between the www and non-www versions of your site. Most people miss the importance of using h1 and h2 tags, but I see you are covered there. You might also want to increase your relevant backlinks.

     

    Some Ideas for generating high quality inbound links include:

    1.       Start a blog – and write content that will give people a reason to link to your website

    2.       Join a reputable industry association – often times they will list their members and provide links to their websites. Examples could be a local rotary club, or a professional association like the American Medical Association.

    3.       Get involved with your community – participating with your community through blogs, forums and other online resources may give you legitimate reasons to provide links to your site.

    4.       Talk to a reporter – is there a potential story around your business? Or do you have helpful tips about your business people might be interested in? Pitch a story to a reporter or journalist, and they might give you a link.

    5.       Press Releases – if your company has a significant event, consider doing a press release through a site like http://prweb.com.

    6.       Suppliers and partners – ask your business partners if they would add a section to their website describing your partnership, with a link to your website. Or, if your suppliers have a website, perhaps they have a page where they recommend local distributers of their products.

    7.       Evangelize your site in the real world – with business cards, magnets, USB keys and other fun collectables

     

    Brett  

    Friday, November 21, 2008 8:34 PM
  • Morning Brett,

    I've been scratching my head for the past day or so trying to work out where I’ve got links to both http://callanswering... and http://www.callanswering.. as I’ve been careful of recent to always use the www address.

    It's been right there in front of me the whole time in the robots file! I was telling the robots to go to http://callanswering... and not the www version! I'm hoping that's where the main fault lay.

    I've changed it now so hopefully this should improve things somewhat.

    Thanks for you help, I really appreciate it
    -Nicky

    Thursday, November 27, 2008 10:09 AM
  • It's been a few days. Any change?

     

    Thursday, December 18, 2008 8:44 PM
  • Hi Brett,

     

    Unfortunety no change as of yet with MSN, don't seem to be showing at all for the keywords "call answering". However, for the same keywords we are now top on Yahoo and 3rd top on Google.

     

    thanks

    -Nicky

    Friday, December 19, 2008 4:22 PM
  • Morning Brett,

    Still not showing anywhere on MSN for the keywords "call answering"

    -Nicky
    Monday, December 29, 2008 11:39 AM
  • Still nothing, is it possible to have a "black mark" against your site or something. MSN crawled the site over 2 months ago after i started posting on this forum, however, it hasn't crawled it since. Surely my site should have been crawled since 23/11/2008?
    Tuesday, January 20, 2009 9:20 PM
  • Anybody able to help?
    Thursday, January 22, 2009 11:13 AM
  • I have the same Problem, i have 19 backlinks, but Msn don't crawl my site. Yahoo, Ask and Google were no Problem. I have no idea why MSN don't crawl my site, but now im not wondering why Msn isn't the marktleader ;-).
    Thursday, January 22, 2009 12:33 PM
  • Hi Brett,
    Do you think you could wave your magic stick and get my site crawled again? It's been 3 months since its one and only visit and that only seemed to happen after i posted on this forum.

    We're still front page on Google and Yahoo (as we have been for months )for the term "call answering" and still nowhere at all on MSN.

    -Nicky
    Friday, January 23, 2009 3:27 PM
  • As suggested by Brett on the 21 Nov 2008 I have been submitting articles, press releases, forums, general link building and to date have over 100 key rich backlinks (anchor term "call answering") to my site www.callanswering.org.uk , we are consistently in the top 5 for google and top 3 for yahoo for the past 2 months but still absolutely nowhere for MSN. I know MSN is widely known as being slow but how long must I wait for at least a spider to have a single little shifty at the site again?

    Anyone?

    What if I blow some kisses your way x x x x x x x?

    Tuesday, January 27, 2009 3:58 PM
  • 4th place on Google, 3rd place on Yahoo and still nothing on the first 20 pages of MSN (i got bored of looking after that).

    Haven't been looked at by the MSN spider since mid-november 2008, there is no cannonicalization of site, have over 150 backlinks according to yahoo. Any ideas anyone???
    web design
    Tuesday, February 3, 2009 5:41 PM
  • 3rd place on google now and still no where on MSN.
    web design
    Monday, February 9, 2009 3:00 PM
  • I have the same problem here for my website http://www.leedscomputerrepairs.co.uk

    The site is number one in Google and Yahoo for various computer repairs in Leeds type searches yet I can't get MSN to crawl the website.

    Site maps are all in place, the robots file is correct and all the code on the website passes validation.

    I would suggest if there are so many people having the same problem, maybe it's more an issue with MSN?

    Google has even indexed the video content on the website via the video site map facility -

    http://video.google.co.uk/videosearch?hl=en&q=leeds%20computer%20repairs&um=1&ie=UTF-8&sa=N&tab=wv#

    Can someone at MSN please shed any light?

    Thanks,
    Dave.
    Monday, February 9, 2009 10:23 PM
  • Ditto, showing up well in Google and Yahoo, but not even being crawled by MSN. But then I've only been waiting 6 weeks!

    www.parkerseal.org.uk

    Have followed all the (often conflicting) suggestions in the webmaster.live.com help pages, but just get "Last crawled: N/A" on the site summary.

    Tuesday, February 10, 2009 9:34 AM
  • As asked above can anyone form MSN please advise us?

    Thanks,
    Dave.
    Wednesday, February 11, 2009 6:16 PM
  • www.notkenbradley.com was, for a week or two, the #1 rank for query "ken bradley" and now isn't indexed at all.

    MSN probably has accepted a deceptive removal request from the person who is the subject of the site.

    But I'd be just as willing to believe the usual MS incompetence is the problem.

    I've tried everything.  MSN Live Search simply won't index a single page.  I sent an email and was told to come here, use the webmaster tools, etc.  All done.  No result.

    Given the many others here who complain of similar madness, I'm not sure it's worth my time to pursue the matter further.

    This is the kind of thing that makes Google the dominant force in Web search.  Fortunately I can count on the vast majority of sane users to query Google.

    Well done, monopoly-boys.  Evidently you can't wrap your overrated brains around the problems of a competitive market.  Instead of just doing it right, you toss off a bunch of self-made 'standards,' intrude upon your content providers and arrogantly force them to jump thru hoops-to-nowhere.

    It's all too similar to your abuse of users via the Vista O/S.

    I presume you're hoping later on you can find a way to destroy (or buy?) Google like you did so many others who made better products.  Easier than doing the job right, eh, guys?  But your days are numbered if you go on like this.

    I'll try one more email.  I'll try to be polite, and hide my contempt.  It won't be easy.

    Wednesday, February 11, 2009 8:05 PM
  • Nope, still nowhere to be seen on MSN. Have been front page of google and Yahoo for the past 4 months for the search term "call answering" website www.callanswering.org.uk , have done everything suggested by MSN but still nothing. Anyone else had any luck?
    web design
    Tuesday, February 17, 2009 2:48 PM
  • My site isn't crawled. What i'm wondering about is, that the msn crawler doen't inspect my site so he can't know how the site looks?! i have now 32 backlinks and in google and yahoo i'm on the first place. I deliver an sitemap.xml active to live.com and nothing happens?!
    Greetings strauch
    Wednesday, February 18, 2009 2:45 PM
  • Brett,

    You last replied on the 18 December 2008 asking if there was any movement, there still isn't. Is anybody within microsoft able to answer why my site www.callanswering.org.uk continues not to be indexed by MSN for the term "call answering". I have left numerous updates over the past 3 months all stating no change.
    Can anybody at least respond please?

    web design
    Wednesday, February 25, 2009 8:35 PM
  • Still nothing and still no reply from anyone at MSN.

    Is it that MSN doesn't know the answer? If I could please have a reply at least. The most gauling part of this is that when I look at the results for "call answering" I can see websites appearing that were not in existence 5 months ago and yet they have been indexed quicker than mine!

    If you would like examples please respond. I started this thread on 12 November 2008, at which point i had already been trying for around 6 months to get MSN to look at it.
    web design
    Tuesday, March 3, 2009 1:26 PM
  • Still nothing
    web design
    Wednesday, March 4, 2009 9:35 PM
  • I don't think it is a good command order in your robots.txt.

    User-agent: *
    Disallow:
    Sitemap: http://callanswering.org.uk/sitemap.xml

    What exactly you are disallowing here?

    Possibly: Sitemap: http://callanswering.org.uk/sitemap.xml

    Maybe crawler understand your:

    Disallow:
    Sitemap: http://callanswering.org.uk/sitemap.xml


    as:

    Disallow: http://callanswering.org.uk/sitemap.xml

    If you wrote "Disallow:" write the URL of disallowed page, or don't write "Disallow:" at all.


    Try this:


    User-agent: *
    Sitemap: http://callanswering.org.uk/sitemap.xml
    Disallow: 'Here is the place for disallowed URL.

    Maybe this can help.
    Thursday, March 5, 2009 6:52 AM
  • Hi Alexander,

    Thanks for the feedback, I'm not sure if it'll make a difference as google and yahoo find it okay but then again MSN is a world unto it's own!

    I've changed it round now so fingers crossed...

    again...

    web design
    Saturday, March 7, 2009 10:42 PM
  • My site isn't crawled, too. many people have this problem. If i search for my site, I see many pages which links to my site, i have no idea why live.com don't crawl my site.
    Greetings strauch
    Wednesday, March 11, 2009 1:18 PM
  • Been crawled and indexed at last- straight in at position 1 for our main term "call answering", only took 6 months of nothing!
    web design
    Saturday, March 28, 2009 8:50 AM