Sign in
Microsoft.com
 
Microsoft
 
 
 

locked
My website has been crawled once, but never again...! RRS feed

 > 

  • Question

  • Question
    Sign in to vote
    0
    Sign in to vote
    Hi All,

    I've never had a problem with websites being crawled by Live or MSN; until now.

    Can anyone offer any insight into why a website would be initially crawled and then not?

    Sitemap - Check
    Robots - check
    Blocked status NO - check

    Please help!
    Thursday, July 10, 2008 8:59 PM

Answers

  • Question
    Sign in to vote
    0
    Sign in to vote

    Hi,

     

    You are extremely low ranked. You have a fair amount of links, but only a couple of them are medium quality, the rest are as low as you are. I would look to building higher ranked links.

     

    Monday, July 21, 2008 3:58 PM

All replies

  • Question
    Sign in to vote
    0
    Sign in to vote

    I´m not sure if this is the key to you´re problem, but try the following:

     

    Remove this from you’re sitemap.xml:

    <url>

          <loc>http://www.searchenginetraffictoday.com/default.aspx</loc>

          <priority>1</priority>

          <changefreq>weekly</changefreq>

      </url>

     

    I don’t think you want the crawlers to index you’re main page twice. Or?

     

    I get the robots.txt in the browser, but did you save the file as ANSI in notepad (save as.. ANSI) because it doesn’t seem to be picked up right.

     

    Best regards

     

    Thursday, July 17, 2008 4:12 PM
  • Question
    Sign in to vote
    0
    Sign in to vote

    Hi,

     

    You are extremely low ranked. You have a fair amount of links, but only a couple of them are medium quality, the rest are as low as you are. I would look to building higher ranked links.

     

    Monday, July 21, 2008 3:58 PM