locked
http://www.mirc-il.com/ - mIRC & Scripting Official Hebrew Site RRS feed

  • Question

  • I own the site http://www.mirc-il.com/, and I have used the tool of liveserach, but it keeps telling me that the MSN bot has crawled only 1 page of the site.

    Is it even possible to crawl only 1 page? how come? and what should I do in order to make it crawl my whole site?

    thanks for your support.

    Monday, July 28, 2008 5:28 PM

Answers

  • I highly suggest searching for a sitemap generator tool which will create an xml sitemap for you and then adding the path to that sitemap to your robots.txt file which would look something like:

     

    http://www.mirc.il.com/sitemap.xml

     

     

     

    Friday, August 8, 2008 10:30 PM

All replies

  •  mIRC.iL.com wrote:

    I own the site http://www.mirc-il.com/, and I have used the tool of liveserach, but it keeps telling me that the MSN bot has crawled only 1 page of the site.

    Is it even possible to crawl only 1 page? how come? and what should I do in order to make it crawl my whole site?

    thanks for your support.

    and by the way, what else can I do with the livesearch tool?

    Monday, July 28, 2008 5:30 PM
  • Hi,

     

    We do have only one page indexed: mirc-il.com/portal.php. One problem I noticed is that you have not canonicalized your domain. I can get to both www and non-www versions which is splitting your link juice and lowering your PR. Increasing your PR will help your chances of getting more pages in the index. 

     

    Brett
    Tuesday, July 29, 2008 6:14 PM
  •  Brett Yount wrote:

    Hi,

     

    We do have only one page indexed: mirc-il.com/portal.php. One problem I noticed is that you have not canonicalized your domain. I can get to both www and non-www versions which is splitting your link juice and lowering your PR. Increasing your PR will help your chances of getting more pages in the index. 

     

    Brett

    Thanks so much for the observation, but im afraid i do not know how to cancel the option of the non-www version...

    can you guid me?

    and more - how do i make the bot crawl the site and not just that one page?

    Wednesday, July 30, 2008 5:09 PM
  • You have to set up a .htaccess file.

     

    Do some search for ".htaccess+domain.com+www.domain.com" or ask in one of many forums for php that´s out there..

     

    Best regards.

     

    Thursday, July 31, 2008 8:31 PM
  • we did it Smile

    if youll try to enter the site through http://mirc-il.com it will direct you to http://www.mirc-il.com/ 

    now that we've done, how do we make the bot crawl more pages of the site?

    and what else can i do to improve the sire pagerank?

    thanks very much!

    Friday, August 1, 2008 1:09 PM
  • It´s hard to help you, I don’t understand *** of the language, hehehe..

    Try to read some of the guidelines you find here. Get some good links inn to your website, and do some research for SEO. There is nobody that’s gonna give you the SEO part just like that, you have to pay for it or learn about it yourself. The key to make it rank even better is out there, you just have to do the right (live)search..

    Best regard.

     

    Friday, August 1, 2008 6:16 PM
  • well..  sorry about the lingo, its Hebrew Stick out tongue

    referring sites sent 658 visits to my sites via 41 sources, and im using SEO system...

    and i still have that same question - why does the bot crawled only 1 page?

    thnak you again!

    Friday, August 1, 2008 8:44 PM
  • hmm I even added a site map at this address http://www.mirc-il.com/sitemap.php

    but it still crawl just the portal page.

    can you please tell me what to do?

    Friday, August 8, 2008 7:41 PM
  • I highly suggest searching for a sitemap generator tool which will create an xml sitemap for you and then adding the path to that sitemap to your robots.txt file which would look something like:

     

    http://www.mirc.il.com/sitemap.xml

     

     

     

    Friday, August 8, 2008 10:30 PM
  •  Brett Yount wrote:

    I highly suggest searching for a sitemap generator tool which will create an xml sitemap for you and then adding the path to that sitemap to your robots.txt file which would look something like:

     

    http://www.mirc.il.com/sitemap.xml

     

    thank you.

    I'll try it and i will let you guys know Smile

    Saturday, August 9, 2008 11:08 AM
  • well, I have listened to your advice and i created a site map with xml extension all by my self.

    here's the link - http://www.mirc-il.com/sitemap.xml

    more than that, i wrote on robots.txt file to msnbot to crawl my sitemap before the whole site.

    the only problem is - the bot crawled the site a month ago and never came back since.

    Ive subbmited the sitemap a few times, but nothing...

    any suggestions?

    Friday, August 22, 2008 3:44 PM
  • bumpy bump

    any1?

     

    Monday, August 25, 2008 6:48 PM