Site not crawled RRS feed

  • Question

  • Can someone show an example of the correct robots.txt and sitexml.xml for live? My site (desitools.com) has been around for more than three years, google and yahoo have both indexed almost all the pages, however live shows it has indexed just four pages. I submitted the site using webmaster tools back in Feb/Mar.. but still no change in the number of pages indexed. My site has never appeared on live search engine results, so trying desperately to get at least the main page.

    Any help is really appreciated.

    Friday, April 25, 2008 12:35 AM