Site Being Indexed Even Though robots.txt Disallowing It RRS feed

  • Question

  • The robots.txt file that we're using looks like this:

    User-agent: *
    Disallow: /

    The Webmaster Tools validation says that's correct, however we're able to find our site on MSN, 16 pages of results in fact.

    Is there a way I can remove the site from being crawled and indexed??
    Tuesday, May 13, 2008 5:59 PM


  • Hi,


    could you please email me at my hotmail account which is my sign-in name (brett_yount) at hotmail.com with the domain info. also, please fill out our Live Search Site Owner support form.





    Wednesday, May 28, 2008 4:11 PM

All replies