locked
Webmaster Tools Robots.txt Validator RRS feed

  • Question

  •  

    I try to validate the current robots.txt file for site www.world.com.ru

     

    User-Agent: msnbot
    Disallow: /*.php
    Disallow: /*?
    Sitemap: http://www.world.com.ru/sitemap.xml

     


    in Webmaster Tools Robots.txt Validator and get Validation results:

     

    Line #2: Disallow: /*.php
    Warning: MSNBOT doesn't support wildcard characters.
    **************************************************
    Line #3: Disallow: /*?
    Warning: MSNBOT doesn't support wildcard characters.
    **************************************************

     

    Is MSNBOT really doesn't support wildcard characters?

    Tuesday, June 17, 2008 10:11 AM

Answers

  • MSNbot does not support wildcards. Sorry

     

    Tuesday, June 17, 2008 4:49 PM

All replies

  • MSNbot does not support wildcards. Sorry

     

    Tuesday, June 17, 2008 4:49 PM
  • So how does on exclude such things as jsessionids which tend to be on the end of urls that are already in existence in a clean form?

     

    Thanks

     

    Wednesday, July 30, 2008 4:17 PM