locked
Robots.txt File text that matters most Please Help RRS feed

  • Question

  •  

    I have put up Google adds on my site,I have the problem that is explained hereunder in detail,Please some Guide me How it can be solved.The detail is as under:

     

    Dear Sir,

    In adSense Site Diagnostics I found an error as Blocked URL and
    further going deep I noticed to add
    User-agent:
    Mediapartners-Google*
    Disallow:

     

    This is entered in to top of my robots.txt  file
    And now file looks like this as under

    User-agent:
    Mediapartners-Google*
    Disallow:

    User-agent: *
    Disallow:

    Sitemap: http://www.sikandarmachines.com/sitemap.xml

    This I have checked in robots.txt  validate programme in MSN and it
    gave an error read as under
    Line #1: User-agent:
    Error: Blank Tag
    **************************************************

    Now I do not know what is this error type,will it effect other bots
    to
    crawl and if I tested the file by adding *  over user-agent as

    user-agent*
    Mediapartners-Google*
    Disallow:

    User-agent: *
    Disallow:

    Sitemap: http://www.sikandarmachines.com/sitemap.xml
     and tested again for validity again,the message read as

    Line #2: Mediapartners-Google*
    Warning: MSNBOT doesn't support this tag.
    **************************************************

    Now let me know what should I write in robots.txt file without
    effecting any bot also allowing  Mediapartners-Google

    Regards
    Rajinder Singh Dhanjal

     
    Friday, March 7, 2008 12:53 PM

Answers

  • The asterisks following google on the second line should be removed and placed in the first line.

     

    Wednesday, May 28, 2008 3:46 PM