locked
something seems wrong ! RRS feed

  • Question

  • Can someone have a look and advice at what is wrong with my site map?
    Or offer some advice ?



    Website status
    Website address: odakuzhal.com    Indexed pages: 3
    Last crawled: 2/13/2008     Blocked: No
    Domain rank:
    Top 5 pages
    Web page    Rank    Language                          Country/region                   Last crawled                Blocked    
    malayalam film songs background flute music         en    us                           2/12/2008                     No
    www.odakuzhal.com                                             zz    us                           2/13/2008                      No



    Had a tough time in getting MSN to index my site >about 4 months !

    No problems with yahoo and Google .


    Friday, February 15, 2008 3:28 AM

Answers

  •  

    >>>Now I would also submit your edited sitemap.xml through Google webmaster tools directly, not through Godaddy. http://www.google.com/webmasters/. Also to Yahoo through there webmaster tools - they call it site explorer. http://siteexplorer.search.yahoo.com/>>>

     
    DONE (.Before I got this tip ). Successful !

    Goggle webmaster tools >>Site map statistics:
    Total URLs: 25
    site map.XML Site map Web 17 hours ago 16 hours ago OK 25
    Details
    Site map type Web
    Submitted Feb 17, 2008
    Last downloaded by Goggle Feb 17, 2008
    Total URLs in Site map 25
    Indexed URLs in Site map No data available. Please check back soon.

    Site map errors and warnings
    No errors or warnings found.

     
    So that Part is Okay !
     

     

    Robots.txt Validator in Live search Webmaster Tools show>>>No problems found

    So that part seems okay !


    And in Google webmaster tools >>>

    Analyze robots.txt [?]
    odakuzhal.comrobots.txt URL
    http://odakuzhal.com/robots.txt
    Last downloaded 31 minutes ago
    Status-- 200 (Success)   [?]


    So that is also perfect !


    >>>1. robots.txt - I read somewhere that the "Site map: ...." line should be the 1st line in robots.txt, before User-agent line. Also I read that after "Sitemap: " line and before User-agent line should be one blank line (for some search engines). Some real webmaster should verify this, but that is how I did mine.>>

     

    You now know how I did mine .As you said we would both like some expert opinion

     

    2. http://www....... vs http://    (non www).

    >>Basically it is the same site, but some search engines differentiate. I researched this and many experts are strongly suggesting to permanently (301) redirect non-www site to www site - it is suppose to help ranking.
     

    May be some SEO expert can comment.>>


    Yes same with me .I had written to GO Daddy on this matter and they were not very helpful in this matter

     

    >>I have done this 301 redirect on my site hosted by Godaddy. It was not easy, since .htaccess file already exists (is hidden), so you have to download it, edit and upload. Plus there were other quirks - only notepad can save .htaccess and in ftp download you need to use ansii, not binary transfer; also after I have done it, expression web I am using could not open the site, than I found out I had to modify .htaccess in other directories. It seem to work for me, but I have done it like 3 weeks ago and I am not sure if at the end it will help or hurt. >>

     

    I am not going into it for the time being .(Whew!) Please inform if you are successful !

     

    >>Good luck.>>

     

    Thanks Marian .You are a great teacher ! .If you send me your e.mail Id I can send you some flute tunes as
    an expression of my gratitude!  (
    pillaigplkrshnn@yahoo.co.in )

     

    Regards
    pillaikgk


     

    Monday, February 18, 2008 5:12 AM

All replies

  • I've taken a look at your sitemap.xml and see a couple problems that may be causing the problem. Schema validator crashed trying to validate. There are illegal characters in the code.


    Validate your sitemap here: http://www.xml-sitemaps.com/validate-xml-sitemap.html

     

    The first thing approach is create a new sitemap.xml with another provider, such as www.xml-sitemaps.com 

     

    There are several very good sitemap generators that produce Valid XML sitemaps, which MSN has no issues with when crawling:

    I hope this has been helpful.

     

    Doc Matthias

     

     

    Friday, February 15, 2008 8:06 AM
  • Dear Doc Matthias,

    Thanks for the reply . But I have a Go daddy account and my site map was created by the facility offered by Go Daddy inside its Hosting account (along with Google webmaster Tools) .All I had to do was to click a button and a sitemap was created, and URL's were collected on its own All I had to do was to submit  it  in
    the Google webmaster tools account provided .

    And this site map works fine with Google and google webmaster tools account shows >>Sitemap errors and warnings >>>No
    errors or warnings found.

    To be frank I would not like to tamper with it  as I am afraid that Google may reject the sitemap .

    Can you tell me  if I can delete the  site map offered to MSN  rather than creating further problems ?

    Thanks 




    Friday, February 15, 2008 1:17 PM
  • odakuzhal, I encourage you to take control of your website without fear of furthering your problems.

    Your website will be crawled by Google and Yahoo whether or not your have a sitemap.  Sitemaps make it easier for engines to obtain information about your website and provides clues on what the crawlers should be looking for. The same holds true for your meta tags. Having a bad sitemap, your problems will only get worse (and not better).

     

    Having a BAD sitemap is worse than having NO sitemap.

    A bot may be prevented from crawling your site if the sitemap is in error.  With your existing sitemap, there are major errors that are bound to cause more problems in the future.  Your sitemap.xml is failing validation due to errors in the code which it was written. This will prevent robots from accurately obtaining information about your site.

     

    Can you delete a sitemap submitted to MSN?

    Good question!  To be honest, I don't know.  But I do know that you'll have more problems getting the sitemap removed from MSN, rather than fixing your existing sitemap.  Yesterday, when I reviewed your sitemap, I was able to create a new VALID sitemap in less than one minute.  Once you become familiar with the proper webmaster tools, your work will become easier and your results will be productive.

     

    Your robots.txt file

    Another thing I noticed in your existing sitemap was that your Google and Yahoo HTML meta tag files were included in your XML sitemap. Thes two files should not be part of your XML map, nor should a robots.txt file. 

     

    Doc

    Friday, February 15, 2008 9:03 PM
  • I agree with the conclusions of previous answers from Doc.

     

    My website is also hosted on Godaddy and I also used the same tools to generate sitemap as you did. Only in my case it included only valid web pages, not the undesirable ones your sitemap is showing. I could not get a clear answer about if the Google sitemap is good enough for MSN, outside of saying to study the sitemap.org specs.

     

    Unfortunately, MSN webmaster tools does not give a feedback / status of submitted sitemap as Google webmaster tools does - would be nice enhancement!!!!!!!

     

    Since I had a problem with MSN, I spent a lot of time investigating and experimenting on my own. I will try to summarize - I am not a 'webmaster', so take it with for what it is.

     

    You could clean up your sitemap in your Google webmaster tools - removing undesirable urls. But than you will be at the same point as I was in the beginning.

     

    1. I tried to validate my godaddy / google sitemap through the suggested web sites and it was failing the same way as previous answer described.  I found out that in order to pass the sitemap.org validation tools, the sitemap generated by Google did not have the statements required by such validation tools. I had to change

    "<urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">"

    to

    "<urlset
          xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"
          xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
          xsiTongue TiedchemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9
                http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">”.

     

    After that it passed.

     

    According to the sitemap.org these added statements are required only by the validation tools, not by the search engines, but who knows if MSN needs it???

     

    2. Godaddy / Google tools produced only sitemap.xml.gz file - I see that you extracted on your own also sitemap.xml file. In theory MSN is OK with the .gz file, but I switched in robots.txt to sitemap.xml and also switched submission to MSN to sitemap.xml. It could be coincidence, but now MSN is visiting and indexing and using the sitemap. It did not happen over night, took a few weeks.

     

    3. At this point I am using sitemap generator from www.xml-sitemaps.com  and stopped using the sitemap generator from Godaddy / Google. It produces not only sitemap.xml.gz, but also sitemap.xml, .html … . And it produces the full urlset needed for validation and Google and Yahoo have no problem with it too and MSN uses it also OK. As I said before all of this could be just a coincidence, but it worked for me.

     

    Hope this helps.

    Good luck.

    Saturday, February 16, 2008 5:15 AM
  • No reason to remove it, fix it is the answer. Then resubmit it. Yes there is a site map that is approved by all search engines, but will require some work on your part. Start off with a xml blank page, name it sitemap. Copy and paste this format on that page.

    <?xml version="1.0" encoding="UTF-8"?>
    <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">

    <url>
    <loc>http://www.yourdomainname.com/</loc>
    <lastmod>2007-10-26</lastmod>
    <changefreq>weekly</changefreq>
    <priority>1.0</priority>
    </url>
    <url>
    <loc>http://www.yourdomainname.com/page_1</loc>
    <lastmod>2007-10-26</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.5</priority>
    </url>
    <url>
    <loc>http://www.yourdomainname.com/page_2</loc>
    <lastmod>2007-10-26</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.5</priority>
    </url>

    </urlset>

    _________________________________________________________________________________

    This part do not change

    <?xml version="1.0" encoding="UTF-8"?>
    <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">



    This first url remove yourdomainname and in place of it put in your home page address (if your site is Doc Matthias then it should look like <loc>http://www.DocMatthias.com/</loc>)

    <url>
    <loc>http://www.yourdomainname.com/</loc>
    <lastmod>2007-10-26</lastmod>
    <changefreq>weekly</changefreq>
    <priority>1.0</priority>
    </url>

    Have a url for every page that is not listed in your robots.txt file (pages that you do not want craweled) again remove the
    yourdomainname.com/page_1 and put in place of it the page name. You will need one for each page.
    <url>
    <loc>http://www.yourdomainname.com/page_1</loc>
    <lastmod>2007-10-26</lastmod>
    <changefreq>weekly</changefreq>
    <priority>0.5</priority>
    </url>
    <url>
    <loc>http://www.yourdomainname.com/page_2</loc>
    <lastmod>2007-10-26</lastmod>

    This tells the search engine how offten the page contents are changed.
    <changefreq>weekly</changefreq>

    This tells the search engine the priority of the page 1 being very inportant 0 being who cares
    <priority>0.5</priority>

    Make sure you have your closing at the bottom part for each page
    </url>


    Close the page with
    </urlset>



    Upload and your all set, taken by all and you control what pages are crawled. Then resubmit.

    Here is one of my site maps http://www.truckerservicesus.com/sitemap.xml
    the <?xml version="1.0" encoding="UTF-8"?>
    <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9">
    does not show but it is there. I also use go daddy for web service but just for the web service I use my own tools.
    Saturday, February 16, 2008 6:49 AM
  • Dear Marian,

     

    >>.My website is also hosted on Godaddy >>

    That is a great relief ! I may have a few questions for you in the future .Please bear with me .

     

     

    >>Only in my case it included only valid web pages, not the undesirable ones your sitemap is showing. >>

     

    I dont know what you mean by "Undesirable ones " .Can you give an example ?  

     

     

    >>Unfortunately, MSN webmaster tools does not give a feedback / status of submitted sitemap as Google webmaster tools does - would be nice enhancement!!!!!!!>>

     

    Bill Gates is not an ordinary mortal . If he was they would have !

     

    Frankly doing all this ia a tall order for a poor musician !

     

    Can anybody tell me how I can delete the sitemap submitted to MSN ? Doc seems to have no idea !

     

    I would be quite happy with MSN just indexing my home page .

     

    Just want to get out of this mess . But as you know I have to delete the sitemap submitted  to MSN or else I am in trouble later on !

     

    Thanks

    pillaikgk

    Saturday, February 16, 2008 12:13 PM
  • Dear irmcspeedy ,

     

    I am overwhelmed by your support !

     

    Please refer to my question to Marrian >>> Can somebody tell me how to delete the sitemap I have submitted in MSN ?

    Would like to quit !

     

    Thanks . 

    Saturday, February 16, 2008 12:18 PM
  • Looking at your sitemap, what I meant "the undesirable ones" urls, most likely are:

     

    odakuzhal.com/?page=edit&amp;key=f8e3e6b5275caf4642129510034cd61a

    odakuzhal.com/?page=edit&amp;key=18399ea85525b1c23f1cb0fa3fe8689a

    odakuzhal.com/?page=edit&amp;key=1746cb39273e91e4da84b2716c0f6625

    odakuzhal.com/google9899d577edf45d43.html

    odakuzhal.com/robots.txt

    odakuzhal.com/?page=delete&amp;name=Prabhanjan&amp;key=830c594cf4c91ca5816ee384e762445e

    odakuzhal.com/odakuzhal

     

    And there are a few more like that.

     

    As Doc suggested, you should go to the www.xml-sitemaps.com site and type in your URL. It should generate clean sitemap for you and will replace your current one on your site.

     

    As far as deleting sitemap submitted to MSN. What you submitted is just a pointer to sitemap on your site. It does not appear that when you submit your sitemap, they immediately retrieve your sitemap and use the information inside it later.

    There is no such thing as deleting sitemap from webmaster tools. After you have a new and good sitemap, just resubmit it.

     

    After that it may take some time, before msnbot will visit your site and look at your sitemap.

     

    Saturday, February 16, 2008 3:22 PM
  • Sorry made a mistake (just remembered how I did it). The www.xml-sitemaps.com 

    will create the sitemaps and you save it on your pc. Than you need to upload it to your site on Godaddy. By the way in the godaddy control panel under content is a ftp utility making upload easy - you are most likely aware of.

    Saturday, February 16, 2008 3:35 PM
  • Dear Marian .P.,

     

    I have done a rethink .With so many of you well wishers out there and the overwhelming  support you are giving me I feel bad with the decision to let go ! .

     

    I have a site map created by www.xml-sitemaps.com   appended below .The XML Validation Results show>>

    Schema validating with XSV 3.1-1 of 2007/12/11 16:20:05

    • Target: http://www.xml-sitemaps.com/download/www.odakuzhal.com/sitemap.xml
         (Real name: http://www.xml-sitemaps.com/download/www.odakuzhal.com/sitemap.xml
          Length: 434 bytes
          Server: Apache/2.2.6 (Unix) mod_ssl/2.2.6 OpenSSL/0.9.8b mod_auth_passthrough/2.1 mod_bwlimited/1.4 PHP/5.2.5)
    • docElt: {http://www.sitemaps.org/schemas/sitemap/0.9}urlset
    • Validation was strict, starting with type [Anonymous]
    • schemaLocs: http://www.sitemaps.org/schemas/sitemap/0.9 -> http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd
    • The schema(s) used for schema-validation had no errors
    • No schema-validity problems were found in the target

    Schema resources involved

    Attempt to load a schema document from http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd (source: schemaLoc) for http://www.sitemaps.org/schemas/sitemap/0.9, succeeded


     

    So that part looks okay .

     

    <?xml version="1.0" encoding="UTF-8" ?>
    - <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsiTongue TiedchemaLocation="http://www.sitemaps.org/schemas/sitemap/0.9 http://www.sitemaps.org/schemas/sitemap/0.9/sitemap.xsd">
    - <url>
      <loc>http://www.odakuzhal.com/</loc>
      <priority>0.5</priority>
      <changefreq>daily</changefreq>
      </url>
      </urlset>
     
    Now I am going to download the Download un-compressed XML Sitemap and save it to my hard drive as>>File name>>>sitemap>>Save as type XML Document
     
    Then I am going to the Go Daddy Account >>Content >.sitemaps >>Delete.
    Then Upload the new sitemap via FTP client ( Know how to do it /No problem )
    Then go to Google webmaster Tools (in the Go daddy Account ) and then >>delete  sitemap.xml.gz(present one )
    and submit the new one .
     
    Then go to Live search webmaster central and update the sitemap . 
     
    Now I have some haunting (maybe  foolish questions )
     
    (1) Is the file name >>sitemap ? or is it sitemap.xml?
     
    (2) Will all my pages be indexed with this sitemap?(would like that )
     
    Please advise and I plan to get it done .
     
    An Immensely grateful
    Pillaikgk
     
     
     
     
     
    Saturday, February 16, 2008 4:05 PM
  • POST SCRIPT

     

    This is my Robots.txt

     

     

    # robots.txt generated at http://www.mcanerin.com
    User-agent: *
    Disallow:

    ????????????? (what should come here ? I mean after Disallow?)

     


    I find that the site map file will be named XML Document (93 Bytes ) .So that is the file I will have to upload  to the Go Daddy account via FTP .

     

    Once the XML file is uploaded then I have to go to Site  summary for - www.odakuzhal.com (in Live search webmaster Tools) >>Sitemap>> sitemap web address >>www.odakuzhal.com/Xml ?

     

    What is the correct name of the file www.odakuzhal.com.xml?????????

     

     

    Saturday, February 16, 2008 4:20 PM
  • Sounds like a good plan. I would modify it as follows:

     

    I do not believe you can submit through Godaddy - Google web master tools your own sitemap, not generated there. I submitted to Google and Yahoo my sitemap via the ping in Internat explorer and I did not worry about the sitemap in the godaddy / google webmaster tools. You can search internet for correct ping url for google and yahoo for sitemap submission. Or join webmaster tools outside of godaddy.

    But before I would submit it, I would review the URLs generated. I noticed that there are some Urls generated even by this tools, which you may want to delete. It did get rid of the really bad ones like robots.txt, ..., but it did generate also the ?page=edit.... and ?page=delete... ones. I do not know enough, but I do not like them. I am not sure if you use expression web or front page or not, but if you do you can open the sitemap.xml file and edit it and save it to have there only pages you really want indexed.

    1. the file name is sitemap.xml

    2. the sitemap seem to have all pages, most likely too many (see above). that does not mean all pages will be indexed. in case of msn, the msnbot seem to pick up some each times it crawles and decides which to index and which to not index. it seem to take a loong time.

     

    Saturday, February 16, 2008 4:40 PM
  • Your robots.txt should look like:

    Sitemap: http://www.odakuzhal.com/sitemap.xml
    
    User-agent: *
    Disallow:
    The #robots.txt generated at .... is a comment line.
    If you want to restrict robots to crawl some of your pages, there is a way to do it, but someone else should answer that. I would have to look it up.
    The correct address for you sitemap should be html://www.odakuzhal.com/sitemap.xml
    Saturday, February 16, 2008 4:54 PM
  • Okay Marian ! .The facts are crystal clear . My site was not accessible today via search words . I deleted the site from Live webmaster and added it again back (leaving the sitemap column blank)  And Lo it was back and now one can access it through search words like >>>malayalam flute,malayalam film songs flute,etc>>>And the Home page is is fully Cached .

     

    So I think I will wait for a while and see what happens . ( I very well know that the matter is far from over )

     

    Once I am desperate then I shall  do it (thanks to you ) as I have almost all the material to do it .

     

    I shall also delete some of the unnecessary files in my site map in the meantime .

     

    Time is 12.45 here in India (yawn) .

     

    Have a good day (presuming that you are from the other end of the planet )

     

    Thanks for time you have spent on this .

     

    regards

    pillaikgk  

    Saturday, February 16, 2008 5:34 PM
  • Dear Friends,

     

    I have created a new site map from www.xml-sitemaps.com  edited it with Liquid Xml Studio http://www.liquid-technologies.com/ and Validated my  sitemap at>> http://www.xml-sitemaps.com/validate-xml-sitemap.html.There was no problem with the Validation .

     

    However, my Web Site URL is : http://odakuzhal.com and I have created a sitemap for it and NOT http://www.odakuzhal.com AND my Web address in LIve search webmaster Tools  is www.odakuzhal.com and not http://odakuzhal.com .

     

     

    My site map web address re-submitted to Live search webmaster Tools is>>www.odakuzhal.com/sitemap.xml

    My Robots .text is>>>

    # robots.txt generated at http://www.mcanerin.com
    User-agent: *
    Disallow:
    Sitemap: http://www.odakuzhal.com/sitemap.xml

     

    I dont know if I have done every thing correctly as per the instructions of the welwishers in this forum.

     

    Please advice if there is something wrong .

     

    Thanks

    pillaikgk  

     

    Sunday, February 17, 2008 2:18 PM
  • Good!

     

    Now I would also submit your edited sitemap.xml through Google webmaster tools directly, not through Godaddy. http://www.google.com/webmasters/. Also to Yahoo through there webmaster tools - they call it site explorer. http://siteexplorer.search.yahoo.com/

     

    Comments:

     

    1. robots.txt - I read somewhere that the "Sitemap: ...." line should be the 1st line in robots.txt, before User-agent line. Also I read that after "Sitemap: " line and before User-agent line should be one blank line (for some search engines). Some real webmaster should verify this, but that is how I did mine.

     

    2. http://www....... vs http://    (non www).

    Basically it is the same site, but some search engines differentiate. I researched this and many experts are strongly suggesting to permanently (301) redirect non-www site to www site - it is suppose to help ranking.

     

    May be some SEO expert can comment.

     

    I have done this 301 redirect on my site hosted by Godaddy. It was not easy, since .htaccess file already exists (is hidden), so you have to download it, edit and upload. Plus there were other quirks - only notepad can save .htaccess and in ftp download you need to use ansii, not binary transfer; also after I have done it, expression web I am using could not open the site, than I found out I had to modify .htaccess in other directories. It seem to work for me, but I have done it like 3 weeks ago and I am not sure if at the end it will help or hurt.

     

    Good luck.

    Sunday, February 17, 2008 3:50 PM
  •  

    >>>Now I would also submit your edited sitemap.xml through Google webmaster tools directly, not through Godaddy. http://www.google.com/webmasters/. Also to Yahoo through there webmaster tools - they call it site explorer. http://siteexplorer.search.yahoo.com/>>>

     
    DONE (.Before I got this tip ). Successful !

    Goggle webmaster tools >>Site map statistics:
    Total URLs: 25
    site map.XML Site map Web 17 hours ago 16 hours ago OK 25
    Details
    Site map type Web
    Submitted Feb 17, 2008
    Last downloaded by Goggle Feb 17, 2008
    Total URLs in Site map 25
    Indexed URLs in Site map No data available. Please check back soon.

    Site map errors and warnings
    No errors or warnings found.

     
    So that Part is Okay !
     

     

    Robots.txt Validator in Live search Webmaster Tools show>>>No problems found

    So that part seems okay !


    And in Google webmaster tools >>>

    Analyze robots.txt [?]
    odakuzhal.comrobots.txt URL
    http://odakuzhal.com/robots.txt
    Last downloaded 31 minutes ago
    Status-- 200 (Success)   [?]


    So that is also perfect !


    >>>1. robots.txt - I read somewhere that the "Site map: ...." line should be the 1st line in robots.txt, before User-agent line. Also I read that after "Sitemap: " line and before User-agent line should be one blank line (for some search engines). Some real webmaster should verify this, but that is how I did mine.>>

     

    You now know how I did mine .As you said we would both like some expert opinion

     

    2. http://www....... vs http://    (non www).

    >>Basically it is the same site, but some search engines differentiate. I researched this and many experts are strongly suggesting to permanently (301) redirect non-www site to www site - it is suppose to help ranking.
     

    May be some SEO expert can comment.>>


    Yes same with me .I had written to GO Daddy on this matter and they were not very helpful in this matter

     

    >>I have done this 301 redirect on my site hosted by Godaddy. It was not easy, since .htaccess file already exists (is hidden), so you have to download it, edit and upload. Plus there were other quirks - only notepad can save .htaccess and in ftp download you need to use ansii, not binary transfer; also after I have done it, expression web I am using could not open the site, than I found out I had to modify .htaccess in other directories. It seem to work for me, but I have done it like 3 weeks ago and I am not sure if at the end it will help or hurt. >>

     

    I am not going into it for the time being .(Whew!) Please inform if you are successful !

     

    >>Good luck.>>

     

    Thanks Marian .You are a great teacher ! .If you send me your e.mail Id I can send you some flute tunes as
    an expression of my gratitude!  (
    pillaigplkrshnn@yahoo.co.in )

     

    Regards
    pillaikgk


     

    Monday, February 18, 2008 5:12 AM
  • So from what I get from all this is that the sitemaps have for Google are not going to work with MSN?

    Tuesday, February 19, 2008 10:15 PM
  • No, it does not mean that!!!!

     

    This was specific to only ONE sitemap created by Godaddy tools, which included also robots.txt, ...... . Also, Godaddy tools do not add stuff to the sitemap required by sitemap validation tools, which according to the sitemap org. is not needed by search engines - only for validation tools.

     

    Also some sitemap generators are including urls which do not seem to be accessible pages. Like in your case http://maguireclan.net/Joomla/component/option,com_awesom/Itemid,46/task,viewlist/listid,14/

    and others, which gives a fatal error in internet explorer. Someone should comment if such urls should be in sitemap or if they should be edited out. If it would be me, I would at least remove from your sitemap all the joomla urls. But, some real web master should comment. I am just a pool guy.

     

    Wednesday, February 20, 2008 1:47 AM
  •  

    After all the trouble my site http://www.odakuzhal.com  was properly indexed and cached . and it was possible for someone tofind the site using  search words like "malayalam flute " film song flute " etc . Well , there was no problem for a couple of months till MSN again cached my site on 05/04/2008 . Now my site is no longer showing up with search words !

     

     

    I have not changed anything and can some one be kind enough to take a look and advise ?

     

    Thanks

    pillai kgk

     

    Thursday, April 10, 2008 12:09 PM
  • Hi all I am facing this problem while validation my robots.txt in MSN webmaster Message appear as

    First my Robbots.txt is

    # Alexa
    User-agent: ia_archiver
    Disallow:

    # Ask Jeeves
    User-agent: Teoma
    Disallow:

    # Google
    User-agent: googlebot
    Disallow:

    # MSN
    User-agent: msnbot
    Disallow:

    # Yahoo!
    User-agent: Slurp
    Disallow:

    # Abacho
    User-agent: AbachoBOT
    Disallow:

    # Baidu
    User-agent: baiduspider
    Disallow:

    # Fireball
    User-agent: fireball
    Disallow:

    # ObjectsSearch
    User-agent: ObjectsSearch
    Disallow:

    # Szukacz
    User-agent: szukacz
    Disallow:

    # Voila.fr
    User-agent: VoilaBot
    Disallow:

    # Walhello
    User-agent: Appie
    Disallow:

    # Yandex
    User-agent: Yandex
    Disallow:

    # Others
    User-agent: *
    Disallow:

    Validations Results:

    Line #55: Disallow:
    Error: Conflicting disallow tags found.
    **************************************************
    Warning: 'sitemap' - tag isn't specified.
    **************************************************

    Could you please tell me how to solve it.I will be very thankful to you all.
    Monday, June 23, 2008 11:59 AM