No announcements
Found 9204 threads
-
0 VotesRobots.txt ignored by msnbot/2.0b
btw we recently changed robots.txt, the version used for the paste few months uptil 13th May is ...Unanswered | 1 Replies | 7049 Views | Created by barryhunter - Saturday, May 16, 2009 4:52 PM | Last reply by barryhunter - Saturday, May 16, 2009 5:09 PM
-
2 Votes
msnbot is using MY robots.txt to crawl YOUR site
For some reason, msnbot/2.0b is visiting the wrong IP addresses to retrieve robots.txt.Answered | 2 Replies | 18230 Views | Created by bmpub - Saturday, April 11, 2009 4:17 PM | Last reply by Brett Yount - Wednesday, April 15, 2009 5:21 PM -
0 Votes
Why is MSNBOT ignoring our robots.txt
Hi, If you call out a bot, it will ignore the * section, so you have to specify all paths you want disallowed.Answered | 1 Replies | 4300 Views | Created by SteveC99 - Tuesday, August 5, 2008 12:14 PM | Last reply by Brett Yount - Monday, August 25, 2008 8:13 PM -
0 Votes
Need MSNbot to follow the robots.txt
robots.txt contains something like # go away ?Answered | 1 Replies | 5273 Views | Created by Jim3ELS - Thursday, May 7, 2009 2:35 PM | Last reply by Brett Yount - Thursday, May 7, 2009 5:07 PM -
0 Votes
msnbot ignoring my robots.txt
Hi Aukuma, could you please send the URLs to lswmc@microsoft.com and I will look into why we disregarded your robots.txt.Answered | 1 Replies | 4777 Views | Created by aukuma - Monday, December 1, 2008 2:48 AM | Last reply by Brett Yount - Wednesday, December 3, 2008 6:33 PM -
0 Votes
MSNbot only crawling robots.txt
Made any changes to your robots.txt file (http and/or https)?Answered | 1 Replies | 4799 Views | Created by homberger - Wednesday, April 1, 2009 3:38 PM | Last reply by Brett Yount - Wednesday, April 8, 2009 9:25 PM -
1 Votes
MSN Bot ignoring robots.txt?
My site isn't blocked so I'm not sure what we've done to upset the msnbot, first it decided to index pages it should have ignored now it's decided to index nothing at all.Answered | 5 Replies | 6627 Views | Created by The Feed Station - Friday, March 20, 2009 7:30 PM | Last reply by Brett Yount - Wednesday, May 6, 2009 3:58 PM -
0 Votes
MSNBOT appears to be case sensitive when reading robots.txt
Does anyone have any suggestions about how to resolve the issue I am having, where MSNBOT appears to ignore my robots.txt?Answered | 10 Replies | 7098 Views | Created by SteveC99 - Thursday, July 3, 2008 12:38 PM | Last reply by Brett Yount - Monday, August 25, 2008 8:21 PM -
0 Votes
MSNBot Not Hitting Robots.txt
None of the sitemaps have been hit by MSNBot.Answered | 9 Replies | 6112 Views | Created by Altnet_00 - Tuesday, December 9, 2008 9:10 AM | Last reply by Brett Yount - Tuesday, February 24, 2009 5:44 PM -
0 Votes
MSNBot ignores nofollow/robots
Something is bonkers with the bot, 2008-03-10 01:39:26 mysite GET /robots.txt - 80 - 65.55.104.29 HTTP/1.1 ...Answered | 4 Replies | 4425 Views | Created by PromoManagers.com - Thursday, March 6, 2008 1:30 AM | Last reply by PromoManagers.com - Wednesday, March 12, 2008 3:43 AM -
0 Votes
Error in Robots.txt Validator
Just ignore the message and wait for the bug to be fix and validate again ?Answered | 3 Replies | 4640 Views | Created by jwolthuis - Wednesday, November 21, 2007 12:45 AM | Last reply by free-survey - Wednesday, December 5, 2007 5:17 PM -
0 Votes
robots.txt file
That was the problem, the site map information doesn't go into placing it on the robots.txt file.Answered | 2 Replies | 4307 Views | Created by lrmcspeedy - Saturday, January 12, 2008 7:36 AM | Last reply by lrmcspeedy - Friday, January 18, 2008 3:06 AM -
0 Votes
Webmaster Tools Robots.txt Validator
MSNbot does not support wildcards.Answered | 2 Replies | 4546 Views | Created by World Web Directory - Tuesday, June 17, 2008 10:11 AM | Last reply by Jdebosdari - Wednesday, July 30, 2008 4:17 PM -
0 Votes
msnbot ignores meta robots tag?
Therefore I advise people to use robots.txt and not rely on meta tags.Answered | 1 Replies | 4187 Views | Created by mameha - Wednesday, February 20, 2008 12:58 AM | Last reply by Brett Yount - Tuesday, October 14, 2008 1:40 PM -
0 Votes
What happens to MSNBot?
to all those who have problems in the indexing of your site, review their log files, on visits by the MSNBot, in the bytes that send to ...Answered | 6 Replies | 4879 Views | Created by Juso - Wednesday, October 1, 2008 12:14 AM | Last reply by Brett Yount - Monday, November 17, 2008 5:27 PM -
0 Votes
msnbot bombarding my site
Over the past several weeks on of my sites has been periodically bombarded by msnbot.Answered | 1 Replies | 4084 Views | Created by Halden-VB - Wednesday, February 20, 2008 3:42 PM | Last reply by Brett Yount - Tuesday, April 1, 2008 4:38 PM -
0 Votes
msnbot not honoring robots.text
What kind of problem are you experiencing with MSNbot?Answered | 6 Replies | 4715 Views | Created by Marcia_W - Friday, December 7, 2007 9:52 PM | Last reply by Robin100 - Wednesday, December 24, 2008 2:56 PM -
0 Votes
MSNBOT and WebMaster Tools
Verify your robots.txt file Ping Live.com and notify of the new sitemap You can ping Live.com with the following URL ...Answered | 2 Replies | 5567 Views | Created by bobitza - Monday, February 11, 2008 9:27 PM | Last reply by bobitza - Saturday, February 16, 2008 4:30 AM -
0 Votes
MSbot not obeying robots.txt
Why should ANYONE have to tell YOU where not to go, when there is an established method for doing exactly this (ITS CALLED ROBOTS.TXT, AND YOU ARE IGNORING IT)?Answered | 2 Replies | 5084 Views | Created by ukmodelshops - Monday, March 2, 2009 10:22 AM | Last reply by TiredOfMSN - Wednesday, April 22, 2009 12:00 AM -
0 Votes
Robots.txt Validator, again
Hi, Your validator find now errors on a robots.txt as basic as this one : Code Block User-agent: ... - Items 1 to 20 of 9204 Next ›
No announcements
