30 mai 2004 08:01
A Hotmail crawler?
Isabelle Hontebeyrie
Has anyone noticed this in their visitors list: Host: 2.67-19-10.reverse.theplanet.com Agent: TestCrawler/1.0 (testcrawler@hotmail.com)?
PS: I've sent an email to the Microsoft PR in Montréal. I'll keep you posted with regular updates.
Update - June 2nd - I just got this email:
Hi,
I am testing some search engine software and wanted to let it crawl normal
web data. I put a hotmail email address in the user-agent to make sure that
people could contact me if there was a problem with how the crawler was
crawling their site. I didn't want to put a real email address in there
because logs tend to make it onto the web which would really add to the
horrible amount of spam that I receive.
Did the crawler do anything bad to your site or did you just email because
you noticed it in the logs?
Cheers,
Chris.
Guess that answers my questions :-)))
Update - May 31st - According to Microsoft, there is no Hotmail bot. Since I'm curious to see who testcrawler@hotmail.com is, I've just sent an email. I'll keep you posted.
Categorie(s)/Catégorie(s):
Tech and Web
Feedback/Réaction(s):
TrackBack & pings(0) |
Comments/Commentaires(0) |
Referring Web Pages, last 5 days