source: trunk/EventBenchConsole/misc/robotfilter.txt @ 111

Last change on this file since 111 was 110, checked in by sherbold, 13 years ago
  • updated bot filter
  • Property svn:mime-type set to text/plain
File size: 450 bytes
Line 
1findlinks
2discobot
3Googlebot
4Slurp
5YandexBot
6Spider
7ScholarUniverse
8Baiduspider
9Exabot
10Robot
11MetaGer-Bot
12YandexImages
13Gigabot
14SiteBot
15bingbot
16Ezooms
17Jeeves/Teoma
18msnbot
19DotBot
20changedetection.com/bot.html
21FAST Enterprise Crawler 6
22psbot
23http://ws.daum.net/aboutWebSearch.html
24NerdByNature.Bot
25Sogou web spider
26ssearch_bot
27Purebot
28http://www.icjobs.de
29scoutjet
30Netcraft Web Server Survey
31TurnitinBot
32ia_archiver
33MJ12bot
Note: See TracBrowser for help on using the repository browser.