Robots |
1 | 152 | 18.67 | MJ12bot/v1.4.5 |
2 | 131 | 16.09 | compatible Mozilla/5.0 |
3 | 131 | 16.09 | YandexBot/3.0 |
4 | 101 | 12.41 | bingbot/2.0 |
5 | 94 | 11.55 | Googlebot/2.1 |
6 | 60 | 7.37 | linkdexbot/2.0 |
7 | 53 | 6.51 | meanpathbot/1.0 |
8 | 26 | 3.19 | Baiduspider/2.0 |
9 | 19 | 2.33 | Exabot/3.0 |
10 | 15 | 1.84 | Exabot/3.0 (BiggerBetter) |
11 | 7 | 0.86 | Apache-HttpClient/4.3 (java 1.5) |
12 | 6 | 0.74 | LSSRocketCrawler/1.0 LightspeedSystems |
13 | 3 | 0.37 | www.osaicbt.com/Nutch-2.2.1 |
14 | 3 | 0.37 | spbot/4.1.0 |
15 | 2 | 0.25 | Wotbox/2.01 (+http://www.wotbox.com/bot/... |
16 | 2 | 0.25 | MSIE 7.0 |
17 | 2 | 0.25 | AdnormCrawler www.adnorm.com/crawler |
18 | 2 | 0.25 | - |
19 | 2 | 0.25 | Riddler (http://riddler.io/about.html) |
20 | 2 | 0.25 | MSIE 8.0 |
21 | 1 | 0.12 | BlackBerry9000/4.6.0.167 Profile/MIDP-2.... |