|
Robots |
1 | 116 | 56.31 | Googlebot/2.1 |
2 | 20 | 9.71 | bingbot/2.0 |
3 | 17 | 8.25 | YandexBot/3.0 |
4 | 12 | 5.83 | AhrefsBot/5.0 |
5 | 10 | 4.85 | compatible Mozilla/5.0 |
6 | 8 | 3.88 | LSSRocketCrawler/1.0 LightspeedSystems |
7 | 7 | 3.40 | Exabot/3.0 |
8 | 4 | 1.94 | DotBot/1.1 |
9 | 4 | 1.94 | spbot/4.4.2 |
10 | 4 | 1.94 | meanpathbot/1.0 |
11 | 2 | 0.97 | Python-urllib/2.6 |
12 | 2 | 0.97 | CCBot/2.0 (http://commoncrawl.org/faq/) |
|
|