| crawler | operator | pages | rate | amount |
|---|---|---|---|---|
| Amazonbot | Amazon model training |
1,104 | $0.01 | $11.04 |
| Googlebot | Google search indexing |
1,003 | $0.01 | $10.03 |
| ClaudeBot | Anthropic model training |
902 | $0.01 | $9.02 |
| Bingbot | Microsoft search indexing |
532 | $0.01 | $5.32 |
| PerplexityBot | Perplexity AI answers (live retrieval) |
516 | $0.01 | $5.16 |
| Meta-ExternalAgent | Meta model training |
363 | $0.01 | $3.63 |
| GPTBot | OpenAI model training |
348 | $0.01 | $3.48 |
| OAI-SearchBot | OpenAI AI answers (live retrieval) |
325 | $0.01 | $3.25 |
| ChatGPT-User | OpenAI AI answers (live retrieval) |
83 | $0.01 | $0.83 |
| Applebot | Apple search indexing |
48 | $0.01 | $0.48 |
| Claude-User | Anthropic AI answers (live retrieval) |
35 | $0.01 | $0.35 |
| DuckDuckBot | DuckDuckGo search indexing |
13 | $0.01 | $0.13 |
| CCBot | Common Crawl model training |
11 | $0.01 | $0.11 |
| Bytespider | ByteDance model training |
11 | $0.01 | $0.11 |
| Perplexity-User | Perplexity AI answers (live retrieval) |
8 | $0.01 | $0.08 |