cohere-ai: user agent, purpose, and whether to allow it
cohere-ai collects web content associated with Cohere.
Specification
| Operator | Cohere |
|---|---|
| Purpose | TrainingCollects content that may be used to train future models. Blocking it removes your content from future training runs. It does not affect whether a model can find and cite you today. |
| Agent kind | CrawlerAutonomous crawler. Appears in your logs under its own user-agent. |
| User agent | Not documented by Cohere. Kymo matches this agent on the token cohere-ai, observed in real logs rather than published in operator documentation. |
| robots.txt token | cohere-ai |
| robots.txt compliance | No operator statement located |
| Verification | No published method, user agent is the only signal |
| Sends referral traffic | No |
| Attaches a citation | No |
| Status | Active |
| Legacy Kymo category | training |
| Source | Third-party source, not yet confirmed against operator docsCohere publishes no crawler documentation that Kymo could locate. Everything on this page comes from observed traffic, not from a vendor page. |
| Verified on |
What blocking it costs you
Documentation is thin. If no primary source can be found, label the user agent as observed rather than documented and say so on the page.
robots.txt directives
Both blocks below address cohere-ai only. Rules for one token never apply to another, even from the same operator.
Allow cohere-ai
User-agent: cohere-ai Allow: /
Block cohere-ai
User-agent: cohere-ai Disallow: /
Questions
What is the cohere-ai user agent?
Cohere documents the robots.txt token cohere-ai but does not publish a full user-agent string for it. Kymo records this agent from observation rather than from documentation.
Does cohere-ai respect robots.txt?
No operator statement located
What does blocking cohere-ai cost me?
Documentation is thin. If no primary source can be found, label the user agent as observed rather than documented and say so on the page.
Related crawlers
All AI crawlers and control tokens
See this bot in your own logs
Kymo classifies every crawler hit server-side using this registry, so cohere-ai shows up under Cohere with its purpose attached. Read how crawler detection works, or run a free free AI visibility check to see what each crawler currently gets back from your server. No account needed for the check.