# coccocbot: Coc Coc Crawler User Agents and robots.txt

> coccocbot is the crawler family of the Coc Coc search engine. Its user agent strings, robots.txt rules, Crawl-delay limit and reverse DNS check.

coccocbot is the name of the crawlers that build the index of the Cốc Cốc search engine. Cốc Cốc is a web browser with its own search engine, made for the Vietnamese market ([Wikipedia](https://en.wikipedia.org/wiki/C%E1%BB%91c_C%E1%BB%91c)). It is a search crawler, not an AI training crawler. If you want your site in Cốc Cốc search, allow it. If not, block `coccocbot` in robots.txt.

## Cốc Cốc robots

Cốc Cốc's [robots page](https://coccoc.com/search/console/en/coc-coc-robots) lists one generic name and five specific robots:

| Robot name | What it does |
|---|---|
| `coccocbot` | Generic name for all Cốc Cốc robots |
| `coccocbot-web` | Main web robot |
| `coccocbot-image` | Image robot |
| `coccocbot-fast` | Fast robot |
| `coccocbot-ads` | Ads robot |
| `coccocbot-shopping` | Robot for e-commerce websites |

## User-agent strings

The user agent is the client name in the User-Agent HTTP header. Cốc Cốc publishes these strings:

```
Mozilla/5.0 (compatible; coccocbot/1.0; +http://help.coccoc.com/searchengine)
Mozilla/5.0 (compatible; coccocbot-web/1.0; +http://help.coccoc.com/searchengine)
coccocbot-web/1.0 (+http://help.coccoc.com/searchengine)
Mozilla/5.0 (compatible; coccocbot-image/1.0; +http://help.coccoc.com/searchengine)
Mozilla/5.0 (compatible; coccocbot-fast/1.0; +http://help.coccoc.com/searchengine)
Mozilla/5.0 (compatible; coccocbot-ads/1.0; +http://help.coccoc.com/searchengine)
Mozilla/5.0 (compatible; coccocbot-shopping/1.0; +http://help.coccoc.com/searchengine)
```

The short `coccocbot-web/1.0` string is a second form that the main web robot uses in some cases.

## How coccocbot reads robots.txt

robots.txt is a text file at the site root with rules for crawlers. Cốc Cốc's [robots.txt page](https://coccoc.com/search/console/en/robots.txt) says that its robots support the Robots Exclusion Protocol. It also documents these details:

1. The robot requests robots.txt before any other URL on the site. It follows up to 5 redirects.
2. If the robot gets no response, it treats the site as unavailable and does not crawl it for a period of time.
3. If the response is not 200 OK, the robot assumes full access to the site.
4. Each robot uses the `User-agent` group that matches its name most closely.
5. `Crawl-delay` is a whole number of seconds. Values above 10 count as 10.

Item 3 is different from [RFC 9309](https://www.rfc-editor.org/rfc/rfc9309.html). Under RFC 9309, a server error (HTTP 5xx) on robots.txt means that the crawler must assume a full disallow. If your robots.txt sometimes returns a 5xx error, coccocbot can crawl paths that you disallowed.

## Block or limit coccocbot

If you want to block all Cốc Cốc robots, use the generic name:

```
User-agent: coccocbot
Disallow: /
```

If you want to block only the image robot, use its own name:

```
User-agent: coccocbot-image
Disallow: /
```

If you want fewer requests, set a delay. This example asks all Cốc Cốc robots to wait 5 seconds between requests:

```
User-agent: coccocbot
Crawl-delay: 5
```

## Verify requests

Cốc Cốc tells site owners to use reverse DNS (a lookup from an IP address to a host name):

1. Find the IP address of the request in your access log.
2. Run a reverse DNS lookup on the address. The host name must end with `.coccoc.com`.
3. Run a forward DNS lookup on that host name.
4. Make sure that the result is the original IP address.

If the addresses do not match, Cốc Cốc says that someone probably pretends to be its robot.

---

[View the canonical page](https://aichatwatch.com/ai-crawler-bot/coccocbot/) · [Browse llms.txt](https://aichatwatch.com/llms.txt)