---
title: What this site is asked for
desc: Every request txtfirst.com has answered since its own measurement was corrected, by shape and by client. Generated from live data, not written by hand.
---

# What this site is asked for

Generated 2026-11-01, counting every response since 2026-09-07 06:29:46 UTC. This page is not written by anyone. The
Worker records one row per response, with no IP address, no cookie and no identifier:
the shape it served, the path, the client family, the user agent and the Accept header.
That is the whole dataset.

Measurement began on 6 September 2026, two days after the domain went live, and the
count here starts a day later than that. The first day of rows classified a 404 served
as an HTML page as though it were a page view, which turned 185 vulnerability scanners
into readers. To be exact about that number: 185 requests from 22 different clients,
seven of which were for a favicon, which is not a scanner but is not a reader either.
That is fixed, and the mislabelled rows are excluded rather than quietly included, so
these numbers are small. They are published anyway, because a site arguing
that the web should be measurable should be measurable itself, including when its own
first measurement was wrong.

## The one number

Of **78176 requests** that were not this site's own probe, **1433 asked for markdown**
and **6007 were answered with the HTML page**. **55299 were misses**. A miss is a
request for something that is not here, and most of them are vulnerability scanners
looking for `/wp-login.php` and `/.env`, which arrive at any domain within hours of it
existing and are not readers. Misses are counted apart rather than as traffic.

## Shape by client

`browser` is a client sending a browser user agent, which includes any program
pretending to be one. `cli` is curl, wget or a plain HTTP library. `other-bot` is a
declared crawler that is not one of the named model builders. A shape of `miss` is a
404 or a 405.

| shape    | client     | n     |
|----------|------------|-------|
| miss     | browser    | 32406 |
| miss     | other-bot  | 7479  |
| miss     | none       | 7365  |
| redirect | browser    | 7215  |
| html     | browser    | 5365  |
| miss     | cli        | 3845  |
| redirect | other-bot  | 2324  |
| redirect | cli        | 2138  |
| miss     | anthropic  | 1252  |
| miss     | openai     | 1117  |
| md       | browser    | 1064  |
| miss     | google     | 742   |
| miss     | perplexity | 709   |
| txt      | browser    | 578   |
| json     | browser    | 504   |
| redirect | openai     | 447   |
| redirect | anthropic  | 446   |
| miss     | other      | 384   |
| txt      | other-bot  | 368   |
| redirect | none       | 350   |
| html     | other-bot  | 293   |
| redirect | other      | 250   |
| md       | other-bot  | 244   |
| redirect | perplexity | 240   |
| redirect | google     | 231   |
| txt      | openai     | 212   |
| html     | other      | 207   |
| html     | cli        | 142   |
| txt      | cli        | 134   |
| md       | openai     | 125   |

## Declared crawlers

Every request from a client that names itself as a crawler, with the shape it received.
If this table is empty, or holds only crawlers that are not model builders, that is
itself the finding: publishing in a machine readable format does not summon anyone.

| client    | agent                                                                                                              | shape | n   |
|-----------|--------------------------------------------------------------------------------------------------------------------|-------|-----|
| other-bot | Mozilla/5.0 (compatible; Kimi-SearchBot/1.0; +https://kimi.ai/)                                                    | miss  | 523 |
| other-bot | Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)                                | miss  | 501 |
| other-bot | Mozilla/5.0 (compatible; DeepSeekBot/1.0; +https://www.deepseek.com/)                                              | miss  | 437 |
| anthropic | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)            | miss  | 436 |
| other-bot | Mozilla/5.0 (compatible; Qwenbot/1.0; +https://qwen.alibaba.com/)                                                  | miss  | 409 |
| anthropic | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-User/1.0; +claudebot@anthropic.com)          | miss  | 392 |
| other-bot | Mozilla/5.0 (compatible; YouBot/1.0; +https://you.com/bot)                                                         | miss  | 389 |
| other-bot | Mozilla/5.0 (compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)                           | miss  | 389 |
| other-bot | Mozilla/5.0 (compatible; Bravebot/1.0; +https://brave.com/search/)                                                 | miss  | 381 |
| other-bot | Mozilla/5.0 (compatible; MoonshotBot/1.0; +https://kimi.ai/)                                                       | miss  | 378 |
| openai    | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko); compatible; ChatGPT-User/1.0; +https://openai.com/bot          | miss  | 368 |
| other-bot | DuckAssistBot/1.1 (https://duckduckgo.com/duckassistbot)                                                           | miss  | 367 |
| google    | Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)                                           | miss  | 364 |
| other-bot | Mozilla/5.0 (compatible; Meta-ExternalAgent/1.0; +https://developers.facebook.com/docs/sharing/webmasters/crawler) | miss  | 363 |
| other-bot | Mozilla/5.0 (compatible; KimiBot/1.0; +https://kimi.ai/)                                                           | miss  | 358 |
| anthropic | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-SearchBot/1.0; +claudebot@anthropic.com)     | miss  | 355 |
| other-bot | CCBot/2.0 (https://commoncrawl.org/faq/)                                                                           | miss  | 354 |
| other-bot | Mozilla/5.0 (compatible; cohere-ai; +https://cohere.com/crawler)                                                   | miss  | 353 |
| other-bot | Mozilla/5.0 (compatible; GrokBot/1.0; +https://x.ai/)                                                              | miss  | 348 |
| other-bot | Mozilla/5.0 (compatible; ChatGLM-Spider/1.0; +https://zhipuai.cn/)                                                 | miss  | 314 |

## Paths people and programs actually reach

Misses excluded, so this is what was found rather than what was guessed at.

| path                       | shape | n    |
|----------------------------|-------|------|
| /                          | html  | 5972 |
| /robots.txt                | txt   | 825  |
| /llms.txt                  | txt   | 215  |
| /api/pages.json            | json  | 204  |
| /contact.md                | md    | 188  |
| /index.md                  | md    | 161  |
| /.well-known/txtfirst.json | json  | 154  |
| /about.md                  | md    | 152  |
| /spec.md                   | md    | 140  |
| /dialect.md                | md    | 140  |
| /implement.md              | md    | 134  |
| /why.md                    | md    | 121  |
| /measure.md                | md    | 119  |
| /adopt/chassis_kv.py       | txt   | 116  |
| /agent.md                  | md    | 112  |

## What this cannot tell you

A user agent is a claim, not an identity, and anything can send any string. This page
cannot separate a person clicking a `.md` link from a scraper wearing a Chrome string.
Analytics Engine samples under load, so counts are estimates. Nothing
here is a visit count and none of it identifies anyone.

Check any site yourself with the checker this site publishes, which needs nothing
installed beyond Node:

```
curl -s https://txtfirst.com/cli/index.js > txtfirst.js
node txtfirst.js check yourdomain.com
```