---
title: What this site is asked for
desc: Every request txtfirst.com has answered since its own measurement was corrected, by shape and by client. Generated from live data, not written by hand.
---

# What this site is asked for

Generated 2026-09-16, counting every response since 2026-09-07 06:29:46 UTC. This page is not written by anyone. The
Worker records one row per response, with no IP address, no cookie and no identifier:
the shape it served, the path, the client family, the user agent and the Accept header.
That is the whole dataset.

Measurement began on 6 September 2026, two days after the domain went live, and the
count here starts a day later than that. The first day of rows classified a 404 served
as an HTML page as though it were a page view, which turned 185 vulnerability scanners
into readers. To be exact about that number: 185 requests from 22 different clients,
seven of which were for a favicon, which is not a scanner but is not a reader either.
That is fixed, and the mislabelled rows are excluded rather than quietly included, so
these numbers are small. They are published anyway, because a site arguing
that the web should be measurable should be measurable itself, including when its own
first measurement was wrong.

## The one number

Of **10574 requests** that were not this site's own probe, **291 asked for markdown**
and **1394 were answered with the HTML page**. **7024 were misses**. A miss is a
request for something that is not here, and most of them are vulnerability scanners
looking for `/wp-login.php` and `/.env`, which arrive at any domain within hours of it
existing and are not readers. Misses are counted apart rather than as traffic.

## Shape by client

`browser` is a client sending a browser user agent, which includes any program
pretending to be one. `cli` is curl, wget or a plain HTTP library. `other-bot` is a
declared crawler that is not one of the named model builders. A shape of `miss` is a
404 or a 405.

| shape    | client     | n    |
|----------|------------|------|
| miss     | browser    | 5464 |
| html     | browser    | 1192 |
| miss     | other-bot  | 766  |
| redirect | browser    | 763  |
| redirect | other-bot  | 328  |
| miss     | none       | 199  |
| miss     | other      | 184  |
| md       | browser    | 177  |
| miss     | anthropic  | 137  |
| miss     | openai     | 98   |
| txt      | browser    | 98   |
| txt      | cli        | 94   |
| redirect | anthropic  | 94   |
| html     | other-bot  | 87   |
| miss     | cli        | 78   |
| txt      | other-bot  | 75   |
| html     | cli        | 74   |
| json     | browser    | 74   |
| md       | cli        | 67   |
| redirect | openai     | 66   |
| redirect | other      | 65   |
| redirect | cli        | 56   |
| miss     | perplexity | 55   |
| other    | cli        | 48   |
| md       | other-bot  | 47   |
| miss     | google     | 43   |
| html     | other      | 41   |
| redirect | none       | 39   |
| txt      | openai     | 37   |
| json     | cli        | 28   |

## Declared crawlers

Every request from a client that names itself as a crawler, with the shape it received.
If this table is empty, or holds only crawlers that are not model builders, that is
itself the finding: publishing in a machine readable format does not summon anyone.

| client    | agent                                                                                                                                                              | shape    | n  |
|-----------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------|----------|----|
| other-bot | Mozilla/5.0 (compatible; Kimi-SearchBot/1.0; +https://kimi.ai/)                                                                                                    | miss     | 81 |
| other-bot | DuckAssistBot/1.1 (https://duckduckgo.com/duckassistbot)                                                                                                           | miss     | 65 |
| other-bot | Mozilla/5.0 (compatible; YouBot/1.0; +https://you.com/bot)                                                                                                         | miss     | 54 |
| other-bot | Mozilla/5.0 (compatible; KimiBot/1.0; +https://kimi.ai/)                                                                                                           | miss     | 44 |
| other-bot | Mozilla/5.0 (compatible; ChatGLM-Spider/1.0; +https://zhipuai.cn/)                                                                                                 | miss     | 44 |
| other-bot | Mozilla/5.0 (compatible; Qwenbot/1.0; +https://qwen.alibaba.com/)                                                                                                  | miss     | 44 |
| other-bot | Mozilla/5.0 (compatible; YiBot/1.0; +https://01.ai/)                                                                                                               | miss     | 35 |
| other-bot | Mozilla/5.0 (compatible; Bytespider; spider-feedback@bytedance.com) AppleWebKit/537.36                                                                             | miss     | 34 |
| other-bot | Mozilla/5.0 (compatible; DeepSeekBot/1.0; +https://www.deepseek.com/)                                                                                              | miss     | 33 |
| openai    | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.3; +https://openai.com/gptbot)                                                             | miss     | 33 |
| other-bot | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot) Chrome/119.0.6045.214 Safari/537.36 | redirect | 32 |
| google    | Mozilla/5.0 (compatible; Google-Extended; +http://www.google.com/bot.html)                                                                                         | miss     | 32 |
| other-bot | Mozilla/5.0 (compatible; Meta-ExternalAgent/1.0; +https://developers.facebook.com/docs/sharing/webmasters/crawler)                                                 | miss     | 32 |
| other-bot | Mozilla/5.0 (compatible; Amazonbot/0.1; +https://developer.amazon.com/support/amazonbot)                                                                           | miss     | 26 |
| other-bot | Mozilla/5.0 (compatible; Bravebot/1.0; +https://brave.com/search/)                                                                                                 | miss     | 25 |
| openai    | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ChatGPT-User/1.0; +https://openai.com/bot)                                                          | miss     | 25 |
| openai    | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.4; +https://openai.com/gptbot)                                                             | md       | 24 |
| anthropic | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)                                                            | miss     | 23 |
| anthropic | Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-SearchBot/1.0; +claudebot@anthropic.com)                                                     | miss     | 23 |
| other-bot | CCBot/2.0 (https://commoncrawl.org/faq/)                                                                                                                           | miss     | 23 |

## Paths people and programs actually reach

Misses excluded, so this is what was found rather than what was guessed at.

| path                       | shape | n    |
|----------------------------|-------|------|
| /                          | html  | 1379 |
| /robots.txt                | txt   | 207  |
| /spec.md                   | md    | 49   |
| /llms.txt                  | txt   | 48   |
| /contact.md                | md    | 45   |
| /api/pages.json            | json  | 41   |
| /.well-known/txtfirst.json | json  | 34   |
| /index.md                  | md    | 33   |
| /reads                     | html  | 32   |
| /about.md                  | md    | 30   |
| /changes.json              | json  | 27   |
| /implement.md              | md    | 25   |
| /reads.md                  | md    | 24   |
| /dialect.md                | md    | 23   |
| /tools/factblock.py        | txt   | 21   |

## What this cannot tell you

A user agent is a claim, not an identity, and anything can send any string. This page
cannot separate a person clicking a `.md` link from a scraper wearing a Chrome string.
Analytics Engine samples under load, so counts are estimates. Nothing
here is a visit count and none of it identifies anyone.

Check any site yourself with the checker this site publishes, which needs nothing
installed beyond Node:

```
curl -s https://txtfirst.com/cli/index.js > txtfirst.js
node txtfirst.js check yourdomain.com
```
