AdmitIndexBot

If you found this URL in your logs, this page explains the request and how to stop it.

User agents:
AdmitIndexBot/0.2.0 (+https://admitindex.com/bot; agent-admission measurement)
AdmitIndexBot/0.2.0 (+https://admitindex.com/bot; headless measurement arm)

What it does

It makes two kinds of weekly visit to public home pages:

Each visit records one thing: whether an identified automated client was admitted, challenged, or refused. The results are published as the Admit Index.

What it does not do

It does not solve CAPTCHAs, rotate IP addresses, disguise itself as a human browser, log in, submit forms, buy anything, or collect personal data. It does not copy your content. It records status codes, response headers, the page title, and how many characters of text rendered.

Where requests come from

Unsigned probes
(panel and full set)
178.156.241.71
2a01:4ff:f4:c610::/64
A dedicated server in Ashburn, Virginia, US.
Signed probes
(panel only)
Cloudflare Browser Run. These requests carry a Web Bot Auth signature (Signature-Agent: "https://web-bot-auth.cloudflare-browser-rendering-085.workers.dev") and still send the AdmitIndexBot user agent.
Self-signed probes
(panel only, once our key is verified)
The same server as the unsigned probes. One extra home-page request signed with AdmitIndexBot's own Web Bot Auth key (Signature-Agent: "https://admitindex.com"; keys at https://admitindex.com/.well-known/http-message-signatures-directory).

Rate

The panel and the full set each run once a week, so a site in both is visited twice a week. During initial calibration, either may run up to once a day until 15 October 2026. Per site, per run, that is a read of robots.txt and three public policy files, then one visit to the home page from each probe type. No retries past a challenge.

robots.txt is obeyed

If your robots.txt disallows AdmitIndexBot (or all user agents) from /, your home page is never visited. Your site is then listed as excluded by robots.txt, never as blocking.

Opt out

Email optout@admitindex.com from an address at the domain concerned. It is removed before the next run of either kind, normally within one business day. The opt-out list is published: a silent removal would make the index misleading.