AdmitIndexBot
If you found this URL in your logs, this page explains the request and how to stop it.
User agents:AdmitIndexBot/0.2.0 (+https://admitindex.com/bot; agent-admission measurement)
AdmitIndexBot/0.2.0 (+https://admitindex.com/bot; headless measurement arm)
What it does
It makes two kinds of weekly visit to public home pages:
- The panel. About 125 sites, Mondays around 09:25 UTC, from both unsigned and signed probes.
- The full set. About 1,800 US sites, Thursdays around 03:40 UTC, from unsigned probes only.
Each visit records one thing: whether an identified automated client was admitted, challenged, or refused. The results are published as the Admit Index.
What it does not do
It does not solve CAPTCHAs, rotate IP addresses, disguise itself as a human browser, log in, submit forms, buy anything, or collect personal data. It does not copy your content. It records status codes, response headers, the page title, and how many characters of text rendered.
Where requests come from
| Unsigned probes (panel and full set) | 178.156.241.712a01:4ff:f4:c610::/64A dedicated server in Ashburn, Virginia, US. |
| Signed probes (panel only) | Cloudflare Browser Run. These requests carry a Web Bot Auth signature (Signature-Agent: "https://web-bot-auth.cloudflare-browser-rendering-085.workers.dev") and still send the AdmitIndexBot user agent. |
| Self-signed probes (panel only, once our key is verified) | The same server as the unsigned probes. One extra home-page request signed with AdmitIndexBot's own Web Bot Auth key (Signature-Agent: "https://admitindex.com"; keys at https://admitindex.com/.well-known/http-message-signatures-directory). |
Rate
The panel and the full set each run once a week, so a site in both is visited twice a week. During initial calibration, either may run up to once a day until 15 October 2026. Per site, per run, that is a read of robots.txt and three public policy files, then one visit to the home page from each probe type. No retries past a challenge.
robots.txt is obeyed
If your robots.txt disallows AdmitIndexBot (or all user agents) from /, your home page is never visited. Your site is then listed as excluded by robots.txt, never as blocking.
Opt out
Email optout@admitindex.com from an address at the domain concerned. It is removed before the next run of either kind, normally within one business day. The opt-out list is published: a silent removal would make the index misleading.