AdmitIndexBot

If you found this URL in your logs, this page explains the request and how to stop it.

User agents:
AdmitIndexBot/0.2.0 (+https://admitindex.com/bot; agent-admission measurement)
AdmitIndexBot/0.2.0 (+https://admitindex.com/bot; headless measurement arm)

What it does

Once a week it visits the home page of each site in a published panel and records one thing: whether an identified automated client was admitted, challenged, or refused. The results are published as the Admit Index.

What it does not do

It does not solve CAPTCHAs, rotate IP addresses, disguise itself as a human browser, log in, submit forms, buy anything, or collect personal data. It does not copy your content. It records status codes, response headers, the page title, and how many characters of text rendered.

Where requests come from

Unsigned probes178.156.241.71
2a01:4ff:f4:c610::/64
A dedicated server in Ashburn, Virginia, US.
Signed probesCloudflare Browser Run. These requests carry a Web Bot Auth signature (Signature-Agent: "https://web-bot-auth.cloudflare-browser-rendering-085.workers.dev") and still send the AdmitIndexBot user agent.

Rate

Once a week, Mondays around 09:25 UTC. During initial calibration (late September to mid October 2026) it may run up to once a day. Per site, that is a read of robots.txt and three public policy files, then one visit to the home page from each probe type. No retries past a challenge.

robots.txt is obeyed

If your robots.txt disallows AdmitIndexBot (or all user agents) from /, your home page is never visited. Your site is then listed as excluded by robots.txt, never as blocking.

Opt out

Email optout@admitindex.com from an address at the domain concerned. It is removed before the next weekly run, normally within one business day. The opt-out list is published: a silent removal would make the index misleading.