Measured, and not part of the index

These are signals, not scores. They are kept apart on purpose: mixed in with the dimensions, a low one reads as a bad grade for something the index never counted.

0.0%
Sites with an AI crawler policy

Sites with an AI crawler policy

Sample
n=136
Coverage
100.0%

Not a Lighthouse audit: it is read from the robots.txt of the sampled sites, checking whether the file names any of the AI crawlers we track. It measures HAVING AN EXPLICIT POLICY and not permitting: blocking AI crawlers is a legitimate decision, and penalising it would be a value judgement dressed up as a measurement. What is a sign of maturity is having decided.

Sites with an AI crawler policy: 5 months, no significant change= −1.4 pp

What else we measure here

0.0%
Sites with an AI crawler policy

Sites with an AI crawler policy

Sample
n=136
Coverage
100.0%
100.0%
Agents that can reach the site

Agents that can reach the site

Sample
n=136
Coverage
100.0%

How this was measured