DossierENTITY

AI crawlers

Coverage of AI crawlers in the Nexus archive.

Earliest in view: Aug 2 · 11:53 UTCMost recent: Aug 2 · 11:53 UTC

Co-mentioned in this coverage

Recent coverage

TECHNOLOGYAug 2 · 11:53 UTCHACKER NEWS
Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers
Only 8.9% of websites block AI crawlers, while 94.8% of sites are never cited in AI-generated answers. The data comes from the AI Visibility Index by Website Auditor, with the article receiving 26 points and 19 comments on Hacker News.