ARTICLEDEV.to AI·4/25/2026
How I tracked which AI bots actually crawl my site
The author implemented a tracker to monitor which AI bots access their new static website, analyzing CloudFront logs stored in S3. After five days, bots like OAI-SearchBot and Bingbot were identified, with the methodology based on user-agents.
27