← heapsort
ARTICLE27

How I tracked which AI bots actually crawl my site

DEV.to AIΒ·April 25, 2026

The author implemented a tracker to monitor which AI bots access their new static website, analyzing CloudFront logs stored in S3. After five days, bots like OAI-SearchBot and Bingbot were identified, with the methodology based on user-agents.

Read original β†—