AI crawler tracking
An AI crawler fetches a page, and the visit lands in the log.
Not quite it? Ask for a variation
Install
Writes one React component into components/illos. Nothing else to install.
npx shadcn@latest add https://illos.dev/r/flat/ai-crawler-tracking.jsonOr hand it to your agent
Claude Code, Cursor, Codex and any other coding agent can add it from the prompt.
How it moves
- an AI crawler is wired to your server.
- it requests a page, and the server reports the visit.
- the request lands at the top of the crawler log with a tick.
Where it fits
For analytics, SEO and hosting products: the crawler report before tracking is set up, the docs page on logging AI crawlers from the server, or a features card on seeing which AI tools read your pages. The request running from the crawler to your server and landing in the log shows why this tracking needs a server-side call, and what each visit looks like once it has one. As a spot it fits above the heading and a set-up button. It is free to copy and pairs with No assistants connected, Web crawler and Log stream.
Pairs well with No assistants connected, Web crawler and Log stream.
On your site
Read where product illustrations go, how to place an animated SVG and how to keep animations fast.
For developers
- File size
- 3 KB gzipped
- Motion
- Plays once, 4.4 s, then holds
- Reduced motion
- Shows a still
- File
- ai-crawler-tracking.svg