Glossary · Web analytics

AI crawler

A program that reads web pages for an AI company: to train a model, to build an answer index, or to fetch a page somebody asked about.

In BackendFree

23 AI crawlers are named one by one and counted apart from people, and none of them spends the events allowance.

Read more

Guide · Web analytics Which AI crawlers should you let in? Guide · Web analytics Is ChatGPT sending you visitors? Product · Web analytics Website analytics without a cookie banner