Brave Search API
-
AI Search & GEO
Brave’s unnamed crawler means you can’t block it without Google
Brave sells its search index of over 30 billion pages to AI companies via an API, and its crawler has no separate user agent, so robots.txt can't target it. You can only block it by also blocking Google, or by using noindex.