AI21 Jamba: Model Facts and Web Access for Site Owners
AI21 Jamba is a family of open language models with a 256K context window. It has no web access of its own, and AI21 documents no crawler.
2 min read
AI CHAT BOT
Ai Chat Bot
Amazon Q: Web Crawler, robots.txt and Site Access
What Amazon Q Developer and Amazon Q Business do with websites, and how to block the Amazon Q web crawler with the amazon-QBusiness token.
3 min read
BLOOM: BigScience Open Model, No Web Access
BLOOM is a 176B-parameter open multilingual model from BigScience, released in 2022. It has no web access or crawler, and its training data is fixed.
2 min read
Character.AI: Web Access and Crawlers for Site Owners
Character.AI documents no web search, page fetches or crawler. What this means for site owners, and why there is no robots.txt rule for it.
2 min read
Codeium, Now Windsurf and Devin Desktop: Web Access
Codeium became Windsurf in 2025 and Devin Desktop in 2026. How its agent searches and reads web pages, and why no robots.txt token exists.
2 min read
Cohere Command: RAG, Web Content and Citations
Cohere Command models have no web access. How apps pass web pages to them as documents, how Command cites those documents, and which Cohere bots exist.
3 min read
Copy.ai: Web Search, Page Scraping and Site Access
Copy.ai Chat searches the web and its workflows scrape pages. No user agent or robots.txt token is documented. What site owners can do.
2 min read
Cursor Agent: Web Search, Browser and Site Access
The Cursor agent can search the web, read links and control a browser. Cursor documents no user agent or robots.txt token for this traffic.
2 min read
Drift Chatbot: Salesloft Acquisition and Shutdown
Drift, the B2B chat product of Clari + Salesloft, has a gradual sunset with 1mind as successor. Dates, the 2025 breach and steps for sites.
3 min read