unclenchbot
Last updated 1 October 2026
When it visits
- A business adds its own website as a knowledge source in unclench.ai. We then re-check those pages once a day so answers stay current.
- Someone enters a website on our free demo tool. We read up to five pages, once.
What it fetches
robots.txt and sitemaps to find a site's pages, then the pages robots.txt allows it to read. When a site has no sitemap, it follows links from the address it was given. It stays on that site, reads public pages only, and never submits forms or signs in.
How many pages it reads is capped by the business's plan, at most 600 per site. To index a page, we also pass its address to our search provider, Supermemory, which fetches it from its own servers.
How to recognise it
Every request sends this user agent:
Mozilla/5.0 (compatible; unclenchbot/1.0; +https://unclench.ai/bot)
and comes from 2.28.117.129.
Letting it in
If your site uses Cloudflare bot protection and you want unclench.ai to read it, add 2.28.117.129 as an IP Access Rule with the action Allow (Security, then WAF, then Tools).
Stopping it
unclenchbot follows robots.txt. It obeys rules for unclenchbot, or for * when none name it. To keep it out of your whole site:
User-agent: unclenchbot Disallow: /
Changes apply on its next visit, within a day. Questions: [email protected]