knectybot

knectybot (user agent knectybot/1.0 (+https://knecty.com/bot)) fetches a small number of web pages that appeared in a user's search results, so knecty's deep-research feature can cite what a page actually says. It only requests URLs surfaced by that search — it never crawls or follows links — it honors robots.txt, it backs off permanently on any refusal (4xx, rate limit, bot wall, or paywall), and it fetches at most one page at a time per site with at least a one-second delay between requests and a hard cap of a few pages per research run. Questions or blocking issues: contact us at knecty.com/support.