BoeiBot — Boei's Website Crawler

BoeiBot crawls websites on behalf of Boei customers to power their AI chatbots.

What is BoeiBot?

When a Boei customer connects their website, BoeiBot visits and reads their pages so the chatbot can answer questions about their business. It only crawls sites when a customer explicitly triggers a sync — it does not crawl on a schedule or index the broader web.

Identification

  • User agent: BoeiBot/1.0 (+https://boei.help/crawler)
  • Operator: Ruby Foundry BV, Utrecht, Netherlands
  • IP addresses: Not fixed — we use a third-party crawl service. Verification is via user agent only.

Respecting your preferences

BoeiBot respects robots.txt. To block BoeiBot, add the following to your robots.txt:

User-agent: BoeiBot
Disallow: /

If you use Cloudflare and BoeiBot is being blocked by your firewall or bot protection, you can allowlist it. See how to allow BoeiBot in Cloudflare.

What data is collected

  • Page text and metadata only
  • No personal data, no form submissions, no login attempts
  • Data is used solely to answer chatbot questions on behalf of the site owner

Contact / abuse

For abuse reports or questions about a specific crawl, email [email protected].