Training Auto-Sync

Auto-sync keeps trained website content up to date without a manual re-train.

How to get there: Go to Setup → AI agent → select your chatbot → Training → Knowledge → click the Manual sync or Auto sync badge on a source. For one page, open its ··· menu and choose Update settings.

Sitemap Sources

At the selected frequency, Boei reads the sitemap again:

  1. New URLs are added and trained.
  2. URLs removed from the sitemap are removed from the source.
  3. Existing URLs are refreshed when their sitemap <lastmod> is newer than the previous crawl.
  4. If <lastmod> is absent or unreadable, Boei uses a time-based fallback.

Your sitemap should provide an accurate <lastmod> for each URL. Use the date when that page's content last changed. Do not set every URL to the deployment date, because this can cause unnecessary page checks and fetching costs.

Sitemaps support Daily, Weekly, and Monthly checks. A correct <lastmod> can trigger a refresh at each check. When <lastmod> is missing or unreadable, Boei checks existing page content about once a month. A present <lastmod> is trusted, so an incorrect frozen value can prevent content refreshes. This avoids charging for an unconditional crawl of every trained page.

Site Crawls

Crawled websites can auto-sync Daily, Weekly, or Monthly. Daily checks can generate more crawl-provider requests than weekly or monthly checks, especially for large sites. Choose the frequency that matches how often the content changes. Boei maps the site again, adds new URLs, and refreshes trained pages that are older than the selected interval. Existing schedules stay unchanged; new sources default to manual updates. URLs missing from a crawler map are not deleted, because crawler maps can be incomplete.

Individual Pages

Individual pages offer Daily, Weekly, and Monthly updates. A page inside a source can also have its own schedule, unless its parent source already has auto-sync enabled. This prevents duplicate crawls.

During an automatic refresh, Boei checks whether a page has changed. Unchanged pages keep their existing training data, which avoids unnecessary processing costs.

Manual Sync and Email

Choose Sync now from a source's ··· menu to check it immediately. This uses the same update rules as a scheduled check. If you ask Boei to train a page again, an unchanged automatic check will not cancel that request.

Source sync emails go to the chatbot owner. They summarize new, changed and removed pages after processing. Pages that failed or could not finish are listed separately. If every page is unchanged, Boei sends no sync email. You can still see the last check time in the source settings.

For each sitemap, open its settings under Knowledge. Below the update frequency, use Email the chatbot owner after a sync with changes to turn these emails on or off. This setting covers that sitemap's sync emails, including page problems. Automatic updates continue when you turn the emails off.

You can also choose Turn off emails for this sitemap at the bottom of a sync email. Confirm on the page that opens. You do not need to log in. To turn emails back on, use the same sitemap settings under Knowledge.

A separate email is sent when a user-started training batch has finished. The sitemap email setting does not change that preference.

Availability

The frequency control shows the available schedules. Choosing automatic updates without access opens the upgrade explanation and keeps the saved schedule unchanged. Auto-sync is included during an eligible free trial; afterwards you need a plan that includes it. Check the displayed availability for your account.