Open Training → Knowledge → Add source → Website.
Use the address field for one website, a sitemap URL or several page URLs, one per line. You can paste addresses with or without https://.
For one homepage, Also add other pages from this website is selected by default. Uncheck it to add only the homepage. For one specific page, Also add subpages is off by default. Turn it on to discover only that page and its descendants: /help/start belongs to /help, but /helpful does not.
With either option enabled, Boei looks for a sitemap first and otherwise discovers URLs through the website crawler. A selected subpath remains the boundary on later syncs too.
For several pasted links, sitemaps and file links, no scope checkbox is shown. Several links add only those addresses, while an explicitly pasted sitemap contributes its listed pages. Documents use document processing. Duplicate addresses are removed.
Discovery lists addresses without fetching the contents of every page. Pages behind a login or missing from your sitemap may need another source.
Reading and training continue in the background. You can leave the screen. Boei trains what fits your available space and pauses when you need to free space or upgrade. It retains measured content for resuming. See Training credits.
A page already added individually can be adopted into its website source when discovered there. It should not require a second copy to be trained.
Supported online document URLs use the document-reading path in the backend, including when discovered through a sitemap. A document discovered as a website URL stays in that website source. Boei does not automatically download every PDF merely linked somewhere in an HTML page; its address must be discovered or supplied.
Use the source's search field and View filters. Open a page to inspect the available extracted content and actions. Use ··· for deletion and update settings. Status labels distinguish content ready to use, content not trained, work in progress and items needing action. Open an item needing action for its reason.
Website groups and individual pages have automatic-update settings. Use Sync now for a source refresh. Use page training when you need to explicitly read and process a particular page again.
Boei removes common boilerplate. Set CSS filters in the source's ··· → Website settings if you need more control. If reading fails, inspect the error before retrying; see Crawl errors.
Check missing answers to find real customer questions that need better content.