Add your website

Your website is the first and most important source of knowledge. When you add it, ASDK reads its public pages and your agents answer from what they say. This page covers adding a site, reading only some sections of it, and the settings every site has.

Add a site

The setup wizard adds your first site for you. To add another one later:

Adding a site sets up three things at once: a Website source that starts at your home page and follows links, a list of Allowed domains with your address and its www variant, and the widget settings for the site.

Each plan includes a number of sites; the line above your sites shows how many you use. When you reach the limit, Add a site is turned off: upgrade your plan or delete a site to add another. See Plans and limits.

Read only part of your site

The default Website source reads every page it can reach from your home page. To add or limit sections, use a separate source:

1. Open Knowledge, choose Add source, then A section of your website.
2. In Start reading at, enter the address where reading starts, such as https://acme.com/help. Pages under this address are read, following links.
3. Optionally open Choose which pages (optional):
   • Only pages under: one path per line, such as /help. Leave it empty to read everything under the start address.
   • Skip pages under: one path per line, such as /blog or /**/print.
4. Optionally set Most pages to read (optional). Your plan's page limit applies either way.
5. Choose Add source.

Patterns work like this: a path such as /blog covers that page and everything under it; * matches one level (/blog/*) and ** any depth (/**/print). Each list takes up to 50 patterns. Exclude pages has more examples.

Every address must be on the site itself. To read another website, add it as its own site.

Which pages ASDK reads

The crawler, ASDK-Crawler, reads public pages only. It doesn't log in, fill in forms or click buttons. It follows your robots.txt, honors Crawl-delay, and keeps its request rate low. It skips pages that add nothing to your knowledge and tells you why on the source's Pages list:

• "Too little text to be useful." Pages such as an empty category page.
• "Same content as …" or "Already in your knowledge from another source." Duplicates are kept once.

If your site blocks crawlers, uses bot protection or builds its pages only with JavaScript, see Crawl stuck or blocked.

Site settings

On Sites, open a site to change its settings. Only owners and admins can change them.

Name

How the site is called in the dashboard and in emails to your team, up to 120 characters. New sites are named after their address.

Allowed domains

The widget only works on pages of these domains, so nobody can copy your snippet and put your agent on another website. Add a domain with Add a domain, such as shop.example.com. Use *.example.com to cover every subdomain of example.com. A site can list up to 100 domains, and needs at least one.

If the widget doesn't appear on a subdomain or a staging copy of your site, its domain is probably missing from this list.

Pause site

Pause site turns the widget off on your site and stops scheduled re-reading, without deleting anything. Your knowledge and conversations are kept. Resume site turns everything back on.

Delete this site

Deleting removes the site, everything ASDK learned from it, its Q&A pairs and its conversations. The widget stops working on it right away. This can't be undone, so remove the snippet from your website as well. See Delete your data.

Next steps

• Add a sitemap to read exactly the pages you list.
• Upload files for content that isn't on your website.
• How syncing works explains when ASDK reads your site again.