Train AI support agent using website crawler in Chatbase | Alpha | PandaiTech

Train AI support agent using website crawler in Chatbase

Initialize a Chatbase agent by crawling a target website and adding specific knowledge sources like Q&A and text snippets.

Learning Timeline
Key Insights

Optimizing with Q&A

Use the Q&A section specifically for the top 10 questions that account for the majority (e.g., 90%) of your support volume. Hard-coding these ensures the chatbot gives the exact approved answer every time.

Using Text Snippets for Rules

For rigid procedures like 'Refund Requests,' do not rely solely on crawled pages. Paste the exact procedure into the 'Text' section to ensure the AI follows specific logic steps.
Step by Step

Initializing the Website Crawler

  1. Click the 'Build your AI agent' button on the Chatbase homepage.
  2. Select the 'Website' data source option.
  3. Paste the target URL into the provided text field.
  4. Set the 'Use Case' to 'Customer Support Agent'.
  5. Click the 'Continue' (or 'Fetch Links') button to initiate the crawler.
  6. Wait for the process to finish scanning the site (e.g., finding ~58 links).
  7. Review the list of populated URLs displayed on the screen.

Refining Data and Training the Agent

  1. Identify irrelevant pages in the crawled link list.
  2. Click the exclude/delete icon next to any link you wish to remove from the training data.
  3. Add specific URLs manually if the crawler missed a required page.
  4. (Optional) Navigate to the 'Files' tab to upload PDF or Word documents containing internal knowledge.
  5. (Optional) Navigate to the 'Q&A' tab to manually input high-frequency questions and answers.
  6. (Optional) Navigate to the 'Text' tab to paste specific snippets (like refund policies).
  7. Click the 'Train and continue' button to finalize the data ingestion.

More from Build & Deploy Autonomous AI Agents

View All