Skip to main content
This guide walks you through running your first simulation with Botster.

Prerequisites

Before you begin:
  • A Botster account (sign up here)
  • Access to your chatbot’s API endpoint or integration credentials

Step 1: Create a Chatbot Connection

  1. Log into your Botster dashboard
  2. Navigate to Chatbots and click Add Chatbot
  3. Enter a descriptive name (e.g., “Customer Support Assistant”)
  4. Provide your chatbot’s API endpoint URL
  5. Add any required authentication headers
For detailed setup instructions, see Connect Your Chatbot.

Step 2: Describe Your Chatbot

Write a clear description of what your chatbot does. This helps Botster generate realistic personas and scenarios. Example:
“A customer support chatbot for an e-commerce platform. Handles order tracking, returns, product questions, and shipping inquiries. Supports English-speaking customers in the US and Canada.”
For best practices, see Write Effective Descriptions.

Step 3: Configure Your Simulation

  1. Go to Simulations and click New Simulation
  2. Select the chatbot you created
  3. Set your simulation parameters:
    • Number of personas: Start with 10
    • Max conversations: Start with 50
    • Max conversation length: 5-7 turns
For sizing guidance, see Set Simulation Size.

Step 4: Define What to Test

Add a simulation prompt that guides persona generation: Example:
“Users seeking help with order status, returns, and product availability questions.”
You can also select built-in metrics like:
  • Hallucination detection
  • Content safety
  • Topic adherence
For custom evaluation criteria, see Create Custom Metrics.

Step 5: Run and Review

  1. Click Run Simulation
  2. Wait for completion (typically 2-5 minutes for 50 conversations)
  3. Review results:
    • Metrics overview — Performance scores across all scenarios
    • Conversation transcripts — Read individual simulated conversations
    • Failure analysis — Identify patterns in problematic interactions

What’s Next?