Skip to main contentThis guide walks you through running your first simulation with Botster.
Prerequisites
Before you begin:
- A Botster account (sign up here)
- Access to your chatbot’s API endpoint or integration credentials
Step 1: Create a Chatbot Connection
- Log into your Botster dashboard
- Navigate to Chatbots and click Add Chatbot
- Enter a descriptive name (e.g., “Customer Support Assistant”)
- Provide your chatbot’s API endpoint URL
- Add any required authentication headers
For detailed setup instructions, see Connect Your Chatbot.
Step 2: Describe Your Chatbot
Write a clear description of what your chatbot does. This helps Botster generate realistic personas and scenarios.
Example:
“A customer support chatbot for an e-commerce platform. Handles order tracking, returns, product questions, and shipping inquiries. Supports English-speaking customers in the US and Canada.”
For best practices, see Write Effective Descriptions.
- Go to Simulations and click New Simulation
- Select the chatbot you created
- Set your simulation parameters:
- Number of personas: Start with 10
- Max conversations: Start with 50
- Max conversation length: 5-7 turns
For sizing guidance, see Set Simulation Size.
Step 4: Define What to Test
Add a simulation prompt that guides persona generation:
Example:
“Users seeking help with order status, returns, and product availability questions.”
You can also select built-in metrics like:
- Hallucination detection
- Content safety
- Topic adherence
For custom evaluation criteria, see Create Custom Metrics.
Step 5: Run and Review
- Click Run Simulation
- Wait for completion (typically 2-5 minutes for 50 conversations)
- Review results:
- Metrics overview — Performance scores across all scenarios
- Conversation transcripts — Read individual simulated conversations
- Failure analysis — Identify patterns in problematic interactions
What’s Next?