Skip to content
  • There are no suggestions because the search field is empty.

Setting Up A/B Testing with Agent Groups

A/B testing in Taalk allows you to compare multiple AI agent configurations—such as personas, voices, or scripts—within a single campaign. By grouping agents and tracking performance, you can identify which setup drives the best customer engagement and optimize accordingly.

 




How to Set Up A/B Testing 

Step 1: Create or Select an Agent Group

  1. Go to AI Workforce > AI Agents.

  2. Click the AI agent you want to configure.

  3. Create a new Agent Group (if needed), or select an existing one. In Voice and Behavior Settings:

  4. Repeat this process for each agent you want included in the group.

Step 2: Assign the Agent Group to a Campaign

  1. Navigate to Contact Center > Campaign.

  2. Select the campaign where you want to run the test.

  3. In campaign settings, go to Dialer Strategy > Outbound Dialing Strategy.

  4. Under AI Agents, assign the Agent Group you created in Step 1.

 

Analyzing A/B Testing Results

Where to View Results

  • Go to Campaign Reporting.

  • Use the AI Agents Utilization graph to see how each agent in the group performs.

  • Compare key metrics like:

    • Engagement Rate

    • Average Call Duration

    • Customer Sentiment

 

Tips for Effective A/B Testing

  • Use the Duplicate Agent feature to quickly create a variant:

    1. In an agent’s settings, click the three-dot menu near Save.

    2. Select Duplicate Agent to copy it.

    3. Adjust voice, tone, or script for testing.

     

  • Ensure your group has a balanced mix of agents to avoid skewed results.

  • Run tests for a sufficient duration to gather reliable data.