Back to Voice Agents

In this article

Using the Speak with Agent Feature

AlloMia's primary testing tool is the 'Speak with Agent' feature, accessible directly from the voice agent interface:

  • Access the Tool: Look for the 'Speak with Agent' button, typically displayed within your agent's configuration page.
  • Start a Test Conversation: Click the button to open a dialog interface that connects you directly to your voice agent.
  • Interact Naturally: Speak to the agent as a real caller would, asking questions or making requests that match your expected use cases.
  • Use the Controls: During the test, you can mute your microphone, adjust volume, end the call, or view the call duration.
  • End Testing: When finished, click the end call button or press the ESC key to terminate the test session.

This interactive testing environment closely simulates a real call, allowing you to experience your agent as your callers would.

Evaluating Voice Agent Responses

When testing your voice agent, evaluate these key aspects of performance:

  • Initial Greeting: Does the agent introduce itself appropriately with the correct organization name?
  • Understanding Ability: How well does the agent understand your questions or requests, especially domain-specific terminology?
  • Response Accuracy: Are the agent's answers factually correct based on the context and knowledge you've provided?
  • Conversation Flow: How natural is the back-and-forth interaction? Does the agent maintain context throughout the conversation?
  • Voice Quality: Is the selected voice clear, professional, and appropriate for your organization?
  • Task Completion: Can the agent successfully complete core tasks like scheduling, answering FAQs, or transferring to the right department?

Take notes during testing to identify specific areas that need improvement.

Iterative Improvement Process

Voice agent optimization is an iterative process. Follow these steps to systematically refine your agent:

  1. Test with Specific Scenarios: Create a list of common scenarios your agent should handle (e.g., booking appointments, answering FAQs) and test each one.
  2. Identify Issues: Note any problems with understanding, accuracy, or conversation flow.
  3. Refine System Instructions: Update the 'Initial Prompt' in the System Instructions section to address the issues you've identified. Add explicit guidance for handling problematic scenarios.
  4. Enhance Knowledge Base: If the agent lacks necessary information, consider updating or expanding your knowledge base documents.
  5. Re-test and Validate: After making changes, test the same scenarios again to verify improvements.
  6. Expand Testing Scope: Gradually introduce more complex or edge-case scenarios as the agent's performance improves.

Document both the issues and the solutions you implement to track progress over time.

Best Practices for Voice Agent Testing

Follow these recommendations for effective voice agent testing:

  • Test in a Quiet Environment: Minimize background noise to ensure the agent can clearly understand your speech.
  • Involve Multiple Testers: Include colleagues with different speech patterns, accents, and levels of technical knowledge.
  • Test Various Speaking Styles: Try speaking naturally, then with hesitations or interruptions to see how the agent handles different conversation patterns.
  • Simulate Real Conditions: If possible, test using the same devices and network conditions your callers might use.
  • Start Simple, Then Complicate: Begin testing with straightforward scenarios before introducing complex or multiple requests in a single conversation.
  • Regular Maintenance Testing: Schedule periodic testing even after deployment to ensure continued performance.

Remember that no agent will be perfect initially, and continuous improvement based on testing feedback is essential for long-term success.