Skip to main content
The September 2025 PolyAI Agent Studio release focuses on the addition of new Webchat configuration options and individual Test Cases to complement the previously introduced Test Sets. Expand the items for details:
Configure, preview, and test non-voice Webchat deployments directly in Studio.webchat-configWhat’s new:
  • There is a new Webchat configuration section in the Agent Studio Settings tab.
  • You can customize the appearance of the chat widget quickly using the live preview.
  • You can test the widget quickly in-browser with Preview Demo or in any site using the embed script tag: one-webchat-click
The Test Suite now supports individual Test Cases.test-casesWhat’s new:
  • You can use a conversation to create a Test Case against a single scenario.
  • These are run directly from the Test Cases tab, after selecting the agent version (Draft/Sandbox) to test against.
  • Outcomes and last-run timestamps are tracked automatically.
  • Organize cases into Test Sets to rerun whole groups at once and view aggregated results with charts.
  • Cases can belong to multiple sets, so you can target them by feature or however else is required.
The Agent Studio home page now surfaces more trend data and a clearer quality summary.home-v2What’s new:
  • Average PolyScore added to Quick Insights
  • New charts for Containment rate and PolyScore over time
  • Consistent “PolyScore” naming across tables, filters, and details
Smart Analyst now supports structured responses using reasoning logic. A persistent chat history has also been added.smart-analyst-reasoningWhat’s new:
  • Structured responses: answers now include reasoning logic along with the final answer, as well as more clearly labelled sources and steps. smart-analyst-history
  • Chat history: resume previous analyses; conversations stored with redacted transcript data
  • Auto titles with the ability to rename and delete old analyses from the history list.
You can now buy and assign phone numbers from the new Numbers tab in the Agent Studio UI, and you can optionally link these to individual multi-site variants.phone-numbersWhat’s new:
  • New Numbers page under Configure shows all numbers by environment
  • Add, view, and delete numbers in Sandbox and Pre-release.
  • Assign numbers to variants for multi-site projects.
Functions can now write structured logs Conversation Review and the Conversations API using conv.log.conv-logWhat’s new:
  • Use conv.log.info, conv.log.warning, and conv.log.error inside functions
  • Entries appear in Conversation Review → Diagnosis and using the Conversations API.
  • Mark entries as PII so they are only visible to users with permission.
Third-party QA tools and internal test rigs can now read tool/function call events from the Conversations API.What’s new:
  • Every function call made during a conversation is now surfaced in the API response
  • Makes it possible to verify not just the dialogue, but also the actions taken behind the scenes
  • Access is scoped per environment (Sandbox, Pre-release, Live) so external tools don’t touch production data