In one line
AI voice agent live in production: answers the customer-portal support hotline, understands the caller's request and routes them to the right team.
Context & problem
Our call agents are the bottleneck for customer calls – there are only so many of them – and customers can't get help outside office hours. SmartIVR solves both problems.
SmartIVR replaces the rigid "press 1, press 2". Callers describe their request in their own words, and SmartIVR decides how best to resolve it. It is live in production for customer portal support and already handles part of the work.
- Understands the request (intent): e.g. login and access problems, a locked customer portal account, registration, activation code, password, SMS/MFA, contracts and documents in the portal, questions about the app, or a request for a specific department or person.
- Routes correctly: checks the availability of the responsible team and connects directly. If no target is clear, the call goes to the switchboard. If a team or agent isn't available, it records a callback or creates a support ticket. (Tool calling)
- Natural and multilingual: also understands Swiss German («Wie chan ich Ihne wiiterhälfe?»), clarifies ambiguities and continues the conversation without starting over.
- Controlled rollout: A/B testing of the new voice experience is built in. (Testing and eval tools created)
- Self-learning loop: if it can't help a customer and the call is transferred to an agent, it stays on the line, listens in, learns from the agent's answer and improves its knowledge base through a self-created pull request.
What I did
- Designed the call flow: 0800 number → SBC → Twilio → voice agent (GPT Realtime on Azure AI Foundry) → recognizes intent → hands over via SIP REFER to the right language-specific Nimbus team
- Tool calls run on sub-agents, each on a model chosen for its use case and the speed needed
- Integrated it into the existing stack: AudioCodes SBC, Teams Direct Routing, Luware Nimbus
- Built failover: if the agent is down, Twilio routes to a failover service with an announcement; manual standard failover at Swisscom if Nimbus is down
- SmartIVR (live): natural-language intent, KYC identity verification for sensitive actions such as unlocking a customer's account, routing / callback / ticket fallback
Result / impact
Live in production. For customer portal support, the SmartIVR voice agent resolves or triages 55% of all calls on its own.
Details
- My role: Voice architect and engineer
- Processes automated: call triage, intent recognition, language routing, callback scheduling, support ticket creation, KYC identity verification before sensitive actions (e.g. unlocking a customer's account)
- Compliance & data protection: KYC check before any sensitive action (e.g. account unlock)
- Standards & methods: EU AI Act transparency for voice bots; aligned with the NIST AI RMF