Automated evaluations transform quality assurance
TTEC Digital helped a home technology company increase CX visibility from 1% to 100%
Automated evaluations transform quality assurance
TTEC Digital helped a home technology company increase CX visibility from 1% to 100%
Proof, not promises:
The problem
The quality assurance team at a home automation and smart technology company relied on a highly manual call evaluation process to assess its customer experience (CX). Analysts pulled small segments of calls from Amazon Connect and listened to each recording one call at a time, which meant they could evaluate only about 1% of total call volume.
This limited view made it difficult to identify broader customer sentiment trends, understand performance at scale, and act on insights hidden within the remaining 99% of conversations.
The manual workload also created an evaluation bottleneck and left supervisors with less time for associate coaching and other higher-value activities.
Our solution
TTEC Digital had an existing relationship with the company, with our Managed Services team supporting the organization since 2023. Soon after, when Amazon first launched evaluation forms in Amazon Connect, we demonstrated the new capability to the organization and showed how it could replace the cumbersome call-by-call manual reviews.
In 2025, we implemented Automated Evaluation Forms within the organization’s Amazon Connect environment. The client brought two existing evaluation forms to the project: one assessing associates’ soft skills and one assessing their technical skills. TTEC Digital configured Contact Lens rules within Amazon Connect that used automated speech recognition to analyze calls, detected key phrases, flagged conversations that met defined criteria, and automatically filled out the corresponding evaluation forms.
We were a strategic advisor to the company every step of the way. Before rollout, we conducted extensive internal testing to confirm the evaluations delivered the business outcomes the organization wanted. Our team also revamped the scoring weights on each form, assigning different weights to individual criteria to fine-tune how precisely the evaluations reflected associate performance. When a form couldn’t be fully completed automatically, AI flagged it so a human reviewer could step in, keeping people in the loop where judgment matters.
With automation handling the evaluation process, analysts could shift their attention from completing individual reviews to interpreting insights, identifying trends, and helping leaders take action. In this way, the collaboration helped uncover solutions that the organization had not initially anticipated.
Results
Automated evaluations increased call evaluation coverage from 1% to 100%, giving the organization a far more complete and reliable view of its customer interactions.
Our work also drove several important benefits for the company. Evaluations were done much more quickly once we removed the bottleneck created by manual reviews. Associate coaching became better informed since it was based on a more comprehensive view of performance.
In addition, we reduced supervisors’ workloads, freeing up leaders to focus on higher-value activities. And we gave the client great confidence in its evaluation trends, since those trends were drawn from significantly larger datasets.
Most importantly, the organization could now uncover large-scale insights far more efficiently than it could through manual evaluations alone.
A leader at the company said, “Automated evaluations enable us to get large-scale insights much more easily than doing exclusively manual evaluation.”
Another called the process “effortless,” saying, “TTEC helped find solutions to our requests that we had not anticipated.”