73% ticket deflection from a RAG support agent, live in four weeks
Support automation usually fails in one of two ways. Either it answers confidently from the wrong source and erodes trust faster than it saves time, or it is hedged so heavily that customers route around it and the deflection rate never moves.
- 73% ticket deflection
- RAG-powered support agent across 12 product lines
- Four-week rollout, running in production
What made it hard
Support automation usually fails in one of two ways. Either it answers confidently from the wrong source and erodes trust faster than it saves time, or it is hedged so heavily that customers route around it and the deflection rate never moves.
Twelve product lines makes that sharper: an answer correct for one product can be actively wrong for another, so retrieval has to respect which product the customer is actually asking about.
How it was done
Retrieval before generation
The difficulty in a RAG system is almost never the model. It is whether the right passage is retrieved, scoped to the right product line, before the model is asked anything.
Evaluated against real questions
Quality was measured against questions customers actually ask, not a curated set. A demo passes on the curated set; production does not.
Handover as a feature
Knowing when to stop and pass to a human is part of the product. An agent that cannot decline is the one that produces the confidently wrong answer.
Shipped in four weeks
Delivered as a working system rather than a pilot that needed a second project to make it real.
Where it landed
73% of tickets deflected across 12 product lines, running in production after a four-week rollout.
Deflection at that level only holds when the answers are trusted; the number reflects retrieval quality more than model choice.
Bring us the version of this you are facing
A 45-minute call with the engineer who would run it. We will tell you what we would look at first, and whether it is a project at all.
Talk to an Engineer