WARQLINE
WQL.WORK.ECOMMERCE.SUPPORT.AGENT// ONLINE
/ 05 — GLOBAL E-COMMERCE PLATFORM

73% ticket deflection from a RAG support agent, live in four weeks

Support automation usually fails in one of two ways. Either it answers confidently from the wrong source and erodes trust faster than it saves time, or it is hedged so heavily that customers route around it and the deflection rate never moves.

What was delivered
  • 73% ticket deflection
  • RAG-powered support agent across 12 product lines
  • Four-week rollout, running in production
CHALLENGE

What made it hard

Support automation usually fails in one of two ways. Either it answers confidently from the wrong source and erodes trust faster than it saves time, or it is hedged so heavily that customers route around it and the deflection rate never moves.

Twelve product lines makes that sharper: an answer correct for one product can be actively wrong for another, so retrieval has to respect which product the customer is actually asking about.

APPROACH

How it was done

Retrieval before generation

The difficulty in a RAG system is almost never the model. It is whether the right passage is retrieved, scoped to the right product line, before the model is asked anything.

Evaluated against real questions

Quality was measured against questions customers actually ask, not a curated set. A demo passes on the curated set; production does not.

Handover as a feature

Knowing when to stop and pass to a human is part of the product. An agent that cannot decline is the one that produces the confidently wrong answer.

Shipped in four weeks

Delivered as a working system rather than a pilot that needed a second project to make it real.

Technology
RAGLLM evaluationVector retrievalProduction observability
OUTCOME

Where it landed

73% of tickets deflected across 12 product lines, running in production after a four-week rollout.

Deflection at that level only holds when the answers are trusted; the number reflects retrieval quality more than model choice.

AI Engineering →

Bring us the version of this you are facing

A 45-minute call with the engineer who would run it. We will tell you what we would look at first, and whether it is a project at all.

Talk to an Engineer