16.3% vs 11.6%: how we measured whether our AI agent actually sells more
How ZAVORA compared its WhatsApp sales agent against the rules bot it replaced: same conversations, a clear baseline, and the limits of the sample published next to the number.
Every AI startup says its agent is better. At ZAVORA we wanted a number we could defend in front of a skeptical customer, and we wanted to publish it with its limits attached. This is how we measured it, and what the number does and does not mean.
Beat the baseline, not a straw man
The comparison was not "AI versus nothing". It was our agent versus the rules-based bot it replaced, the menus and keywords that many businesses on WhatsApp already use. A number only means something next to the best alternative a customer actually has.
Same conversations, same catalog
In August 2026 we ran the same set of conversations through both engines, 86 turns each, against the same product catalog. Same questions, same products, same prices. The only thing that changed was the engine answering.
- The AI agent closed a sale in 16.3% of cases. The rules bot closed 11.6%. That is about 40% more, relative.
- The agent gave a useful recommendation 73% of the time, against 43% for the bot.
Publish the limits with the number
Here is the part most companies leave out. This was a controlled test, not a market study. Eighty-six turns per engine is enough to see a clear difference, not enough to promise any specific business a specific lift. So that is exactly what ZAVORA's public guide says, right next to the figures, with the date of the measurement.
Hype expires. Credibility compounds.
An agent that admits what it does not know
Part of why the agent sells more is that it does not invent. When a product or a price is not in the catalog, it says so and asks. A rules bot fails silently; a careless AI fails confidently. Neither closes the sale. We also built a check into our own content pipeline that blocks publishing any capability the product does not actually have.
What I would tell any founder
- Pick the real alternative as your baseline, not the easiest one to beat.
- Hold everything constant except the thing you are testing.
- Put the date and the limits next to the number. The people you want as customers will trust you more for it.
ZAVORA was co-founded by Camilo Abella and me. Camilo leads the product and the conversational agent; I lead integrations and the platform. The measurement and its limits are published in ZAVORA's guide (in Spanish).