- What are customer support chat bots?
- Type 1: rule-based bots
- Type 2: retrieval (knowledge) bots
- Type 3: agentic bots
- Type 4: hybrid and AI-assist
- The four types compared
- Which type fits your business
- The vendor landscape
- Buying criteria that predict outcomes
- The tradeoffs nobody puts on the pricing page
- When a chat bot is the wrong answer
- Where Bookbag sits
What are customer support chat bots?
Customer support chat bots are automated systems that hold a conversation with a customer to answer questions or resolve requests without a human agent. The term covers four genuinely different technologies, and the difference between them is worth more than the difference between any two vendors inside a type. A rule-based bot and an agentic bot are both sold as customer support chat bots, and one resolves roughly a tenth of a queue while the other clears well over half.
The four types arrived in waves and all four are still on the market, which is why comparison is confusing. Rule-based bots came first and are still shipped as free or bundled add-ons. Retrieval bots arrived with usable language models and answer from your documentation. Agentic bots came last and connect to your systems to take actions. Hybrid and AI-assist tools sit alongside, helping human agents rather than replacing them.
Sorting a shortlist by type before comparing features saves most of the evaluation work. Two products in different types are not competitors even when their marketing pages look identical, and the cheaper one is often cheaper because it does substantially less. The rest of this piece takes each type in turn, says where it genuinely fits, and names what it costs you.
Customer support chat bots: automated conversational systems that handle inbound customer requests. Four types dominate. Rule-based bots follow decision trees (10-25% autonomous resolution). Retrieval bots answer from documentation (25-45%). Agentic bots reason over live data and take actions (50-70%). Hybrid AI-assist tools draft replies for human agents instead of resolving independently.
Type 1: rule-based bots (decision trees)
Rule-based bots match keywords or button clicks against a flow somebody authored in advance. Every path is drawn by hand. Ask a question inside the tree and you get a fast, predictable, correct answer. Ask anything else and you get a menu, a rephrase prompt, or a dead end. Their ceiling is the number of paths the team had patience to build, which in practice means the top eight to twelve intents.
That sounds dismissive, and it should not be. Rule-based bots have real virtues that the newer types partly gave up. They are fully deterministic, so they cannot invent a fact. They are auditable, which matters in regulated categories where every response has to be pre-approved. They cost little or nothing, since most help desks bundle one. And for a narrow, high-volume, unambiguous flow (order lookup by number, opening hours, a returns portal handoff) they are perfectly adequate.
The cost shows up as maintenance and abandonment. Every policy change means re-authoring flows, and every unanticipated phrasing produces a customer typing 'agent' at the second reply. Legacy intent-matching systems consistently benchmark around 60-70% on intent recognition, which is the root of the menu-loop experience customers associate with the word chatbot.
- Best fit: a handful of very high-volume, unambiguous questions; strict regulatory approval requirements; a near-zero budget.
- Real strength: deterministic, auditable, cannot hallucinate, cheap or bundled.
- Real weakness: fails outside the tree, high authoring and maintenance cost, drives the escape-to-human reflex.
- Typical autonomous resolution: 10-25% of an ecommerce queue.
- Tell-tale in a demo: the first reply is a list of buttons rather than an answer.
Type 2: retrieval bots (answer from your documentation)
Retrieval bots (often sold as AI knowledge bots, or built on the RAG pattern) index your help centre, policy pages, and product content, then generate an answer restricted to what they retrieved. Nobody authors flows. Coverage is whatever your documentation covers, and quality tracks the quality of that documentation almost exactly.
For policy and product-information questions this is a genuine step change over decision trees. Return windows, warranty terms, shipping zones, care instructions, ingredient lists: all of it becomes answerable in the customer's own phrasing without anyone maintaining a synonym list. Grounding also keeps the accuracy respectable. Support benchmarks put ungrounded models at 15-30% incorrect or invented answers, while the same models restricted to retrieved sources fall to low single digits.
The ceiling is hard and predictable: a retrieval bot knows nothing about this customer or this order. Ask where a package is and the honest ones say to check the confirmation email. In ecommerce that is the wrong ceiling, because order status is typically 30-45% of the queue. A retrieval bot deployed at a store often posts a good accuracy score and a disappointing deflection number for exactly this reason.
- Best fit: SaaS and information businesses, stores with heavy pre-purchase product questions, teams with strong documentation.
- Real strength: no flow authoring, handles novel phrasing, deploys in hours, accurate when grounded.
- Real weakness: no customer or order context, cannot take actions, inherits every gap in your docs.
- Typical autonomous resolution: 25-45%, concentrated in policy and product questions.
- Tell-tale in a demo: it answers your policy question well and deflects your order question to email.
Type 3: agentic bots (reason, look up, act)
Agentic bots add two things to retrieval: live data access and permitted actions. They read the actual order record rather than guessing, and they can do something about it. Rather than describing the return policy, the agent checks eligibility against the order date, creates the RMA, issues the label, and posts the tracking. The customer's request ends where it started instead of bouncing to a queue.
This is where the volume is in ecommerce, because it is the only type that touches the largest categories. Order status becomes a lookup with 85-95% accuracy. Returns and exchanges reach 70-85% when the policy is clear and the actions are wired. Refund status, address changes before fulfilment, subscription skips and swaps all become self-serve. Together those categories are most of a store's inbound, which is where the industry's 'up to ~70%' deflection framing comes from.
The tradeoffs are real. Actions need permissions, caps, and audit logs, because a system that can issue refunds is a system that can issue the wrong refund. Setup requires connecting your store rather than pasting a script tag, though on Shopify that is usually a same-day job. And the honest one: agentic bots can still be wrong, so escalation discipline and a weekly review sample stop being optional the moment the bot can move money.
| Action | What it replaces | Typical resolution | Guardrail to set |
|---|---|---|---|
| Order and delivery lookup | WISMO ticket plus follow-up | 85-95% | None; read-only |
| Return / exchange creation | Manual RMA and label email | 70-85% | Policy window, condition rules |
| Refund issue | Agent processing a refund | 60-80% | Hard value cap per order |
| Address or order edit | Urgent pre-fulfilment ticket | 65-85% | Fulfilment status check |
| Subscription skip / pause / swap | Retention ticket | 70-85% | Offer rules, cancel escalation |
| Product recommendation | Pre-sale question, lost sale | n/a (revenue side) | Stock and margin rules |
Type 4: hybrid and AI-assist (help the human, not replace them)
The fourth type does not talk to customers at all, or does so only under supervision. AI-assist drafts a reply the agent edits and sends, summarises long threads, suggests the right macro, or scores sentiment for routing. Hybrid configurations put an agentic bot in front but keep a human approving anything above a risk threshold.
This is the underrated option for two kinds of team. Brands where voice is the product (luxury, wellness, anything consultative) get most of the speed benefit without ceding tone control. And teams with genuinely messy documentation get value on day one, because the human is the accuracy backstop while the content gets fixed. Assist typically cuts handle time 20-40% rather than removing tickets, which is a smaller but much more reliable win.
The catch is that it does not scale the way automation does. Assist saves minutes per ticket; automation removes tickets. If your problem is that volume grows faster than headcount, assist alone will not close the gap, and a hybrid that requires human approval on every reply has quietly recreated the staffing constraint you were trying to escape. Most teams that start here move to a hybrid with an autonomous tier for the safest categories within a quarter or two.
Let the agent resolve order status, tracking, and policy questions autonomously. Let it draft (but not send) replies on returns and refunds for the first month, then release the categories where the review queue shows consistent accuracy. Keep complaints, damage claims, and anything legal on a human-only path permanently.
The four types compared
The table below is the compressed version of everything above. Read the last two columns first: setup effort and resolution rate together tell you the shape of the return, and they do not move in the direction most buyers expect. Rule-based bots are the cheapest to license and the most expensive to maintain, because every flow is hand-drawn and every policy change means re-authoring.
One column deserves a note. 'Can be wrong' is not a defect list, it is a design decision. Deterministic systems cannot invent facts and also cannot handle anything they were not told about. Generative systems handle novelty and can be confidently wrong when ungrounded. Grounding plus escalation thresholds is how the second group buys back most of the first group's safety without giving up its coverage.
| Dimension | Rule-based | Retrieval | Agentic | AI-assist |
|---|---|---|---|---|
| How it decides | Pre-drawn flow | Retrieved docs | Docs + live data + actions | Suggests to a human |
| Reads live order data | No | No | Yes | Via the agent's console |
| Takes actions | No | No | Yes, permissioned | Human executes |
| Handles novel phrasing | No | Yes | Yes | Yes |
| Can state something false | No | Rarely if grounded | Rarely if grounded | Human catches it |
| Autonomous resolution | 10-25% | 25-45% | 50-70% | 0% (cuts handle time 20-40%) |
| Setup effort | Weeks of flow authoring | Hours | Hours to days | Hours |
| Ongoing maintenance | High | Content upkeep | Content upkeep + review | Low |
| Typical monthly cost | $0-50 (often bundled) | $30-200 | $100-800 | $20-60 per agent |
Which type fits your business
Match the type to the shape of your queue, not to your revenue. Two stores with identical turnover can need different tools because one sells a single SKU with a simple policy and the other runs eleven thousand variants with sizing questions. The decisive inputs are monthly ticket volume, the share of tickets that are order-related, and how good your documentation currently is.
The one rule that holds across every size: if order status is a third or more of your inbound, only an agentic bot moves the number. Every other type will produce a reasonable accuracy score on the tickets it can reach and leave your largest category untouched. That single fact resolves most shortlists faster than a feature matrix does.
| Your situation | Best-fit type | Why | Watch out for |
|---|---|---|---|
| Under 200 tickets/month | Rule-based or none | Setup and review time exceeds hours saved | Buying ahead of the volume |
| 200-1,000 tickets, order-heavy | Agentic | WISMO and returns dominate; actions pay back fast | Vendors selling retrieval as agentic |
| 200-1,000 tickets, pre-sale heavy | Retrieval or agentic | Product questions answer well from good content | Thin catalog attribute data |
| 1,000+ tickets, multi-channel | Agentic + assist | Volume justifies both automation and handle-time gains | Channels that are separate inboxes |
| Luxury or consultative brand | AI-assist, then hybrid | Voice control matters more than deflection | Over-automating the brand experience |
| Regulated or high-liability | Rule-based or assist | Every response needs approval and audit | Ungrounded generative replies |
| Documentation is stale | Fix content first | Every type inherits your content quality | Expecting a vendor to fix this |
The vendor landscape: which chatbots company does what
The vendors cluster into five groups, and knowing which group a product came from predicts its strengths better than its feature page does. Products keep the shape of the problem they were originally built to solve, even after several years of adding capabilities on top.
Two practical consequences. First, help-desk-first products give you excellent ticketing and an AI layer that is usually newer and thinner than the incumbent's marketing suggests. Second, general chatbot builders give you a strong retrieval experience and leave the store integration to you, which is a project rather than a setting. Neither is a flaw, but both are frequently mis-bought by merchants who assumed the category was uniform.
| Vendor group | Examples | Built to solve | Where it is strong | Where merchants get surprised |
|---|---|---|---|---|
| Help-desk first | Zendesk, Gorgias, Freshdesk, Re:amaze | Ticketing and agent workflow | Inbox, SLAs, reporting, team management | AI layer added later; automation depth varies |
| Live chat first | Tidio, LiveChat, Crisp, Intercom | Real-time conversations and sales chat | Widget experience, routing, engagement | Order actions often need extra apps |
| General AI chatbot builders | Chatbase, Botpress, Voiceflow | Any-website Q&A over your docs | Fast retrieval setup, flexible, cheap to start | Not ecommerce-native; you build the integrations |
| Enterprise conversational AI | Ada, Netomi, Sierra, Decagon | Large contact centres | Scale, governance, complex routing | Longer deployment; enterprise pricing |
| Ecommerce-native AI agents | Bookbag, Siena, Yuma | Store tickets end to end | Order data, returns, actions, fast setup | Less useful outside ecommerce |
Buying criteria that actually predict outcomes
Most feature matrices in this category compare things that do not vary much. Every serious product does multilingual, sentiment, and a widget. The criteria below are the ones where products genuinely differ and where the difference shows up in your resolution rate three months later. They are ordered by how often they decide the outcome.
Notice that only two of the seven are about the AI. The rest are about data, permissions, handoff, and commercial structure. That ratio reflects what actually determines results: architecture and inputs beat model choice, and pricing structure quietly shapes how the system gets configured.
- 1Live store data: can it read real orders, fulfilment states, tracking, and customer history, natively? If this needs custom development, your WISMO category is not getting solved this quarter.
- 2Actions with guardrails: which actions can it complete end to end, and what caps, permissions, and audit logs surround them? 'Can issue refunds' and 'can issue refunds up to $75 with a log' are different products.
- 3Grounding and refusal behaviour: does it decline and escalate when the data does not support an answer, or does it improvise? Test this on purpose during a trial.
- 4Handoff quality: does the human agent receive the transcript, order, and a summary? Poor handoff converts deflection into re-work.
- 5Channel coverage with shared context: email, widget, WhatsApp, Instagram DM, Messenger, SMS, and whether a customer moving between them has to repeat themselves.
- 6Pricing structure at your real volume, including peak season. Per-resolution pricing charges you more exactly when the bot works well; per-seat pricing charges for the headcount you are trying not to add.
- 7Time to first correct answer. Ecommerce-native tools are typically live in under a day. Platforms that need flow authoring or custom integration take weeks, and that gap is real money.
The tradeoffs nobody puts on the pricing page
Every type in this category buys something and gives something up, and the giving-up part rarely appears in vendor material. Naming the tradeoffs upfront is what separates a deployment that holds up at month six from one that gets quietly switched off after peak season.
The most expensive one is the deflection trap. Deflection is the easy number to put on a dashboard, so teams optimise it, and the fastest way to raise deflection is to stop escalating, including the cases that should escalate. Accuracy and CSAT lag by weeks because they need sampling and customer responses, so the damage arrives a month later as repeat contacts and disputes. Read all three together from week one or do not read any of them.
- Speed vs control: generative bots handle anything but need grounding and thresholds; deterministic bots are safe and narrow. You pick which risk you prefer.
- Coverage vs quality: widening scope to more ticket types always lowers blended accuracy at first. Widen deliberately, one category at a time.
- Cost vs incentive: per-resolution pricing aligns the vendor's revenue with automating cases you might want escalated. Flat pricing removes that pressure but charges you during quiet months.
- Automation vs brand voice: a technically correct reply in the wrong register still costs CSAT. Budget real time for tone configuration, not just knowledge import.
- Deflection vs trust: customers forgive an escalation and remember a confident wrong answer. Optimise for the second, not the first.
- Vendor lock-in: knowledge, conversation history, and configuration portability vary a lot. Ask how you would export everything before you sign.
When a customer support chat bot is the wrong answer
Sometimes the correct decision is not to buy one, and it is worth saying so plainly. Below roughly 150-200 tickets a month, the configuration and weekly review time usually exceeds the hours saved. A well-built help centre, three good macros, and a shipping-delay notification email will remove more work than any bot will at that volume, and cost nothing per month.
Documentation is the second gate. A chat bot faithfully reproduces whatever content it is given, including a return window that changed last spring. If your policies live in three people's heads, two weeks of content work before you buy changes the result more than the vendor choice does. The same goes for catalog data: sizing and compatibility answers come from structured attributes, and no amount of model quality substitutes for a missing field.
The third case is queue shape. A business whose tickets are mostly bespoke, consultative, or regulated has a small automatable share, and the honest projection is 20-30% deflection rather than 70%. That can still pay for itself at volume, but buy against that number. A vendor who quotes you the headline figure without asking about your ticket mix has told you something useful about the vendor.
Tag one month of tickets by category so you know your real mix. Update the six most-contacted policy pages. Add structured attributes for size, fit, materials, and compatibility to your top 100 SKUs. Every one of these raises the ceiling for every vendor you later trial, and none of them cost a subscription.
Where Bookbag sits in this landscape
Bookbag is in the fourth group: an ecommerce-native AI agent rather than a general chatbot builder or a help desk with AI attached. It connects natively to Shopify, WooCommerce, and BigCommerce, and also ships an API and npm SDK for custom stacks. That connection is the point. Order questions become live lookups, return requests become created RMAs, and refunds happen inside caps you set rather than being described to the customer.
It runs across the website widget, email, WhatsApp, Instagram DM, Facebook Messenger and Slack with shared context, plus a help desk and shared inbox so escalations land somewhere with the full transcript and order attached. Skills package the common playbooks (returns, refunds, cancellations) so you are not authoring flows. Most stores go live in under a day: connect the store, import help docs and catalog, drop in the widget snippet.
Two honest limits. Bookbag is built for ecommerce, so if your support is not order-shaped, a general retrieval product may fit you better. And it is not the cheapest option in the landscape; a bundled help-desk bot costs less. Pricing is flat monthly plans with message-credit allowances and a spend cap you set, not per-resolution fees, which means a good month does not produce a surprise invoice and there is no commercial pressure to automate cases that should escalate.
Key takeaways
- Customer support chat bots are four different technologies: rule-based (10-25% resolution), retrieval (25-45%), agentic (50-70%), and AI-assist (0% autonomous, 20-40% handle-time reduction).
- If order status is a third or more of your inbound, only an agentic bot with live store data moves the number.
- Vendors keep the shape of the problem they were built for: help-desk-first, live-chat-first, general builders, enterprise CAI, and ecommerce-native agents behave differently.
- The criteria that predict outcomes are live data, actions with guardrails, refusal behaviour, handoff quality, channel context, pricing structure, and time to first correct answer.
- Optimising deflection alone is the most expensive mistake; the fastest way to raise it is to stop escalating cases that should escalate.
- Below 200 tickets a month, or with stale documentation, fixing content beats buying software.