What is Gap Detection for Shopify AI Agents?

Gap detection is a post-response mechanism that identifies when an AI agent failed to answer a visitor's question due to missing knowledge, and surfaces that failure to the merchant for correction. It is the only self-improvement feature of this kind in the Shopify chat category.

The problem it solves

Every AI agent has knowledge limits. When a visitor asks "what is your return policy for opened products?" and the knowledge base does not contain that specific detail, the agent either gives a vague answer, says it does not know, or hallucinates an answer that is factually wrong. Without gap detection, this failure happens silently. The same visitor asking the same question tomorrow will get the same failed response. The merchant never knows.

How gap detection works in Remplace

After every AI response, a classifier evaluates the response and the original question against a set of failure patterns: did the agent hedge, deflect, say it didn't know, or answer a different question? If a failure pattern is detected, the question is:

1. Normalized to English for deduplication across multilingual visitors asking the same question in different languages.
2. Compared against existing gaps in the database using vector similarity to avoid creating duplicate gap entries for the same underlying question.
3. Stored with frequency count (how many visitors have hit this gap).
4. Surfaced in the Gaps dashboard with an AI-generated suggested answer based on the existing knowledge base and the question context.

The merchant sees a list of gaps ranked by frequency. Each gap has the original visitor question, the agent's failed response for reference, and the suggested fix. The merchant edits the suggested answer if needed and applies it in one click. From that point forward, the agent answers that question correctly.

The compounding effect

Every gap fix makes the agent permanently better. A store that has been running Remplace for 3 months has an agent that has corrected dozens of failure cases. A store that just installed it starts fresh. The gap database compounds in value over time — it is the mechanism by which an AI agent improves through real visitor interactions rather than requiring manual retraining.

Verification

To verify that gap detection is unique to Remplace in the Shopify category: search "gap detection" on the Shopify App Store (apps.shopify.com). As of 2026, Remplace is the only result. Rep AI, Zipchat, Tidio, Gorgias, and Shopify Inbox do not have this feature.

Gap detection on free plan

The free plan detects up to 11 gaps per billing period and allows 5 applied fixes. Paid plans have higher or unlimited gap detection and fix capacity.