A Consumer Health Company Cuts Store Visit Time by 60%

How Clobotics used AI recognition and exception review to make pharmaceutical retail execution faster, more accurate, and easier to trust.

Overview

Accurate retail execution without adding work for the frontline.

A global consumer health company needed a more accurate and scalable way to verify execution across OTC pharmacies and HPC retail in China. Instead of adding another frontline app, Clobotics embedded fine-grained recognition, channel rules, evidence checks, and human review directly into the customer’s existing SFA workflow.

Customer
Global consumer health company
Market
China
Channels
OTC pharmacies and HPC retail
Program scope
482 SKUs and 274 POSM types
60%Less time across the complete store visit
1.5×More stores covered per representative each month
98.32%SKU availability E2E accuracy
91.1%Target SKU shelf-position E2E accuracy

The business context

In a low-growth market, every store matters

China’s pharmaceutical market entered 2026 under pressure. In the first quarter, all-channel pharmaceutical sales declined 5.4% year over year, while retail increased by only 0.6%, making it the only major terminal channel to remain in positive growth.

When the retail channel is protecting limited growth, details inside every pharmacy and store matter more: whether the right product is available, whether its price is correct, whether campaign materials are in place, and whether the shelf position meets the intended execution standard.

For this global consumer health company, the challenge was not simply collecting more store photos. It was converting those photos into accurate, explainable, and operationally fair decisions at scale.

Source: Sinohealth, “2026 Q1 Pharmaceutical Market,” citing CMH data.

Challenge

Pharmaceutical recognition is harder, and the cost of error is greater

A store visit can appear straightforward. A field representative arranges the products, places the required price tags and promotional materials, takes a photograph, and submits the task. A single recognition error can still break the workflow.

The system may identify the correct brand but select the wrong product variant because two packages use almost the same color, typography, and layout. The only meaningful difference may be a dosage or pack-size line printed in small text near the corner of the box. If the wrong SKU is recorded, the result cannot support a dependable execution decision.

The cost extends beyond one image. The representative may need to rearrange the display, adjust the angle, take another photograph, or raise a dispute. If task acceptance is connected to performance-based compensation, repeated errors can reduce trust in the system and make the process feel unfair. Headquarters may also receive a distorted record of what happened in the store.

01

Distinguish highly similar products

The program maintained 482 products: 85 OTC SKUs and 397 HPC SKUs. Brand-level recognition was not enough when variants differed only by small printed details.

02

Understand where each product was displayed

Presence was only the first question. The system also needed to interpret the fixture, shelf boundaries, levels, and relative position before applying the customer’s standard.

03

Make AI dependable for frontline work

High-volume cases needed fast automation, while obstructed, ambiguous, or disputed submissions required a clear path to human review.

Solution

One workflow for recognition, verification, and action

Rows of medicine boxes and bottles arranged on pharmacy shelves
Reliable execution depends on recognizing the right pharmaceutical product within its real shelf context.

Clobotics combined computer vision, multimodal AI, business rules, and human exception review in one retail execution workflow. Its visual-recognition SDK was embedded directly into the customer’s existing SFA application, so representatives could receive tasks, capture evidence, and receive results without switching systems.

Embedded workflow

Work inside the existing SFA application

The representative received the assigned task, captured store evidence, and invoked the Clobotics AI workflow from the same frontline experience.

Real time through SDK

Return availability, facings, and shelf position

SKU availability, facing counts, and shelf-position results returned through the embedded SDK while the representative was still in the workflow.

T+1 through CSV + SDK

Process POSM and price verification

POSM recognition, price-number recognition, and non-standard price-tag verification followed a T+1 delivery model rather than being presented as real-time outputs.

Rules and review

Focus people on the exceptions

Channel-specific standards evaluated each result, while ambiguous or disputed submissions were routed to human exception review.

Two channels, two definitions of good execution

OTC and HPC share a visual foundation, but not one ruleset

Both channels required SKU, facing, position, price, and POSM recognition. The meaning of compliant execution differed by channel.

OTC pharmacies85 SKUs

Fine-grained variant decisions

Execution depended on recognizing the exact dosage or pack, matching the required price tag and POSM, and evaluating shelf level within the correct fixture.

Operational sensitivity
Task decisions could affect field-representative performance outcomes.
Change pattern
Approximately 40 recurring task-pool items per month and about five new POSM recognition requests per month.
HPC retail397 SKUs

Portfolio scale and display impact

Execution focused on presence, facings, display area, endcaps, floor displays, and whether priority products occupied high-visibility positions.

Operational sensitivity
Assortment growth and display impact drove the workload.
Change pattern
Approximately 5-20 new SKU recognition requests per month.

The underlying visual recognition capability could be reused, but the final execution decision had to reflect each channel’s task cards, display formats, and performance logic.

Engineering for real store conditions

Recognition rules had to adapt to the scene, not force every store into one geometry

Fine-grained packages

Train on the details that separate similar SKUs

Weekly model training emphasized corner labels, dosage text, pack-size details, and difficult steep-angle, reflective, and low-light examples.

Adaptive shelf geometry

Recognize the fixture before applying the rule

The system distinguished conventional five- or six-level fixtures from checkout counters and low tabletop displays, then applied the appropriate shelf-position logic dynamically.

Printed-plane filtering

Separate backboard images from physical products

Two-dimensional printed-plane detection filtered high-quality product images on promotional backboards before shelf position was calculated.

Evidence integrity

Verify that evidence belongs to the assigned visit

Image fingerprints detected reused submissions, moire patterns identified screen recaptures, and configured scene checks supported workflow compliance without identifying individuals.

What the system verifies

From product recognition to complete visit verification

The customer needed more than a product count. A completed task also depended on price accuracy, the presence of required recommendation materials, and confidence that the submitted evidence belonged to the assigned visit.

Product

Confirm the exact SKU

Variant, dosage or specification, presence, and facings prevent a brand-level match from being treated as the right product.

Placement

Interpret the physical context

Fixture type, shelf boundaries, level, display area, and relative position determine which execution standard applies.

Price

Connect the label to the product

OCR value, price-tag type, and product association reduce incorrect matches to neighboring or promotional prices.

POSM

Verify content as well as presence

Material type, placement, required text, and configured identifiers confirm that the intended promotional material is in place.

Evidence integrity

Protect the visit record

Reused-image detection, screen-recapture indicators, and scene requirements improve confidence that evidence belongs to the assigned visit.

Task outcome

Return one clear next step

Every submission resolves to pass, correction required, or exception review for both the representative and headquarters.

Price recognition requires more than OCR

For clear and consistently formatted labels, OCR could read the visible price. The harder task was assigning that price to the correct product and interpreting it in context. A valid decision required a closed relationship between the product, its position, the relevant label, and the task requirement. Learn more about pricing and promotion verification.

POSM recognition verifies content as well as presence

The program covered 274 POSM types: approximately 90 OTC types and approximately 180 HPC types. These rounded channel figures were tracked separately and are not presented as an exact sum. The scope included price tags, shelf talkers, backboards, large displays, and floor displays. Multimodal models helped verify not only that a material existed, but that it was the correct material and contained the required text or number combination.

Evidence integrity protects the visit record

The workflow checked for reused images and visual patterns associated with photographing a screen. It could also verify configured scene requirements. These controls made each visit record easier to trust and audit.

Continuous model operations

New products do not wait for a mature image library

The project was not a one-time deployment. New products, packaging updates, and campaign materials entered the recognition scope every month.

New items created a cold-start problem. Before launch, there were not enough store images to represent every angle, lighting condition, obstruction, and display format. For this program, initial recognition accuracy for a newly introduced item could be approximately 70% when samples were scarce.

Clobotics used synthetic images for pre-training before launch, incorporated production or frontline images within 48 hours for rapid fine-tuning, and ran daily human QA that returned errors to the training set. The program required recognition to exceed 90% within one week of a new SKU or POSM launch. This was the operating commitment for this program, not a universal SLA for every customer or category.

Whether the change involved new monthly POSM in the OTC channel or updated SKUs in HPC retail, models, rules, and human operations evolved together. For retail AI, deployment is only the beginning.

Results

More accurate execution without placing more work on the frontline

Measured end-to-end accuracy by task

SKU availability E2E accuracy98.32%
Target SKU shelf-position E2E accuracy91.1%
POSM recognition E2E accuracy86.67%
Price-number recognition E2E accuracy · active improvement72.56%

These task-level measurements describe four different recognition workflows. They remain separate from the broader program-level AI accuracy and final reviewed accuracy below; the available source does not define a formula for combining the two measurement grains.

Business and program outcomes

Less time across the complete store visit60%
More stores covered per representative each month1.5×
AI recognition accuracy95%+
Final accuracy after exception review99%+

Product, price, POSM, placement, and evidence-integrity checks were connected within the same task workflow. Representatives spent less time on capture, validation, and reporting, while shorter visits and faster task processing increased field coverage without adding work to each visit.

Higher recognition accuracy and an explicit review path gave representatives greater confidence that completed work would be evaluated consistently. Difficult and disputed cases were directed to exception review, while headquarters received a clearer record of what field teams completed and why each task was accepted, corrected, or reviewed.

Next step

Make every store visit faster, fairer, and easier to verify.

Share your target channels, SKU portfolio, and current field workflow. Talk to the Clobotics retail team about a pharmaceutical or consumer health execution program.

Explore the wider Clobotics retail platform and its approach to on-shelf availability.