Overview
Accurate retail execution without adding work for the frontline.
A global consumer health company needed a more accurate and scalable way to verify execution across OTC pharmacies and HPC retail in China. Instead of adding another frontline app, Clobotics embedded fine-grained recognition, channel rules, evidence checks, and human review directly into the customer’s existing SFA workflow.
- Customer
- Global consumer health company
- Market
- China
- Channels
- OTC pharmacies and HPC retail
- Program scope
- 482 SKUs and 274 POSM types
The business context
In a low-growth market, every store matters
China’s pharmaceutical market entered 2026 under pressure. In the first quarter, all-channel pharmaceutical sales declined 5.4% year over year, while retail increased by only 0.6%, making it the only major terminal channel to remain in positive growth.
When the retail channel is protecting limited growth, details inside every pharmacy and store matter more: whether the right product is available, whether its price is correct, whether campaign materials are in place, and whether the shelf position meets the intended execution standard.
For this global consumer health company, the challenge was not simply collecting more store photos. It was converting those photos into accurate, explainable, and operationally fair decisions at scale.
Source: Sinohealth, “2026 Q1 Pharmaceutical Market,” citing CMH data.
Challenge
Pharmaceutical recognition is harder, and the cost of error is greater
A store visit can appear straightforward. A field representative arranges the products, places the required price tags and promotional materials, takes a photograph, and submits the task. A single recognition error can still break the workflow.
The system may identify the correct brand but select the wrong product variant because two packages use almost the same color, typography, and layout. The only meaningful difference may be a dosage or pack-size line printed in small text near the corner of the box. If the wrong SKU is recorded, the result cannot support a dependable execution decision.
The cost extends beyond one image. The representative may need to rearrange the display, adjust the angle, take another photograph, or raise a dispute. If task acceptance is connected to performance-based compensation, repeated errors can reduce trust in the system and make the process feel unfair. Headquarters may also receive a distorted record of what happened in the store.
Distinguish highly similar products
The program maintained 482 products: 85 OTC SKUs and 397 HPC SKUs. Brand-level recognition was not enough when variants differed only by small printed details.
Understand where each product was displayed
Presence was only the first question. The system also needed to interpret the fixture, shelf boundaries, levels, and relative position before applying the customer’s standard.
Make AI dependable for frontline work
High-volume cases needed fast automation, while obstructed, ambiguous, or disputed submissions required a clear path to human review.
Solution
One workflow for recognition, verification, and action

Clobotics combined computer vision, multimodal AI, business rules, and human exception review in one retail execution workflow. Its visual-recognition SDK was embedded directly into the customer’s existing SFA application, so representatives could receive tasks, capture evidence, and receive results without switching systems.
Work inside the existing SFA application
The representative received the assigned task, captured store evidence, and invoked the Clobotics AI workflow from the same frontline experience.
Return availability, facings, and shelf position
SKU availability, facing counts, and shelf-position results returned through the embedded SDK while the representative was still in the workflow.
Process POSM and price verification
POSM recognition, price-number recognition, and non-standard price-tag verification followed a T+1 delivery model rather than being presented as real-time outputs.
Focus people on the exceptions
Channel-specific standards evaluated each result, while ambiguous or disputed submissions were routed to human exception review.
Two channels, two definitions of good execution
OTC and HPC share a visual foundation, but not one ruleset
Both channels required SKU, facing, position, price, and POSM recognition. The meaning of compliant execution differed by channel.
Fine-grained variant decisions
Execution depended on recognizing the exact dosage or pack, matching the required price tag and POSM, and evaluating shelf level within the correct fixture.
- Operational sensitivity
- Task decisions could affect field-representative performance outcomes.
- Change pattern
- Approximately 40 recurring task-pool items per month and about five new POSM recognition requests per month.
Portfolio scale and display impact
Execution focused on presence, facings, display area, endcaps, floor displays, and whether priority products occupied high-visibility positions.
- Operational sensitivity
- Assortment growth and display impact drove the workload.
- Change pattern
- Approximately 5-20 new SKU recognition requests per month.
The underlying visual recognition capability could be reused, but the final execution decision had to reflect each channel’s task cards, display formats, and performance logic.
Engineering for real store conditions
Recognition rules had to adapt to the scene, not force every store into one geometry
Train on the details that separate similar SKUs
Weekly model training emphasized corner labels, dosage text, pack-size details, and difficult steep-angle, reflective, and low-light examples.
Recognize the fixture before applying the rule
The system distinguished conventional five- or six-level fixtures from checkout counters and low tabletop displays, then applied the appropriate shelf-position logic dynamically.
Separate backboard images from physical products
Two-dimensional printed-plane detection filtered high-quality product images on promotional backboards before shelf position was calculated.
Verify that evidence belongs to the assigned visit
Image fingerprints detected reused submissions, moire patterns identified screen recaptures, and configured scene checks supported workflow compliance without identifying individuals.
What the system verifies
From product recognition to complete visit verification
The customer needed more than a product count. A completed task also depended on price accuracy, the presence of required recommendation materials, and confidence that the submitted evidence belonged to the assigned visit.
Confirm the exact SKU
Variant, dosage or specification, presence, and facings prevent a brand-level match from being treated as the right product.
Interpret the physical context
Fixture type, shelf boundaries, level, display area, and relative position determine which execution standard applies.
Connect the label to the product
OCR value, price-tag type, and product association reduce incorrect matches to neighboring or promotional prices.
Verify content as well as presence
Material type, placement, required text, and configured identifiers confirm that the intended promotional material is in place.
Protect the visit record
Reused-image detection, screen-recapture indicators, and scene requirements improve confidence that evidence belongs to the assigned visit.
Return one clear next step
Every submission resolves to pass, correction required, or exception review for both the representative and headquarters.
Price recognition requires more than OCR
For clear and consistently formatted labels, OCR could read the visible price. The harder task was assigning that price to the correct product and interpreting it in context. A valid decision required a closed relationship between the product, its position, the relevant label, and the task requirement. Learn more about pricing and promotion verification.
POSM recognition verifies content as well as presence
The program covered 274 POSM types: approximately 90 OTC types and approximately 180 HPC types. These rounded channel figures were tracked separately and are not presented as an exact sum. The scope included price tags, shelf talkers, backboards, large displays, and floor displays. Multimodal models helped verify not only that a material existed, but that it was the correct material and contained the required text or number combination.
Evidence integrity protects the visit record
The workflow checked for reused images and visual patterns associated with photographing a screen. It could also verify configured scene requirements. These controls made each visit record easier to trust and audit.
Continuous model operations
New products do not wait for a mature image library
The project was not a one-time deployment. New products, packaging updates, and campaign materials entered the recognition scope every month.
New items created a cold-start problem. Before launch, there were not enough store images to represent every angle, lighting condition, obstruction, and display format. For this program, initial recognition accuracy for a newly introduced item could be approximately 70% when samples were scarce.
Clobotics used synthetic images for pre-training before launch, incorporated production or frontline images within 48 hours for rapid fine-tuning, and ran daily human QA that returned errors to the training set. The program required recognition to exceed 90% within one week of a new SKU or POSM launch. This was the operating commitment for this program, not a universal SLA for every customer or category.
Whether the change involved new monthly POSM in the OTC channel or updated SKUs in HPC retail, models, rules, and human operations evolved together. For retail AI, deployment is only the beginning.
Results
More accurate execution without placing more work on the frontline
Measured end-to-end accuracy by task
These task-level measurements describe four different recognition workflows. They remain separate from the broader program-level AI accuracy and final reviewed accuracy below; the available source does not define a formula for combining the two measurement grains.
Business and program outcomes
Product, price, POSM, placement, and evidence-integrity checks were connected within the same task workflow. Representatives spent less time on capture, validation, and reporting, while shorter visits and faster task processing increased field coverage without adding work to each visit.
Higher recognition accuracy and an explicit review path gave representatives greater confidence that completed work would be evaluated consistently. Difficult and disputed cases were directed to exception review, while headquarters received a clearer record of what field teams completed and why each task was accepted, corrected, or reviewed.
Make every store visit faster, fairer, and easier to verify.
Share your target channels, SKU portfolio, and current field workflow. Talk to the Clobotics retail team about a pharmaceutical or consumer health execution program.
Explore the wider Clobotics retail platform and its approach to on-shelf availability.