Digimarc Corporation

Eric D Evans

Geoffrey B Rhoads

Tony F Rodriguez

Bruce L Davis

Tomas Filler

Rebecca L Gerlach

Christopher M Haverkate

John F Stach

Yang Bai

Mark-Andrew Ray Tait

Ravi K Sharma

Bryan L Olmstead

Vojtech Holub

Donald Haaga

Alastair M Reed

William Y Conwell

John Douglas Lord

Scott M Long

Utkarsh Deshmukh

Arthur L Powell

Marc G Footen

Philip J Stafford

Becky G Kiichle-Gross

Jeffery B Schulte

Jeffrey B Schulte

Sean Calhoon

Brian T Macintosh

John Stach

Inventory on a rack of store shelves is monitored by a camera-equipped system that senses when items have been removed. Image data is desirably sensed at plural spectral bands, to enhance item identification by digital watermark and/or other image recognition techniques. The system can be alert to the presence of nearby shoppers, and change its mode of operation in response, e.g., suppressing flash illumination or suspending image capture. The system may self-calibrate to the geometry of shelving in its field of view, and affine-correct captured imagery based on the camera's viewpoint. A great many other features and arrangements are also detailed.

Methods and systems employing image sensing and 3D sensing to identify shelved products

In computer vision systems that need to decode machine-readable indicia from captured imagery, it is critical to select imaging parameters (e.g., exposure interval, exposure aperture, camera gain, intensity and duration of supplemental illumination) that best allow detection of subtle features from imagery. In illustrative embodiments, a Shannon entropy metric or a KL divergence metric is used to guide selection of an optimal set of imaging parameters. In accordance with other aspects of the technology, different strategies identify which spatial locations within captured imagery should be successively examined for machine readable indicia, in order to have a greatest likelihood of success, within a smallest interval of time. A great variety of other features and arrangements are also detailed.

Methods and arrangements for configuring industrial inspection systems

In an illustrative system, a point-of-sale scanner is equipped to respond to multiple different symbologies printed on a single product. The scanner captures many frames per second, as products are swiped through a viewing volume. Each frame is decoded, yielding one or more payloads. A reconciliation module compares each newly-decoded payload against a list of payloads previously output by the module, to determine if the current payload is semantically-equivalent to a previously-output payload. If so, the previously-output payload is output again, in lieu of the just-decoded payload. If no equivalent is found, the current payload is output and added to the list for comparison against future payloads. A great number of other features and arrangements are also detailed.

Methods and arrangements for reconciling data from disparate data carriers

Authenticity of a sticker (e.g., a mark-down sticker on a retail item), or integrity of a closure (e.g., on a delivery bag or package), is confirmed by reference to spatial information. In some embodiments a fingerprint is formed from parameters describing spatial placement of a sticker or pattern on a substrate. In some embodiments a digital watermark pattern provides a spatial frame of reference within which one or more other features can be located. A great many other features and arrangements are also detailed.

Tamper detection arrangements, and point of sales systems employing same

The present disclosure relates to advanced image processing and encoded signal processing. One claim currently recites an image processing method comprising the acts: receiving a digital representation of artwork, the artwork having an area of uniform color; generating a two-dimensional data signal that redundantly encodes a plural-bit message, the data signal comprising plural elements, each of which has a single bit value; receiving a two-dimensional synchronization signal comprising plural elements, each of which has a plural-bit value, each element of said data signal having an element of the synchronization signal corresponding thereto; processing the two-dimensional data signal with the two-dimensional synchronization signal and with a gradient function to yield a two-dimensional gradient marking signal; and printing an ink counterpart of the gradient marking signal on a medium with the artwork, said printing comprising printing plural dithered two-dimensional blocks of at least four contiguous elements each, in which one or more elements of each block are printed to be dark. Of course, other claims and combinations are described as well.

Sparse modulation for robust signaling and synchronization

In one aspect, a retail store has multiple sensors, including item sensors in a shopping cart for gathering data from a shopper-selected first item. At least certain of the sensor data is provided to a classifier, which was previously-trained (using data including optical data from known items) to identify possible item matches corresponding to data sensed from the first item. An item identification hypothesis that the shopper-selected first item has a particular identity is evaluated based on (a) information from the classifier, and (b) store layout data indicating items associated with a store location visited by the cart or shopper. The item identification hypothesis has a confidence score. If the score meets a criterion, an item of the hypothesized identity is added to a shopping tally. A great number of other features and arrangements are also detailed.

Cart-based shopping arrangements employing probabilistic item identification

In one aspect, a retail store includes a multitude of cameras, including a plurality of 3D cameras, and a plurality of other cameras. Certain of the cameras provide imagery from which a shopper's track through the store is monitored, and certain of the cameras are positioned to detect removal of items from store shelves. The store also includes a computer system that provides a database of information about store layout, indicating stock locations of different items. The computer system receives imagery from the cameras (or information derived from such imagery) and uses this data, together with information from the database and information derived from other sensors in the store, to produce a probabilistic tally of items selected by a store shopper. This tally includes an item bearing a barcode, but is produced without reading the barcode. Each item on the tally is associated with a confidence score that meets a computer system-determined threshold. A great number of other features and arrangements are also detailed.

Retail store with sensor-fusion enhancements

Ambient inventorying arrangements

In some arrangements, product packaging is digitally watermarked over most of its extent to facilitate high-throughput item identification at retail checkouts. Imagery captured by conventional or plenoptic cameras can be processed (e.g., by GPUs) to derive several different perspective-transformed views&#x2014;further minimizing the need to manually reposition items for identification. Crinkles and other deformations in product packaging can be optically sensed, allowing such surfaces to be virtually flattened to aid identification. Piles of items can be 3D-modelled and virtually segmented into geometric primitives to aid identification, and to discover locations of obscured items. Other data (e.g., including data from sensors in aisles, shelves and carts, and gaze tracking for clues about visual saliency) can be used in assessing identification hypotheses about an item. Logos may be identified and used&#x2014;or ignored&#x2014;in product identification. A great variety of other features and arrangements are also detailed.

Methods and arrangements for identifying objects

The disclosure relates to detecting digital watermarking from retail items such as from packaged items, containers, bottles, cans or boxes. One claim recites a method utilized at a retail checkout location comprising: receiving imagery representing a retail item from a digital camera, the retail item including digital watermarking encoded thereon, the retail item moving relative to the digital camera; determining a region in the imagery corresponding to at least one faster moving object relative to background imagery, said determining yielding a determined region; arranging digital watermark detection blocks over the determined region; and analyzing data representing imagery from within the digital watermark detection blocks to detect the digital watermarking. Of course other claims and combinations are also provided.

Imagery captured by a point-of-sale scanner (e.g., in a supermarket) for purposes of barcode decoding, is contrast-enhanced preparatory to use for watermark decoding&#x2014;despite the fact that such operation may sometimes result in contrast between certain pixels being diminished. A great variety of other features and arrangements are also detailed.

Arrangements for enhancing digital watermark decoding

A variety of technologies having practical application in retail stores are detailed. One is an improved method of identifying items selected by customers. This method includes receiving sensor data from plural sensors, including (a) ceiling-mounted cameras that monitor tracks of customers through aisles of the store, and (b) inventory sensors that are positioned to monitor removal of stock from store shelves. This received sensor data is employed in evaluating plural alternate item identification hypotheses. These hypotheses include a first hypothesis that a customer selected an item having a first identity, and a second hypothesis that the customer selected an item having a second identity. A confidence score is associated with each of the first and second item selection hypotheses. These confidence scores are refined as sensor data is received, e.g., increasing a confidence score of one hypothesis, and reducing a confidence score of another. Such refining continues until one of the hypotheses becomes a winner, due to an associated confidence score fulfilling a predetermined criterion (e.g., reaching a threshold value), at which time the item can be added to a tally for that individual. The winning item identification hypothesis may identify a barcoded item, without that item's barcode ever having been read by a barcode reader. A great number of other features and arrangements are also detailed.

Methods of identifying barcoded items by evaluating multiple identification hypotheses, based on data from sensors including inventory sensors and ceiling-mounted cameras

Growing community of inventors

Portland, OR, United States of America

Eric D Evans