Digimarc Corporation

Brian T MacIntosh

Geoffrey B Rhoads

Tony F Rodriguez

Bruce L Davis

Ravi K Sharma

John Douglas Lord

Phillip Andrew Seder

Daniel O Ramos

William Y Conwell

Neil E Lofgren

William C Hein, Iii

Eoin C Sinclair

Kenneth Lee Levy

Yang Bai

Scott M Long

Matthew M Weaver

Eliot Rogers

Kurt M Eaton

Nicole Rhoads

Joshua A Rosenthol

Brett T Hannigan

Marc D Miller

Sierra K Modro

An illustrative implementation of the technology includes three primary components: a desktop application, a mobile phone application, and connections to retailer inventory and pricing APIs (e.g., for Walmart and/or Best Buy). The experience begins with the consumer going to an online retailer's website (e.g., Amazon) to search for a product. The desktop application automatically searches for the same product using the APIs of Walmart and/or Best Buy. If matches and near-matches of the product are found, the product name, model, price, and local availability at affiliate locations are shown. With a mobile phone camera-scan of the product page, relevant information is transferred to the consumer's phone. From there, the consumer can interact with the options on the mobile phone to be directed to the nearby brick and mortar store of choice carrying that product at the price they want. Along the way, the retailer can present offers and additional product information directly to the consumer. A great variety of other technologies and arrangements are also detailed.

Methods and arrangements including data migration among computing platforms, e.g. through use of audio encoding

An illustrative implementation of the technology includes three primary components: a desktop application, a mobile phone application, and connections to retailer inventory and pricing APIs (e.g., for Walmart and/or Best Buy). The experience begins with the consumer going to an online retailer's website (e.g., Amazon) to search for a product. The desktop application automatically searches for the same product using the APIs of Walmart and/or Best Buy. If matches and near-matches of the product are found, the product name, model, price, and local availability at affiliate locations is shown. With a mobile phone camera-scan of the product page, relevant information is transferred to the consumer's phone. From there, the consumer can interact with the options on the mobile phone to be directed to the nearby brick and mortar store of choice carrying that product at the price they want. Along the way, the retailer can present offers and additional product information directly to the consumer. A great variety of other technologies and arrangements are also detailed.

Methods and arrangements including data migration among computing platforms, e.g. through use of steganographic screen encoding

Methods and arrangements involving portable user devices such smartphones and wearable electronic devices are disclosed, as well as other devices and sensors distributed within an ambient environment. Some arrangements enable a user to perform an object recognition process in a computationally- and time-efficient manner. Other arrangements enable users and other entities to, either individually or cooperatively, register or enroll physical objects into one or more object registries on which an object recognition process can be performed. Still other arrangements enable users and other entities to, either individually or cooperatively, associate registered or enrolled objects with one or more items of metadata. A great variety of other features and arrangements are also detailed.

Methods for object recognition and related arrangements

Supplemental network services are synchronized with a program using the program's audio signal. A synchronization method employs local caching of portions of a fingerprint database to manage network services for identifying which programs a user's mobile device is exposed to and the timing of events within the program. The system enables background recognition and synchronization of network services in a way that consumes less device power and bandwidth.

Content recognition and synchronization using local caching

An illustrative implementation of the technology includes three primary components: a desktop application, a mobile phone application, and connections to retailer inventory and pricing APIs (e.g., for Walmart and/or Best Buy). The experience begins with the consumer going to an online retailer's website (e.g., Amazon) to search for a product. The desktop application automatically searches for product matches using the APIs of affiliated retailers. If matches and near-matches of the product are found, the product name, model, price, and local availability at affiliate locations is shown. With a mobile phone camera-scan of the product page, relevant information is transferred to the consumer's phone. From there, the consumer can interact with the options on the mobile phone to be directed to the nearby brick and mortar store of choice carrying that product at the price they want. Along the way, the retailer can present offers and additional product information directly to the consumer. A great variety of other technologies and arrangements are also detailed.

Methods and arrangements including data migration among computing platforms, E.G. through use of steganographic screen encoding

Mobile phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some aspects relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others concern user interface improvements. Other aspects relate to imaging architectures, in which a mobile phone's image sensor is one in a chain of stages that successively act on packetized instructions/data, to capture and later process imagery. Still other aspects relate to distribution of processing tasks between the mobile device and remote resources ('the cloud'). Elemental image processing (e.g., simple filtering and edge detection) can be performed on the mobile phone, while other operations can be referred out to remote service providers. The remote service providers can be selected using techniques such as reverse auctions, through which they compete for processing tasks. A great number of other features and arrangements are also detailed.

Methods and systems for content processing

A portable device, such as a cell phone, is used to 'forage' media content from a user's environment. For example, it may listen to a television viewed by a traveler in an airport lounge. By reference to digital watermark or other data extracted from the content, the device can identify the television program, and enable a variety of actions. For example, the device may instruct a DVR to record the remainder of the television program&#x2014;or determine when the program will be rebroadcast, and instruct the DVR to record the program in its entirety at that later time. The device may also identify content that preceded (or follows) the foraged content. Thus, a user who tunes-in just at the end of an exciting sporting event can capture one of the following commercials, identify the preceding program, and download same for later viewing. In other aspects, a cell phone can be used as a 'second screen,' through which a user can interact with ambient content&#x2014;such as reviewing electronic program guide data, or enjoying interactive television features. A great variety of other functions and arrangements are also detailed.

Content interaction methods and systems employing portable devices

In some arrangements, product packaging is digitally watermarked over most of its extent to facilitate high-throughput item identification at retail checkouts. Imagery captured by conventional or plenoptic cameras can be processed (e.g., by GPUs) to derive several different perspective-transformed views&#x2014;further minimizing the need to manually reposition items for identification. Crinkles and other deformations in product packaging can be optically sensed, allowing such surfaces to be virtually flattened to aid identification. Piles of items can be 3D-modeled and virtually segmented into geometric primitives to aid identification, and to discover locations of obscured items. Other data (e.g., including data from sensors in aisles, shelves and carts, and gaze tracking for clues about visual saliency) can be used in assessing identification hypotheses about an item. Logos may be identified and used&#x2014;or ignored&#x2014;in product identification. A great variety of other features and arrangements are also detailed.

Methods and arrangements for identifying objects

Consumer uses of mobile devices and electronic media are changing. Mobile devices include increased computational capabilities, mobile broadband access, better integrated sensors, and higher resolution screens. These enhanced features are driving increased consumption of media such as images, maps, e-books, audio, video, and games. As users become more accustomed to using mobile devices for media, opportunities arise for new digital watermarking usage models. For example, transient media, like images being displayed on screens, can be watermarked to provide a link between mobile devices, extending the reach of digital watermarking. Digital fingerprinting can also be employed. Applications based on these emerging usage models can provide richer user experiences and drive increased media consumption. A great variety of other features and arrangements are also detailed.

Mobile media, devices, and signaling

A content fingerprint based recognition system employs local caching of portions of a fingerprint database to manage network services for identifying which programs a user's mobile device is exposed to and the timing of events within the program. The system enables background recognition and synchronization of network services in a way that consumes less device power and bandwidth.

In some arrangements, product packaging is digitally watermarked over most of its extent to facilitate high-throughput item identification at retail checkouts. Imagery captured by conventional or plenoptic cameras can be processed (e.g., by GPUs) to derive several different perspective-transformed views&#x2014;further minimizing the need to manually reposition items for identification. Crinkles and other deformations in product packaging can be optically sensed, allowing such surfaces to be virtually flattened to aid identification. Piles of items can be 3D-modelled and virtually segmented into geometric primitives to aid identification, and to discover locations of obscured items. Other data (e.g., including data from sensors in aisles, shelves and carts, and gaze tracking for clues about visual saliency) can be used in assessing identification hypotheses about an item. Logos may be identified and used&#x2014;or ignored&#x2014;in product identification. A great variety of other features and arrangements are also detailed.

Many of the detailed technologies are useful in enabling a smart phone to respond to a user's environment, e.g., so it can serve as an intuitive hearing and seeing device. A few of the detailed arrangements involve using radio base station SDR equipment (e.g., at a cell tower) to perform image recognition operations for phones; forecasting service needs from remote processors, and reserving such capacity in advance of use; delegating a remote execution task to a service provider chosen in a competitive process, such as by a reverse auction; using nearby processors, e.g., in an automobile, another phone, or set-top box, for remote execution tasks; phones with separable camera and/or illumination components; phone camera illumination using different colors of light; using search tree methods with image frames captured at different focuses; using a phone's microprojector to aid in object identification; correcting lens aberrations by texture mapping captured imagery onto a corrective polygon surface using a phone GPU; etc. A great variety of other features and arrangements are also detailed.

Methods for enhancing content objects within web pages use persistent content identification to identify content signals and associate behaviors with the content signals, such as controlling rendering of the content signals along with other information, such as advertising. One method executes within a user device and automatically inserts code within the web page to fetch remote information used in connection with rendering the content signal in a web page. Another method operates on a server and enhances a content object so that it will have certain behaviors when downloaded and presented with a web page.

Growing community of inventors

Lake Oswego, OR, United States of America

Brian T MacIntosh