Ncr Voyix Corporation

Ncr Corporation

Gina Torcivia Bennett

Kip Oliver Morgan

Kelli Lee

Aleah Jean Kadry

Meenakshi Sreeraman

Jacob Alexander Poston

John Kennedy

Jerry Steven Massey

Zachary Taylor Lasater

Ankit Madhusudan Amin

Caleb Wayne Martinez

Julia Anne Ogilvy

Noah Tyler Gardner

James Naoki Shaw

Jaier Gordon

Yoshiki Kakehi

Timothy Edward Mason

Mike Zheng

A transaction session is established directly or indirectly between a wearable processing device and a cloud-based server of a store. During the session, items are recognized by placing the items in a field-of-view of a front-facing camera of the device. Item recognition does not require item barcode identification. A depth sensor associated with the camera creates a three-dimensional mapping of a given item. The mapping and image features are processed to uniquely identify the item even when the item is associated with a same category of items. Customer input during the session can be achieved through gestures (hand, eyes, head, fingers, etc.) and/or voice commands. The customer input is translated and mapped into transaction interface commands/options and processed during the session to select items, delete items, view a transaction receipt, identify a quantity of items, obtain item details for a given item, etc.

Transaction session for wearable processing device

Preferences with respect nutrition and ingredients are established for a user. The preferences are managed and stored on a mobile device. Images of nutrition and ingredient information are captured and analyzed against the preferences. Any ingredient for an item associated with the images that do not conform to the preferences are flagged and the user notified. The user is provided an option to receive a substitute item that does conform with the preferences. In an embodiment, a discount is provided to the user for incentivizing the user to select the substitute item.

Methods and a system of item nutrition information processing

A transaction terminal includes at least one top-down camera, side cameras, and at least one barcode scanner. Images captured by the cameras are processed by one or more computer vision applications for purposes of counting items placed on a tray of the terminal during a checkout. Each item is associated with a bounding box or region of the tray within the images. The computer vision applications and scanner are polled to provide a region identifier, a barcode, and a confidence value for each item on the tray. Duplicated item barcodes are removed and barcodes with the highest confidence values are retained. The final item barcodes are provided to a transaction manager of the terminal to complete the self-checkout with a customer at the terminal.

Interruption free vision checkout

A mobile device establishes an indirect network connection to a User Interface (UI) agent of a terminal. The indirect connection managed as a mobile navigational control session maintained through a server or through the server and a proxy. A keyboard widget/object and a navigation-selection widget/object are rendered within a mobile screen on a display of the mobile device. During the session, a user interacts with the keyboard and/or navigation-selection widgets and corresponding UI key events are forwarded to the UI agent. The UI agent provides the UI key events as Human Interface Device (HID) key events to the terminal causing a transaction interface to update transaction screens being rendered on a transaction display of the terminal during a transaction. The user conducts the transaction at the terminal without touching the transaction display and controls the transaction screens for the transaction via the keyboard and navigational widgets from the mobile device.

Mobile navigational control of terminal user interface

A viewing height of a rendered transaction interface screen on a transaction display is controlled by or automatically adjusted for a customer performing a transaction at a transaction terminal. The display can physically be raised and lowered along a post to achieve a desired viewing height or only a portion of the viewable surface area for the display is occupied by a transaction interface screen for the transaction with the location of the portion controlled by or auto adjusted on behalf of the customer. In an embodiment, another portion of the viewable surface area not currently occupied by the transaction interface screen can be used to render additional information such as advertisements and the advertisement portions can be dynamically changed based on changes made to the location of the transaction interface screen.

Height adjustable screen interface and display

A self-service checkout system has a processor and a non-transitory computer-readable storage medium storing executable instructions. The executable instructions, when executed by the processor, cause the processor to perform operations including: receiving a message from a vision system that includes a current list of identified items on a tray positioned adjacent to the vision system for a current transaction, comparing the current list of identified items to a previous list of identified items, and adding any items on the current list that are not on the previous list to a transaction list for a current transaction, determining that the current transaction is complete when the current list of identified items has no items, enabling a customer to review the transaction list and remove any duplicate entries, and completing the current transaction.

System and method for providing large basket vision checkout

A self-service checkout terminal for vision-based checkout includes a computing device having a processor and a memory. A camera coupled to the computing device has a predefined field of view focused on a scan zone and provides a video output signal of the scan zone to the computing device. A checkout tray has a tactile surface formed from a predefined number of rows and a predefined number of columns of raised dot. The checkout tray is positioned within the scan zone. The processor processes the video output signal from the camera to attempt to identify an item placed on the checkout tray by a user during a transaction, provides a description of the item to the user via the user interface when the item is identified, and provides the user of an indication of a location of the item via a user interface when the item is not identified.

Vision-based self-checkout system and method for the visually impaired

Three-dimensional (3D) model images for menu item are maintained in a content delivery network (CDN) along with codes. The codes are printed/affixed to menus adjacent to the menu items. The menus include an anchor object that is sized in proportion to plates that serve the menu items. A user operates an augmented reality (AR)-enabled application (app) and uses a gesture to identify a code associated with a menu item from a menu. The code is decoded to contact the CDN and obtain the 3D model image corresponding to the menu item. The user centers a view-finder over the anchor object on the menu and the 3D model image is rendered on the anchor object in a scaled size and a scaled proportion for what will be provided to the user. The user may spin the 3D model to inspect proportions and ingredients of the menu item through the app.

Augmented reality order assistance

A self-service checkout system includes a processor and a non-transitory computer-readable storage medium storing executable instructions. The executable instructions when executed by the processor cause the processor to perform operations including: receiving a message from a vision system that includes a list of identified items on a tray positioned adjacent to the vision system for a current transaction and one or more issues related to an identification of the items on the tray, processing the message to identify the one or more issues related to the identification of the items on the tray, providing a user interface for a customer to correct the one or more issues related to the identification of the items on the tray, and completing the current transaction once the issues related to the identification of the items on the tray are corrected.

System and method for interfacing between a vision checkout system and a self-service checkout terminal

Objects associated with a self-checkout area are identified and tracked through transaction data comprised of transaction details, device statuses, transaction interrupts/events, and video feeds during transactions on Self-Service Terminals (SSTs). Selective objects and selective transaction data are correlated together in a group for each transaction. Actions required of an attendant who is managing the transactions are identified for each group. An Augmented Reality (AR) interface is provided on an attendant-operated device that visually and uniquely identifies the actions, each group requiring a given action, and each object of each group that is to be the subject of the given action. In an embodiment, remote verification, audit, and override actions are processed through gestures made by the attendant and detected by the AR interface.

Augmented reality (AR) self checkout attendant

An interface is rendered on a user-operated device. Selections are made with respect to a first set of options by the user operating the interface. A list of potential food dishes for further selection by the user is presented within the interface based on the selections. A food dish selection is received from the user through the interface. A recipe for the selected food dish is generated and presented within the interface based on the food dish selection and a list of ingredients needed for the recipe are generated as a shopping list for the user to obtain at a store. In an embodiment, a navigation route to obtain the ingredients within the store is provided to the user when the user is at the store, allowing the user to traverse the route within the store and obtain each of the ingredients.

Recipe-based shopping list service method and system

A managed device associated with an error code is identified. An animation associated with physically manipulating a component and parts of the component for the managed device is generated. The animation representing a workflow for resolving the error code. A live video feed of the managed device and the physical surroundings of the managed device is presented within an Augmented Reality (AR) interface on a mobile device operated by a support person. The animation is rendered over a portion of the live video feed for the support person to view while following the workflow and physically manipulating the component and parts of the managed device to resolve the error code.

Augmented reality (AR) device support

A touch field is created around a touchscreen display, the field is in front of a touch surface of the display and the field maps to locations on the display. An operator of a terminal during a transaction is presented with transaction interface screens that are visually rendered on the display. The operator makes interface options selections, performs screen navigation, and provides date entry field inputs by placing the operator's hand within the field without touching the touch surface of the display and making hand poses, hand movements, and/or hand gestures. The poses, movements, and/or gestures are translated into touch actions and touch inputs recognized by the transaction interface and processed as operator-provided input during the transaction.

Growing community of inventors

Lawrenceville, GA, United States of America

Gina Torcivia Bennett