Ncr Voyix Corporation

Ncr Corporation

Kip Oliver Morgan

Gina Torcivia Bennett

Kelli Lee

Meenakshi Sreeraman

Aleah Jean Kadry

Jacob Alexander Poston

Alexander Arrabis Bronola

James Emery Fugedy, Ii

Zachary Taylor Lasater

John Kennedy

Ankit Madhusudan Amin

Caleb Wayne Martinez

Jerry Steven Massey

Larry James Salmen

Ryan Scott Elliott

John Edward Haney

Michael Thomas Inderrieden

Theodore C Chen

Jennie Psihogios Johnson

Paul Ford Knight

David Taylor Baker

Zachary Christopher DeBardlebon

Andrew Michael Reusche

Karhan Jones

Raheel Jooma

Geoffrey Dodd

Miguel Cintron

Julia Anne Ogilvy

May Hu

Sirang Taudray Woolheater

Noah Tyler Gardner

James Naoki Shaw

Jaier Gordon

Yoshiki Kakehi

Timothy Edward Mason

Steven W Ulrich

Mike Zheng

A transaction session is established directly or indirectly between a wearable processing device and a cloud-based server of a store. During the session, items are recognized by placing the items in a field-of-view of a front-facing camera of the device. Item recognition does not require item barcode identification. A depth sensor associated with the camera creates a three-dimensional mapping of a given item. The mapping and image features are processed to uniquely identify the item even when the item is associated with a same category of items. Customer input during the session can be achieved through gestures (hand, eyes, head, fingers, etc.) and/or voice commands. The customer input is translated and mapped into transaction interface commands/options and processed during the session to select items, delete items, view a transaction receipt, identify a quantity of items, obtain item details for a given item, etc.

Transaction session for wearable processing device

Preferences with respect nutrition and ingredients are established for a user. The preferences are managed and stored on a mobile device. Images of nutrition and ingredient information are captured and analyzed against the preferences. Any ingredient for an item associated with the images that do not conform to the preferences are flagged and the user notified. The user is provided an option to receive a substitute item that does conform with the preferences. In an embodiment, a discount is provided to the user for incentivizing the user to select the substitute item.

Methods and a system of item nutrition information processing

A transaction terminal includes at least one top-down camera, side cameras, and at least one barcode scanner. Images captured by the cameras are processed by one or more computer vision applications for purposes of counting items placed on a tray of the terminal during a checkout. Each item is associated with a bounding box or region of the tray within the images. The computer vision applications and scanner are polled to provide a region identifier, a barcode, and a confidence value for each item on the tray. Duplicated item barcodes are removed and barcodes with the highest confidence values are retained. The final item barcodes are provided to a transaction manager of the terminal to complete the self-checkout with a customer at the terminal.

Interruption free vision checkout

A base transaction User Interface (UI) is provided that provides transaction processing for transactions at transaction terminals. The base UI can be customized through independent and decoupled customization/extension files, which provide specific UI customizations for UI screen content, UI screen styles, UI screen views, UI screen workflows, and UI screen resource functionality. Customizations or extensions are achieved without modifying the base UI. The customizations or extensions are dynamically obtained during execution of the base UI from the corresponding files and processed by the base UI as user-defined custom overrides.

Methods and a system for interface extensions

A mobile device establishes an indirect network connection to a User Interface (UI) agent of a terminal. The indirect connection managed as a mobile navigational control session maintained through a server or through the server and a proxy. A keyboard widget/object and a navigation-selection widget/object are rendered within a mobile screen on a display of the mobile device. During the session, a user interacts with the keyboard and/or navigation-selection widgets and corresponding UI key events are forwarded to the UI agent. The UI agent provides the UI key events as Human Interface Device (HID) key events to the terminal causing a transaction interface to update transaction screens being rendered on a transaction display of the terminal during a transaction. The user conducts the transaction at the terminal without touching the transaction display and controls the transaction screens for the transaction via the keyboard and navigational widgets from the mobile device.

Mobile navigational control of terminal user interface

A viewing height of a rendered transaction interface screen on a transaction display is controlled by or automatically adjusted for a customer performing a transaction at a transaction terminal. The display can physically be raised and lowered along a post to achieve a desired viewing height or only a portion of the viewable surface area for the display is occupied by a transaction interface screen for the transaction with the location of the portion controlled by or auto adjusted on behalf of the customer. In an embodiment, another portion of the viewable surface area not currently occupied by the transaction interface screen can be used to render additional information such as advertisements and the advertisement portions can be dynamically changed based on changes made to the location of the transaction interface screen.

Height adjustable screen interface and display

A self-service checkout system has a processor and a non-transitory computer-readable storage medium storing executable instructions. The executable instructions, when executed by the processor, cause the processor to perform operations including: receiving a message from a vision system that includes a current list of identified items on a tray positioned adjacent to the vision system for a current transaction, comparing the current list of identified items to a previous list of identified items, and adding any items on the current list that are not on the previous list to a transaction list for a current transaction, determining that the current transaction is complete when the current list of identified items has no items, enabling a customer to review the transaction list and remove any duplicate entries, and completing the current transaction.

System and method for providing large basket vision checkout

A self-service checkout terminal for vision-based checkout includes a computing device having a processor and a memory. A camera coupled to the computing device has a predefined field of view focused on a scan zone and provides a video output signal of the scan zone to the computing device. A checkout tray has a tactile surface formed from a predefined number of rows and a predefined number of columns of raised dot. The checkout tray is positioned within the scan zone. The processor processes the video output signal from the camera to attempt to identify an item placed on the checkout tray by a user during a transaction, provides a description of the item to the user via the user interface when the item is identified, and provides the user of an indication of a location of the item via a user interface when the item is not identified.

Vision-based self-checkout system and method for the visually impaired

Three-dimensional (3D) model images for menu item are maintained in a content delivery network (CDN) along with codes. The codes are printed/affixed to menus adjacent to the menu items. The menus include an anchor object that is sized in proportion to plates that serve the menu items. A user operates an augmented reality (AR)-enabled application (app) and uses a gesture to identify a code associated with a menu item from a menu. The code is decoded to contact the CDN and obtain the 3D model image corresponding to the menu item. The user centers a view-finder over the anchor object on the menu and the 3D model image is rendered on the anchor object in a scaled size and a scaled proportion for what will be provided to the user. The user may spin the 3D model to inspect proportions and ingredients of the menu item through the app.

Augmented reality order assistance

When a new order is received and is to be inserted into an unprepared order queue for order preparation. The new order's items and items' ingredients are obtained along with expected preparation/cook time for each ingredient. Items and ingredients for the orders that are already in the queue are also inspected along with the times that each order was placed in the queue. A machine-learning model is processed with the data associated with the orders and the new order. The model returns an optimized rearrangement of the queue with the new order inserted into the queue that levels out the expected order wait times, reduces variations in order wait times, and minimizes order preparation times based on the rearranged/modified queue. The optimized queue is presented on a display associated with staff responsible for preparing the orders of the queue.

Order queue optimization

A self-service checkout system includes a processor and a non-transitory computer-readable storage medium storing executable instructions. The executable instructions when executed by the processor cause the processor to perform operations including: receiving a message from a vision system that includes a list of identified items on a tray positioned adjacent to the vision system for a current transaction and one or more issues related to an identification of the items on the tray, processing the message to identify the one or more issues related to the identification of the items on the tray, providing a user interface for a customer to correct the one or more issues related to the identification of the items on the tray, and completing the current transaction once the issues related to the identification of the items on the tray are corrected.

System and method for interfacing between a vision checkout system and a self-service checkout terminal

Objects associated with a self-checkout area are identified and tracked through transaction data comprised of transaction details, device statuses, transaction interrupts/events, and video feeds during transactions on Self-Service Terminals (SSTs). Selective objects and selective transaction data are correlated together in a group for each transaction. Actions required of an attendant who is managing the transactions are identified for each group. An Augmented Reality (AR) interface is provided on an attendant-operated device that visually and uniquely identifies the actions, each group requiring a given action, and each object of each group that is to be the subject of the given action. In an embodiment, remote verification, audit, and override actions are processed through gestures made by the attendant and detected by the AR interface.

Augmented reality (AR) self checkout attendant

An indoor location is mapped into a grid comprising grid cells, each cell associated with items or objects detected as being present in the corresponding cell. The grid, grid cells, and linked items and/or objects are generated and updated using an Augmented Reality (AR) algorithm that maps a physical environment into cells and measures distances and directions within the environment relative to each cell. Walking paths (routes) to the items within the indoor location are generated using the grid information. As a user walks a path, the user's position within the indoor location is mapped and tracked to the cells and the path revised based on the user's actual position. A user device provides video via an AR application to track the user's position; a rendering of the position and path are superimposed within the video being viewed by the user on the user-operated device.

Indoor route mapping

Items are identified from one or more catalogues and images of the items are obtained. A dynamically rendered Virtual Reality (VR) store is constructed from the images and from images of objects/structures associated with a store. The item images that populate the VR store can be customized to a given customer and/or a given store. A VR session is established with a customer within the VR store, the item images can be selected, examined, and purchased during the session by the customer as the customer navigates through the VR store. Specialized rooms during the VR session allow the customer to interact in real time with other customers shopping via other VR sessions. The customer and other customers are rendered as avatars within the specialized room. A designated avatar or automated chatbot provides automated and real time assistance to the customer during the VR session.

Growing community of inventors

Atlanta, GA, United States of America

Kip Oliver Morgan