7-eleven, Inc.

Matthew Raymond Magee

Shahmeer Ali Mirza

Trong Nghia Nguyen

Ravi Kumar Kurva

Sarath Vakacharla

Joshua E Berry

Maninder Singh Suri

Ranganathan Mohan

Jonathan Christopher Hodge

Franklin Philips

Crystal Maung

Kyle Dalal

Xinan Wang

An apparatus to create a virtual layout of a virtual store to emulate a physical layout of a physical store includes a memory and a processor. The processor receives a physical position and orientation associated with a physical rack located in the physical store. In response, the processor places a virtual rack at a virtual position and orientation on the virtual layout, to represent the physical position and orientation of the physical rack on the physical layout. The processor receives virtual items associated with physical items located on physical shelves of the physical rack. In response, the processor places the virtual items on virtual shelves of the virtual rack, the virtual shelves representing the physical shelves of the physical rack. The processor assigns a rack camera, which captures video that includes the physical rack, to the virtual rack and stores the virtual layout in the memory.

Tool for generating a virtual store that emulates a physical store

An apparatus includes a display and a processor. The processor displays a virtual shopping cart. The processor also receives information indicating that an algorithm determined that a physical item was selected by a person during a shopping session in a physical store, based on a set of inputs received from sensors located within the store. In response, the processor displays a virtual item, which includes a graphical representation of the physical item. The processor additionally displays a rack video captured during the shopping session by a rack camera located in the store. The rack camera is directed at a physical rack located in the store, which includes the physical item. In response to displaying the rack video, the processor receives information identifying the virtual item, where the rack video depicts that the person selected the physical item. The processor then stores the virtual item in the virtual shopping cart.

System and method for populating a virtual shopping cart based on a verification of algorithmic determinations of items selected during a shopping session in a physical store

An apparatus includes a display, interface, and processor. The interface receives video from a camera located in a physical store and directed at a first physical rack. The camera captures video of the rack during a shopping session. The processor displays a first virtual rack that emulates the first physical rack and includes first and second virtual shelves. The virtual shelves include virtual items, which include graphical representations of physical items located on the physical rack. The processor displays the rack video, which depicts an event including the person interacting with the first physical rack. The processor also displays a virtual shopping cart. The processor receives information associated with the event, identifying the first virtual item. The rack video depicts that the person selected the first physical item while interacting with the first physical rack. The processor then stores the first virtual item in the virtual shopping cart.

System and method for populating a virtual shopping cart based on video of a customer's shopping session at a physical store

An apparatus includes a display, interface, and processor. The interface receives a live camera feed from a camera directed at a first physical structure located in a physical space. The processor receives an indication of an event associated with the first physical structure and accordingly displays a first virtual structure corresponding to the first physical structure. The first virtual structure includes virtual items that emulate physical items located on the first physical structure. The processor additionally displays a recording of the live camera feed, which depicts the event associated with the first physical structure.

System and method for presenting a virtual store shelf that emulates a physical store shelf

An apparatus includes an interface, display, memory, and processor. The interface receives a video feed including first and second camera feeds, each feed corresponding to a camera located in a store. The processor stores a video segment in memory, assigned to a person and capturing a portion of a shopping session. The video segment includes first and second camera feed segments, each segment corresponding to a recording of the corresponding camera feed from a starting to an ending timestamp. Playback of the first and second camera feed segments is synchronized, and a slider bar controls a playback progress of the camera feed segments. The processor displays the camera feed segments and copies of the slider bar on the display. The processor receives an instruction from at least one of the copies of the slider bar to adjust the playback progress of the camera feed segments and adjusts the playback progress.

Customer-based video feed

An apparatus includes a memory and processor. The memory stores a machine learning algorithm configured to decide whether to use a virtual shopping cart to verify all or a portion of a transaction performed with an algorithmic shopping cart. The processor receives feedback for a decision made by the algorithm, indicating whether the algorithmic and virtual carts match. The processor assigns a reward to the feedback. A first positive reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts match. A second positive reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts do not match. A first negative reward is assigned when the virtual shopping cart is not used for verification, and the feedback indicates that the carts do not match. A second negative reward is assigned when the virtual cart is used for verification, and the feedback indicates that the carts match. The processor uses the reward to update the algorithm.

Machine learning algorithm trained to identify algorithmically populated shopping carts as candidates for verification

An apparatus includes a memory and a processor. The memory stores a set of inputs, an algorithmic shopping cart, and a machine learning algorithm. The set of inputs includes information collected from sensors located in a physical store during a shopping session of a person. The algorithmic shopping cart includes items determined by an algorithm, based on the set of inputs, to have been selected during the shopping session. The machine learning algorithm is configured to use the set of inputs to select between using the algorithmic shopping cart and using a virtual shopping cart to process a transaction associated with the shopping session. The processor uses the machine learning algorithm to determine, based on the set of inputs, to use the algorithmic shopping cart to process the transaction.

System and method for selectively verifying algorithmically populated shopping carts

An apparatus includes a display, interface, and processor. The interface receives a camera feed from a camera directed at a first physical rack located in a physical store. The processor displays virtual racks assigned to physical racks. The processor receives an indication of an event associated with the first physical rack and accordingly displays a first virtual rack, which includes first and second virtual shelves. The first and second virtual shelves include virtual items that emulate physical items located on physical shelves of the first physical rack. The processor additionally displays a recording of the camera feed, which depicts the event associated with the first physical rack.

An apparatus includes a display and a processor. The processor receives a refund request, which includes a request for a refund of a price of an item charged to an account belonging to a person, and information identifying a shopping session of the person in a physical store. In response to receiving the refund request, the processor locates a video segment captured during the shopping session and stored in a database. The processor displays the video segment, which depicts a scenario indicating that the person did not select the item for purchase during the shopping session. The processor further receives information indicating that the person did not select the item for purchase during the shopping session. The information is based at least in part on the video segment. In response to receiving the information, the processor credits the account belonging to the person with the price of the item.

System and method for processing a refund request arising from a shopping session in a cashierless store

An apparatus includes a display, interface, and processor. The interface receives a camera feed from a camera directed at a first physical rack located in a physical store. The processor displays, in a first region of the display, a virtual layout of a virtual store, configured to emulate a physical layout of the physical store. The virtual layout includes virtual racks assigned to physical racks. The virtual layout emulates the physical layout of the physical store. The processor receives an indication of an event associated with the first physical rack and accordingly displays the first virtual rack, which includes first and second virtual shelves. The first and second virtual shelves include virtual items that emulate physical items located on physical shelves of the first physical rack. The processor additionally displays a recording of the camera feed, which depicts the event associated with the first physical rack.

Growing community of inventors

Sanger, TX, United States of America

Matthew Raymond Magee