Walmart Apollo, LLC

Abhimanyu Mitra

Kannan Achan

Afroza Ali

Omkar Deshpande

Venkata Syam Prakash Rapaka

Evren Korpeoglu

Sinduja Subramaniam

Abhay Kashyap

Yang Deng

Sushant Kumar

Gary Tang

Zachary Poley

Patrick Lloyd Harrington, Jr

Nikhil Raj

Shirpaa Manoharan

Long Lin

Somnath Banerjee

Yun Zhang

Xiaotong Suo

Galana Gebisa

Robert Bartoszynski

Kailing Wang

Chung-Wei Yen

Xiang Xiao

Zhihao Huang

Atul Kochhar

Systems and methods for generating dynamic interfaces using explore-exploit models is disclosed. A first interface including a first set of content modules selected from a set of candidate content modules is generated and feedback data representative of one or more interactions with the first interface is received. The feedback data includes positive feedback and negative feedback. A set of weights for each content module is generated by a contextual explore-exploit model based on the feedback data. A request for a second interface including a context is received and a set of ranked content modules is selected for the context based on the weights of each of the content modules in the set of candidate content modules. A second interface including a second set of content modules is generated. The second set of content modules includes a predetermined number of top ranked content modules in the set of ranked content modules.

Systems and methods of dynamic page layout using exploration-exploitation models

Systems and methods for content selection and presentation are disclosed. Training data including indicating one or more interactions with one or more content elements and associated with one of a plurality of individual contexts is received. A selection model is trained by applying a reinforcement learning mechanism and an individual explore-exploit mechanism. A context for a user is selected by applying the selection model, which is configured to determine an expected future reward value of at least one of the plurality of individual contexts, determine an expected future reward value of a global context based on a past click-through rate, a reward value, and a future click-through rate, and, select the global context or one of the one or more individual contexts based on a comparison of the expected future reward values.

Dynamic evaluation and use of global and contextual personas

A method including tracking impression response data in response to online impressions of content elements displayed to users of a website. The method also can include performing a classification of the users based on the impression response data. The method additionally can include generating a webpage of the website to comprise a content element selected from among the content elements based on the classification of a user of the users. Other embodiments are described.

Automatic resolution of the explore-exploit decision in omnichannel settings

A system including one or more processors and one or more non-transitory computer-readable media storing computing instructions configured to run on the one or more processors and perform: coordinating displaying a personalized list of recommended items on a graphical user interface of a user device of a user; determining a personal replenishment cycle for an item of a set of items previously purchased by the user; increasing available storage space in the one or more non-transitory computer-readable media of the system by removing a first item from the set of items to identify that the user has stopped purchasing the first item; and increasing a network bandwidth of the system by reducing a number of database requests for the set of items previously purchased by the user. Other embodiments are disclosed.

Systems and methods for estimating personal replenishment cycles

A system including one or more processors and one or more non-transitory media storing computer instructions configured to run on the one or more processors and perform: identifying a first sub-population of case individuals from a gross population of the case individuals; presenting first test content to a first test sub-population of the case individuals, the first test content is selected according to a first statistical model; measuring a first test sub-population average feedback metric based on first test content feedback provided from the first test sub-population of the case individuals; determining that the first test sub-population average feedback metric exceeds a first control population average feedback metric of a first control population of the case individuals; and determining that a probability value for a difference between the first test sub-population average feedback metric and the first control population average feedback metric is less than a predetermined significance level value. Other embodiments are disclosed.

Systems for learning and using one or more sub-population features associated with individuals of one or more sub-populations of a gross population and related methods therefor

A system and method for content selection and presentation is disclosed. A plurality of content elements configured for presentation in at least one content container is received and one of the plurality of content elements is selected for presentation in the at least one content container. The one of the plurality of content elements is selected by a trained selection model configured to select one of an individual context or a global context. An interface including the selected one of the plurality of content elements is generated.

A system including one or more processors and one or more non-transitory computer-readable media storing computing instructions configured to run on the one or more processors and perform: displaying content elements on one or more websites to users; tracking respective impression response data for each impression of a respective content element of the content elements comprising (a) a respective response of a respective user of the users and (b) a respective time of the respective response of the respective user; determining respective weightings of the content elements based on posterior distributions using the respective impression response data, as adjusted by a temporal decay factor, based on the respective times of the respective impression response data for the content elements; and generating a webpage of the one or more web sites to comprise a selected content element based on the respective weighting of the selected content element. Other embodiments are disclosed.

Automated mechanisms to resolve explore-exploit dilemma with adaptive revival opportunities

A method including tracking impression response data in response to online impressions of content elements displayed to users of a website. The impression response data can include (i) first responses by the users in one or more physical stores in response to the online impressions, and (ii) second responses by the users in the website in response to the online impressions. The method also can include receiving a request from a user of the users to display a webpage of the website. The method additionally can include generating the webpage to include a content element selected from among the content elements based on a classification of the user and the impression response data for the content elements. Other embodiments of related systems and methods are described.

A system including one or more processors and one or more non-transitory computer-readable media storing computing instructions configured to run on the one or more processors and perform: displaying content elements on one or more websites to users; performing a classification of the users into segments; receiving a request from a first user of the users to display a webpage of the one or more websites; determining an amount of information in a respective posterior distribution of each of the one or more first segments of the segments in which the first user is classified, for each of the content elements based on impression response data; selecting a selected content element from among the content elements based on weightings of the content elements for the one or more first segments; and generating the webpage comprising the selected content element. Other embodiments are disclosed.

Personalized mechanisms to resolve explore-exploit dilemma with dynamically shared learnings

A system and method for content selection and presentation is disclosed. A system receives a plurality of content elements configured for presentation in at least one content container and selects one of the plurality of content elements for presentation in the at least one content container. The one of the plurality of content elements is selected by a trained selection model configured to use Thompson sampling. An interface including the selected one of the plurality of content elements is generated.

Robust reinforcement learning in personalized content prediction

A system and method for content selection and presentation is disclosed. A plurality of content elements configured for presentation in at least one content container is received and one of the plurality of content elements is selected for presentation in the at least one content container. The one of the plurality of content elements is selected by a trained selection model based on an optimal impression allocation. An interface is generated that includes the selected one of the plurality of content elements.

Dynamical switching between long-term and short-term rewards

Systems and methods including one or more processing modules and one or more non-transitory storage modules storing computing instructions configured to run on the one or more processing modules and perform acts of: utilizing historical transaction information to derive metric information associated with prior transactions; generating a listing of user-item pairs, each of the user-item pairs identifying a user and an item; executing a machine learning model that is configured to generate a transmission list for sending push notifications; generating a transmission list by selecting user-item pairs based on the conversion probability values and the confidence indicators that are assigned to the user-item pairs; customizing content for the push notifications to include information for items identified by the user-item pairs included in the transmission list; and transmitting the push notifications to the users identified by the user-item pairs included in the transmission list. Other embodiments are disclosed herein.

Machine learning techniques for transmitting push notifications

A method including displaying content elements on one or more websites to users. This method can also include tracking impression response data comprising (a) a response of the user to the content element of the content elements displayed on the one or more websites and (b) a time of the response of the user. Additionally, the method can include receiving a request from a first user. The method can further include determining weightings of the content elements based on posterior distributions using the impression response data, as adjusted by a temporal decay factor based on the times of the impression response data for the content elements. The method additionally can include generating the webpage to comprise the selected content element. Other embodiments are disclosed.

A method including tracking usage data for users using a first channel and a second channel. The method also can include performing a classification of first users of the users into a first group and second users of the users into a second group. The classification can be based on the usage data. The method additionally can include, for each impression of a content element of content elements being displayed on a website to a user of the users, tracking impression response data including (a) whether the user is grouped into the first group or the second group, and (b) response data including: (i) a first response by the user to the content element in the first channel, and (ii) a second response by the user to the content element in the second channel. The method further can include receiving a request from a first user of the users to display a webpage of the website. The method additionally can include generating the webpage to include a selected content element from among the content elements. The selected content element can be selected based on the classification of the first user and the impression response data for the content elements. Other embodiments of related systems and methods are disclosed.

Growing community of inventors

San Jose, CA, United States of America

Abhimanyu Mitra