Roblox Corporation

Apple Inc.

Aswath Manoharan

Nikolaus Sonntag

Eric Holmdahl

Shailendra Rathore

I-Wu Lu

David Alyea

Myra C Lukens

Sejal Chauhan

Madhok Shivaratre

Saurabh Adya

Alkeshkumar M Patel

Jianan Duan

Karan M Daryanani

Stephen Olivier Lemay

Pedro Mari

Jay Moon

Sreeneel K Maddika

Chaitanya Mannemala

Keith P Avery

Lynn I Streja

Abhishek Rawat

Systems and processes for operating a digital assistant are provided. An example process for determining a response includes, at an electronic device having one or more processors and memory, receiving a spoken input including a request, performing a semantic analysis on the spoken input, determining, based on the semantic analysis, a likelihood that the electronic device requires additional contextual data to satisfy the request, and in accordance with the determined likelihood exceeding a threshold, enabling a camera of the electronic device and determining a response to the request based on data captured by the camera of the electronic device.

Selectively using sensors for contextual data

An example process includes: while displaying a portion of an extended reality (XR) environment representing a current field of view of a user: detecting a user gaze at a first object displayed in the XR environment, where the first object is persistent in the current field of view of the XR environment; in response to detecting the user gaze at the first object, expanding the first object into a list of objects including a second object representing a digital assistant; detecting a user gaze at the second object; in accordance with detecting the user gaze at the second object, displaying a first animation of the second object indicating that a digital assistant session is initiated; receiving a first audio input from the user; and displaying a second animation of the second object indicating that the digital assistant is actively listening to the user.

Extended reality based digital assistant interactions

Systems and processes for operating an intelligent automated assistant are provided. An example process includes receiving an utterance including a user request and determining whether at least a portion of the user request is ambiguous. If at least the portion of the user request is ambiguous then a set of context data based on the ambiguous portion of the user request is determined, metadata is extracted from the context data and a response to the user request is determined based on the extracted metadata.

Multimodal assistant understanding using on-screen and device context

A user query, such as a user query processed by the online game system, is provided as input into a trained machine learning model. The machine learning model predicts candidate languages of the user query and outputs language confidence scores for the candidate languages. The user query is also matched with stored query data associated with game information in individual language databases for the respective candidate languages. A match scores may be determined based on a certainty of the respective response matches. The match scores and the language confidence scores may be weighted to determine a weighted score. The weighted scores of the response matches are applied to decide which game information retrieved from the identified database is used in forming a response of search results to the user.

Language detection of user input text for online gaming

Implementations relate to systems, methods, and computer-readable media to generate text tags for games. A computer-implemented method is provided to generate one or more text tags for a game using a trained machine learning model. Data that includes a game identifier of the game and a set of digital assets associated with the game are provided as input to the trained machine learning model. Predicted text tags are generated using the trained machine learning model based on the set of digital assets associated with the game. The text tags are associated with a respective prediction score. One or more text tags are selected from the plurality of predicted text tags based on the respective prediction score.

Automated generation of game tags

A request to perform a set of map reduce jobs that generate a plurality of cross products from a dataset based on a join field is received. The join field indicates that each of the plurality of cross products is to be generated from a corresponding subset of the dataset. Responsive to receiving the request to perform the set of map reduce jobs, the set of map reduce jobs on the dataset to generate the plurality of cross products is performed. The final output data of the set of map reduce jobs is stored. The final output data comprises the plurality of cross products.

Computing cross products using map reduce

A system and method identifies activity data that is related to activity of a plurality of users of a gaming platform. The activity data is used by the gaming platform to perform a gaming process. The system and method identifies first data of the activity data based on a first characteristic. The first data is a subset of the activity data. The system and method determines a number of times that the first data of the activity data meets a first condition. The system and method responsive to determining that the number of times that the first data of the activity data meets the first condition satisfies a first threshold, modifies the activity data by removing the first data from the activity data. The system and method performs the gaming process using the modified activity data.

Data flood checking and improved performance of gaming processes

Implementations described herein relate to methods, systems, and computer-readable media to dynamically customize rankings. In some implementations, a method includes receiving, from a user, a request for a list of items available on an online gaming platform, identifying a particular trained machine learning model based at least in part on user data associated with the user, providing an input feature vector to the particular trained machine learning model, obtaining an output feature vector from the particular trained machine learning model, assigning a rank for each of the plurality of items based on the output feature vector, generating the list of items, wherein items in the list of items are ordered based on respective ranks, and providing a user interface to the user that includes the list of items.

Providing dynamically customized rankings of game items

Prominent display of a targeted game in search results from a search within an online gaming platform. In some implementations, a server receives a search query from a device. The search query is executed against a data store of available games to obtain search results indicating a set of games. Based on one or more characteristics of the set of games, it is determined whether the search query is directed to a narrow search for a particular game in the set of games. In response to determining such a narrow search, the particular game is designated with a highlight indication, and the search results and highlight indication are transmitted to the device, causing display of a user interface that includes at least a portion of the search results. The highlight indication causes the device to display an identifier of the particular game as highlighted relative to other search results.

Prominent display of targeted game in search results

Some implementations relate to methods, systems, and computer-readable media to generate text tags for games. In some implementations, a computer-implemented method to generate one or more text tags includes obtaining a plurality of chat transcripts, each chat transcript associated with a respective gameplay session of a respective game of a plurality of games. Each chat transcript includes content provided by participants in the gameplay session. The method further includes programmatically analyzing the plurality of chat transcripts to determine one or more characteristics for each game of the plurality of games, and generating a text tag for at least one game of the plurality of games based on the one or more characteristics of the at least one game.

Generation of text tags from game communication transcripts

Implementations relate to providing search suggestions on a collaboration platform. In some implementations, a method includes generating a dictionary of terms comprising terms associated with games of the collaboration platform by identifying a set of the games that have a frequency of play that meets a threshold frequency and identifying a plurality of search terms associated with previous search queries of the collaboration platform. The method further includes comparing the plurality of search terms with the dictionary of terms, identifying a first set of the search terms that are candidate search terms and a second set of the search terms that are search suggestions, and generating a record that associates candidate search terms of the first set of the search terms with respective search suggestions wherein the record is used to provide a suggestion for one or more new search terms of a new search query.

Recommendation of search suggestions

A method includes identifying a search term and obtaining historical data indicative of a number of times a game was selected from search results corresponding to search queries using the search term and indicative of a number of times the selected game was played by one or more users for at least a threshold amount of time. The method further includes generating a score based on the historical data. The score is associated with the search term and the selected game.

Leveraging historical data to improve the relevancy of search results

A system and method includes using a queue with reduce operations. A method can include, responsive to generation of one or more markers by a first node or a second node, causing a submission of one or more markers to a queue associated with a computing cluster. Additionally, responsive to a determination that the first node has completed a first reduce operation, directing the first node to perform a first copy operation to copy first data identified by a first marker of the one or more markers in the queue, where the first copy operation is performed concurrently with the second reduce operation.

Growing community of inventors

Sunnyvale, CA, United States of America

Aswath Manoharan