Google Inc.

Ian MacGillivray

Emma Sarah Persky

Darwin Yamamoto

Jon Bedard

Yonatan Erez

Christopher Ross

Varun Jasjit Singh

Kaylin Spitz

Selena Sunling Yang

Evan Moore

Engin Cinar Sahin

Max Bogue

Angela Ni-Hwey Chang

Konrad Piotr Delong

Tim Gleason

Manuel Christian Clement

Jason Matthew Toff

Stefan Welker

Charles Han

Shawn Buessing

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for providing filters from resource content. In one aspect, a system receives data identifying a set of resources that are determined to be responsive to a search query and extracts a set of keywords from the contents of the resources and related queries. The keywords are processed according to candidate selection criteria, and a set of candidate query filters are determined. The candidate filters may be used to filter the resources that are responsive to the query.

Search result filters from resource content

Techniques of collecting and displaying data include mapping user interaction data having multiple components (or, dimensions) to a plurality of buckets representing a set of values of each of the components. When a user causes a computer to generate user interaction data by interacting with an object on an electronic display, the computer performs a mapping of the many components of the user interaction data to a plurality of buckets. Each bucket represents a set of values of the user interaction data. The number of buckets is far smaller than the number of possible data points. Accordingly, rather than individual, multidimensional data points being transmitted to another computer that compiles the user interaction data into heat maps, a relatively small number of bucket identifiers are transmitted. In this way, the analysis of the user interaction data requires minimal resources and can take place in real time.

Data reduction for generating heat maps

In an augmented reality and/or a virtual reality system, detected commands may be intelligently batched to preserve the relative order of the batched commands while maintaining a fluid virtual experience for the user. Commands detected in the virtual environment may be assigned to a batch command, of a plurality of batch commands, based on a temporal window in which the command(s) are detected, based on an operational type associated with the command(s), or based on a spatial position at which the command is detected in the virtual environment. The commands included in a batched set of commands may be executed in response to an un-do command and/or a re-do command and/or a re-play command.

Intelligent command batching in an augmented and/or virtual reality environment

Systems and methods are described that include generating a virtual reality experience in a virtual reality environment, detecting, a first gesture from a first user accessing the virtual reality environment, the first gesture being configured as a command to initiate a privacy mode with a second user accessing the virtual reality environment, and generating a prompt for display to the second user, the prompt corresponding to the command. In response to detecting a second gesture from the second user, the second gesture determined to substantially match the first gesture, initiating the privacy mode between the first user and the second user in the virtual reality environment, and sharing communications occurring in the virtual environment from the first user to the second user and from the second user to the first user while modifying, for users other than the first user and the second user, the communications occurring between the first user and the second user.

Information privacy in virtual reality

A method includes: identifying a physical environment to be a basis for virtual training, the physical environment associated with performance of operations; creating, in a computer system, a three-dimensional (3D) model of the physical environment; defining, in the computer system, virtual operations to be performable during the virtual training, the virtual operations corresponding to the operations of the physical environment; identifying, in the computer system, a controllable component in the physical environment; creating, in the computer system, a 3D model of the identified controllable component; creating, in the computer system, a state model of the physical environment; and assembling, in the computer system, a virtual environment from the 3D model of the physical environment and the 3D model of the identified controllable component, and associating the created state model with the virtual environment.

Virtual instruction tool

Systems and methods for a volumetric multi-selection interface for selecting multiple entities in three-dimensional (3D) space are provided. An example method includes generating a selection region within a three-dimensional space and receiving a selection path user input to define a selection path. The method also includes defining a selection volume based on the selection region and the selection path and selecting entities within the 3D space based on the selection volume. In some implementations, an alter selection region user input is received while the selection path is being defined. The size or shape of the selection region may be altered in response thereto.

Volumetric multi-selection interface for selecting multiple objects in 3D space

Techniques of generating a virtual environment in a virtual reality system involves changing, within a user interface of the second user, an attribute of an avatar representing the first user while maintaining a spatial position of an object with which the first user is interacting. In this way, the second user may see only non-threatening or otherwise pleasant avatars within their user interface while other users may not perceive any change to the virtual environment as displayed in their respective user interfaces.

Avatars in virtual environments

According to an example implementation, a method may include receiving, from a non-virtual reality application, a non-virtual reality event notification, and providing, in a virtual environment based on the non-virtual reality event notification, a non-textual indication of a status of the non-virtual reality application, wherein a characteristic of the non-textual indication is adjusted to indicate the status of the non-virtual reality application.

Representations of event notifications in virtual reality

The disclosed methods and apparatus allow a lay person to easily and intuitively define virtual scenes using natural language commands and natural gestures. Natural language commands include statements that a person would naturally (e.g., spontaneously, simply, easily, intuitively, etc.) speak without any or little training. Example natural language commands include 'put a cat on the box,' or 'put a ball in front of the red box.' Natural gestures include gestures that a person would naturally do, perform or carry out (e.g., spontaneously, simply, easily, intuitively, etc.) without any or little training. Example natural gestures include pointing, a distance between hands, gazing, head tilt, kicking, etc. The person can simply speak and gesture how it naturally occurs to them.

Methods and apparatus to define virtual scenes using natural language commands and natural gestures

In an augmented reality and/or a virtual reality system, virtual annotation surfaces, or virtual sheets, or virtual whiteboards, may be materialized in response to a detected gesture. A user may annotate, adjust, store, review and revise the virtual annotation surfaces, and allow for collaboration with other users, while in the current virtual environment, and/or within another virtual environment, and/or outside of the virtual environment.

Generating virtual notation surfaces with gestures in an augmented and/or virtual reality environment

Computer-implemented systems and methods are provided for analyzing and responding to a query from a user. Consistent with certain embodiments, systems and methods are provided for receiving a query from the user and dividing the query into query segments based on a set of grammar rules. Further, systems and methods are provided for selecting a first segment from the query segments, receiving at least one tuple stored in association with the user, selecting a second segment from the at least one tuple. Additionally, systems and methods are provided for receiving information related to the first and second segments, and generating a response to the query based on the received information. In addition, systems and methods are provided for transmitting information to a display device for presenting the response to the user.

Growing community of inventors

New York, NY, United States of America

Ian MacGillivray