Google Inc.

Jon Bedard

Ian MacGillivray

Darwin Yamamoto

Evan Moore

Jason Matthew Toff

Antonio Bernardo Monteiro Costa

Andrey Doronichev

Ana Krulec

David Louis Bergman Quaid

Tim Gleason

Ian Macgillivray

Ben Schrom

Jennifer Holland

Yunxin Zheng

A method includes: identifying a physical environment to be a basis for virtual training, the physical environment associated with performance of operations; creating, in a computer system, a three-dimensional (3D) model of the physical environment; defining, in the computer system, virtual operations to be performable during the virtual training, the virtual operations corresponding to the operations of the physical environment; identifying, in the computer system, a controllable component in the physical environment; creating, in the computer system, a 3D model of the identified controllable component; creating, in the computer system, a state model of the physical environment; and assembling, in the computer system, a virtual environment from the 3D model of the physical environment and the 3D model of the identified controllable component, and associating the created state model with the virtual environment.

Virtual instruction tool

The disclosed methods and apparatus allow a lay person to easily and intuitively define virtual scenes using natural language commands and natural gestures. Natural language commands include statements that a person would naturally (e.g., spontaneously, simply, easily, intuitively, etc.) speak without any or little training. Example natural language commands include 'put a cat on the box,' or 'put a ball in front of the red box.' Natural gestures include gestures that a person would naturally do, perform or carry out (e.g., spontaneously, simply, easily, intuitively, etc.) without any or little training. Example natural gestures include pointing, a distance between hands, gazing, head tilt, kicking, etc. The person can simply speak and gesture how it naturally occurs to them.

Methods and apparatus to define virtual scenes using natural language commands and natural gestures

In an augmented reality and/or a virtual reality system, virtual annotation surfaces, or virtual sheets, or virtual whiteboards, may be materialized in response to a detected gesture. A user may annotate, adjust, store, review and revise the virtual annotation surfaces, and allow for collaboration with other users, while in the current virtual environment, and/or within another virtual environment, and/or outside of the virtual environment.

Generating virtual notation surfaces with gestures in an augmented and/or virtual reality environment

In a general aspect, a system can include a leader device. The leader device can include an interface configured to display a plurality of preview images, each preview image corresponding with respective virtual reality (VR) content. The leader device also include a selection device configured to select a preview image of the plurality of preview images and a leader application configured to control presentation of the respective VR content associated with the selected preview image. The system can further include a plurality of participant devices that are operationally coupled with the leader device. Each participant device of the plurality of participant devices can be configured to, responsive to the leader device, display at least one image included in the respective VR content corresponding with the selected preview image.

Virtual reality expeditions

Growing community of inventors

New York, NY, United States of America

Jon Bedard