Meta Compnay

Meta View, Inc.

Yishai Gribetz

Rebecca B Frank

Zachary R Kinstner

Raymond Chun Hing Lo

The methods, systems, techniques, and components described herein may facilitate user interactions with virtual objects in a three-dimensional virtual environment using user input into a graphical interface of a control device that is coupled to a display that may display the three-dimensional virtual environment. The control device may be configured to display a 3D representation of a virtual object having a non-virtual reality representation of the virtual object. The graphical interface of the control device may receive selection information that corresponds to a user selection of the 3D representation of the virtual object. Transformation parameters that provide a basis for rendering a three-dimensional representation of a virtual object in the three-dimensional virtual environment may be obtained to define a transformation of the 3D representation of the virtual object. The transformation parameters may be applied to compose a 3D representation of a virtual object that represents the virtual object in the three-dimensional virtual environment.

System and method for facilitating user interaction with a three-dimensional virtual environment in response to user input into a control device having a graphical interface

Aspects of the disclosed apparatuses, methods and systems provide manipulation of a virtual world three dimensional (3D) space based on input translated from the real world. Elements in the virtual world may have an associated charge and field. An element in the virtual world becomes interactive with an element translated from the real world when the translated real world element interacts with a field associated with the virtual element according to the charges. Forces may be applied to the virtual element using a real world physics model to determine a response by the virtual element to the applied force.

Apparatuses, methods and systems for application of forces within a 3D virtual environment

The methods, systems, techniques, and components described herein allow interactions with virtual objects in a virtual environment, such as a Virtual Reality (VR) environment or Augmented Reality (AR) environment, to be modeled accurately. More particularly, the methods, systems, techniques, and components described herein allow interactive virtual frames to be created for virtual objects in a virtual environment. The virtual frames may be built using line primitives that form frame boundaries based on shape boundaries of virtual objects enclosed by the virtual frame. An area of interactivity defined by the virtual frame may allow users to interact with the virtual object in the virtual environment.

System and method for managing interactive virtual frames for virtual objects in a virtual environment

A system configured for tracking a human hand in an augmented reality environment may comprise a distancing device, one or more physical processors, and/or other components. The distancing device may be configured to generate output signals conveying position information. The position information may include positions of surfaces of real-world objects, including surfaces of a human hand. Feature positions of one or more hand features of the hand may be determined through iterative operations of determining estimated feature positions of individual hand features from estimated feature position of other ones of the hand features.

System and method for tracking a human hand in an augmented reality environment

Various implementations provide for a three-dimensional trackpad in which sensors and a three-dimensional physical region may be used to interact with a three-dimensional virtual environment. The methods, systems, techniques, and components described herein may facilitate interactions with virtual objects in a three-dimensional virtual environment in response to sensor input into a control device having one or more sensors implemented thereon. The control device may be coupled to a display that may be configured to display the three-dimensional virtual environment. In various implementations, the sensor(s) capture physical movement of a user interaction element (a hand, a stylus, a physical object, etc.) within a specified three-dimensional physical region. The physical movement may be translated into a virtual interaction with the three-dimensional virtual environment. A virtual action in the three-dimensional virtual environment may be identified and displayed.

System and method for facilitating virtual interactions with a three-dimensional virtual environment in response to sensor input into a control device having sensors

The methods, systems, techniques, and components described herein allow interaction volumes of virtual objects in a virtual environment, such as a Virtual or Augmented Reality environment, to be modified based on user interactions taken on virtual frames created for those virtual objects. A user interaction element of a virtual frame may receive a user interaction. The user interaction may comprise one or more instructions to modify the size, shape, or other visual property of the virtual object. For example, the user interaction may comprise one or more instructions to change a size of the virtual object while maintaining a scale of the virtual object. In response to the user interaction, visual properties of the virtual frame and/or the virtual object may be modified. Interaction volumes of component elements of the virtual frame as well as interaction volumes of the virtual object may be modified in response to the user interaction.

System and method for modifying virtual objects in a virtual environment in response to user interactions

A system configured for tracking a human hand, e.g., in an interactive space, may comprise a distancing device, one or more physical processors, and/or other components. The distancing device may be configured to generate output signals conveying position information. The position information may include positions of surfaces of real-world objects, including surfaces of a human hand. A group of points may be identified that lie on a candidate surface which is a candidate for being the surface of a hand. The edges of the candidate surface may be detected. The points furthest away from the closest edge may be determined. A model may be created by connecting at least some of these points. Sections of the model are identified that may be a digit of the hand. Per section, fingertips and metacarpophalangeal joints may be identified. The model may be analyzed to determine whether the candidate surface is the surface of a hand.

System and method for identifying and tracking a human hand in an interactive space based on approximated center-lines of digits

The methods, systems, techniques, and components described herein allow interaction volumes of virtual objects in a virtual environment, such as a Virtual Reality (VR) environment or Augmented Reality (AR) environment, to be modified based on user interactions taken on virtual frames created for those virtual objects. A user interaction element of a virtual frame may receive a user interaction. The user interaction may comprise one or more instructions to modify the size, shape, or other visual property of the virtual object. As an example, the user interaction may comprise one or more instructions to change a size of the virtual object while maintaining a scale of the virtual object. In response to the user interaction, visual properties of the virtual frame and/or the virtual object may be modified. Interaction volumes of component elements of the virtual frame as well as interaction volumes of the virtual object may be modified in response to the user interaction.

Growing community of inventors

Belmont, CA, United States of America

Yishai Gribetz