Electronic Scripting Products, Inc.

Invent.ly, LLC

Marek Alboszta

Michael J Mandella

Hector H Gonzalez-Banos

Stephen J Brown

Timothy J Hawks

Stewart R Carl

Hector H Gonzalez

The present invention discloses systems and methods for both viewing and interacting with a virtual reality (VR), an augmented reality (AR) or a mixed reality (MR). More specifically, the systems and methods allow the user to interact with aspects of such realities including virtual items presented in such realities or within such environments by manipulating a control device that has an inside-out camera mounted on-board. The apparatus or system uses two distinct representations including a reduced representation in determining the pose of the control device and uses these representations to compute an interactive pose portion of the control device to be used for interacting with the virtual item. The reduced representation is consonant with a constrained motion of the control device.

Realistic virtual/augmented/mixed reality viewing and interactions

The present invention concerns methods and apparatus for perturbing a known contextualization of an underlying proposition adopted by a group of subjects that are considered in a quantum representation. Initially, the subjects belonging to the group exhibit the known contextualization modulo the proposition and also have known measurable indications in the known contextualization. Perturbation is due to injection into the group of a disruptive subject that exhibits a Fermi-Dirac (F-D) anti-consensus statistic modulo the underlying proposition. A monitoring unit and a statistics module are deployed to collect and study subsequent measurable indications from subjects in the group after injection of the disruptive subject and upon re-confronting of the underlying proposition. The perturbation is thus detected and changes in the quantum representation due to it are estimated.

Perturbing the contextualization of a proposition by a group of subjects considered in a quantum representation by injecting a subject exhibiting an anti-consensus statistic modulo the proposition

A manipulated object using high optical contrast features and an on-board photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The manipulated object uses one or more controllers to determine its position and/or orientation, including full pose, in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector. The manipulated object can be embodied by any suitable device manipulated by a user, including a tablet computer or a phone.

Computer interface for manipulated objects with an absolute pose detection component

The present invention is directed to methods and apparatus for predicting the quantum state, including the dynamics of such quantum state in so far as it represents a subject embedded in a community of community subjects. In the quantum representation adopted herein the internal states of all subjects are assigned to quantum subject states defined with respect to an underlying proposition about an item that can be instantiated by an object, a subject or by an experience. Contextualization of the proposition about the item is identified with a basis (eigenbasis of a spectral decomposition) referred to herein as the social value context. The dynamics are obtained from quantum interactions on a graph onto which the quantum states of all the subjects are mapped by a surjective mapping dictated by subject interconnections and subject-related data, including the social graph and information derived from 'big data'.

Quantum state dynamics in a community of subjects assigned quantum states modulo a proposition perceived in a social value context

A remotely controlled object (e.g., an aircraft) or a wearable article (e.g., virtual or augmented reality glasses) using high optical contrast features and a photodetector that detects light produced, reflected or scattered by the features and outputs data indicative thereof. The remotely controlled object or wearable article uses one or more controllers to determine its position and/or orientation in the real three-dimensional environment based on data from the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.

Computer interface for remotely controlled objects and wearable articles with absolute pose detection component

Efficient techniques of recovering the pose of an optical apparatus exploiting structural redundancies due the conditioned motion of an apparatus are disclosed. The techniques are based on determining a reduced homography consonant to the conditioned motion of the optical apparatus. The optical apparatus comprises an optical sensor on which space points are imaged as measured image points. The reduced homography is based on a reduced representation of the space points, obtained by exploiting the structural redundancy in the measured image points due to the conditioned motion. The reduced representation consonant with the conditioned motion is defined by rays in homogeneous coordinates and contained in a projective plane of the optical sensor.

Reduced homography based on structural redundancy of conditioned motion

The present invention concerns methods and apparatus for detecting perturbations to previously established and known contextualizations practiced or exhibited by subjects when confronted by certain propositions about original items. The subjects are understood to be any sentient beings, e.g., human beings that use the known contextualizations modulo the propositions and also exhibit known measurable indications in response to these propositions. Measurable indications can take on the form of responses, actions, behaviors or any measurable aspects that can be collected from the subjects in response to the propositions. The perturbation to the contextualization that is adopted by the subjects is due to altering the original item to generate an altered item and placing the altered item at the center of the proposition that was previously apprehended by the subjects to be about the original item.

Perturbing a subject's contextualization of a proposition about an item considered in a quantum representation by altering the item

A wearable article, such as glasses for a virtual reality program or glasses for an augmented reality application, using light sources and a photodetector that detects their light and outputs data indicative of the detected light. The wearable article uses one or more controllers to determine its position and/or orientation in the environment based on the data output by the photodetector. Data from one or more auxiliary motion sensing devices, e.g., a relative motion sensor such as an inertial device or other auxiliary motion device relying on acoustics, optics or electromagnetic waves within or outside the visible spectrum, can be used to supplement the position and/or orientation data from the photodetector.

Computer interface employing a wearable article with an absolute pose detection component

The present invention relates to interfaces and methods for producing input for software applications based on the absolute pose of an item manipulated or worn by a user in a three-dimensional environment. Absolute pose in the sense of the present invention means both the position and the orientation of the item as described in a stable frame defined in that three-dimensional environment. The invention describes how to recover the absolute pose with optical hardware and methods, and how to map at least one of the recovered absolute pose parameters to the three translational and three rotational degrees of freedom available to the item to generate useful input. The applications that can most benefit from the interfaces and methods of the invention involve 3D virtual spaces including augmented reality and mixed reality environments.

Deriving input from six degrees of freedom interfaces

A reduced homography H for an optical apparatus to recover pose parameters from imaged space points Pusing an optical sensor. The electromagnetic radiation from the space points Pis recorded on the optical sensor at measured image coordinates. A structural uncertainty introduced in the measured image points is determined and a reduced representation of the measured image points is selected based on the type of structural uncertainty. The reduced representation includes rays {circumflex over (r)}defined in homogeneous coordinates and contained in a projective plane of the optical apparatus. At least one pose parameter of the optical apparatus is then estimated by applying the reduced homography H and by applying a condition on the motion of the optical apparatus, the condition being consonant with the reduced representation employed in the reduced homography H.

Reduced homography for recovery of pose parameters of an optical apparatus producing image data with structural uncertainty

A system with a remote control or wand equipped with a relative motion sensor that outputs data indicative of a change in position. The system has one or more light sources and a photodetector that detects their light and outputs data indicative of the detected light. One or more controllers are used to determine the absolute position of the wand based on the data output by the relative motion sensor and by the photodetector. The wand's absolute pose is determined from the data and includes the absolute position of a reference point on the wand and the wand's absolute orientation. A display is used to show an image defined by two orthogonal axes, e.g., those of world coordinates (X,Y,Z). The display is rendered as a function of absolute position of the wand in or along a third orthogonal axis.

Computer interface employing a manipulated object with absolute pose detection component and a display

A system that has a remote control, e.g., a wand, equipped with a relative motion sensor that outputs data indicative of a change in position of the wand. The system also has one or more light sources and a photodetector that detects their light and outputs data indicative of the detected light. The system uses one or more controllers to determine the absolute position of the wand based on the data output by the relative motion sensor and by the photodetector. The data enables determination of the absolute pose of the wand, which includes the absolute position of a reference point chosen on the wand and the absolute orientation of the wand. To properly express the absolute parameters of position and/or orientation of the wand a reference location is chosen with respect to which the calculations are performed. The system is coupled to a display that shows an image defined by a first and second orthogonal axes such as two axes belonging to world coordinates (X,Y,Z). The one or more controllers are configured to generate signals that are a function of the absolute position of the wand in or along a third axis for rendering the display. To simplify the mapping of a real three-dimensional environment in which the wand is operated to the cyberspace of the application that the system is running, the third axis is preferably the third Cartesian coordinate axis of world coordinates (X,Y,Z).

An apparatus and method for optically inferring an absolute pose of a manipulated object in a real three-dimensional environment from on-board the object with the aid of an on-board optical measuring arrangement. At least one invariant feature located in the environment is used by the arrangement for inferring the absolute pose. The inferred absolute pose is expressed with absolute pose data (&#x3c6;, &#x3b8;, &#x3c8;, x, y, z) that represents Euler rotated object coordinates expressed in world coordinates (X, Y, Z) with respect to a reference location, such as, for example, the world origin. Other conventions for expressing absolute pose data in three-dimensional space and representing all six degrees of freedom (three translational degrees of freedom and three rotational degrees of freedom) are also supported. Irrespective of format, a processor prepares the absolute pose data and identifies a subset that may contain all or fewer than all absolute pose parameters. This subset is transmitted to an application via a communication link, where it is treated as input that allows a user of the manipulated object to interact with the application and its output.

Growing community of inventors

Montara, CA, United States of America

Marek Alboszta