Microsoft Technology Licensing, LLC

Autodesk, Inc.

Christian Holz

Eyal Ofek

Michael Jack Sinclair

Andrew David Wilson

Hrvoje Benko

Nicolas Villar

Haiyan Zhang

Edward Bryan Cutrell

Greg Saul

Mar Gonzalez Franco

Daniel Cletheroe

Ivan Jelev Tashev

Meredith June Morris

Ishan Chatterjee

Mihai R Jalobeanu

David Emerson Johnston

Hannes Gamper

Hakim Si Mohammed

Jeremy Hartmann

Lung-Pan Cheng

Dimitra Emmanouilidou

Adrian Kuo Ching Lee

Yuhang Zhao

Cynthia Lynn Bennett

George William Fitzmaurice

Stephen Edward Hodges

Tovi Samuel Grossman

Andrew William Fitzgibbon

Eric Michael Whitmire

Inrak Choi

Karan Ashok Ahuja

Oscar Salandin

Sebastian Lennard Marwecki

Junrui Yang

Jaeyeon Lee

Artem Dementyev

Anne Agur

Andrew Fitzgibbon

A sensor device is described herein. The sensor device includes a multi-dimensional optical sensor and processing circuitry, wherein the multi-dimensional optical sensor generates images and the processing circuitry is configured to output data that is indicative of hemodynamics of a user based upon the images. The sensor device is non-invasive, and is able to be incorporated into wearable devices, thereby allowing for continuous output of the data that is indicative of the hemodynamics of the user.

Sensor device

The present concepts relate to haptic controllers. In one example the haptic controller can include first and second capstans rotationally secured to a base and an energy storage mechanism connected between the first and second capstans. The example haptic controller can also include a user engagement assembly secured to the first capstan and a controller configured to control rotational forces imparted on the user engagement assembly by controlling rotational friction experienced by the first and second capstans.

Haptic controller

A computer device is provided that includes a display device, and a sensor system configured to be mounted adjacent to a user's head and to measure an electrical potential near one or more electrodes of the sensor system. The computer device further includes a processor configured to present a periodic motion-based visual stimulus having a changing motion that is frequency-modulated for a target frequency or code-modulated for a target code, detect changes in the electrical potential via the one or more electrodes, identify a corresponding visual evoked potential feature in the detected changes in electrical potential that corresponds to the periodic motion-based visual stimulus, and recognize a user input to the computing device based on identifying the corresponding visual evoked potential feature.

Periodic motion-based visual stimulus

Various embodiments are provided herein for tracking a user's physical environment, to facilitate on-the-fly blending of a virtual environment with detected aspects of the physical environment. Embodiments can be employed to facilitate virtual roaming by compositing virtual representations of detected physical objects into virtual environments. A computing device coupled to a HMD can select portions of a depth map generated based on the user's physical environment, to generate virtual objects that correspond to the selected portions. The computing device can composite the generated virtual objects into an existing virtual environment, such that the user can traverse the virtual environment while remaining aware of their physical environment. Among other things, the computing device can employ various blending techniques for compositing, and further provide image pass-through techniques for selective viewing of the physical environment while remaining fully-immersed in virtual reality.

Blending virtual environments with situated physical reality

A virtual reality system is described herein. The virtual reality system includes a cane controller and a computing system. The cane controller comprises a rod, a sensor, and a brake mechanism, wherein the sensor is configured to generate a signal that is indicative of position, direction of movement, and velocity of the rod, and wherein the brake mechanism is configured to apply a force to the rod. The computing system receives the signal, computes a position, direction of movement, and velocity of a virtual rod in a virtual space, and outputs a control signal to the brake mechanism based upon such computation. The brake mechanism applies the force to the rod in a direction and with a magnitude indicated in the control signal, thereby preventing the user from causing the virtual rod to penetrate a virtual barrier in the virtual space.

Apparatus for use in a virtual reality system

Examples of the present disclosure describe systems and methods for providing real-time motion styling in virtual reality (VR), augmented reality (AR), and/or mixed reality (MR) environments. In aspects, input data corresponding to user interaction with a VR, an AR, or an MR environment may be received. The input data may be featurized to generate a feature set. The feature set may be compared to a set of stored motion data comprising motion capture data representing one or more motion styles for executing an action or activity. Based on the comparison, the feature set may be matched to feature data for one or more motions styles in the stored motion data. The one or more motions styles may then be executed by a virtual avatar or a virtual object in the VR/AR/MR environment.

Real time styling of motion for virtual environments

An imaging system comprises an optical sensor array with a plurality of sensor elements, an objective lens, an active polarization filter, and associated logic. The objective lens is configured to direct light from a field of view onto the plurality of sensor elements. Switchable electronically between first and second operational states, the active polarization filter is positioned to filter the light en route to the optical sensor array. The active polarization filter provides unequal relative attenuance, in the first versus the second operational state, of nonparallel polarization components of the light. The logic is configured to switch the active polarization filter from the first operational state to the second operational state, and to compare a light-intensity response of the plurality of sensor elements in the first operational state to the light-intensity response of the plurality of sensor elements in the second operational state.

Switched polarization imaging to detect display screen

Various embodiments are provided herein for modifying a virtual scene based on eye-tracking. A computing device coupled to a HMD can provide a virtual scene for display on the HMD. The computing device can receive sensor data from a set of eye-tracking sensors coupled to the HMD. Based on the received sensor data, the computing device can determine a set of focal regions of the displayed virtual scene, including a perifoveal region of the displayed virtual scene. A portion of the virtual scene can then be modified based, in part, on a determination that the portion is outside of the determined perifoveal region.

Using eye tracking to hide virtual reality scene changes in plain sight

An extender object for use with a multi-modal sensing surface comprises at least two antenna coils. A first antenna coil in the object is electrically connected to a second antenna coil in the object and the two antenna coils may be spatially separated. At least one of the first and second antenna coils comprises a plurality of radial elements extending in and/or out from the coil.

Extender object for multi-modal sensing

An imaging system comprises one or more optical sensor arrays with separate first and second sensor elements, an objective lens system, a polarization filter system, and associated logic. The objective lens system is configured to direct light received at a given angle onto the first sensor element and onto the second sensor element. The polarization filter system includes a first polarizer portion positioned to filter the light en route to the first sensor element and a second polarizer portion positioned to filter the light en route to the second sensor element, the first and second polarizer portions providing unequal relative attenuance of nonparallel polarization components of the light received at the given angle. The logic is configured to compare intensity of the light directed onto the first sensor element relative to the light directed onto the second sensor element.

Polarization imaging to detect display screen

In various embodiments, computerized methods and systems for dynamically updating a fully-immersive virtual environment based on tracked physical environment data. A computing device coupled to a HMD receives sensor data from a variety of sensors. The computing device can generate a virtual scene based on the received sensor data, whereby the virtual scene includes at least a portion of a virtual path that corresponds to at least a portion of a navigable path determined based on the received sensor data. The computing device can modify the virtual scene include a virtual obstruction that corresponds to a physical object detected based on additional sensor data received from the sensors. The modified virtual scene is presented to the user for display, so that the user can safely traverse the physical environment while staying fully-immersed in the virtual environment.

Reality-guided roaming in virtual reality

Growing community of inventors

Seattle, WA, United States of America

Christian Holz