Magic Leap, Inc.

Microsoft Technology Licensing, LLC

Gregory Michael Link

Brian Keith Smith

Jose Felix Rodriguez

Carlos A Rivera Cintron

Matthew Thomas Hull

Koon Keong Shee

Michaela Porubanova

Ricardo Martinez Perez

Jeffrey Scott Sommers

Nicole Elizabeth Samec

Mark Baerenrodt

Nastasja U Robaina

Jonathan Lindsey Tate

Mohammadamin Eftekhar

Cintron Carlos A Rivera

Techniques for linking a distance used during a reprojection operation with a focal length of a sensing system are disclosed. As a result, modifications to the focal length result in corresponding modifications to the distance. A focal length of the sensing system is adjusted. An image generated by the sensing system is accessed. A particular distance is selected based on the adjusted focal length of the sensing system. The distance is used to reproject the image.

Selecting a reprojection distance based on the focal length of a camera

Techniques for correcting a vertical angular image misalignment in stereoscopic images generated by an extended reality (ER) system are disclosed. A hologram is identified. This hologram is displayed in a scene of the ER system. A spatial frequency of the hologram is determined. A determination is made that the spatial frequency exceeds a spatial frequency threshold. The spatial frequency of the hologram is reduced until the spatial frequency is below the spatial frequency threshold. Such an operation results in a compensation being performed for a vertical angular image misalignment that exists between the stereoscopic images.

Techniques for correcting vertical angular image misalignment in extended reality systems

The invention provides a method of initiating code including (i) storing an application having first, second and third functions, the first function being a main function that calls the second and third functions to run the application, (ii) compiling the application to first and second heterogeneous processors to create first and second central processing unit (CPU) instruction set architecture (ISA) objects respectively, (iii) pruning the first and second CPU ISA objects by removing the third function from the first CPU ISA objects and removing first and second functions from the second CPU ISA objects, (iv) proxy inserting first and second remote procedure calls (RPC's) in the first and second CPU ISA objects respectively, and pointing respectively to the third function in the second CPU ISA objects and the second function in the first CPU ISA objects, and (v) section renaming the second CPU ISA objects to common application library.

Thread weave for cross-instruction set architectureprocedure calls

A system and method for operating a depth sensor. A configuration operation can be performed by storing a first sequence of operation steps which define a first depth sensing mode of operation, and a second sequence of operation steps which define a second depth sensing mode of operation, in the memory. In response to a first request for depth measurements according to the first depth sensing mode of operation, the depth sensor can be operated in the first mode of operation by causing it to execute the first sequence of operation steps. In response to a second request for depth measurements according to the second depth sensing mode of operation, and without performing an additional configuration operation, the depth sensor can be operated in the second mode of operation by causing it to execute the second sequence of operation steps.

Depth sensing techniques for virtual, augmented, and mixed reality systems

Head-mounted display systems with power saving functionality are disclosed. The systems can include a frame configured to be supported on the head of the user. The systems can also include a head-mounted display disposed on the frame, one or more sensors, and processing electronics in communication with the display and the one or more sensors. In some implementations, the processing electronics can be configured to cause the system to reduce power of one or more components in response to at least in part on a determination that the frame is in a certain position (e.g., upside-down or on top of the head of the user). In some implementations, the processing electronics can be configured to cause the system to reduce power of one or more components in response to at least in part on a determination that the frame has been stationary for at least a threshold period of time.

Head-mounted display systems with power saving functionality

Thread weave for cross-instruction set architecture procedure calls

A head mounted display system can process images by assessing relative motion between the head mounted display and one or more features in a user's environment. The assessment of relative motion can include determining whether the head mounted display has moved, is moving and/or is expected to move with respect to one or more features in the environment. Additionally or alternatively, the assessment can include determining whether one or more features in the environment have moved, are moving and/or are expected to move relative to the head mounted display. The image processing can further include determining one or more virtual image content locations in the environment that correspond to a location where renderable virtual image content appears to a user when the location appears in the display and comparing the one or more virtual image content locations in the environment with a viewing zone.

Augmented reality display with frame modulation functionality

Techniques for determining a user's IPD are described. A first stimulus is displayed on a first display, and a second stimulus is displayed on a second display. A stimulus separation distance is a distance that exists between the first and second stimuli. The stimulus separation distance is progressively increased by progressively moving, in opposing directions relative to one another, the first and second stimuli. While that distance is being progressively increased, at least one of the user's eyes is tracked. While the distance is being progressively increased, a change in a rate of eye movement for the user's eye is detected. When the change is detected, a value for the stimulus separation distance is recorded. The recorded value is set as a baseline for the user's IPD.

Determining IPD by adjusting the positions of displayed stimuli

Techniques for facilitating calibration of an IPD for an ER system are disclosed. A current IPD setting for the ER system is determined. An object in a scene is selected. A first distance between the ER system and the object is determined. A hologram is generated, where this hologram includes at least one boundary region that corresponds to at least one boundary region of the object. The hologram is displayed in the scene. The hologram is displayed based on the current IPD setting for the ER system. User input adjusts the current IPD setting such that a new IPD setting is provided to the ER system. The hologram is displayed in the scene based on the new IPD setting. Based on the new IPD setting, the hologram is caused to align with the object, thereby calibrating the IPD setting.

Adjusting IPD settings to match interocular distance in extended reality devices

A depth sensing system includes a sensor having first and second sensor pixels to receive light from a surface. The system also includes a filter to allow transmission of full spectrum light to the first sensor pixel and visible light to the second sensor pixel while preventing transmission of infrared light to the second sensor pixel. The system further includes a processor to analyze the full spectrum light and the visible light to determine a depth of the surface. The filter is disposed between the sensor and the surface.

Depth sensing systems and methods

An augmented reality display system is configured to use fiducial markers to align 3D content with real objects. The augmented reality display system can optionally include a depth sensor configured to detect a location of a real object. The augmented reality display system can also include a light source configured to illuminate at least a portion of the object with invisible light, and a light sensor configured to form an image using reflected portion of the invisible light. Processing circuitry of the display system can identify a location marker based on the difference between the emitted light and the reflected light and determine an orientation of the real object based on the location of the real object and a location of the location marker.

3D object rendering using detected features

A power profile library includes a plurality of power profiles with each power profile having a plurality of maximum clock speeds for respective processors. The maximum clock speeds of each power profile are selected to limit a maximum amount of heat per unit time generated by the processors in combination. A developer computer system selects sections of an eventual application for a consumer device and a target intent for each section. A power profile lookup uses the target intents to determine a power profile for each section.

Growing community of inventors

Half Moon Bay, CA, United States of America

Gregory Michael Link