Apple Inc.

Skydio, Inc.

Tesla, Inc.

David A Kalinowski

Jae Hwang Lee

Brian S Lau

Cameron A Harder

Fletcher R Rothkopf

Abraham Galton Bachrach

Adam Parker Bry

Daniel Thomas Adams

Hyungryul J Choi

Patrick Allen Lowe

Grant H Mulliken

Benjamin Scott Thompson

Nathanael D Parkhill

Stephen Robert McClure

Samuel Gilkison Smith

Vikrant Bhakta

Eric N Vergo

Claire E Dalke

Michael J Oudenhoven

Avi Bar-Zeev

Arthur Yasheng Zhang

Ray Ling Chang

Byron R Cocilovo

Paul Meade

David A Schmuck

Austin S Young

Stanley K Melax

Brandon R Neale

Martin E Johnson

Li Zhang

Daniel K Boothe

Adnan Esmail

Guolin Peng

Peter Victor Jupin

Eric J Hansotte

Jonathan C Moisant-Thompson

David A Sumberg

William B Stockton

Erik Raymond Hammer

Bradley C Steele

Stephen R Mcclure

Jochen Wilden

Jing Cai

Joseph Daniel Penniman

A head mounted device includes a housing and an elongate member configured to support the housing with respect to the head of a user. A controller is configured to determine a correction based on a change in position of the display enclosure relative to the elongate member.

Head mounted device with position change detection and correction

Embodiments are described for a stabilization system configured, in some embodiments, for stabilizing image capture from an aerial vehicle (e.g., a UAV). According to some embodiments, the stabilization systems employs both active and passive stabilization means. A passive stabilization assembly includes a counter-balanced suspension system that includes an elongated arm that extends into and is coupled to the body of a vehicle. The counter-balanced suspension system passively stabilizes a mounted device such as an image capture device to counter motion of the UAV while in use. In some embodiment the counter-balanced suspension system passively stabilizes a mounted image capture assembly that includes active stabilization means (e.g., a motorized gimbal and/or electronic image stabilization). In some embodiments, the active and passive stabilization means operate together to effectively stabilize a mounted image capture device to counter a wide range of motion characteristics.

Counter-balancing vibrations from a vehicle for stabilizing image capture

An output device that includes a housing, a first speaker driver that is integrated within the housing at a first location and is arranged to project sound into an ambient environment in a first direction, and a second speaker driver that is integrated within the housing at a second location that is different than the first location and is arranged to project sound into the ambient environment, where the first and second speaker drivers are integrated within the housing and share a common back volume within the housing.

Dual-speaker system

A display system includes a head-mounted display unit and a wake control system. The head-mounted display unit provides content to a user and is operable in a low-power state and a high-power state that consumes more power to provide the content to the user than the low-power state. The wake control system determines when to operate in the high-power state. The wake control system may assess a first wake criterion with low power, assess a second wake criterion with higher power than the first wake criterion upon satisfaction of the first wake criterion, and cause the head-mounted display unit to operate in the high-power state upon satisfaction of the second wake criterion.

Display system

A head-mounted device may have a head-mounted support structure with a left side portion, a right side portion, and a transparent front portion forming a lens. The lens may extend across the front of a user's face between the left and right side portions. The lens may have a mirror coating or other optical coating that helps obscure objects on the inner side of the lens when viewed from an exterior region surrounding the head-mounted device. Left and right forward-facing cameras with overlapping fields of view may be used to capture visible-light images through the lens. The cameras may also be used for gaze tracking. Left and right light sources may provide eye illumination that reflects from the lens into left and right eye boxes. Images from the eye boxes may reflect from the lens towards the left and right forward-facing cameras.

Head-mounted devices with forward facing cameras

An electronic device may include an optical combiner with a waveguide. The waveguide may have an output coupler that directs high resolution light towards an eye box within a field of view. Peripheral light sources may provide low resolution peripheral light to the eye box about a periphery of the field of view. The peripheral light sources may be mounted to a frame for the waveguide, to an additional substrate mounted to the frame and overlapping the waveguide, in a low resolution projector that projects the peripheral light towards reflective structures in the additional substrate, or in a display module that produces the high resolution light. The optical combiner may overlay real world light with the high resolution light and the low resolution peripheral light.

Optical systems with low resolution peripheral displays

An electronic device may include a display module that produces light having an image, a lens that directs the light to a waveguide, and a waveguide that directs the light to an eye box. The lens may produce a foveated image in the light by applying a non-uniform magnification to the image in the light. The non-uniform magnification may vary as a function of angle within a field of view of the lens. This may allow the foveated image to have higher resolution within the central region than in the peripheral region. Performing foveation using the lens maximizes the resolution of images at the eye box without increasing the size of the display module. Control circuitry on the device may apply a pre-distortion to the image that is an inverse of distortion introduced by the lens in producing the foveated image.

Optical systems with lens-based static foveation

A head-mounted device may have a head-mounted support structure. The head-mounted support may support optical systems. The optical systems may be display systems that provide images to eye boxes. A user may view images from the display systems when the user's eyes are located in the eye boxes. The head-mounted support structure is bent due to pressure from a user's head while the head-mounted support structure is being worn by the user. Spring hinges or other structures may be used to supply a constant bending force to the head-mounted support structure over a range of head sizes. When the head-mounted support structure is in an unbent configuration, the images will be misaligned with respect to the eye boxes and each other. When the head-mounted support structure is being worn and the head-mounted support structure is being bent, the images will be aligned satisfactorily.

Head-mounted display systems with bendable frames

An electronic device such as a head mounted device may have a head-mounted support structure. A portion of the head-mounted support structure may form a transparent housing member through which real-world objects can be viewed from eye boxes. A display system for the head-mounted device may have a display device that provides image light to a waveguide and may have an output coupler that couples the image light out of the waveguide toward the eye box. Peripheral portions of the transparent housing member or other peripheral device structures may be provided with a peripheral display that emits diffuse light into a user's peripheral vision. The peripheral display may use light guide structures, light sources, reflective structures, and other structures that provide transparency to real-world light.

Transparent display system with peripheral illumination

A head-mounted device includes a device housing, a support structure that is connected to the device housing to support the device housing with respect to a user, a display device that is connected to the device housing to display content, an optical system that is associated with the display device, and sensors that generate sensor output signals. The head-mounted device also includes a tension controller that determines a tensioning command based on the sensor output signals, and a tension adjuster that applies tension to the user according to the tensioning command in order to restrain motion of the device housing with respect to the user.

Head-mounted device with tension adjustment

A system may include electronic devices such as a head-mounted electronic device, a cellular telephone, a wristwatch device, a computer, and other devices. During operation of the system, one or more of the electronic devices may gather information on the positions of the electronic devices. Information may also be gathered on the positions of objects and obstructions. This position information and/or other information such as information on which sensor resources are available in each of the devices may be used to determine which of the sensors of the electronic devices in the room should be shared. Shared sensors may gather information that is communicated wirelessly to other devices for use by those devices.

Systems with networked electronic devices and shared resources

A head-mounted device may have a left display and a right display that provide respective left and right images. Left and right optical combiner systems may be configured to pass real-world light to left and right eye boxes while directing the left and right images respectively to the left and right eye boxes. Misalignment of the left and right images with respect to the left and right eye boxes may be detected using gaze tracking systems, using cameras such as front-facing cameras in conjunction with a database of known real-world object properties, using visual inertial odometry systems formed from cameras and inertial measurement units, or using one or more sensors in a portable head-mounted device case or other item with a receptacle configured to receive a head-mounted device. Compensating adjustments may be made to the images based on the measured misalignment.

Head-mounted display systems with alignment monitoring

A head-mounted device may have a head-mounted support structure with left and right portions that are coupled at a nose bridge portion. The left and right portions may support respective clear transparent members that form left and right lenses. During operation of the head-mounted device, a user with eyes located in left and right eye boxes may view real-world objects through the left and right lenses. A left display system may have a left display device that faces inwardly and a right display device that faces inwardly. Input couplers, waveguides, and output couplers may be used to supply left and right images from the left and right display systems to the left and right eye boxes. The left display device and right display device may be mounted in the nose bridge portion of the head-mounted support structure.

Head-mounted devices with nose bridge displays

A head mounted device includes a housing, lenses connected to the housing, and a lens cover that is connected to the housing and is movable between a connected position and a disconnected position with respect to the housing.

Head mounted device

A head-mounted device may have a head-mounted support structure. Gaze tracking systems may be supported by the support structure so that the gaze of a user may be monitored. Lenses may be supported by the support structure. Display systems may provide computer-generated images to the user while the user is viewing real-world objects through the lenses. The gaze tracking systems may include image-sensor-based systems such as glint-based systems. A glint-based gaze tracking system may include light-emitting devices that emit light beams that create eye glints on the surface of a user's eyes and may include an image sensor that measures the eye glints to gather information on the user's gaze. A low-power gaze tracking system may be included in the head-mounted device. The low-power gaze tracking system may use light detectors to measure the magnitudes of respective light reflections of the light beams.

Head-mounted devices with dual gaze tracking systems

Growing community of inventors

Redwood City, CA, United States of America

David A Kalinowski