Apple Inc.

Cambridge Mechatronics Limited

Thomas M Gregory

Richard John Topliss

Richard H Tsai

Paul J Gelsinger-Austin

Albert A Ho

Alexander Shpunt

James H Foster

Andrew Benjamin David Brown

Robert John Leedham

David Charles William Richards

Richard Topliss

Michael David Simmonds

Scott Thomas Smith

James E Pedder

Paul G Puskarich

Anthony Hooley

Matthew C Waldon

Ning Yeung Chan

Dominic George Webber

Richard J Topliss

Patrick R Gill

Jawad Nawasra

Daniel John Burbridge

Nader W Moussa

Igor Gotlibovych

John Grayley

A light system that may project virtual content onto surfaces of a room. The system may include one or more low-resolution light-emitting diode (LED) projectors for emitting light representing low-resolution virtual content, and a high-resolution LED projector for emitting light representing high-resolution virtual content. The high-resolution projector may be used to project a 2D image of augmented or virtual reality content being viewed by a person in a room using a device such as a headset or glasses onto a surface of the room so that other persons in the room can view a representation of what the person using the device is seeing. The low-resolution projector(s) may project low-resolution images onto other surfaces in the room, for example the walls and ceiling. The system may also be configured to emit diffuse light to illuminate a room when not emitting light representing virtual content.

Augmented reality system

An augmented reality headset may include a reflective holographic combiner to direct light from a light engine into a user's eye while also transmitting light from the environment. The combiner and engine may be arranged to project light fields with different fields of view and resolution to match the visual acuity of the eye. The combiner may be recorded with a series of point to point holograms; one projection point interacts with multiple holograms to project light onto multiple eye box points. The engine may include a laser diode array, a distribution waveguide, scanning mirrors, and layered waveguides that perform pupil expansion and that emit wide beams of light through foveal projection points and narrower beams of light through peripheral projection points. The light engine may include focusing elements to focus the beams such that, once reflected by the holographic combiner, the light is substantially collimated.

Display device including foveal and peripheral projectors

A mixed reality direct retinal projector system that may include a headset that uses a reflective holographic combiner to direct light from a light engine into an eye box corresponding to a user's eye. The light engine may include light sources coupled to projectors that independently project light to the holographic combiner from different projection points. The light sources may be in a unit separate from the headset that may be carried on a user's hip, or otherwise carried or worn separately from the headset. Each projector may include a collimating and focusing element, an active focusing element, and a two-axis scanning mirror to project light from a respective light source to the holographic combiner. The holographic combiner may be recorded with a series of point to point holograms; each projector interacts with multiple holograms to project light onto multiple locations in the eye box.

Mixed reality system

In some embodiments, a depth map acquisition system, includes a housing, a light source for emitting light to illuminate objects in a scene subject to depth mapping, fixedly mounted to the housing, a mirror tilt actuator, fixedly mounted to the housing, for tilting a mirror fixedly mounted to the mirror tilt actuator, a mirror fixedly mounted to the mirror tilt actuator, for reflecting light from the light source to the objects, and a partially transparent photosensitive detector in the direct path of the light from the mirror to the objects.

Mirror tilt actuator

An electronic device may have back-to-back displays. A user-facing display may have microlenses, tunable lens structures, holograms, lasers, and other structures for displaying images in multiple eye boxes while the electronic device is being worn on the head of a user. In some configurations, a switchable diffuser may be incorporated into the user-facing display. In one mode, the switchable diffuser allows microlenses of the pixels of the user-facing display to provide images to eye boxes in which images from the display are viewable. In another mode, the switchable diffuser diffuses light from the pixels so that the user-facing display may be used while the device is being held in the hand of the user.

Electronic device with back-to-back displays

Display device with a holographic combiner

An SMA actuation assembly comprising SMA actuator wires connected in tension between a support structure and a movable element is controlled to drive movement of the movable element with respect to the support structure by supplying drive signals to the SMA actuator wire. Target signals representing desired positions of the movable element are set, varying within a predetermined spatial envelope. Measures of resistance of the SMA actuator wires are derived and the power of the drive signals is controlled under closed loop control on the basis of the target signals and feedback signals obtained from the measures of resistance. Electrical characteristics of the SMA actuator wires are monitored and used to detect when a motion limit of the movement is reached. In response thereto, the spatial envelope is adjusted to restrict the movement to be within the detected motion limit.

Centring control of an SMA actuation assembly

In some embodiments, an image sensor structure includes a super-pixel sensor comprising a plurality of micro-pixel sensors. The image sensor structure includes a plurality of micro-lenses affixed to focus light on the plurality of micro-pixel sensors. In some embodiments, each micro-lens of the plurality of micro-lenses directs light to locations on a respective one or more of the plurality of micro-pixel sensors. In some embodiments, the image sensor structure includes one or more color filters affixed at locations for filtering light directed by the micro-lenses to a first set of color image micro-pixel sensors comprising one or more of the plurality of micro-pixel sensors for capturing color image data and one or more polarization filters affixed at locations for filtering light directed by the micro-lenses to a second set of polarization micro-pixel sensors comprising one or more of the plurality of micro-pixel sensors for capturing depth map data.

Depth mapping with polarization and focus pixels

Some embodiments include a camera of a mobile computing device. In some embodiments, the camera includes an autofocus coil for moving a lens module, a plurality of optical image stabilization coils, a driver circuit element, connected to the autofocus coil, for passing an alternating current waveform through the autofocus coil, and one or more measurement circuit elements, connected to respective ones of the plurality of the optical image stabilization coils, for measuring changes induced in currents in the respective ones of the plurality of the optical image stabilization coils by the waveform.

Inductive three-axis lens position measurement using AF and OIS coils

Embodiments described include a system comprising a position sensing device (PSD) and a light source. The light source is configured to, by passing one or more light beams through the PSD, cause one or more electrical currents to flow through the PSD. The system further comprises a processor, configured to (i) in response to the electrical currents, ascertain an amount of power that is delivered by the light source, and (ii) in response to the amount of power exceeding a threshold amount of power, inhibit the light source from further operation. Other embodiments are also described.

Thin PSD for laser-scanning systems

Some embodiments include a fixed chassis structure and a moveable carriage body carrying one or more lenses. The fixed chassis structure includes a magnetic friction track. The moveable carriage body carries one or more lenses. An electrically-controllable magnet is mounted to the moveable carriage body for generating a magnetic attraction force between the magnet and the magnetic friction track. The moveable carriage body is movably mounted to the chassis to allow movement along an optical axis through the one or more lenses. An inertial actuator is mounted to the moveable carriage body in an alignment such that the axis of motion of the actuator is parallel to the optical axis through the one or more lenses. The moveable carriage body is held in place with respect to the at least one allowed degree of freedom by one or more friction forces resulting from the magnetic attraction force.

Miniature camera zoom actuator with magnet-induced friction

SMA actuator wires in an SMA actuation apparatus are connected in tension between a movable element and a support structure, applying forces to the movable element in opposed directions. Measures of the resistances of the SMA actuator wires are detected. A feedback difference measure is derived being the sum of the measures of resistance of the SMA actuator wires, relatively scaled by factors, in respect of the SMA actuator wires, the magnitude of which represents a component along the predetermined axis of a force applied by the SMA actuator wire and the sign of which represents a direction along the predetermined axis. The ratio has opposite signs for respective ones of said opposed directions. The powers of drive signals supplied to the SMA actuator wires are controlled in response to the feedback difference measure to reduce the difference between the feedback difference measure and a target difference measure.

Control of an SMA actuation apparatus

In some embodiments, a camera actuator module includes a linear actuator motor for moving a lens assembly, a position sensor coupled to the lens assembly, a mechanical end stop mounted in the path of motion of the lens assembly, and a non-transitory storage medium storing program instructions. In some embodiments, the program instructions are computer-executable to implement exciting, using the linear actuator motor, a mechanical resonance in the camera actuator module calculated to cause the lens assembly to move to an overload displacement by powering the linear actuator of the camera actuator module at a resonant frequency of the camera actuator module, measuring, using the position sensor, a current maximal displacement of the lens assembly during the exciting using a position sensor, and estimating a position of the mechanical end stop using at least the current maximal displacement.

Growing community of inventors

Cupertino, CA, United States of America

Thomas M Gregory