Apple Inc.

Other

Richard H Tsai

Richard John Topliss

Thomas M Gregory

Brandon Baxter Harris

Andrew Bradley Just

Richard Lawrence Baer

Douglas Stuart Brodie

Anthony J Rossetti

Paul J Gelsinger-Austin

Albert A Ho

Lihua Zhao

Richard P Howarth

Daniel William Jarvis

Alexander Shpunt

David Tupman

Ning Yeung Chan

Jeffrey Nathan Gleason

Damien J Thivent

Richard J Topliss

David C Beard

Systems and methods are provided for navigating a three-dimensional model using deterministic movement of an electronic device. An electronic device can load and provide an initial display of a three dimensional model (e.g., of an environment or of an object). As the user moves the electronic device, motion sensing components can detect the device movement and adjust the displayed portion of the three-dimensional model to reflect the movement of the device. By walking with the device in the user's real environment, a user can virtually navigate a representation of a three-dimensional environment. In some embodiments, a user can record an object or environment using an electronic device, and tag the recorded im and orientation of the programmable device relative to the three-dimensional object at the first time responsive to detection of movement ages or video with movement information describing the movement of the device during the recording. The recorded information can then be processed with the movement information to generate a three-dimensional model of the recorded environment or object.

Generating a three-dimensional model using a portable electronic device recording

Some embodiments provide an apparatus for controlling the motion of a camera component. In some embodiments, the apparatus includes an actuator module. The actuator module includes a plurality of magnets. Each magnet of the plurality of magnets is poled with magnetic domains substantially aligned in the same direction throughout each magnet. The apparatus further includes a coil rigidly disposed around a lens. Each magnet of the plurality of magnets contributes to the forces to adjust focus of the lens based on Lorentz forces generated from the coil.

Voice coil motor optical image stabilization

An augmented reality headset may include a reflective holographic combiner to direct light from a light engine into a user's eye while also transmitting light from the environment. The combiner and engine may be arranged to project light fields with different fields of view and resolution to match the visual acuity of the eye. The combiner may be recorded with a series of point to point holograms; one projection point interacts with multiple holograms to project light onto multiple eye box points. The engine may include a laser diode array, a distribution waveguide, scanning mirrors, and layered waveguides that perform pupil expansion and that emit wide beams of light through foveal projection points and narrower beams of light through peripheral projection points. The light engine may include focusing elements to focus the beams such that, once reflected by the holographic combiner, the light is substantially collimated.

Display device including foveal and peripheral projectors

A mixed reality direct retinal projector system that may include a headset that uses a reflective holographic combiner to direct light from a light engine into an eye box corresponding to a user's eye. The light engine may include light sources coupled to projectors that independently project light to the holographic combiner from different projection points. The light sources may be in a unit separate from the headset that may be carried on a user's hip, or otherwise carried or worn separately from the headset. Each projector may include a collimating and focusing element, an active focusing element, and a two-axis scanning mirror to project light from a respective light source to the holographic combiner. The holographic combiner may be recorded with a series of point to point holograms; each projector interacts with multiple holograms to project light onto multiple locations in the eye box.

Mixed reality system

Voice coil motor optical image stabilization wires

Display device with a holographic combiner

In an embodiment of the invention, an unlocked mobile device is configured to capture images, analyze the images to detect a user's face, and automatically lock the device in response to determining that a user's face does not appear in the images. The camera capturing and face recognition processing may be triggered by the device having detected that it has been motionless for a threshold period of time. In another embodiment, a locked mobile device is configured to capture an initial image using its camera, capture a new image in response to detecting movement of the device, determine that the device moved to a use position, capture a subsequent image in response to determining that the device moved to a use position, analyze the subsequent image to detect a user's face, and unlock the device in response to detecting the user's face. Other embodiments are also described and claimed.

Locking and unlocking a mobile device using facial recognition

In some embodiments, an image sensor structure includes a super-pixel sensor comprising a plurality of micro-pixel sensors. The image sensor structure includes a plurality of micro-lenses affixed to focus light on the plurality of micro-pixel sensors. In some embodiments, each micro-lens of the plurality of micro-lenses directs light to locations on a respective one or more of the plurality of micro-pixel sensors. In some embodiments, the image sensor structure includes one or more color filters affixed at locations for filtering light directed by the micro-lenses to a first set of color image micro-pixel sensors comprising one or more of the plurality of micro-pixel sensors for capturing color image data and one or more polarization filters affixed at locations for filtering light directed by the micro-lenses to a second set of polarization micro-pixel sensors comprising one or more of the plurality of micro-pixel sensors for capturing depth map data.

Depth mapping with polarization and focus pixels

Some embodiments include a camera of a mobile computing device. In some embodiments, the camera includes an autofocus coil for moving a lens module, a plurality of optical image stabilization coils, a driver circuit element, connected to the autofocus coil, for passing an alternating current waveform through the autofocus coil, and one or more measurement circuit elements, connected to respective ones of the plurality of the optical image stabilization coils, for measuring changes induced in currents in the respective ones of the plurality of the optical image stabilization coils by the waveform.

Inductive three-axis lens position measurement using AF and OIS coils

Some embodiments include an electrically conductive capacitor plate mounted to a chassis supporting an actuator using one or more suspension wires. In some embodiments, the first electrically conductive capacitor plate is electrically connected with an electrically conductive coil of the actuator. Some embodiments include the electrically conductive coil. In some embodiments, a capacitance between the first electrically conductive capacitor plate and the electrically conductive coil varies as function of the position of the electrically conductive coil relative to the first electrically conductive capacitor plate.

Capacitive auto focus position detection

Growing community of inventors

Cupertino, CA, United States of America

Richard H Tsai