Apple Inc.

Other

Arthur Yasheng Zhang

Clarisse Mazuir

Matthew Emanuel Last

Aleksandr M Movshovich

Moinul H Khan

Ray Ling Chang

Jim Chen Chou

Hao Pan

Fletcher R Rothkopf

Avi Bar-Zeev

Sheng Zhang

Tobias Eble

Tushar Gupta

Geoffrey Grant Stahl

Daniel E Potter

Nicholas C Soldner

Guy Cote

Albert John Golko

Gurjeet S Saund

Hyungryul J Choi

Timothy Robert Oriol

Graham Butler Myhre

Justin A Hensley

Christopher P Child

Thaddeus Stefanov-Wagner

Ling Su

Collin James Palmer

Bivin J Varghese

Sonca Teng

Cheng Kai Chen

Chaohao Wang

Paolo Sacchetto

Malcolm J Northcott

Jae Hwang Lee

David A Kalinowski

Nicolas P Bonnier

Grant H Mulliken

Ryan Joseph Garrone

Paul V Johnson

Yunhui Hou

Budhadipta Dan

Samuel B Schaevitz

Holly Gerhard

Christy Fernandez Cull

Paul Meade

Nathanael D Parkhill

John M Kearney

Cody J White

Randall R Rauwendaal

Ye Cong

Yanli Zhang

Jonathan P Ive

Alan C Dye

Stephen Olivier Lemay

Julian Jaede

Jeremy C Franklin

William A Sorrentino, Iii

Daniel R Kurz

James R Wilson

Jason C Sauers

Sorin Constantin Cismas

Matheen M Siddiqui

Wey-Jiun Lin

Russell Y Webb

Ivan S Maric

Phil M Hobson

Michael J Rockwell

Forrest C Wang

David Glen Havskjold

Yoonhoo Jo

Sreeraman Anantharaman

Bradford J Zercoe

Muhammad F Hossain

Yanghai Tsin

Jia Tao

Marinus Meursing

Jack E Graves

Yohan Rajan

Bertrand Nepveu

Kathrin Berkner Cieslicki

Tom Sengelaub

William W Sprague

Jan K Quijalvo

Siddharth Shankar Hazra

Julian Hoenig

Jason L Slupeiks

Irene Perali

Peter Kaufmann

William J Dobbie

Luke A Pillans

Thibaut Weise

Branko Petljanski

James W Vandyke

Hesam Najafi

Methods and systems for relative inertial measurement may include a user device comprising an inertial measurement device and/or a camera. A second inertial measurement device may be configured to move with a reference frame. One or more processors may receive inertial measurements from the first and second inertial measurement devices and determine movement of the user device relative to the reference frame by comparing the received inertial measurements. Additionally reference objects in a view of a camera may be used to calibrate the determined motion of the user device within the reference frame.

Relative inertial measurement system with visual correction

Methods and apparatus for specular surface mapping in which a camera detects reflections of a light source from a specular surface. The detected light sources may be projected onto a celestial sphere as virtual point sources. True positive observations should be tightly clustered on the celestial sphere; thus, false positives may be identified and removed. Specular surface information may then be determined from clusters of the virtual point sources on the celestial sphere. The clusters of virtual point sources on the celestial sphere may be identified and used to identify a surface as a specular surface. The clusters may also be used to extract other information regarding the specular surface, including but not limited to distance to and extent of the specular surface.

Specular surface mapping

A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.

Head mountable display

A display system includes a head-mounted display unit and a wake control system. The head-mounted display unit provides content to a user and is operable in a low-power state and a high-power state that consumes more power to provide the content to the user than the low-power state. The wake control system determines when to operate in the high-power state. The wake control system may assess a first wake criterion with low power, assess a second wake criterion with higher power than the first wake criterion upon satisfaction of the first wake criterion, and cause the head-mounted display unit to operate in the high-power state upon satisfaction of the second wake criterion.

Display system

An electronic device may have a camera and a display. The display may be configured to display virtual reality content for a user in which no real-world content from the camera is displayed or mixed reality content in which a combination of real-world content from the camera and overlaid virtual reality content is displayed. Control circuitry in the device may adjust the display and camera while transitioning between virtual reality and mixed reality modes. The control circuitry may reconfigure the camera to exhibit a desired frame rate immediately upon transitioning from virtual reality mode to mixed reality mode. Transitions between modes may be accompanied by smooth transitions between frame rates to avoid visible artifacts on the display. The camera frame rate may be synchronized to the display frame rate for at least part of the transition between the virtual reality and mixed reality modes.

Electronic device with coordinated camera and display operation

Fiducial patterns that produce 2D Barker code-like diffraction patterns at a camera sensor are etched or otherwise provided on a cover glass in front of a camera. 2D Barker code kernels, when cross-correlated with the diffraction patterns captured in images by the camera, provide sharp cross-correlation peaks. Misalignment of the cover glass with respect to the camera can be derived by detecting shifts in the location of the detected peaks with respect to calibrated locations. Devices that include multiple cameras behind a cover glass with one or more fiducials on the cover glass in front of each camera are also described. The diffraction patterns caused by the fiducials at the various cameras may be analyzed to detect movement or distortion of the cover glass in multiple degrees of freedom.

Object localization system

In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.

Dynamic foveated pipeline

A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.

Video pipeline

A system may have system controls that are used in controlling the system. The system may have sensors that gather information on speed, orientation, and position. The sensors may also gather information on relative speed, information on risks of a collision, and other status information and operating environment information. Control circuitry may use light-based devices to display, information on speed, relative speed, status information, custom light information or other user-selected information, or other information on status and the operating environment.

Exterior lighting and warning system

A sensing system that includes an optical,sensor and a sensing window. The optical sensor is configured to sense with electromagnetic radiation an environment. The sensing window is coupled to a structure, such that the electromagnetic radiation passes therethrough from the environment to the optical sensor to be sensed thereby. The sensing window includes an inner side that faces toward the optical sensor and an outer side that faces away from the optical sensor. The outer side includes a superhydrophobic surface that is in fluidic communication with the environment.

Sensing system with sensor window having a superhydrophobic surface

A lighting module comprising lighting elements and a controller configured to receive a control signal that identifies a user as present. In response to the control signal associated with user presence, the lighting module is configured to send a command to one or more of the lighting elements to illuminate a first zone where the user is present. The lighting module is configured to receive a control signal that identifies that illumination of a second zone was previously requested by the user at a current location, and in response to the control signal associated with the current location, send a command to one or more of the lighting elements to illuminate the second zone.

System and method for adjustable lighting

Lighting may be provided using light sources such as lighting systems with arrays of light-emitting diodes. A lighting system may be integrated into interior portions of a system. The interior portions may be illuminated using lighting systems to provide ambient light, to provide custom surface textures and other decorative patterns, to provide icons, text, and other information, and to provide other illuminated regions. Illuminated regions may overlap sensors such as capacitive touch sensors, force sensors, and other sensors. The light-emitting diodes in a lighting system may supply light that passes through openings in a cover layer. The layer may be formed from fabric, leather, or other materials. Lens structures may guide light through the openings.

Lighting systems with adjustable interior lighting

In accordance with some embodiments, a method is performed at an image processing device with a processor and non-transitory memory. The method includes triggering light emission, over a first emission duration, having a characterizing intensity as a function of time. The method further includes obtaining respective pixel events, from an event camera, corresponding to reflections of the light emission during the first emission duration, each respective pixel event corresponding to a breach of a respective comparator threshold indicative of a brightness level, each respective pixel event characterized by a respective electrical threshold value and a timestamp at which the respective electrical threshold value was breached. The method also includes generating a static image by determining a plurality of luminance estimation values from the respective pixel events, wherein the plurality of luminance estimation values respectively correspond to an amount of reflected light received by portions of the event camera.

Generating static images with an event camera

Object detection may include transmitting, by a first device, a first pulse into an environment using a wide field configuration of an ultrasonic sensor array, detecting a presence of an object in the environment based on a detected echo based on the first pulse. In response to detecting the presence of the object, a targeted configuration of the ultrasonic sensor array is determined, and a second pulse is transmitted into the environment based on the second pulse, wherein a characteristic of the object is determined based on a detected echo from the second pulse.

Ultrasonic sensor

Growing community of inventors

San Jose, CA, United States of America

Arthur Yasheng Zhang