Apple Inc.

Nicholas C Soldner

Tushar Gupta

Arthur Yasheng Zhang

Darshan R Kasar

Grant H Mulliken

Javier Mendez

Muhammad F Hossain

Daniel R Kurz

Jahan C Minoo

Aleksandr M Movshovich

Tong Chen

Stergios I Roumeliotis

Robert Denton Silfvast

Ritu Shah

Miaolei Yan

Izzet B Yildiz

Siddharth Shankar Hazra

Syed Farhan Mohiuddin

Jonathan C Atler

Qing He

Hong Pan

Daniel Javaheri-Zadeh

Anthony Y Fai

Seth E Woiszwillo

Luke A Pillans

Joseph Cheung

Jose A Rios

Aleksandar M Movshovich

A head-mountable device including a display, a housing at least partially surrounding the display, a facial interface attached to the housing, and a cover positioned between the housing and the facial interface, the cover comprising a conductive fabric.

Conductive fabric architecture

Various implementations disclosed herein include devices, systems, and methods that determine to record an event based on an emotional state and a scene understanding of an environment. For example, an example process may include obtaining physiological data or behavioral data during a first period of time utilizing the one or more sensors. The process may further include determining an emotional state during the first period of time based on the physiological data or the behavioral data (e.g., elated, happy, etc.). The process may further include determining a scene understanding of an environment based on identifying one or more objects in the environment utilizing the one or more sensors. The process may further include determining to record an event occurring in the environment (e.g., positively valenced events, objects, or situations) based on the emotional state and the scene understanding and record the event utilizing one or more sensors.

Dynamic recording of an experience based on an emotional state and a scene understanding

In at least one example of the present disclosure, a head-mountable device includes a display, a frame at least partially surrounding the display, a facial interface attached to the frame, a cover disposed around the facial interface, and a touch sensitive surface incorporated into the cover to receive input from a user for the head-mountable device.

Touch sensitive input surface

A head mounted device may include one or more interferometric sensors positioned and oriented in a housing to sense particle movement caused by respiration of a user. Interferometric signals from the one or more interferometric sensors may be used to determine respiration information about the user.

Non-contact respiration sensing

Methods and apparatus for specular surface mapping in which a camera detects reflections of a light source from a specular surface. The detected light sources may be projected onto a celestial sphere as virtual point sources. True positive observations should be tightly clustered on the celestial sphere; thus, false positives may be identified and removed. Specular surface information may then be determined from clusters of the virtual point sources on the celestial sphere. The clusters of virtual point sources on the celestial sphere may be identified and used to identify a surface as a specular surface. The clusters may also be used to extract other information regarding the specular surface, including but not limited to distance to and extent of the specular surface.

Specular surface mapping

Various implementations track an eye using both camera images and light sensor data, e.g., from a photosensitive surface or set of photodetectors. The camera need not capture images at a high capture rate since the light sensor data captured from the light sensor provides information about the eye during the time periods between camera frames. An eye tracking device may thus provide eye tracking with high temporal resolution using less power and resources and prior devices. The eye tracking device includes a lens (e.g., a diffractive optical element (DOE)) that splits received light onto the camera and light sensor. The camera and light sensor may be aligned, e.g., co-centered. Using such a lens to provide light to an aligned camera and light sensor facilitates tracking the eye characteristics by reducing the need for matching the data and/or accounting for multiple environmental light sources.

Eye tracking based on fusing lens-aligned camera and light sensor data

A processing unit of an electronic device may transmit a synchronization pulse to each of a first plurality of motion sensors (e.g., Inertial Measurement Units or IMUs) communicatively coupled to the processing unit, wherein the synchronization pulse transmitted to each motion sensor of the first plurality of motion sensors is assigned an offset time amount by the processing unit. The processing unit then obtains motion information samples from each of the first plurality of motion sensors, e.g., in an order corresponding to the offset time amounts assigned to the respective motion sensors, and then performs a processing operation based upon the obtained motion information samples. In some embodiments, each motion sensor may be assigned an equal offset time amount. In other embodiments, the offset time amount assigned to each motion sensor may be individually determined, e.g., based on one or more conditions, settings, or preferences related to the electronic device.

Latency reduction architecture using multiple motion sensors

An electronic device may have a display with an array of pixels for displaying images. The electronic device may also have a lens through which the images are viewable on the display. The display may have a display panel that is mounted to a printed circuit stack. The printed circuit stack may include multiple printed circuit layers to which components are mounted. The components may include an orientation sensor overlapped by the display panel. A camera may be mounted to a printed circuit stack and may overlap one or more electrical components such as an orientation sensor. The printed circuit stacks may include rigid and flexible printed circuits coupled together using solder and other conductive connections. Air gaps may be created between stacked printed circuit layers.

Electronic devices with stacked circuitry

A head-mounted device includes a device housing, a display device, an optical system, and a headband. The head-mounted device also includes a first headband connector that includes a headband-side connector portion that is connected to the headband at a first end of the headband and a device-side connector portion that is connected to the device housing. The first headband connector is movable between a disconnected position, in which the headband-side connector portion is disconnected from the device-side connector portion, and a connected position, in which the headband-side connector portion is connected to the device-side connector portion. The first headband connector also includes paired magnetic components that are configured to attract the headband-side connector portion and the device-side connector portion to one another to urge the first headband connector to move to the connected position.

Headband for head-mounted device

A head-mountable device can securely support sensors in a manner that maintains their positions and orientations over time and avoids applying excessive strain on the sensors, thereby protecting them from harm. The sensor can be mounted on a flex circuit or circuit board, which is rigidly secured within an inner case, including for example a base and an inner shield. The inner case can be suspended within an outer case, including for example a frame and an outer shield. Shock absorbers on opposing sides of the inner case can flexibly couple the inner case to the outer case. The shock absorbers can dampen the effects of vibrations or other forces applied from the outer case. The inner case can decouple the sensor from strain applied from the shock absorbers.

Sensor assembly for head-mountable device

Object detection may include transmitting, by a first device, a first pulse into an environment using a wide field configuration of an ultrasonic sensor array, detecting a presence of an object in the environment based on a detected echo based on the first pulse. In response to detecting the presence of the object, a targeted configuration of the ultrasonic sensor array is determined, and a second pulse is transmitted into the environment based on the second pulse, wherein a characteristic of the object is determined based on a detected echo from the second pulse.

Ultrasonic sensor

A system that includes an audio source device configured to obtain audio data of at least one audio channel of a piece of program content. The audio source device has an optical transmitter for transmitting the audio data as an optical signal and a radio frequency (RF) transceiver. The system also includes a wireless earphone that has an optical receiver for receiving the audio data as the optical signal, a RF transceiver for transmitting feedback data indicating a reception quality of the received optical signal at the wireless earphone as a wireless RF signal, and a speaker for outputting the audio data contained within the optical signal and/or the data packets as sound.

Growing community of inventors

Mountain View, CA, United States of America

Nicholas C Soldner