Apple Inc.

Yuhao Pan

Stephen E Dey

Ahmet Fatih Cihan

Mehmet Mutlu

Mengshu Huang

Adrian Z Harb

Paul Xiaopeng Wang

Alex Joseph Lehmann

Erin M Bosch

Tong Chen

Jeffrey A Griffis

Chang Zhang

Madeleine S Cordier

Luis R Deliz Centeno

Benjamin R Blachnitzky

Tianjia Sun

Nicolai Philip Georg

Jian H Li

Jonathan C Atler

Hongcheng Sun

Kevin Z Lo

Christopher K Ewy

Lilli Ing-Marie Jonsson

Alhad A Palkar

Minhazul Islam

Joon-Sup Han

Paul N DuMontelle

Sang E Lee

William Whitney

Lilli Ing-Marie Johnsson

Hongchen Sun

Paul N Dumontelle

Luis Deliz Centeno

Jian Li

A system may include an electronic device such as a head-mounted device and a handheld controller for controlling the electronic device. The handheld controller may have a housing with an elongated shaft extending between first and second tip portions. The handheld controller may include a touch sensor for gathering touch input, a button, rotating scroll wheel, or other input device for gathering other user input, a force sensor for gathering force input, an inertial measurement unit for gathering motion data, a camera for capturing images of the environment, and/or one or more haptic output devices such as an actuator for providing haptic output. The control circuitry may send control signals to the head-mounted device based on the sensor data and user input (e.g., force input, touch input, motion input, voice input, etc.) gathered with the handheld controller.

Computer systems with handheld controllers

Optical sensors can be used for content generation using an input device without a touch sensitive surface. In some examples, the optical sensors can be used to detect characteristics of the input device including position, orientation, and/or motion of the input device. In some examples, some or all of the characteristics of the input device can be used in processing to generate content, including textual character input and three-dimensional objects. In some examples, the generation of content can use information from one or more additional sensors of the input device and/or from additional devices in combination with the characteristics of the input device based on the optical sensors.

Input device with optical sensors

A wearable electronic device including a housing that is worn by a user and a SMI sensor contained within the housing. The SMI sensor may include an emitter that outputs coherent light toward the skin of a user when the housing is worn by the user. The SMI sensor may also include a detector that detects a portion of the coherent light reflected towards the sensor and generates electrical signals that indicate displacements of the skin based on the portion of coherent light received at the detector. The housing may include a transmitter that is operatively coupled with the SMI sensor and is configured to transmit physiological data to a receiving device based on electrical signals output from the SMI sensor.

Wearable self-mixing interferometry device used to sense physiological conditions

A system may include one or more finger devices that gather input from a user's fingers. A finger device may include one or more self-mixing interferometric proximity sensors that measure a distance to the user's finger. The proximity sensor may measure changes in distance between the proximity sensor and a flexible membrane that rests against a side portion of the user's finger. The self-mixing interferometric proximity sensor may include a laser and a photodiode. In some arrangements, a single laser driver may drive the lasers of multiple self-mixing proximity sensors using time-multiplexing. The self-mixing proximity sensor may operate according to a duty cycle. Interpolation and stitching may be used to determine the total displacement of the user's finger including both the on periods and off periods of the self-mixing proximity sensor.

Finger devices with self-mixing interferometric proximity sensors

A system may include one or more finger devices that gather input from a user's fingers. The system may include control circuitry that sends control signals to an electronic device based on the input gathered with the finger devices. A finger device may include one or more proximity sensors that measure a distance to the user's finger. The proximity sensor may be a self-mixing optical proximity sensor having a laser and photodiode. The proximity sensor may have submicron resolution and may be configured to detect very small movements of the finger as finger pad is moved around by a thumb finger, by a surface, and/or by other finger movements. The proximity sensor may measure changes in distance between the proximity sensor and a flexible membrane that rests against a side portion of the user's finger.

Finger devices with proximity sensors

A finger device may be worn on a user's finger and may serve as a controller for a head-mounted device or other electronic device. The finger device may have a housing having an upper housing portion that extends across a top of the finger and first and second side housing portions that extend down respective first and second sides of the finger. Sensors in the side housing portions may measure movements of the sides of the finger as the finger contacts an external surface. To ensure that the sensors are appropriately positioned relative to the sides of the finger, the housing may include one or more adjustable structures such as an elastomeric band, a drawstring, a ratchet mechanism, a scissor mechanism, and/or other adjustable structures for adjusting the position of the first and second side housing portions and associated sensors relative to the upper housing portion.

Finger devices with adjustable housing structures

Self-mixing interferometry (SMI) sensors can be used for generation of content using an input device without requiring a touch-sensitive surface. In some examples, the SMI sensors can be used to detect characteristics of the input device including position, orientation, and/or motion of the input device and/or force applied by the input device (e.g., force applied by a stylus tip). In some examples, some or all of the characteristics of the input device can be used in processing to generate content, including textual character input and three-dimensional objects. In some examples, the generation of content can use information from one or more additional sensors for the input device and/or from additional devices in combination with the characteristics of the input device based on the SMI sensors for generation of content.

Input device with self-mixing interferometry sensors

An input device includes an enclosure defining a three-dimensional input space and one or more self-mixing interferometry sensors coupled to the enclosure and configured to produce a self-mixing interferometry signal resulting from reflection of backscatter of emitted light by a body part in the three-dimensional input space. In various examples, movement of the body part may be determined using the self-mixing interferometry signal, which may in turn be used to determine an input. In some examples, a body part displacement or a body part speed and an absolute distance to the body part may be determined using the self-mixing interferometry signal and used to determine an input. In a number of examples, multiple self-mixing interferometry sensors may be used and the movement may be determined by analyzing differences between the respective produced self-mixing interferometry signals.

Input devices that use self-mixing interferometry to determine movement within an enclosure

A system may include finger devices. A touch sensor may be mounted in a finger device housing to gather input from an external object as the object moves along an exterior surface of the housing. The touch sensor may include capacitive sensor electrodes. Sensors such as force sensors, ultrasonic sensors, inertial measurement units, optical sensors, and other components may be used in gathering finger input from a user. Finger input from a user may be used to manipulate virtual objects in a mixed reality or virtual reality environment while a haptic output device in a finger device provides associated haptic output. A user may interact with real-world objects while computer-generated content is overlaid over some or all of the objects. Object rotations and other movements may be converted into input for a mixed reality or virtual reality system using force measurements or other sensors measurements made with the finger devices.

Computer systems with finger devices

Growing community of inventors

Sunnyvale, CA, United States of America

Yuhao Pan