Apple Inc.

Sabine Webel

Tobias Eble

Shruti Singhal

Ivan Gavrenkov

Pal Kristian Engstad

Olivier Denis Roger Gutknecht

Symeon Delikaris Manias

Mehrez Souden

Matthew S Connolly

Ante Jukic

Ronald J Guglielmone, Jr

Norman Nuo Wang

Dhruv Aditya Govil

Christian W Gosch

Sheila M Santos

Ritesh Gangadhar Sholapur

A head-mounted device includes one or more displays configured to present a media content to one or more eye boxes. The media content may be presented in a user interface window. The head-mounted device may include an eye tracker that tracks the position of a user's pupils and/or the user's point of gaze. Processors within the head-mounted device may calculate compensation functions based on the user's pupil position to compensate for geometric distortion, color aberration, optical cross-talk, and vignetting, and may calculate foveation based on the user's gaze. A gaze and pupil manager may determine changes in the user's pupil position and/or point of gaze. If the changes meet a threshold, the compensation function and foveation may be updated. If the changes fail to meet the threshold, recalculation of the compensation function and foveation may be paused to save power.

Electronic device with adjustable compensation frequency

An audio renderer can have a machine learning model that jointly processes audio and visual information of an audiovisual recording. The audio renderer can generate output audio channels. Sounds captured in the audiovisual recording and present in the output audio channels are spatially mapped based on the joint processing of the audio and visual information by the machine learning model. Other aspects are described.

Audio renderer based on audiovisual information

A method and device for modifying virtual content according to various simulation characteristics includes obtaining first virtual content; obtaining one or more simulation characteristics; and generating second virtual content by modifying the first virtual content according to the one or more simulation characteristics; and presenting the second virtual content.

Method and device for modifying content according to various simulation characteristics

Various implementations disclosed herein include devices, systems, and methods for presenting content based on environmental data. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes obtaining environmental data associated with a physical environment in which the device is located. In some implementations, the method includes selecting, from a plurality of presentation modes, a first presentation mode for content based on the environmental data. In some implementations, the method includes presenting the content in accordance with the first presentation mode.

Content presentation based on environmental data

In various implementations, a method of presenting video streams at a head-mountable device (HMD) includes generating a first video stream at a first frame rate for a first display portion. In some implementations, the first frame rate indicates a rate at which frames are presented by the first display portion. In various implementations, the method includes generating a second video stream at a second frame rate for a second display portion. In some implementations, the second frame rate indicates a rate at which frames are presented by the second display portion. In some implementations, the second frame rate is within a threshold relative to the first frame rate. In various implementations, the method includes temporally shifting the second video stream relative to the first video stream so that a majority of refresh times of the first display portion are different from refresh times of the second display portion.

Presenting video streams on a head-mountable device

In one implementation, a method of displaying an animation is performed at a device including an optical see-through display, one or more processors, and a non-transitory memory. The method includes receiving a request to display a first animation of an object exhibiting a response characteristic. The method includes determining a metric characterizing an amount of processing power for the device to display the first animation on the optical see-through display. The method includes, in response to a determination that the metric exceeds a threshold associated with the device, selecting a second animation of the object exhibiting the response characteristic. The method includes displaying the second animation.

Growing community of inventors

San Francisco, CA, United States of America

Sabine Webel