Apple Inc.

Dolby Laboratories Licensing Corporation

Avid Technology Limited

Other

Michael J Rockwell

Ranjit Desai

Seung Wook Kim

Ian M Richter

Olivier Soares

Paul Xiaopeng Wang

Alex Joseph Lehmann

Ray Ling Chang

Madeleine S Cordier

David H Bloom

Venu Madhav Duggineni

Kyle J Nekimken

Michael Y Cheung

Hongcheng Sun

Ian M Bullock

Jeremy C Franklin

Peter Meier

Brett Graham Crockett

Anselm Grundhoefer

Louis Dunn Fielder

ByoungSuk Kim

Yi Huang

Sunil Bharitkar

Felipe Bacim De Araujo E Silva

Ping-Yen Chou

Robert Seon Wai Lee

Jonathan P Ive

Alan C Dye

Stephen Olivier Lemay

Julian Jaede

Fletcher R Rothkopf

Tao Chen

Cheng Kai Chen

Robin Atkins

Scott J Daly

Chaohao Wang

William A Sorrentino, Iii

Samir N Hulyalkar

Jason C Sauers

Arthur Yasheng Zhang

Geoffrey Grant Stahl

Wey-Jiun Lin

Walter Christian Gish

Ivan S Maric

Phil M Hobson

Graham Butler Myhre

Forrest C Wang

Yoonhoo Jo

Muhammad F Hossain

Benjamin Hylak

Yanghai Tsin

Jia Tao

Perry A Caro

Amritpal Singh Saini

Scott G Johnston

Marinus Meursing

Bertrand Nepveu

Kathrin Berkner Cieslicki

Tom Sengelaub

Zoey C Taylor

Yi-Pai Huang

Jonathan Ravasz

Jan K Quijalvo

Jason L Slupeiks

Julian Hoenig

Pretesh A Mascarenhas

Kaushik Raghunath

Peter Kaufmann

Arun Kannan

Thibaut Weise

Michael C Friedman

Manjunath M Venkatesh

Saul H Weiss

Russell L Jones

Branko Petljanski

James W Vandyke

Jad-Nicolas Khoury

Hesam Najafi

Alvin Li Lai

In one implementation, a method of generating an output image is performed by a device including a display, one or more processors, and non-transitory memory. The method includes obtaining a currently rendered image. The method includes obtaining an accumulation image based on previously rendered images. The method includes generating an output image based on the currently rendered image and the accumulation image, wherein the output image includes: (1) a first output pixel at a first pixel location associated with a first resolution greater than or equal to a threshold, the first output pixel having a first output pixel value that is a currently rendered image pixel value of a currently rendered image pixel at the first pixel location; (2) a second output pixel at a second pixel location associated with a second resolution less than the threshold, the second output pixel having a second output pixel value that is a weighted sum of a currently rendered image pixel value of a currently rendered image pixel at the second pixel location and an accumulation image pixel value of an accumulation image pixel at a corresponding pixel location corresponding to the second pixel location; and (3) a third output pixel at a third pixel location associated with a third resolution less than the threshold, the third output pixel having a third output pixel value that is a currently rendered image pixel value of a currently rendered image pixel at the third pixel location. The method includes displaying, on the display, the output image.

Foveated anti-aliasing

A head-mountable device can include exchangeable components that can be selected by a user. Such components can include face and head engaging components to secure the head-mountable device on the face and head of the user. Liners can be provided to isolate the components from external and/or environmental influences until removed by a user upon selection of a given set of components. The liners can provide a contact surface that is similar to a contact surface of the component itself. As such, the user can try the component with an authentic experience prior to selection.

Head-mountable device with protective liner

An exemplary process for identifying a type of a physical environment amongst a plurality of types of physical environments is provided. The process includes obtaining, using the one or more cameras, image data corresponding to a physical environment. The process further includes identifying at least one portion of an entity in the physical environment based on the image data; determining, based on the identified at least one portion of the entity, whether the entity is an entity of a first type; determining a type of the physical environment if the entity is an entity of the first type; and presenting one or more virtual objects and a representation of the entity.

Presenting virtual objects in a physical environment

A computer system displays a first application user interface at a first location in a three-dimensional environment. While displaying the first application user interface at the first location in the three-dimensional environment, the computer system detects, at a first time, a first input corresponding to a request to close the first application user interface. In response to detecting the first input corresponding to a request to close the first application user interface: the computer system closes the first application user interface, including ceasing to display the first application user interface in the three-dimensional environment; and, in accordance with a determination that respective criteria are met, the computer system displays a home menu user interface at a respective home menu position that is determined based on the first location of the first application user interface in the three-dimensional environment.

Devices, methods, and graphical user interfaces for interacting with window controls in three-dimensional environments

A head-mounted device is provided that includes one or more cameras configured to acquire a raw video feed and one or more displays configured to present a passthrough video feed to a user. Generation of the passthrough video feed can involve processing the raw video feed using an image signal processor and auxiliary compute blocks. One or more of the auxiliary compute blocks can be bypassed in response to detecting one or more failures associated with the auxiliary compute blocks. Configured and operated in this way, the head-mounted device can fall back to a more reliable passthrough video feed without having to power cycle the head-mounted device when a failure occurs.

Head-mounted electronic device with reliable passthrough video fallback capability

In one implementation, a method includes presenting, via a display device, a first synthesized reality (SR) view of an event that includes SR content associated with the event. The SR content includes a plurality of related layers of SR content that perform actions associated with the event. The method includes detecting, via one or more input devices, selection of a respective layer among the plurality of related layers of SR content associated with the event. The method includes presenting, via the display device, a second SR view of the event that includes the respective layer of SR content in response to the selection of the respective layer. The second SR view corresponds to a point-of-view of the respective layer.

Method and devices for presenting and manipulating conditionally dependent synthesized reality content threads

An electronic device may include a lenticular display. The lenticular display may have a lenticular lens film formed over an array of pixels. The lenticular lenses may be configured to enable stereoscopic viewing of the display such that a viewer perceives three-dimensional images. The display may have a number of independently controllable viewing zones. A eye and/or head tracking system may use a camera to capture images of a viewer of the display. Control circuitry in the electronic device may use the captured images from the eye and/or head tracking system to determine which viewing zones are occupied by the viewer's eyes. The control circuitry may disable or dim viewing zones that are not occupied by the viewer's eyes in order to conserve power. An unoccupied viewing zone and an adjacent, occupied viewing zone may display the same image to increase sharpness in the display.

Displays with viewer tracking

A head-mountable display device includes a housing defining a front opening and a rear opening, a display screen disposed in the front opening, a display assembly disposed in the rear opening, a first securement strap coupled to the housing, the first securement strap including a first electronic component, a second securement strap coupled to the housing, the second securement strap including a second electronic component, and a securement band extending between and coupled to the first securement strap and the second securement strap.

Head mountable display

Techniques are disclosed relating to display devices. In some embodiments, a display device includes a display system configured to display three-dimensional content to a user. The display device is configured to discover, via a network interface, one or more compute nodes operable to facilitate rendering the three-dimensional content and receive information identifying abilities of the one or more compute nodes to facilitate the rendering. Based on the received information, the display device evaluates a set of tasks to identify one or more of the tasks to offload to the one or more compute nodes for facilitating the rendering and distributes, via the network interface, the identified one or more tasks to the one or more compute nodes for processing by the one or more compute nodes.

Distributed processing in computer generated reality system

In one implementation, a method of accessing shared data among processes is performed by a device including processor(s), non-transitory memory, and an image acquisition interface. The method includes obtaining image data acquired by the image acquisition interface. The method further includes determining pose data based at least in part on inertial measurement unit (IMU) information measured by the image acquisition interface. The method also includes determining a gaze estimation based at least in part on eye tracking information obtained through the image acquisition interface. Based at least in part on characteristics of processes, the method includes determining an arrangement for the image data, the pose data, and the gaze estimation. The method additionally includes determining an access schedule for the processes based at least in part on at least one of: the arrangement, the characteristics of the processes, and hardware timing parameters associated with the device.

Method and device for process data sharing

A method includes sensing a plurality of light superposition characteristic values associated with ambient light from a physical environment. The ambient light emanates from the physical environment towards one side of a translucent display. The plurality of light superposition characteristic values quantifies interactions with the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on a function of the plurality of light superposition characteristic values and predetermined display characteristics of a computer-generated reality (CGR) object. The method includes changing one or more display operating parameters associated with the electronic device in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the CGR object within a performance threshold.

Modifying display operating parameters based on light superposition from a physical environment

In one implementation, a method includes: instantiating a first objective-effectuator (OE) associated with first attributes and a second OE associated with second attributes into a synthesized reality (SR) setting, wherein the first OE is encapsulated within the second OE; providing a first objective to the first OE based on the first and second attributes; providing a second objective to the second OE based on the second attributes, wherein the first and second objectives are associated with a time period between a first and second temporal points; generating a first set of actions for the first OE based on the first objective and a second set of actions for the second OE based on the second objective; and rendering for display the SR setting for the time period including the first set of actions performed by the first OE and the second set of actions performed by the second OE.

A finger-mounted device may include finger-mounted units. The finger-mounted units may each have a body that serves as a support structure for components such as force sensors, accelerometers, and other sensors and for haptic output devices. The body may have sidewall portions coupled by a portion that rests adjacent to a user's fingernail. The body may be formed from deformable material such as metal or may be formed from adjustable structures such as sliding body portions that are coupled to each other using magnetic attraction, springs, or other structures. The body of each finger-mounted unit may have a U-shaped cross-sectional profile that leaves the finger pad of each finger exposed when the body is coupled to a fingertip of a user's finger. Control circuitry may gather finger press input, lateral finger movement input, and finger tap input using the sensors and may provide haptic output using the haptic output device.

Finger-mounted device with sensors and haptics

Growing community of inventors

Palo Alto, CA, United States of America

Michael J Rockwell