Apple Inc.

Peter L Hajas

Chanaka G Karunamuni

Jonathan R Dascola

Kenneth L Kocienda

Marcos Alonso Ruiz

Christopher Patrick Foss

William John Thimbleby

Jennifer P Chen

Imran A Chaudhri

Wayne Carl Westerman

Sebastian J Bauer

Gregory M Apodaca

Stephen Olivier Lemay

Freddy Allen Anzures

Gary Ian Butcher

Lawrence Yuan Yang

Wan Si Wan

William Martin Bachman

Nicole M Wells

Giancarlo Yerkes

Camille Moussette

Jae Woo Chang

Aaron Mackay Burns

Daniel Trent Preston

Jean-Pierre M Mouilleseaux

Hugo D Verweij

Israel Pastrana Vicente

Timothy Robert Oriol

Madeleine S Cordier

Alexis Henri Palangie

Pol Pla I Conesa

Benjamin Hunter Boesel

Joshua B Kopin

Edwin Iskandar

Christopher D Mckenzie

Adam Michael O'Hern

Wesley M Holder

Olivier D R Gutknecht

Michael T Jurewitz

Michael E Buerli

Charles Magahern

Justin T Voss

Jonathan Ravasz

Daniel T Kurtz

Daniel Emil Pu

Sophia Teutschler

James T Turner

Kevin E Ridsdale

Mark A Ebbole

Jeremy G Bridon

Sebastien Metrot

Alex Bijamov

Naveen K Vemuri

Reinhard Klapfer

Raffael Hannemann

Conner J Brooks

John R Hass

Michael A Reiter

Diego Trazzi

Olivier Gutknecht

Jacob Wilson

Jason M Cahill

William A Iii Sorrentino

Alexander CD Fringes

Aspects of the subject technology provide volumetric interface layers for an electronic device. The volumetric interface layers may be discrete distance layers, each having a respective distance from the electronic device, in which user interfaces can be displayed by the electronic device. Applications running on the electronic device may be provided with the ability to request display of a user interface for the application in one of the discrete distance layers. In one or more implementations, the discrete distance layers may be semantically labeled, and may be requested by an application using their semantic labels.

Volumetric user interface layers for electronic devices

A device may include a processor configured to receive, by a system process and from an application process, a visibility preference for an object type and segment one or more physical objects associated with the object type from an image of a physical environment. The processor is also configured to determine, by the system process, whether to display the one or more segmented physical objects based at least in part on the visibility preference. In response to a determination display the one or more segmented physical objects, the processor is configured to display at least a portion of the image corresponding to the one or more segmented physical objects. In response to a determination not to display the one or more segmented physical objects, the processor is configured to forgo displaying that at least a portion of the image corresponding to the one or more segmented physical objects.

Configurable extremity visibility

Aspects of the subject technology provide for constrained access to scene information by applications running on an electronic device. A system process of an electronic device may assign a region of a physical environment to an application. A user interface of the application may be displayed in the assigned region. The system process may provide scene information and/or user information to the application only when the scene information and/or user information occurs and/or originates within the assigned region, in one or more implementations.

Scene information access for electronic device applications

In one implementation, a method of recentering an application is performed by a device including a display, one or more processors, and non-transitory memory. The method includes obtaining a transform between a three-dimensional application coordinate system and a three-dimensional world coordinate system. The method includes determining a location of a virtual object in the three-dimensional application coordinate system. The method includes displaying, on the display, the virtual object at a location in a two-dimensional display coordinate system based on the location of the virtual object in the three-dimensional application coordinate system, the transform, and a first pose of the device. The method includes detecting a recentering trigger. The method includes in response to detecting a recentering trigger, updating the transform to an updated transform based on a second pose of the device. The method includes displaying, on the display, the virtual object at an updated location in the two-dimensional display coordinate system based on the location of the virtual object in the three-dimensional application coordinate system, the updated transform, and a third pose of the device.

Application recentering

Aspects of the subject technology provide for intention-based user interface control for electronic devices. For example, an electronic device may utilize multiple indirect engagement indicators performed by a user of the electronic device, to confirm which of several displayed user interfaces with which the user intends to engage. Once the electronic device determines which of the multiple user interfaces the user intends to engage with, the electronic device may provide a user input to the application or other process underlying that user interface. The user input may be based, in whole or in part, one or more of the multiple indirect engagement indicators.

Intention-based user interface control for electronic devices

Various implementations disclosed herein include devices, systems, and methods for indicating a distance to a selectable portion of a virtual surface. In various implementations, a device includes a display, a non-transitory memory and one or more processors coupled with the display and the non-transitory memory. In some implementations, a method includes displaying a graphical environment that includes a virtual surface, wherein at least a portion of the virtual surface is selectable. In some implementations, the method includes determining a distance between a collider object and the selectable portion of the virtual surface. In some implementations, the method includes displaying a depth indicator in association with the collider object. In some implementations, a visual property of the depth indicator is selected based on the distance between the collider object and the selectable portion of the virtual surface.

User interface for interacting with an affordance in an environment

A device implementing a system for managing multi-modal rendering of application content includes at least one processor configured to receive content, provided by an application running on a device, for displaying in a three-dimensional display mode. The at least one processor is further configured to determine that the content corresponds to two-dimensional content. The at least one processor is further configured to identify a portion of the two-dimensional content for enhancement by a three-dimensional render. The at least one processor is further configured to enhance, in response to the determining, the portion of the two-dimensional content by the three-dimensional renderer. The at least one processor is further configured to provide for display of the enhanced portion of the two-dimensional content on a display of the device in the three-dimensional display mode.

Managing multi-modal rendering of application content

An electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a first user interface of a first software application, detects an input on the touch-sensitive surface while displaying the first user interface, and, in response to detecting the input while displaying the first user interface, performs a first operation in accordance with a determination that the input satisfies intensity input criteria including that the input satisfies a first intensity threshold and the input remains on the touch-sensitive surface for a first predefined time period, and performs a second operation in accordance with a determination that the input satisfies tap criteria including that the input ceases to remain on the touch-sensitive surface during the first predefined time period.

Devices and methods for processing touch inputs based on their intensities

The subject technology provides rendering an image in a first view including a plurality of tiles, each tile comprising image data corresponding to a portion of the image. The subject technology, responsive to detecting an initiation of touch input corresponding to the image, copies the image data from the plurality of tiles to a graphical canvas. The subject technology displays the image data in the graphical canvas in a second view, the graphical canvas being overlaid over at least a portion of the rendered image. The subject technology receives input stroke data corresponding to the second view, the input stroke data being continuous with the touch input. The subject technology responsive to detecting that the touch input has ended, copies the input stroke data to the plurality of tiles of the first view. Further, The subject technology displays the input stroke data and the image in the plurality of tiles of the first view.

Providing a graphical canvas for handwritten input

A device implementing a system for rendering animated user input strokes includes at least one processor configured to retrieve a user-specified mapping of physical characteristics of input strokes to ink parameters, and to receive input stroke data, the input stroke data including metadata corresponding to physical characteristics of the input stroke data. The at least one processor is configured to generate, based on the user-specified mapping, a set of ink parameters from the metadata corresponding to the physical characteristics of the input stroke data, and to render, using at least a portion of the generated set of ink parameters, a stroke based on the input stroke data.

Rendering animated user input strokes

A device implementing a system for rendering animated user input strokes includes at least one processor configured to receive input stroke data. The at least one processor is configured to render, in a first rendering stage within a frame rendering period, a first portion of the input stroke data. The at least one processor is configured to render, in a second rendering stage within the frame rendering period, a second portion of the input stroke data, the second rendering stage being after, and temporally separate from, the first rendering stage.

An electronic device with a touch-sensitive surface, a display, and one or more sensors to detect intensity of contacts: displays a first user interface that includes objects of a first type and objects of a second type; detects a first portion of a first input that includes an increase in characteristic intensity of a first contact above an intensity threshold while a focus selector is over a respective user interface object; in response, displays supplemental information associated with the respective user interface object; while displaying the supplemental information, detects an end of the first input; and, in response: if the respective user interface object is the first type of object, ceases to display the supplemental information; and, if the respective user interface object is the second type of object, maintains display of the supplemental information after detecting the end of the first input.

Devices, methods, and graphical user interfaces for manipulating user interface objects with visual and/or haptic feedback

An electronic device with a display, a touch-sensitive surface, and one or more sensors to detect intensity of contacts with the touch-sensitive surface displays a first user interface of a first software application, detects an input on the touch-sensitive surface while displaying the first user interface, and, in response to detecting the input while displaying the first user interface, performs a first operation in accordance with a determination that the input satisfies intensity input criteria including that the input satisfies a first intensity threshold, and performs a second operation in accordance with a determination that the input satisfies pan criteria including that the input has moved across the touch-sensitive surface by at least a predefined distance.

An electronic device displays, on a display, a user interface. While displaying the user interface, the device detects an input on the touch-sensitive surface; and, in response to detecting the input while displaying the first user interface, and while detecting the input, in accordance with a determination that the input satisfies an activation intensity threshold, performs a first operation. The activation intensity threshold includes a first intensity threshold component that decreases from a first intensity value over time.

Growing community of inventors

Santa Cruz, CA, United States of America

Peter L Hajas