Apple Inc.

Chendi Zhang

Arthur L Spence

Richard R Dellinger

David Hayward

Jeremy Sandmel

David Michael Chan

Peter C Tsoi

Alexandre Naaman

Giridhar Sreenivasa Murthy

Giovanni M Agnoli

Joshua H Shaffer

Gregory R Chapman

Matthew Elliot Shepherd

Jacob Z Weiss

Bartosz Ciechanowski

Daniel O Schimpf

Brent W Schorsch

Yiqiang Nie

Benjamin E Nielsen

Philip James Holland

Elena Leyfman

Vikrant Kasarabada

Gennadiy Shekhtman

Cameron W Zwarich

Scott James Forstall

Ralph T Brunner

Brad W Simeral

Jean-Pierre Ciudad

Jason Clay Beaver

Russell Alexader Blaine

Simon M Douglas

Bruce D Nilo

Joseph A Hagedorn

Michael Stochosky

Ross Thompson

Andrey Pokrovskiy

Wanqing Xin

Yuhui Li

Kurt Knight

A device implementing a system for power management includes at least one processor configured to, detect first gesture state associated with motion of a device, the first gesture state being associated with meeting a first threshold of device motion, and set, in response to detecting the first gesture state, the device to a first power state. The at least one processor is further configured to detect, subsequent to detecting the first gesture state, a second gesture state associated with motion of the device, the second gesture state being associated with meeting a second threshold of device motion, and set, in response to detecting the second gesture state, the device to a second power state. The at least one processor is further configured to update, based on setting the device to the second power state, image data on a display of the device.

Power management based on gesture states

Aspects of the subject technology relate to providing frame rate arbitration for electronic devices. Frame rate arbitration can include determining a global frame rate based on frame rate parameters from one or more animation sources, and providing the global frame rate to the animation sources. The frame rate parameters for various animations sources can have differing preferred, minimum, and/or maximum frame rates, and the global frame rate may be determined for concurrent display of multiple animations from the multiple animation sources. In one or more implementations, frame rate arbitration can also be performed based on frame rate parameters from an input source.

Rendering for electronic devices

In some implementations, a first device can record a display screen of a second device remotely. For example, the first device (e.g., a remote computing device) can receive information identifying other computing devices on a network. The first device can receive a selection of one of the other computing devices (e.g., the second device) and send a message to the second device to initiate a recording of the display screen of the second device. In response to receiving the message, the second device can record video frames of images presented on the display of the second device. The second device can send the video frames to the first device for display and/or storage. While recording the images presented on the display screen, the second device can present indicia on the display screen of the second device indicating that a screen recording is in progress.

Screen recording from a remote device

A device implementing a system for displaying an image includes a processor configured to, generate, during a first power state of a device, a data structure specifying image frames and a respective display time for each of the image frames, and retrieve, during a second power state of the device and from the data structure, an image frame based on the respective display time for the image frame. The at least one processor is further configured to display, during a third power state of the device, the retrieved image frame on a display of the device.

Power management for image display

Disclosed herein is a technique for implementing a secure lock screen on a computing device. The secure lock screen is configured to permit particular applications to display their content&#x2014;such as main user interfaces (UIs)&#x2014;while maintaining a desired overall level of security on the computing device. Graphics contexts, which represent drawing destinations associated with the applications, are tagged with entitlement information that indicates whether or not each graphics context should be displayed on the computing device when the computing device is in a locked-mode. Specifically, an application manager tags each application that is initialized, where the tagging is based on a level of entitlement possessed by the application. In turn, a rendering server that manages the graphics contexts can identify the tagged entitlement information and display or suppress the content of the applications in accordance with their entitlements.

Methods and system for implementing a secure lock screen

One embodiment provides for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; a window manager to submit a request to display the one or more frames of data; a display engine to present the one or more frames of data to the display device for display; and display logic to receive the request to display the one or more frames of data and generate one or more display events for the display engine based on the request to display the one or more frames of data, wherein the display logic is to manage a set of statistics associated with the request.

Controlling display performance using display statistics and feedback

This disclosure pertains to systems, methods, and computer readable medium for mapping particular user interactions, e.g., gestures, to the input parameters of various image processing routines, e.g., image filters, in a way that provides a seamless, dynamic, and intuitive experience for both the user and the software developer. Such techniques may handle the processing of both 'relative' gestures, i.e., those gestures having values dependent on how much an input to the device has changed relative to a previous value of the input, and 'absolute' gestures, i.e., those gestures having values dependent only on the instant value of the input to the device. Additionally, inputs to the device beyond user-input gestures may be utilized as input parameters to one or more image processing routines. For example, the device's orientation, acceleration, and/or position in three-dimensional space may be used as inputs to particular image processing routines.

Gesture mapping for image filter input parameters

Systems, methods, and computer readable media for selectively placing an application into a reduced-priority rendering mode during system user interface (UI) operations are described. Techniques disclosed herein transition an executing (foreground) application from a synchronous render mode (having a first render priority) to an asynchronous render mode (having a second, lower, render priority) when the system moves from supporting execution of the application into displaying a system UI. In this new state, the application's UI display element (e.g., an icon or reduced size viewing window) may continue to be updated (e.g., in accordance with the lower render priority) but does not interfere with the system UI's responsiveness.

Selective rendering mode

Embodiments provide for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; a display engine to present the one or more frames of data to the display device for display; display logic to receive a request to display the one or more frames of data and generate one or more display events for the display engine based on the request, wherein the request includes a first hint to indicate a complexity of the one or more frames of data and the one or more display events includes a second hint derived from the first hint; and a performance controller to adjust one or more performance related parameters for the display system based on the second hint.

Controlling display performance using display system hints

Systems, methods, and computer readable media to reduce latency in a graphics processing pipeline of an electronic device having a touch-sensitive input device and a display are described herein. In one embodiment, the method includes obtaining a temporal sequence of multi-touch scan data, processing the multi-touch scan data, determining an 'optimal' time to deliver the processed multi-touch scan data to the relevant application(s) running on the device for processing, animating the resultant graphical changes that are determined by the application(s) based on the multi-touch input, and rendering the determined graphical changes to a frame buffer. In some embodiments, determining the 'optimal' time for delivering the processed multi-touch scan data to the relevant application(s) comprises measuring the performance of the relevant application(s) in order to determine how likely it is that the necessary processing of the received multi-touch information may be completed before the conclusion of the next vertical blanking interval.

Latency reduction for detached content

Embodiments described herein provide for a display system to generate and display data on a display device, the display system comprising one or more graphics processors to generate one or more frames of data for display on the display device; display logic to receive a request to display the one or more frames of data, the request including a requested presentation time in which the one or more frames of data are to be displayed; and a display engine to present the one or more frames of data to the display device for display at a target presentation time, the target presentation time derived from the requested presentation time, wherein the display engine is to adjust a refresh rate of the display device based on the target presentation time of the one or more frames of data.

Controlling display performance with target presentation times

Embodiments provide for a method of generating and displaying data on a display device, the method comprising receiving an input to interact with an image presented via the display; generating a sequence of frames having an animation frame rate independent of a current refresh rate of the display device; presenting configuration data to the display engine at a display time based on the requested presentation time; and dynamically refreshing the display device based on the display time to display the sequence of frames.

Controlling display performance using animation based refresh rates

Growing community of inventors

Mountain View, CA, United States of America

Chendi Zhang