Apple Inc.

Ictv, Inc.

Bruce D Nilo

Michael T Turner

Christopher K Thomas

Jason Clay Beaver

David Michael Chan

David Rahardja

Tyler M Fox

Jacob A Xiao

James R Montgomerie

Kurt A Revis

Stephen R Breen

Emanuele Rudel

Robert D Boehnke

Tom Adriaenssen

Dominik Wagner

Gordie Freedman

W Leo Hoarty

Chendi Zhang

Toby Paterson

Joshua W Soske

At an electronic device, a user input is detected that corresponds to a respective user interface element in a portion of a user interface that is associated with a first standard gesture recognizer and a first supplemental gesture recognizer. The user input is processed in accordance with the first standard gesture recognizer and the first supplemental gesture recognizer. In accordance with a determination that content associated with the respective user interface element cannot be added to a drag operation, the device fails to recognize the user input using the first supplemental gesture recognizer, and processes the user input using the first standard gesture recognizer. On the other hand, in accordance with a determination that the content associated with the respective user interface element can be added to the drag operation, a gesture is recognized using the first supplemental gesture recognizer and the content is added to the drag operation.

Devices, methods, and graphical user interfaces for touch input processing

An electronic device, while displaying a user interface of an application, detects a user input on a portion of the user interface associated with a plurality of gesture recognizers. A first set of standard gesture recognizers are associated with the portion of the user interface by the application; a second set of supplemental gesture recognizers are associated with the portion of the user interface by a system process; and a first failure requirement determines which gesture recognizers must fail before other gesture recognizers can recognize a user input. In one example, the first failure requirement is that a particular standard gesture recognizer (e.g., an intensity-based gesture recognizer) must fail before a particular supplemental gesture recognizer (e.g., a drag start gesture recognizer) can recognize a user input.

In accordance with some embodiments, a method is performed at a device with one or more processors, non-transitory memory, a display, and an input device. The method includes displaying, on the display, a first column and a second column in an application region. The method includes detecting, via the input device, a first user input that starts at a location at a top of the application region and moves toward an edge of the application region. The method includes, in response to detecting the first user input, changing the number of columns displayed in the application region, wherein changing the number of columns displayed in the application region includes, in accordance with a determination that the first user input was in a first direction, displaying a third column in the application region while maintaining display of the first column and the second column in the application region.

Device, method, and graphical user interface for changing a number of columns of an application region

An electronic device, while displaying a user interface for a first application, receives at the first application information that describes a first touch detected at a location on the touch-sensitive surface that corresponds to a respective user interface object. In accordance with a determination that the first touch meets predefined criteria associated with initiating a respective type of interface operation, the device initiates a user interface operation of the respective type involving the respective user interface object. The first application receives instructions to ignore the first touch with respect to user interface operations other than the respective type of interface operation, and ignores the first touch with respect to user interface operations other than the respective type of interface operation. In some embodiments, the respective type of interface operation is a drag operation, for dragging an object in or from a view of the first application.

An electronic device with a touch-sensitive surface displays a user interface of a first software application that is updated at a first display rate. While displaying a first frame of the user interface in accordance with the first display rate, the device detects respective movement of a touch input across the touch-sensitive surface. An application-independent touch processing module of the device selects a respective touch location of the touch input that was detected during the respective movement to identify as a representative touch location for the respective movement based on touch-processing criteria for the first software application, and sends to an application-specific portion of the first software application touch location information for the touch input that identifies the respective touch location as the representative touch location for the respective movement. The first software application updates the user interface in accordance with the touch location information.

Devices and methods for processing touch inputs

The subject technology provides for receiving a request for a representation of an item from a destination application. The subject technology sends the request for the representation of the item to a source application. The subject technology receives a link to a file provider, the file provider fulfilling a data transfer of the representation of the item. Further, the subject technology sends the link to the file provider to the destination application.

Drag and drop for touchscreen devices

The subject technology provides for identifying an item being dragged over an application in which the items are arranged in a table in a first arrangement. The subject technology copies the first arrangement to generate a second arrangement that corresponds to an initial arrangement of the items when the item is identified as being dragged over the first application. The subject technology updates the first arrangement to reflect changed positions of the items in the table resulting from another item being inserted into the table. The subject technology updates the second arrangement to reflect changed positions of items. Further, the subject technology merges the updated second arrangement with the updated first arrangement to reconcile the changed positions resulting from the item being inserted into the table at the location with the changed positions resulting from the another item being inserted into the table.

A device implementing drag and drop for touchscreen devices may include a processor configured to detect a drag gesture selecting an item in a first application. The processor may be further configured to detect a touch release at an end of the drag gesture for dropping the item in a second application, and send, in response to the detected touch release, a message to the second application, the message including information for a plurality of representations of the item. The processor may be further configured to receive, from the second application, a request for a representation of the item from among the plurality of representations. The processor may be further configured to send, to the first application, the request for the representation of the item. The processor may be further configured to initiate a data transfer of the representation of the item from the first application to the second application.

An electronic device, with a touch-sensitive surface and display, displays a user interface at a first display rate. While displaying the user interface, the device detects movement of a touch input across the touch-sensitive surface at a first detection rate that is higher than the first display rate. An application-independent touch processing module sends to an application-specific portion of the first software application touch location information for the touch input that identifies: one or more predicted locations of the touch input on the touch-sensitive surface, and one or more predicted intensity values of the touch input at one or more intensity locations of the touch input on the touch-sensitive surface. The first software application processes the touch location information and updated the user interface accordingly.

Systems, methods, and computer readable media to reduce latency in a graphics processing pipeline of an electronic device having a touch-sensitive input device and a display are described herein. In one embodiment, the method includes obtaining a temporal sequence of multi-touch scan data, processing the multi-touch scan data, determining an 'optimal' time to deliver the processed multi-touch scan data to the relevant application(s) running on the device for processing, animating the resultant graphical changes that are determined by the application(s) based on the multi-touch input, and rendering the determined graphical changes to a frame buffer. In some embodiments, determining the 'optimal' time for delivering the processed multi-touch scan data to the relevant application(s) comprises measuring the performance of the relevant application(s) in order to determine how likely it is that the necessary processing of the received multi-touch information may be completed before the conclusion of the next vertical blanking interval.

Latency reduction for detached content

The subject technology provides for detecting a drag gesture selecting an item in a first application. The subject technology detects a touch release at an end of the drag gesture for dropping the item in a second application. The subject technology sends in response to the detected touch release, a message to the second application, the message including information for a plurality of representations of the item. The subject technology receives, from the second application, a request for a representation of the item from among the plurality of representations. The subject technology sends, to the first application, the request for the representation of the item. Further, the subject technology initiates a data transfer of the representation of the item from the first application to the second application.

An electronic device, with a touch-sensitive surface and display, displays a user interface at a first display rate. While displaying the user interface in accordance with the first display rate, the device detects movement of a touch input, including detecting the touch input at a first set of sequential locations on the touch-sensitive surface, including a plurality of locations on the touch-sensitive surface, and predicts for the touch input a first set of one or more predicted locations on the touch-sensitive surface based on multiple locations in the first set of sequential locations. The device updates the user interface in accordance with the first set of one or more predicted locations of the touch input on the touch-sensitive surface.

An electronic device, with a touch-sensitive surface and display, displays a user interface at a first display rate. While displaying the user interface, the device detects, at a first detection rate that is greater than the first display rate, movement of a touch input at a sequence of locations on the touch-sensitive surface; and, at each of a sequence of update times, updates the user interface from a respective current state to a respective next state in accordance with a selected subset of the sequence of locations of the touch input. Each selected subset of the sequence of locations includes a plurality of locations of the touch input.

Systems and methods for synchronization including the use of a global equivalency identification datum or set of datum. A universally unique identification datum may be associated with each independently created associated data set. In some embodiments, a synchronization server software element may be responsible for maintaining synchronization for a plurality of clients, including software elements or devices. A record believed to be new by the software elements may verify that the record is actually new. In some embodiments, verification of the record's newness involves assuming that the local ID is a global identification datum and comparing that datum to the all the sets of datum that the Sync-Server knows about. The synchronization server software element may use a table to hold information for all of the records known to that element. In some embodiments these records may have been deleted in the past.

Growing community of inventors

Cupertino, CA, United States of America

Bruce D Nilo