Apple Inc.

Jason Clay Beaver

Andrew Emilio Platzer

Joshua H Shaffer

Bruce D Nilo

Jacob A Xiao

Imran A Chaudhri

David Michael Chan

Chanaka G Karunamuni

Tiffany S Jon

Bradford Allen Moore

Nicholas K Jong

Toby Paterson

Christopher P Willmore

Andrew Platzer

Patrick L Coffman

Christopher Patrick Foss

Conrad Rhodes Carlen

Damien Pascal Sorresso

Alexandre R Moha

Ian J Baird

Olivier Gutknecht

Alastair Kenneth Fettes

Sophia Teutschler

Toby Charles Wood Paterson

Linda Y Fong

Freddy Allen Anzures

Eric Lance Wilson

Elizabeth Caroline Cranfill

David Chance Graham

Kenneth L Kocienda

Gregory B Novick

Dallas Blake De Atley

Christopher S Linn

John Joseph Iarocci

Ivan Krstic

Chendi Zhang

Andrew M Wadycki

Curtis Galloway

Ivan Krstić

Daniel T Kurtz

Antonio Cavedoni

Johannes B Fortmann

Luke T Heisterman

Mathieu Martin

Andrew W Platzer

Elisabeth J Kain

Balaji Sarpeshkar

In accordance with some embodiments, a method is performed at a device with one or more processors, non-transitory memory, and a touch-sensitive display. The method includes displaying, on the touch-sensitive display, a text region that includes a first portion of text and a second portion of text. The method includes detecting, on the touch-sensitive display, an input within the text region. The method includes, in response to detecting the input within the text region, moving the first portion of text relative to the second portion of text to display a non-text region between the first portion of text and the second portion of text that does not include any text and converting at least a portion of the non-text region into a drawing panel provided to receive drawing input via the touch-sensitive display and display a corresponding graphic in response to receiving the drawing input.

Device, method, and graphical user interface for annotating text

A computer system detects an input that is directed, when the input starts, to a location within a view in a user interface, and consequentially: sends to a software element associated with the view a plurality of input events, wherein each input event comprises a data structure including a phase field that describes a state of the input at a respective time, and the phase field of one of the plurality of input events is set to an input phase began value indicating that the input is new; determines whether or not the input should be ignored by the electronic device; and, in accordance with a determination that the input should be ignored by the electronic device, includes in the plurality of input events an input event whose phase field is set to an input phase cancel value indicating that the input has been cancelled.

Devices, methods, and user interfaces for processing input events

An electronic device displays one or more views of a software application with a plurality of gesture recognizers including at least one discrete gesture recognizer, configured to send a single action message in response to a respective gesture; and at least one continuous gesture recognizer, configured to send action messages at successive recognized sub-events of a respective recognized gesture. The device detects one or more events and processes each event using one or more of the gesture recognizers, including: processing the respective event at a respective gesture recognizer in accordance with a respective gesture definition corresponding to the respective gesture recognizer, and conditionally sending one or more respective action messages to the software application in accordance with an outcome of the processing of the respective event. The device executes the software application in accordance with one or more action messages received from one or more of the gesture recognizers.

Gesture recognizers with delegates for controlling and modifying gesture recognition

A device with a multi-touch panel displays a user interface, and detects a touch input on the multi-touch panel at a position corresponding to a respective portion of the user interface. In response, the device transmits, to a software application for the respective portion of the user interface, a touch event data structure that describes the touch input, wherein the touch event data structure includes a tap count field that indicates a tap count, indicating how many taps have been sequentially performed at the position of the touch input.

Devices, methods, and user interfaces for processing touch events

In accordance with some embodiments, a method is performed at a device with one or more processors, non-transitory memory, a display, and an input device. The method includes displaying, on the display, a first column and a second column in an application region. The method includes detecting, via the input device, a first user input that starts at a location at a top of the application region and moves toward an edge of the application region. The method includes, in response to detecting the first user input, changing the number of columns displayed in the application region, wherein changing the number of columns displayed in the application region includes, in accordance with a determination that the first user input was in a first direction, displaying a third column in the application region while maintaining display of the first column and the second column in the application region.

Device, method, and graphical user interface for changing a number of columns of an application region

An electronic device with a touch-sensitive surface displays a user interface of a first software application that is updated at a first display rate. While displaying a first frame of the user interface in accordance with the first display rate, the device detects respective movement of a touch input across the touch-sensitive surface. An application-independent touch processing module of the device selects a respective touch location of the touch input that was detected during the respective movement to identify as a representative touch location for the respective movement based on touch-processing criteria for the first software application, and sends to an application-specific portion of the first software application touch location information for the touch input that identifies the respective touch location as the representative touch location for the respective movement. The first software application updates the user interface in accordance with the touch location information.

Devices and methods for processing touch inputs

A method includes displaying a suggestion region above an on-screen keyboard. The suggestion region includes multiple suggested character strings. The method further includes: detecting a gesture that begins within a predefined key of the on-screen keyboard; and responsive to detecting the gesture: in accordance with a determination that the gesture ends within the predefined key, inserting a first character string into a text field; and in accordance with a determination that the gesture ends outside of the predefined key, inserting a second character string into the text field, wherein the second character string is different from the first character string.

Device, method, and graphical user interface for a predictive keyboard

A device with a multi-touch panel and a computer readable medium storing software for displaying a user interface on the multi-touch panel detects a touch at the multi-touch panel. The device sends to the software a touch data structure for defining a state of the touch at a particular time. The touch data structure includes: a location field indicating a location where the touch was or is being received on the multi-touch panel; a phase field defining a phase of the touch at the particular time, the phase of the touch being selected from a plurality of predefined phase state values; and a view field indicating a view, of a plurality of views corresponding to portions of the displayed user interface, that corresponds to the location where the touch was or is being received on the multi-touch panel.

A software application includes a plurality of views and an application state. The application includes instructions for displaying one or more views, where a respective view includes a respective gesture recognizer having a corresponding delegate, detecting one or more touches on a touch-sensitive surface, and processing a respective touch. The processing includes obtaining a receive touch value based on the application state by executing the delegate; when the receive touch value meets predefined criteria, processing the respective touch at the respective gesture recognizer; and conditionally sending information corresponding to the respective touch to the software application in accordance with an outcome of the processing by the respective gesture recognizer and in accordance with the receive touch value determined by the delegate. The software application is executed in accordance with the outcome of the processing of the respective touch by the respective gesture recognizer.

An electronic device with a touch-sensitive display and one or more sensors to detect signals from a stylus associated with the device displays a user interface in a viewing mode, the user interface including a content region and a first control region. While displaying the user interface in the viewing mode, the device detects an input by a first contact on the touch-sensitive display; and, in response to detecting the input: when the first contact is a stylus contact in the content region, the device displays, in the content region, a mark drawn in accordance with movement of the first contact in the input. If the first contact is a non-stylus contact in the content region, the device performs a navigation operation in the content region in accordance with movement of the first contact without displaying the mark that corresponds to the first contact in the content region.

Devices and method for manipulating user interfaces with stylus and non-stylus contacts

The embodiments herein describe a mode of applications on the portable electronic device that improves single-handed operation of the devices. For example, the embodiments herein describe an ergonomic mode of an application that displays the graphical user interface (GUI) of the application in a bottom area of the display screen of the electronic device to allow the user to more easily interact with objects. The embodiments herein also describe an ergonomic mode of a keyboard displayed on the display screen of the portable electronic device. During the ergonomic mode of the keyboard, the keyboard is shifted towards a vertical edge of the display screen to allow a user to more easily reach keys of the keyboard that were previously unreachable without the user switching to two handed operation of the device or repositioning the electronic device in the user's hand.

User interfaces for improving single-handed operation of devices

An electronic device, with a touch-sensitive surface and display, displays a user interface at a first display rate. While displaying the user interface, the device detects movement of a touch input across the touch-sensitive surface at a first detection rate that is higher than the first display rate. An application-independent touch processing module sends to an application-specific portion of the first software application touch location information for the touch input that identifies: one or more predicted locations of the touch input on the touch-sensitive surface, and one or more predicted intensity values of the touch input at one or more intensity locations of the touch input on the touch-sensitive surface. The first software application processes the touch location information and updated the user interface accordingly.

Systems, methods, and computer readable media to reduce latency in a graphics processing pipeline of an electronic device having a touch-sensitive input device and a display are described herein. In one embodiment, the method includes obtaining a temporal sequence of multi-touch scan data, processing the multi-touch scan data, determining an 'optimal' time to deliver the processed multi-touch scan data to the relevant application(s) running on the device for processing, animating the resultant graphical changes that are determined by the application(s) based on the multi-touch input, and rendering the determined graphical changes to a frame buffer. In some embodiments, determining the 'optimal' time for delivering the processed multi-touch scan data to the relevant application(s) comprises measuring the performance of the relevant application(s) in order to determine how likely it is that the necessary processing of the received multi-touch information may be completed before the conclusion of the next vertical blanking interval.

Latency reduction for detached content

Touch event model

Growing community of inventors

San Jose, CA, United States of America

Jason Clay Beaver