Microsoft Technology Licensing, LLC

Microsoft Corporation

Subha Bhattacharyay

Bodin Dresevic

Rudolph Balaz

Timothy H Kannapel

Michael Koenig

Jamie N Wakeam

Alexander G Gounares

Robert L Chambers

Manoj Kumar Biswas

Donald D Karlov

Steve Dodge

Andrew L Silverman

F David Jones

Brigette Krantz

Arin J Goldberg

Todd A Torset

Shiraz M Somji

Robert J Jarrett

Charlton E Lui

Oscar E Murillo

Marieke Watson Iwema

Gregory Nicholas Hullender

Gavin M Gear

Jonathan C Cluts

Janet Ellen Galore

Zoltan C Szilagyi

Richard Jennings Duncan

Herry Sutanto

Alexander J Kolmykov-Zotov

Sashi Raghupathy

Jeffrey Alan Herold

Michael F Koenig

Jerome J Turner

Haiyong Wang

Sebastian Poulose

Patrick M Haluptzok

Todd M Landstad

Tara Sanathanan Prakriya

Stephen Alan Fisher

Michael Frederick Hines

Anuraag Tiwari

Jack Creasey

Gerhard A Schobbe

Colleen G Estrada

Emily Rimas

Tobiasz Alexander Zielinski

Ira L Snyder, Jr

Jennifer A Teed

Richard L Spencer, Ii

Benoit Jules Jurion

Kaushik Barat

Roman Snytsar

Fan Zhang

Terri L Chudzik

Jerome Turner

John Adam Szofran

Eugene A Tsimberg

Lidia Schwarz

Amber P Race

Roman Snystar

Erin Devoy

Hans Thomas Landsberger

Gerard Zytnicki

Christopher Shannon Lester

Anursaag Tiwari

Tara Prakriya

Richard J Duncan

The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.

Multimodal input system

The subject disclosure is directed towards saving undo state information for a digital art program. Changed state data is computed (e.g., via GPU-side logic) based upon the state information of the current state of a canvas and the previous state information, e.g., via an XOR operation or parallel XOR operations. The changed state data is compressed into compressed state data, e.g., via run-length encoding, and the compressed state data is stored, e.g., in a circular buffer in GPU memory. For an undo command, the compressed data is decompressed into the changed state data, and the bitwise operation reversed.

Digital art undo and redo

Learning content may be provided to a user where the learning content may contain learning objectives. A response to the learning content may be received. The response may be analyzed by determining whether the response was the proper response to the learning objectives. If the response was a proper response, less questions on the learning objective may be presented in the future and the if response was an improper response, additional questions on the learning objective may be presented in the future.

Learning assessment and programmatic remediation

Overlaying electronic ink over a document. A typical scenario may be where one it would be useful to mark up a document with electronic ink, such as by making handwritten comments, drawings, and the like over the underlying document. In some embodiments, a developer may easily define an inking surface, such as a transparent or opaque window, over a document. The inking surface may act as an input interface such that a user may write onto the inking surface such that is appears that the document itself is being marked up.

Overlaying electronic ink

A method for displaying input from a portable computing device on a second computing device is described. Later inputs on the portable computing device are displayed in a scrolling fashion on the second computing device with later input being displayed below previous input without regard to the location of the input on the portable computing device.

Inputting data on a portable computing device

A method and system is described for displaying input from a portable computing device to a second computing device. On the second computing device, a display region is created. The region may be a stand alone application or a region inside an application. The second computing device then receives a communication that represents the portable input on the portable computing device. The portable input is then scaled to fit the display region and the portable input is displayed on the second computing device.

Method of displaying input from a portable computing device

Notes and other input may be entered directly onto computer based content. The notes may be taken on a portable computing device that contains metadata from the computer based content. The metadata and input are stored and once the portable computing device is in communication with the second computing device displaying the computer based content, the input is displayed near the computer based content that was displayed at the time the input was created.

Associating input with computer based content

A lasso select tool that allows a user to draw a flexible line of selection ink in order to select one or more graphical objects for manipulation. As the user draws this selection line, the lasso select tool continuously redraws and displays a connection line connecting one end of the selection line with the opposite end of the selection line. This connection line thus graphically demonstrates to the user the area that is presently encompassed by the resulting lasso enclosure. Further, the lasso select tool will change the appearance of any object selected with the lasso enclosure. The lasso select tool also selects objects that are only substantially encompassed by the lasso enclosure. For example, the lasso select tool may select ink objects that are only 60% or more encompassed by the lasso enclosure.

Lasso select

A system and method for storing document data in a serialized binary format recognition lattice structure so that the data is accessible to other applications. The lattice structure is generated that includes root node data. Child nodes correspond to columns of the recognition lattice. Each node includes a descriptor that is a collection of flags indicating presence of specific components of the node. The child nodes may include grandchild nodes with similar structure corresponding to elements within the columns. Each node further includes property information associated with the node. The recognition lattice is stored in a serial binary data format.

System and method for binary persistence format for a recognition result lattice

A system and process for enabling updates of an ink analysis document model are described.

On demand data proxy

A technology for controlling multiple map application operations with a single gesture is disclosed. In one method approach, data describing a single gesture that was inked on a map application output displayed on a device is received. The data is utilized to control multiple operations of the map application.

Controlling multiple map application operations with a single gesture

The present invention relates to interfacing with electronic ink. Ink is stored in a data structure that permits later retrieval by applications. The ink includes stroke information and may include property information. Through various programming interfaces, one may interact with the ink through methods and setting or retrieving properties. Other objects and collections may be used as well in conjunction with the ink objects.

Interfacing with ink

Growing community of inventors

Bellevue, WA, United States of America

Subha Bhattacharyay