Microsoft Technology Licensing, LLC

Emily Tran

Daniel Yancy Parish

Tyler Robert Adams

L Tucker Hatfield

Erez Kikin-Gil

Tucker Hatfield

Robert L Chambers

Alex Jacob Simmons

Lisa Carolyn Cherian

Ian Mikutel

Benjamin David Smith

Alan Linchuan Liu

Tracy ThuyDuyen Tran

Erik Thomas Oveson

A reading order extrapolation and management system and process for facilitating auditory comprehension of electronic documents. As an example, a user may access contents of an electronic document via an application and request a speech-synthesized recitation of any media in the electronic document. The application may make use of a reading order that has been specifically generated and improved by reference to eye tracking data from users reading the document. A reading order can be assigned to a document and implemented when, for example, a screen reader is engaged for use with the document. Such systems can be of great benefit to users with visually impairments and/or distracted users seeking a meaningful audio presentation of textual content.

Reading order system for improving accessibility of electronic content

Techniques performed by a data processing system for processing voice content received from a user herein include receiving a first audio input from a user comprising spoken content, analyzing the first audio input using one or more natural language processing models to produce a first textual output comprising a textual representation of the first audio input, analyzing the first textual output using one or more machine learning models to determine first context information of the first textual output, and processing the first textual output in the application based on the first context information.

Voice context-aware content manipulation

Techniques performed by a data processing system for processing voice content received from a user herein include receiving a first audio input from the user comprising a mixed-mode dictation, analyzing, using one or more machine learning (ML) models, the first audio input to obtain a first interpretation of the mixed-mode dictation, presenting the first interpretation to the user in an application on the data processing system, receiving a second audio input from the user comprising a corrective command, analyzing the second audio input to obtain a second interpretation of the restatement of the mixed-mode dictation presenting the second interpretation to the user, receiving an indication from the user that the second interpretation is a correct interpretation of the mixed-mode dictation, and modifying the operating parameters of the one or more machine learning models to interpret the subsequent instances of the mixed-mode dictation based on the second interpretation.

Compounding corrective actions and learning in mixed mode dictation

A tool for action tool-integrated inking input is provided. In one example, a user selects an inking tool and further selects an action functionality to apply to the inking tool. The inking tool is highlighted and updated to display the selected functionality. In another example, the user selects an action tool having a particular functionality and further selects inking properties to apply to the action tool. The action tool is highlighted and updated to display the selected inking properties. In another example, a tool is provided, and the user selects an action functionality and inking properties to apply to the tool. The action tool is updated to illustrate the selected functionality and properties. In another example, the user selects an inking tool and an action tool to apply properties associated with the inking tool and the functionality associated with the action tool to an active tool.

Action-enabled inking tools

Systems, methods, and software are disclosed herein that enhance drawing technology in application user interfaces. In an implementation, a guide object is disclosed herein that allows a user to draw against the guide object, position other objects against, and otherwise interact with the guide object as-if it were a stencil. The guide object may be presented as a drawing tool in a user interface to an application that a user may invoke by user input to assist with the creation of content on a canvas. As a line is drawn proximate to the guide object, for example, or as a shape is positioned nearby the guide object, the application obtains guidance information from the guide object that allows the application to render the interaction between line or shape and the guide object as-if it were an actual stencil.

Guide objects for drawing in user interfaces

Systems, methods, and software are disclosed herein for supporting reversible ink in a user interface to an application. In an implementation, an application receives inking input on a canvas in a user interface to the application. The application renders ink on the canvas along a path taken by the inking input and monitors for the inking input to reverse direction along the path. In response to the inking input reversing the direction along the path, the application erases at least a portion of the ink from the canvas.

Reversible digital ink for inking application user interfaces

Systems, methods, and software are disclosed herein for supporting directional stamping. In an implementation, an input stroke is received on a canvas in a user interface to an application. The application identifies at least a directional effect with which to render each of a set of discontinuous objects along a continuous path taken by the input stroke on the canvas. The application then renders the set of discontinuous objects on the canvas along the continuous path with at least the directional effect identified for each discontinuous object.

Growing community of inventors

Redmond, WA, United States of America

Emily Tran