Microsoft Technology Licensing, LLC

Yibo Sun

Xiao Tu

Julio Estrada

Olumuyiwa M Durojaiye

Sheng Yi

Francis Zhou

Biyi Fang

David Walker Duhon

Connor Lawrence Weins

Krishnan Menon

Aaron David Cottle

Irina Smolyanskaya

A data processing system implements training a first convolutional neural network (CNN) to classify shapes in digital ink inputs, the first CNN being trained to receive ink stroke information as an input and to output an indication whether the ink stroke information represents a hand drawn geometric shape. The data processing system further implements compressing the first CNN to generate a second CNN capable of being operated on a resource-constrained computing device lacking sufficient computing resources to operate an instance of the first CNN and installing the second CNN on the resource-constrained computing device to process ink stroke information captured by a user interface of the computing device.

Techniques for enabling on-device shape recognition

Systems and methods for aggregating digital ink instances within an electronic document. One system includes a memory configured to store instructions and an electronic processor coupled to the memory. The electronic processor, through execution of the instructions in the memory, is configured to receive detected interactions between a touchscreen and a digital pen representing one or more digital strokes within a canvas and determine whether the one or more digital strokes match a predetermined signifier. The electronic processor is also configured to, in response to determining that the one or more digital strokes match the predetermined signifier, determine a first digital ink instance included in the electronic document based on a position of the one or more digital strokes within the canvas, duplicate the first digital ink instance to create a second digital ink instance, and add the second digital ink instance to a designated portion of the electronic document.

Duplicating and aggregating digital ink instances

A facility enabling a user to operate visual user interface controls with ink commands is described. The facility causes to be displayed a control operable with mouse input, and receives an ink command directed to the displayed control. In response, the facility operates the displayed control in accordance with the received ink command.

Operating visual user interface controls with ink commands

Described herein is a system and method for visually enhancing digital ink of an electronic document. A trigger to visually enhance digital ink of portion(s) of the electronic document is received. In response to the received trigger, the digital ink of portion(s) of the electronic document to determine a semantic structure of the digital ink in response to the received trigger. The digital ink of the portion(s) of the electronic document are visually enhanced in accordance with the determined semantic structure. Visual enhancement can include horizontal line adjustment, aligning line(s), aligning word in a particular line using a baseline, adjusting vertical spacing of lines, paragraphs, and/or lists, adjusting spacing between words and/or list items in a particular line, modifying ink styling (e.g., ink size, ink thickness, ink color), adjusting sizing of characters in a same group, unifying ink color, and/or unifying ink thickness.

Visually enhanced digital ink

A facility for processing ink input is described. In one example facility, the facility receives ink input from an input device. The facility generates and renders ink stroke data structures in response to received ink input in accordance with an ink input processing pipeline. The facility provides to an executing application access to information traversing the ink input processing pipeline at a selected point in the ink input processing pipeline.

Growing community of inventors

Bellevue, WA, United States of America

Yibo Sun