Microsoft Technology Licensing, LLC

Mingqing Xu

Jian Wang

Zhouchen Lin

Dongmei Zhang

Lei Huang

Yu Zou

Jian-Lai Zhou

Xiaohui Hou

Yue Li

Xianfang Wang

Jiang Wu

Wenli Zhu

Hongyun Yang

Systems and methods for detecting annotation digital ink strokes and further associating annotation digital ink strokes with word digital ink strokes are presented. Ink strokes are captured on a writing surface and then classified as words or annotations. Annotations are then anchored to corresponding words. When words are relocated or edited on the writing surface, the anchored annotations are also relocated and may even be reshaped according to the changes in the anchored words.

Annotation detection and anchoring on ink notes

A mechanism for recognizing and inputting handwritten mathematical expressions into a computer by providing part of a multi-path framework is described. The part of the multi-path framework includes a subordinate sub-expression analysis component. A method for analyzing a handwritten mathematical expression for a subordinate sub-expression includes identifying sub-expressions based on dominant symbols and determining a character for potential dominant symbols based upon sub-expression information. A determination may be made whether an expression structure candidate is valid and valid expression structure candidates may be stored in a parse tree.

Analyzing subordinate sub-expressions in expression recognition

Annotation engines are described for handling annotations added to a base document. The annotation engines automatically classify the type of annotations, including, but not limited to: a highlight annotation; a blob annotation (comprising an enclosing-type annotation); an underline annotation; a vertical bracket annotation; a call-out annotation; and a free-note annotation. The annotation engines accept input in the form of a hierarchical tree of document elements and generate an output in the form of a hierarchical tree of annotation elements. Among other uses, a reflow engine can use the output of the annotation engines to properly reposition annotations within a layout-modified base document.

Strategies for processing annotations

A mechanism for recognizing and inputting handwritten mathematical expressions into a computer by providing part of a multi-path framework is described. The part of the multi-path framework includes a subscript/superscript analysis and character determination component that is designed to identify subscript and superscript elements. A method for analyzing a handwritten mathematical expression includes receiving a symbols corresponding to handwritten mathematical expression input strokes, identifying subscript and/or superscript structures, and determining a character for each symbol of the set. A graph of vertexes and edges may be created based upon the set of symbols and the graph may be searched to determine optimized candidates.

Analyzing scripts and determining characters in expression recognition

A mechanism for recognizing and inputting handwritten mathematical expressions into a computer by providing a multi-path framework is described. The framework may include symbol grouping and recognition, tabular structure analysis, subordinate sub-expression analysis, subscript/superscript analysis and character determination, and semantic structure analysis components. A method for recognizing a handwritten mathematical expression includes receiving a plurality of input strokes corresponding to a handwritten mathematical expression and providing a candidate list of recognized candidate expressions based upon the input strokes. Input strokes are grouped into symbols, tabular structures are determined, dominant symbol candidates and subordinate symbols are determined, and subscript and superscript structures are determined.

Mathematical expression recognition

A mechanism for recognizing and inputting handwritten mathematical expressions into a computer by providing a part of a multi-path framework is described. The part of the multi-path framework includes a symbol grouping and recognition component that is designed to group input strokes that correspond to a handwritten mathematical expression into a symbol and to recognize the symbol based upon information associated with the grouped input strokes. A method for grouping and recognizing symbols of a handwritten mathematical expression includes receiving a plurality of input strokes corresponding to a handwritten mathematical expression, grouping the plurality of input strokes into symbols, recognizing the symbols based upon information, such as shape and time series information, associated with the grouped input strokes. Intra-group and inter-group information associated with the plurality of input strokes may be utilized to group the input strokes.

Growing community of inventors

Beijing, China

Mingqing Xu