Microsoft Technology Licensing, LLC

Dongwook Yoon

Sol Sidney Fels

Matin Yarmand

Abigail Jane Sellen

Nicholas Yen-Cherng Chen

The disclosed techniques provide a computing device that displays video content within a comment section of a user interface. When users invoke a video display by selecting a link within a user interface comment section, a system can control a navigational position of a user interface to concurrently display the video and selected comments within the comment section. In one illustrative example, a system can display a user interface having a video display area and a comment section. The user interface may be positioned to show the comment section within a viewing area of a display device, and such a position may place the video display area outside of the viewing area. In such a scenario, when a system receives a user input indicating a selection of a comment displayed within the comment section, the system can generate a rendering of the video content for display within the comment section.

Contextually-aware control of a user interface displaying a video and related user text

A user interface (UI) includes a video display area for presenting video content, a text entry field, and a comment section. The UI also provides UI controls for enabling a user to select a portion of the video content and for generating a typed hyperlink in the text entry field that references the selected portion of the video content. A UI control for creating a new comment in the comment section of the UI that includes the typed hyperlink from the text entry field is also provided. A user can select a typed link in a comment and, in response thereto, the content type for the referenced portion of the video content can be determined based on data in the selected link. A preview of the portion of the video content can then be presented based upon the determined content type.

Authoring comments including typed hyperlinks that reference video content

Previewing video content referenced by typed hyperlinks in comments

The present disclosure provides a computing device that performs an auto-completion process that generates and inserts text of spoken content of a video into a text entry field. By providing quoted content in a text input field, a system can mitigate the need for users to perform the tedious process of listening to spoken content of a video and manually entering the spoken content into a computing device. In some configurations, a system can receive one or more keywords from a user input and identify spoken content containing the keywords. The system can provide text of the spoken content based on a level of relevancy and populate one or more input fields with the text of the spoken content. The generation of auto completion text from spoken content of a video can enhance user interaction with the computer and maximize productivity and engagement with a video-based system.

Auto-completion for content expressed in video data

Gestural annotation is described, for example where sensors such as touch screens and/or cameras monitor document annotation events made by a user of a document reading and/or writing application. In various examples the document annotation events comprise gestures recognized from the sensor data by a gesture recognition component. For example, the gestures may be in-air gestures or touch screen gestures. In examples, a compressed record of the sensor data is computed using at least the recognized gestures, document state and timestamps. In some examples the compressed record of the sensor data is used to facilitate consumption of the annotation events in relation to the document by a second user. In some examples the sensor data comprises touch sensor data representing electronic ink; and in some examples the sensor data comprises audio data capturing speech of a user.

Growing community of inventors

Vancouver, Canada

Dongwook Yoon