Microsoft Technology Licensing, LLC

Silicon Graphics, Incorporated

William Arthur Stewart Buxton

Kenneth Paul Hinckley

Michel Pahud

Andrew David Wilson

Kori M Inkpen

John C Tang

Sasa Junuzovic

Abigail Jane Sellen

Edward Sean Lloyd Rintel

George William Fitzmaurice

Nathalie Henry Riche

Adam Samuel Riddle

Haijun Xia

Payod Panda

Hugo Karl Denis Romat

Christopher Mervin Collins

Eyal Ofek

Gordon P Kurtenbach

Ravin Balakrishnan

Mar Gonzalez Franco

Nicolai Marquardt

Seongkook Heo

Nathalie Maryline Riche

Hrovje Benko

Kunal Gupta

Andriana Boudouraki

Ken Pfeuffer

Lev Tankelevitch

Ozumcan Demir Caliskan

Bo Kang

A computer-implemented method is described which comprises generating a representation of a digital space and a representation of the physical space using an audiovisual feed received from a camera proximate to a display located in the physical space. The representation of the digital space is generated using user information identifying a remote user associated with the display and presence information relating to the remote user and the digital representation comprises an avatar of the remote user. The representation of the digital space is output to the display located in the physical space and the representation of the physical space it output to a computing device associated with the remote user. The method further comprises dynamically updating the representation of the digital space and/or physical space in response to changes in the user information and presence information.

Collaborative system

Aspects of this present disclosure relate to hybrid conference user interface. The hybrid conference interface provides an establishing shot before the meeting begins that places meeting attendees in a specific spatial arrangement, such as in specific seats around a conference table. Upon starting the conference, the hybrid user interface renders an appropriate perspective view of the meeting that is tailored to each attendee's perspective while also being spatially consistent for the entire group of attendees. Allowing attendees to place themselves where they want gives attendees a sense of physical space that helps them stay spatially oriented relative to the other people and resources in the room.

Established perspective user interface and user experience for video meetings

Systems and methods for representing two-dimensional representations as three-dimensional avatars are provided herein. In some examples, one or more input video streams are received. A first subject, within the one or more input video streams, is identified. Based on the one or more input video streams, a first view of the first subject is identified. Based on the one or more input video streams, a second view of the first subject is identified. The first subject is segmented into a plurality of planar object. The plurality of planar objects are transformed with respect to each other. The plurality of planar objects are based on the first and second views of the first subject. The plurality of planar objects are output in an output video stream. The plurality of planar objects provide perspective of the first subject to one or more viewers.

Representing two dimensional representations as three-dimensional avatars

Methods and systems are provided that are directed to automatically adjusting a user interface based on tilt position of a digital drawing board. The digital drawing board has a tiltable screen with a sensor. The tiltable screen may be fixed in a stable tilt position. A sensor is used to determine that the digital drawing board has a first tilt position. The digital drawing board displays a first user interface associated with the first tilt position. The first user interface may be associated with a first use mode, and may also be based on an application running on the digital drawing board. When the sensor senses that the digital drawing board has moved from the first tilt position to a second tilt position, it automatically displays a second user interface associated with a second tilt position. The second user interface may be associated with a second use mode.

Tilt-responsive techniques for digital drawing boards

The description relates to cooperatively controlling devices based upon their location and pose. One example can receive first sensor data associated with a first device and second sensor data associated with a second device. This example can analyze the first sensor data and the second sensor data to determine relative locations and poses of the first device relative to the second device and can supply the locations and poses to enable content to be collectively presented across the devices based upon the relative locations and poses.

Multiple device content management

Methods and systems are provided that are directed to automatically adjusting a user interface based on tilt position of a digital drawing board. The digital drawing board has a tiltable screen with a sensor. The tiltable screen may be fixed in a stable tilt position. A sensor is used to determine that the digital drawing board has a first tilt position. The digital drawing board displays a first user interface associated with the first tilt position. The first user interface may be associated with a first use mode. The first user interface may also be based on an application running on the digital drawing board. When the sensor senses that the digital drawing board has moved from the first tilt position to a second tilt position, it automatically displays a second user interface associated with a second tilt position. The second user interface has different functionality than the first user interface. The second user interface may be associated with a second use mode that is different than the first use mode but may be based on the same application as the first user interface.

Various technologies described herein pertain to utilizing sensed pre-touch interaction to control a mobile computing device. A pre-touch interaction of a user with the mobile computing device is detected. The pre-touch interaction includes a grip of the user on the mobile computing device and/or a hover of one or more fingers of the user with respect to a touchscreen of the mobile computing device. The finger(s) of the user can be within proximity but not touching the touchscreen as part of the hover. Parameter(s) of the pre-touch interaction of the user with the mobile computing device are identified, and a touch of the user on the touchscreen of the mobile computing device is detected. A computing operation is executed responsive to the touch, where the computing operation is based on the touch and the parameter(s) of the pre-touch interaction of the user with the mobile computing device.

Pre-touch sensing for mobile interaction

The unified system for bimanual interactions provides a lightweight and integrated interface that allows the user to efficiently interact with and manipulate content in the user interface. The system is configured to detect a multi-finger interaction on the touchscreen and to differentiate whether the user intends to pan, zoom or frame a portion of the user interface. Generally, the framing interaction is identified by detection of the user's thumb and forefinger on the touchscreen, which cooperate to define a focus area between vectors extending outwards from the user's thumb and forefinger. Upon a determination that the user intends to interact with or manipulate content within the focus area, the unified system for bimanual interactions provides an indication of the objects that are located within the focus area and contextual menus for interacting with the objects.

Unified system for bimanual interactions

Thumb+pen inputs are described herein, to improve the functionality of touch enabled devices for accepting bimanual input in situations where the device is gripped or supported by one of the user's hands, leaving only one hand free. The thumb of an engaging hand is identified and controls are placed within its range of motion to enhance the functionality provided by the free hand. The actions of the thumb can be used to determine how pen actions made using the other hand are interpreted. Alternatively, the pen can indicate an object through pointing, while the thumb indirectly manipulates one or more of its parameters through touch controls. Marking menus, spring-loaded modes, indirect input, and conventional multi-touch interfaces are applied with respect to the bimanual input mode in which one hand is positioned to hold or support the device, and the other hand is free to improve device operability and accessibility.

Thumb and pen interaction on a mobile device

Unified system for bimanual interactions on flexible representations of content

A system that provides a bimanual user interface in which an input device is provided for each of the users hands, a left hand (LH) device and a right hand (RH) device. The input devices are used in conjunction with a large format, upright, human scale display at which the user can stand and upon which the input devices are moved. The positions of the input devices on the display are marked by displayed cursors. The system detects the position of the input devices relative to the display and draws a vector corresponding to unfastened tape between positions of cursors of the corresponding input devices and pointing from the LH device to the RH device. By changing the state of the LH input device the unfastened tape can be fastened or pinned along the vector as the user moves the LH device toward the RH device. By changing the state of the RH device, the tape can be unfastened by moving the LH device away from the RH device. Straight lines are drawn by holding the RH fixed while the LH pins the tape. Curves are drawn by moving the RH device while the LH device pins the tape. The switch between straight and curved lines occurs without an explicit mode switch simply by keeping the RH device fixed or moving it. The radius of the curvature of curved lines corresponds to the separation between the LH and RH devices.

Digital tape drawing system

A system and method that maps temporal control functions into a six degree of freedom pointing device. The six degree of freedom pointing device controls both transport and view modes within a time-based media editing system and allows a user to toggle between modes without losing visual contact with graphical objects appearing on a video screen. During playback operations in the transport (temporal) mode, the system allows a cap on the six degree of freedom pointing device to be divided into multiple uneven regions in one direction along a single degree of freedom. Each of the multiple regions then corresponds to a unique rate of frame increments/decrements.

Growing community of inventors

Toronto, Canada

William Arthur Stewart Buxton