Microsoft Technology Licensing, LLC

Christian Klein

Gregg Robert Wygonik

Ryan Pendlay

Robert Disano

Peter Hammerquist

Andrew Stuart Glass

Mark D Schwesinger

Jan-Kristian Markiewicz

Ali M Vassigh

Oscar E Murillo

Sergio Paolantonio

Diego D Baca Del Rosario

Sang Ho Yoon

Albert Peter Yih

Tommer Leyvand

Joseph Wheeler

Jason S Flaks

Scott David Schenone

Thomas M Soemo

Aaron Burns

Jinyu Li

Adam G Poulos

Jason Anthony Grieves

Jeffrey Sipko

John Benjamin Hesketh

Michael Robert Thomas

Chaitanya Dev Sareen

Julia Schwarz

Lisa Joy Stifelman

Eric Norman Badger

Xiaoji Chen

Jason Craig Nelson

Adam M Smith

Christian Michael Sadak

Kenneth Liam Kiemele

Rita Yu

Eric Sanderson

Jeffrey Neil Margolis

Alex A Kipman

Tsz Yan Wong

Miron Vranjes

Christopher Doan

Travis Muhlestein

Jeremy Monroe Bowen

Charles Claudius Marais

Eric Jonathan Hull

Richard Fang

Patrick Joseph Derks

Ryan Yonghee Kim

Sudhakar Visweswara Prabhu

Shane Jeremy Landry

Christoffer Peter Hart Hansen

Lauren Edelmeier

Emily Yang

Sophors Khut

Jordan Dale Andersen

Raymond Quan

Jay P Kapur

Mitchell Stephen Dernis

David Bastien

Ken M Sadahiro

Roy Henry Berger, Jr

Robert Mitchell Smith

Richard S Bailey

Roger Sebastian Sylvan

Charlene Mary Jeune

Katherine Blair Huffman

Brendan Reville

Paula Julia Chuchro

Vanessa Larco

Jerome Jean-Louis Vasseur

Kenton Allen Shipley

Ron Mondri

Bryan Kim Mamaril

Lavanya Vasudevan

Dax H Hawkins

Federico Schliemann

Otso Joona Casimir Tuomi

Riccardo Giraldi

Carmen Zlateff

Connor Lawrence Weins

Nishad Mulye

Brian Kramp

Steven P Trombetta

Roger Sebastian Kevin Sylvan

Jeremy Richard Hill

Brendan D Elliott

Ernest L Pennington, Ii

Michael D McCormack

Joanna Mason

Andrew Lawrence Mattingly

Dennis Mooney, Ii

Zach Johnson

Christopher E Swan

Duncan James McKay

Meg Niman

Alain Philippe Maillot

Abhishek Malani

Christopher M Barth

Kevin J Endres

A computing device detects a press of a global shortcut key simultaneously with a first press and release of a modifier key. In response thereto, an operation is initiated in a non-default display region. The operation might be displaying a user interface element in the non-default display region. The computing device can also detect a second press and release of the modifier key simultaneously with the press of the global shortcut key. In response thereto, the operation can be initiated in a second display region, such as a default display region. The second press and release of the modifier key can be detected within a predetermined period of time following the detection of the first press and release of the modifier key. The operation might be simultaneously initiated in multiple display regions, such as sharing a region that encompasses the non-default display region and one or more other display regions.

Extensions to global keyboard shortcuts for computing devices having multiple display regions

Technologies are disclosed herein that enable a foldable computing device having multiple screen regions to perform an inter-region user interface (UI) operation in response to an intra-region UI gesture. For example, a UI gesture that begins and ends within a first region may be used to move a window from the first region to the second region. The disclosed technologies address the technical problems described above by providing succinct, accurate UI gestures that cause foldable computing devices to perform inter-region UI operations. The disclosed technologies further address the technical problems described above by combining different types of UI gestures to increase gesture accuracy and expressiveness of inter-region UI operations.

Predictive gesture optimizations for moving objects across display boundaries

A foldable computing device can be configured to provide a user interface (UI) optimization that enables an application window to be presented in a predictable location when an application is launched, a UI optimization that enables an application window to be moved to an active display area, a UI optimization that enables a modal UI element to be presented in such a way that it does not overlap a seam on the device, a UI optimization that enables an image presented by the device to be adjusted to maintain a view of the focal point of the image across device posture or orientation changes, a UI optimization that enables the device to transition between UI modes optimized for front-facing and world-facing image capture, and/or a UI optimization that enables the device to provide a UI for instructing a user to flip the device when a biometric sensor is in use.

User interface transitions and optimizations for foldable computing devices

Techniques for providing adaptive assistive technology for assisting users with visual impairment can be used on a computing device. These techniques include displaying content to a user, capturing a series of images or video of the user using a camera, analyzing the series of images or video to determine whether the user is exhibiting behavior or characteristics indicative of visual impairment, and rendering a magnification user interface on the display configured to magnify at least a portion of the content of the display based on a determination that the user is exhibiting behavior or characteristics indicative of visual impairment. The magnification user interface may be controlled based on head and/or eye movements of the user of the computing device.

Eye gaze control of magnification user interface

The disclosed technologies address various technical and user experience problems by augmenting the functionality provided by virtual on-screen trackpads without requiring users to switch between modes. In this way, users can access extended functionality without interfering with expected traditional trackpad functionality (e.g. moving a cursor, clicking, and scrolling). In particular, technologies are disclosed for modeless digital pen input to a virtual trackpad, modeless gestures for summoning user interfaces, modeless gestures utilizing position relative to adjacent user interfaces, and modeless cursor control and interaction with virtual touch targets.

Modeless augmentations to a virtual trackpad on a multiple screen computing device

Technologies are disclosed herein for positioning application windows based on existing application layout and anticipated user workflows. When an existing application window and a recently launched application window are determined to be related to a workflow, and the default position of the recently launched application window is determined to overlap with the existing application window, the recently launched application window may be displayed in a non-default display region to avoid occlusion. By avoiding occlusion, the foldable device may provide a user-friendly application layout, reducing the number of times a user will move, resize, or switch between application windows in the workflow. This in turn may improve device performance and efficiency while reducing errors attributable to user input. The user-friendly layout may also enable a user to view more content at the same time, increasing productivity, reducing eye strain, facilitating operations such as cut and paste, etc.

Positioning user interface components based on application layout and user workflows

The disclosed technologies address various technical problems, including improving human-computer interaction, by augmenting the functionality provided by user input devices using a digital glove. For example, a digital glove can be utilized to provide pressure sensitivity for non-pressure sensitive touchscreen devices, attribute input made with a digital pen to a user wearing the digital glove, augment the functionality provided by mice and other types of handheld user input devices, augment the functionality provided gaze tracking systems, improve camera-based motion tracking systems, and to augment the functionality provided by speech recognition systems.

Augmenting the functionality of user input devices using a digital glove

Implementations described herein provide a component system that reconfigures interchangeable computing device components based on a current state of the computing device. The current state of the computing device is determined based on a hardware configuration of the device, a shell configuration describing software and firmware of the device, and/or context information describing a relationship between the device and its surrounding environment. Based on the current state of the computing device, an output is determined that specifies interchangeable components are to be activated and deactivated. The output is useable to reconfigure individual computing device functionalities, control a manner in which applications execute on the computing device, and adapt the computing device to its current state.

Interchangeable device components

A foldable computing device provides user interface ('UI') transitions and optimizations while operating in a productivity mode. When the foldable computing device is operating in productivity mode, it can present a UI below a hardware keyboard placed over a display region and occluding only a top portion of the display region or a software keyboard presented in the display region occluding only the top portion of the display region. If the hardware keyboard or the software keyboard occlude only the bottom of the display region, a UI can be shown above the hardware keyboard or the software keyboard. The foldable computing device can adjust the position of UI windows that are occluded when the hardware or software keyboard is placed on the display region. The foldable computing device can move the UI windows back to their original positions if the hardware or software keyboard no longer occlude the display region.

Transitions and optimizations for a foldable computing device operating in a productivity mode

The disclosed technologies address technical problems, including improving human-computer interaction, by augmenting the functionality provided by non-digital objects using a digital glove. To provide this functionality, a machine learning model is trained using sensor data generated by sensors in a digital glove and data generated by a user input device while the digital glove is utilized to manipulate an object like a user input device. Once trained, the machine learning model can take sensor data generated by a digital glove while manipulating a non-digital object and generate virtual user input device data that can be utilized to control a host computer. A digital glove can also be utilized to perform selection operations using non-digital objects when pressure data generated by one or more of the pressure sensors in the digital glove indicates that pressure was exerted at a finger of the digital glove in excess of a threshold value.

Augmenting the functionality of non-digital objects using a digital glove

Growing community of inventors

Duvall, WA, United States of America

Christian Klein