Microsoft Technology Licensing, LLC

Shoham Dekel

Assaf Bar-Ness

Uri Ron

Gilad Pundak

Vadim Mishalov

Arie Yehuda Gur

Orr Srour

Eran Chencinski

Daniel Spivak

Eran Arbel

Idan Palmor

Shmuel Kaufman-fridman

A method to provide classified touch data to a computer program executing on a device comprises: (a) assembling a map of touch signal from a touch sensor arranged on an electronic display and including a plurality of crossings of row and column electrodes, the map including a corresponding touch-signal value for each of the plurality of crossings, and defining at least one touched region of the touch sensor; (b) serving context data relating to user-interface content currently presented on the electronic display; (c) computing classified touch data corresponding to the map of touch signal, based at least partly on the map and the context data; and (d) providing the classified touch data to an operating system of the device.

Touch classifier system using context data

Display zoom setting adjustment systems are disclosed herein. In an example system, content is displayed on a display device according to a first zoom profile. The first zoom profile identifies different zoom values for different lean angles, where the lean angles are based on a position of a user of a computing device in a direction parallel to the display device. Zoom behaviors of the user are observed over a period of time, where the zoom behaviors are based on detecting a set of user movements. The first zoom profile is calibrated based on the observed zoom behaviors to generate a second profile. Using the second zoom profile, content is displayed on the display device and zoomed according to the parameters of the zoom profile. In this manner, zooming behaviors specific to a user based on their physical movements can be tailored, resulting in an improved user interface experience.

Automated display zoom based on movement of user

Examples are disclosed that relate to applying haptic output to a touch-sensitive input device. One example provides a touch-sensitive input device comprising a body, a haptic feedback mechanism within the body, a sensor subsystem, a logic processor, and a memory. The memory stores instructions executable by the processor to receive from the sensor subsystem sensor data indicating locations along the body of a plurality of contact points between a user hand and the body, based at least in part on the sensor data, determine a touch profile of the user hand applied to the body, based at least in part on the touch profile of the user hand, determine a selected haptic output to be applied to the body, and cause a drive signal to be transmitted to the haptic feedback mechanism to apply the selected haptic output to the body.

Touch-sensitive input device with haptic feedback mechanism

A wearable device is provided, including an accelerometer, a gyroscope, and a processing device. The processing device is configured to receive acceleration data from the accelerometer, receive orientation data from the gyroscope, and receive simulated magnetometer data from an offboard computing device. Based at least in part on the acceleration data, the orientation data, and the simulated magnetometer data, the processing device is further configured to perform motion tracking calibration to obtain an estimated position and orientation of the wearable device relative to the offboard computing device. The processing device is further configured to output the estimated position and orientation to an additional computing process.

Motion tracking calibration for wearable device

A head-wearable audio device has a motion sensor that outputs motion parameter values based on a detected motion gesture. A gesture type is recognized by comparing the motion parameter values and per-user per-gesture-type recognition parameter values. An action is selected based on the selected gesture type and is executed by the head-wearable audio device or an application in a remote computing device. The head-wearable audio device may also include a capacitive touch sensor that detects capacitive touch events and outputs capacitive touch parameter values. A gesture type may be recognized by comparing both of detected motion parameter values and detected capacitive touch parameter values with per-user per-gesture-type recognition parameter values. The per-user per-gesture-type recognition parameter values are improved over time using machine learning and/or automated logic based on historical detected motion or capacitive touch parameters and corresponding selected gestures, or user profile data.

Gesture recognition, adaptation, and management in a head-wearable audio device

One example provides a computing device comprising a display, a touch sensor operatively coupled to the display, a non-touch sensor configured to provide an output indicative of user engagement between the computing device and a user of the computing device, a logic machine, and a storage machine. The storage machine comprises instructions executable by the logic machine to determine a touch usage probability based at least upon the output from the non-touch sensor. The instructions are further executable to change the operation of the touch sensor between an idle mode and a scanning mode based at least on the touch usage probability meeting a probability threshold condition.

Controlling touch operation modes for touch sensors utilizing determined touch usage probability

Examples relate to managing power consumption of a stylus haptic feedback component prior to actuation. In one example, power is transmitted to a haptic circuit and a first haptic predicter value corresponding to a first user interaction with the stylus is determined. A weighted first haptic predicter value is generated by weighting the first haptic predicter value. A second haptic predicter value corresponding to a second user interaction is determined, and a weighted second haptic predicter value is generated by weighting the second haptic predicter value. At least the weighted first and second haptic predicter values are combined to generate a combined weighted predictive result, which is compared to a haptic predictive threshold value. On condition that such comparison yields a haptic predictive result, power continues transmitting to the haptic circuit. On condition that such comparison yields a non-haptic-predictive result, power ceases transmitting to the haptic circuit.

Stylus haptic component arming and power consumption

Systems, methods, and instrumentalities are described herein related to a secured stylus. A secure connection is established between a digitizer processor in a computing device and a remote server providing virtual desktop infrastructure (VDI). A digitizer interposer implemented in the computing device, the server, and/or between them receives raw or encrypted digitizer input that bypasses the operating system (OS) and processor of the computing device. Digitizer signal processing, normally performed by the OS, is performed on one or more servers. An edge server provides haptic feedback to a stylus and/or generates display of temporary digital ink as created while a cloud server completes digital ink processing and generates video for display by the computing device. A secure connection between a graphics processing unit (GPU) and the server protects secure connection video by encryption bypassing the OS and processor of the user computing device.

Interposer for secure inking by stylus

A computing device detects an indication of a data-linkable context for the electronic stylus and transitions communication between the digitizer of the computing device and the electronic stylus from a user interface mode to a data link mode, based at least in part on the detecting. The computing device communicates between the electronic stylus and the digitizer in the data link mode via the multiple electrostatic antennas of the electronic stylus, based at least in part on the transitioning.

Contextual data link mode stylus communications

A method of adaptively controlling display color of a display of a computing device is disclosed. Spectral sensing data is received via a spectrometer positioned on a first side of the computing device. Light sensing data is received via a light sensor on a second side of the computing device that opposes the first side. A spectral light source profile is selected from a plurality of different spectral light source profiles based at least on the spectral sensing data. Each of the plurality of different spectral light source profiles have different color calibration values. Display color of the display is adaptively controlled based at least on the light sensing data and the color calibration values of the selected spectral light source profile.

Spectral sensing-based adaptive control of display color

Examples are disclosed relating to providing haptic feedback in a stylus while the stylus crosses a gap between two displays. In one example, a method comprises detecting one or more haptic triggering criteria, and at least on condition of detecting the one or more haptic triggering criteria, actuating the haptic feedback component to produce haptic output. Using a width of the gap between the displays, a stylus velocity, and a stylus direction, a crossing time for the stylus tip to cross the gap is calculated. At a first time after actuating the haptic feedback component, the method determines that the stylus tip crosses an inside edge of one of the displays. At least on condition of determining that the tip of the stylus crosses an inside edge of a display, the method continues to actuate the haptic feedback component for the crossing time.

Stylus haptic component

Examples are disclosed relating to providing haptic output to a stylus. In one example, rotational position data indicating a rotational position of the stylus about a longitudinal axis of the body of the stylus is received. Travel direction data indicating a direction of travel of a tip of the stylus relative to a touch-sensitive screen of a computing device is also received. Using at least the rotational position data and the travel direction data, one or more characteristics of a drive signal are determined. The drive signal is then transmitted to a haptic feedback mechanism within the body of the stylus to generate haptic output at the body.

Stylus haptic output

A method is presented for providing haptic feedback through a touch-sensitive input device configured to provide input to a touch-sensitive computing device. The method comprises determining a haptic perception factor based on a set of computing device inputs received from sensors of the touch-sensitive computing device, the computing device inputs including at least a posture of the touch-sensitive computing device. A haptic response profile is determined based on the haptic perception factor. Haptic devices of the touch-sensitive input device are actuated based on the determined haptic response profile. Responsive to determining a change in the haptic perception factor based on a change in the posture of the touch-sensitive computing device the haptic response profile is then adjusted based on the changed haptic perception factor. The haptic devices of the touch-sensitive input device are then actuated based on the adjusted haptic response profile.

Adjusting haptic feedback through touch-sensitive input devices

A method of providing haptic feedback includes collecting 3D motion data at a handheld computing accessory; analyzing the collected 3D motion data to infer a grip characteristic indicating an aspect of a user grip on the handheld computing accessory; selecting an amplitude for a haptic feedback waveform based on the inferred grip characteristic; and generating, at the handheld computing accessory, haptic feedback according to the selected amplitude.

Growing community of inventors

Tel Aviv, Israel

Shoham Dekel