Microsoft Technology Licensing, LLC

Fiftythree, Inc.

Adobe, Inc.

Jonathan Reed Harris

John K Ikeda

Carl J Ledbetter

Andrew Scott Allen

Joel Bernard Jacobs

Scott Andrew Dallmeyer

Georg F Petschnigg

Jesse Francisco

Sabrina Boler

Matthew Aaron Jubelirer

Joshua J Hinds

Roger Jackson

Brandon Albert Lynne

Stephen Michael Danton

Anthony Reed

Jonah Sterling

Ashok Kuppusamy

Michael Baseflug

Dina-Marie LeDonne Supino

Jaclyn Carley Knapp

Jesse Daniel Eskes Rusak

Richard Leigh Mains

Albert Y S Shum

Jayant Sivarama Krishnamurthy

Chad Steven Estes

Michael Francis Palermiti, Ii

Allison Anne O'Mahony

Harris Syed

David Ernesto Heekin Burkett

Diego Hernan Carlomagno

Talon Edward Ireland

Jose Miguel Rady Allende

Jeffrey C Fong

Thomas C Arends

Adam Abdelhamed

William Lauby

Nicholas Eichhorn Bratt

Hauke Antony Gentzkow

Jonathan R Lucero

Peter Newbury

Andrew Paul McGovern

Anton O A Andrews

Kenneth Paul Hinckley

Scott Harold Wilson

Karandeep Singh Anand

William James Staples

Viktoriya Taranov

Jodie Eilers

Austin Seungmin Lee

Brian Scott Stucker

Eddie Louis Mays, Iii

Lauren Diana Lo

Alice Shirong Ferng

Tudor Buzasu Klein

Sergiy Gavrylenko

David Henry Wykes

Stephen Christopher Siciliano

Koji Yatani

Brad Olenick

Leon Welicki

Stephen Christopher

Jon Lee

Angela L Moulden

David Dzung Lu

Carl L Ledbetter

Allen L Ussher

Kristofer John Owens

Mo Wang

Christopher Scrosati

Andrew Stewart Allen

Aaron David Rogers

Eric Freistadt

Becky Ann Brown

Sung-Ho Son

Robert Alfred Jurgens

Andrew Paul Mcgovern

Cadin Lee Batrack

Ian MacDuff

Andrew A MacBeth

Joshua Prentice Keckley

Eddie Louis Iii Mays

Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. Such heavy integration also allows particular embodiments to support multi-modal input from a user for a single conversational interaction. In this way, client application user interface interactions, such as clicks, touch gestures, or text inputs are executed alternative or in addition to the voice utterances.

Voice assistant-enabled client application with user view context and multi-modal input support

Various embodiments discussed herein enable client applications to be heavily integrated with a voice assistant in order to both perform commands associated with voice utterances of users via voice assistant functionality and also seamlessly cause client applications to automatically perform native functions as part of executing the voice utterance. For example, some embodiments can automatically and intelligently cause a switch to a page the user needs and automatically and intelligently cause a population of particular fields of the page the user needs based on a user view context and the voice utterance.

Voice assistant-enabled client application with user view context

Systems, methods, and software are disclosed herein for enhancing the content capture experience on computing devices. In an implementation, a combined user input comprises a voice signal and a touch gesture sustained at least partially coincident with the voice signal. An occurrence of the combined user input triggers the identification of an associated content object which may then be associated with a captured version of the voice signal. Such an advance provides users with a new framework for interacting with their devices, applications, and surroundings.

Content capture experiences driven by multi-modal user inputs

Examples of the present disclosure relate to systems and methods for managing membership information. In an example, membership information relating to a service comprising authentication information, billing details, among other information may be identified within an electronic communication from a service and stored. In addition, reminders regarding important dates (such as auto-renewal dates) for a membership may be generated, communication from services may be sorted by service type or service provider, or a user may easily unsubscribe from a service. Additional/alternative aspects of the technology may relate to managing information related to one or more memberships.

Smart membership management

Systems, methods, and software are disclosed herein that relate to user input combined from spatial gestures and voice. A combined user input allows users to interact more fluidly with their surroundings when, for example, taking pictures, recording video, or controlling remote services or devices. In various implementations, one or more components of a computing device identify an occurrence of a combined user input such as a spoken utterance and a spatial gesture made with the device at least partially coincident with the spoken utterance. The one or more components identify a content capture experience associated with the combined user input and invoke the content capture experience on the device.

A computing device and method for controlling narration. The computing device comprises a display device displaying a visual user interface including textual information, and an electronic processor. The electronic processor executing instructions to identify a plurality of discrete textual data elements included in the textual information, map each of the plurality of discrete textual data elements to an audio data element, generate an implicit audio narration including the audio data element mapped to each of the plurality of discrete textual data elements and at least one of an audible tone and a pause between audio data elements mapped to at least two of the plurality of discrete textual data elements, and output the implicit audio narration.

Audio landmarking for aural user interface

Techniques are described herein that are capable of providing a pivot-based tile gallery with an adapted tile (e.g., in an application, such as a web application in a browser). A pivot is code that enables selection of a subset of tiles from multiple subsets of tiles. A pivot element is an interface element that represents a pivot. For instance, selection of the subset of tiles via the pivot may cause a user interface (UI) representation of the tile gallery to include UI representations of the tiles in the selected subset (e.g., and not UI representations of the tiles that are not included in the selected subset). An adapted tile is a tile that includes a wrapper and a second tile. The wrapper wraps the second tile. For instance, the wrapper may enable the adapted tile to use the second tile to implement functionality of an aspect of a resource.

Pivot-based tile gallery with adapted tile(s)

In some embodiments, an apparatus includes a housing and an image sensor that is coupled to the housing and has a field of view. The apparatus also includes a non-imaging optical system coupled to the housing and disposed outside of the field of view of the image sensor. The non-imaging optical system can output diffuse light in a set of directions to a surface to produce scattered light. The image sensor and the non-imaging optical system are collectively configured such that during operation, the image sensor receives at least a portion of the scattered light.

Methods and apparatus for an optical system outputting diffuse light and having a sensor

One or more pages are displayed on a display. A page-turning gesture is recognized. Responsive to such recognition, a virtual page turn that lifts a portion of the page is displayed on the display. One side of the lifted portion of the page is visible through the other side of the lifted portion of the page.

Virtual page turn

One or more pages are displayed on a touch display. A page-flipping gesture directed to a displayed page is recognized. Responsive to such recognition, a virtual page flip is displayed on the touch display. The virtual page flip turns successive pages to a landing page.

Stylus settings techniques are described. In implementations, an input is recognized as selecting at least one object displayed in a user interface by a display device of a computing device. Responsive to the recognition, an indication is displayed on the display device that is selectable.

Stylus settings

In some embodiments, a wireless pairing method involves a touchscreen on a wireless host device combined with a switch on a wireless stylus device. The wireless pairing method uses the time-coincidence of a touch on the host device screen with the detection of a tip switch press on the stylus device as a mode of out-of-band communication to authenticate a pairing of the devices. In such embodiments, a user presses a tip portion of the stylus device against a pairing spot on the host device surface; the wireless devices then form a bonded pair if the touch and/or release of the tip portion of the stylus device with respect to the host device surface are within a pre-determined time co-incidence window of the detection by the host device of that touch and/or release of the tip portion of the stylus device.

Apparatuses for authenticating a wireless connection using time related user actions

Techniques involving gestures and other functionality are described. In one or more implementations, the techniques describe gestures that are usable to provide inputs to a computing device. A variety of different gestures are contemplated, including bimodal gestures (e.g., using more than one type of input) and single modal gestures. Additionally, the gesture techniques may be configured to leverage these different input types to increase the amount of gestures that are made available to initiate operations of a computing device.

Link gestures

Growing community of inventors

Kirkland, WA, United States of America

Jonathan Reed Harris