Microsoft Technology Licensing, LLC

Revive Al, Inc.

Petteri Mikkola

Issa Yousef Khoury

Keri Kruse Moran

Elizabeth Fay Threlkeld

Darren Ray Davis

Ryan Pendlay

Ramrajprabu Balasubramanian

Patrick Joseph Derks

William Scott Stauber

Kenton Allen Shipley

Giorgio Francesco Sega

Mohammed Kaleemur Rahman

Abolade Gbadegesin

Lijuan Qin

Gregory Alan Howard

Holger Kuehnle

Susan Chory

Brian David Cross

Peter M Bergler

Tony He

Jon Arnett

Janis Jungeun Lee

Issa Y Khoury

David John Woods

Jon Carlson

Aneesh Shankar Hariharan

Devdatta Bhikaji Waghdhare

Patrick Derks

Ryan Chandler Pendlay

A method of training a neural network for home improvement visualization is disclosed. The method may include receiving a set of annotated images of houses to train the neural network, augmenting the set of annotated images of houses to generate additional annotated images of houses for the neural network, processing the annotates images of houses and the additional annotated images of houses to train the neural network, refining the set of annotated images of houses by detecting the edges elements in the images and adjusting the annotations based on the edge detection, and outputting a trained neural network.

Systems and methods for home improvement visualization

A mobile computing device, such as a smartphone or tablet device, can be coupled to any one or more of multiple display devices at any given time. The mobile computing device allows the home screen displayed on the display devices to be dynamic, changing based on which display device the mobile computing device is coupled to. The mobile computing device can also be coupled to multiple different display devices concurrently, and different home screens are concurrently displayed on those different display devices. User inputs changing the information displayed on the home screen can also be received, and a record of the change is maintained by the computing device so the changed home screen for a particular display device is again displayed to the user the next time the mobile computing device is coupled to that display device.

Automatic home screen determination based on display device

Various models may enable a first device to share a device resource with a second device in various contexts, such as sharing computing sessions via terminal services; sharing displays via display mirroring; and sharing input components across devices. However, such techniques often utilize ad hoc sharing models that depend on configuration and/or administrative access of each device; limit the capabilities of such sharing; and/or exhibit security concerns. Instead, a target device may advertise an availability of a target device resource. A host device may request the target device to lend the target device resource to the computing environment of the host device. The target device may reserve the target device resource for the host device, which may then integrate the target device resource into the host computing environment. The model may enable the user to utilize resources even from target devices that the user is not otherwise permitted to use.

Lending target device resources to host device computing environment

In many computing scenarios, a user of a primary device may wish to incorporate an auxiliary device in the presentation of an application. Such incorporation may involve a terminal services session that projects the computing environment of the primary device onto the auxiliary device; mirroring the computing environment of the primary device through the auxiliary device; and/or utilizing applications that interoperate with client applications executing on the second device. However, such techniques may not fully reflect the properties of each device, and/or may only apply to particular applications and/or configurations. Instead, the primary device may adapt the primary computing environment to an auxiliary computing environment according to a device property of the auxiliary device; partition the application into a primary application portion presented within the primary computing environment and an auxiliary application portion presented within the auxiliary computing environment; and transmit the auxiliary computing environment to the auxiliary device.

Partitioned application presentation across devices

One or more techniques and/or systems are provided for content projection. For example, a communication connection may be established between a primary device (e.g., a smart phone) of a user and a secondary device (e.g., a television). The primary device may identify an interest of the user to view content on the secondary device (e.g., photos for a recently attended concert). The primary device may retrieve the content (e.g., local photos on the smart phone and/or photos remotely retrieved from a social network). The primary device may project a rendering of the content onto a secondary display of the secondary device (e.g., the smart phone may send the rendering over the communication connection to the television for display).

Content projection

A user may interact with a collection of devices that each exhibit particular device properties. Where each device executes and presents an isolated computing environment, inconsistencies may arise in the user interaction by the user with different devices. Alternatively, a terminal server may present a computing environment to various auxiliary devices, but such presentation may fail to utilize some device properties of some devices, and/or may present a computing environment that is not suitable for some devices. Instead, a primary device of the device collection may adapt a primary computing environment to an auxiliary computing environment for each auxiliary device, based upon its device properties. Upon receiving a request to execute an application, the primary device may execute the application within the auxiliary computing environment, and may adapt the application based upon the device properties. The primary device may stream each auxiliary computing environment to the respective auxiliary device.

Presentation of computing environment on multiple devices

A computing device, and method thereof, may have a first display. A first user input is received from an input device of the computing device. In response, a task manager is displayed, the task manager having representations of respective objects on the computing device. When a second user input is received via the input device, a target representation is selected according to the second user input and an application window of an application corresponding to the target representation is displayed on the second display.

Gesture for task transfer

Various user interfaces and other technologies for interacting with devices that support multiple communication lines can be implemented. Scenarios providing separate communications lines, such as voice over internet protocol (VOIP), social network communications, and the like can be supported. For example, communication-line-separated and communication-line-aggregated user interface paradigms can be supported. Intelligent selection of an appropriate paradigm can support user preferences, conversation user interfaces, and the like. Other features such as communication line defaults can help users deal with multiple communication line scenarios. A consistent, compact user interface for switching communication lines can be supported. Users can interact with their devices more efficiently and with less frustration. A wide variety of use scenarios are supported.

Intelligent user interfaces for multiple communication lines

In many computing scenarios, a computing environment of a device may present applications through various presentation components, such as displays, speakers, and headphones. However, navigating among the applications currently presented within the computing environment may be difficult for the user; e.g., for a device presenting many applications on many displays that share an application stack, the application that the user wishes to select may be buried deep within the shared application stack. In accordance with the techniques presented herein, the device may generate an application presentation history for each presentation component, indicating applications that have previously been presented through the presentation component. A request to transition a selected presentation component away from a current application presentation may be fulfilled by identifying a second application having an application presentation in the application presentation history of the selected presentation component, and transitioning the selected presentation component to the second application.

Component-specific application presentation histories

Growing community of inventors

Bellevue, WA, United States of America

Petteri Mikkola