Nokia Technologies Oy

Nokia Corporation

Microsoft Technology Licensing, LLC

Nokia Corpoaration

Raja Bose

Jorg Brakensiek

Jörg Brakensiek

Vidya Raghavan Setlur

Jonathan Bernard Lester

Vivek Shrivastava

Keun-Young Park

Quinn Able Jacobson

Hawk Yin Pang

Hawk-Yin Pang

Kazuhito Koishida

Lu Luo

David Alexander Dearman

Christina Summer Chen

Ruchita Bhargava

Michelle Lynn Holtmann

Hiroshi Horii

Vivek Vishal Shrivastava

Methods and apparatus are provided to promote interoperability between devices having different user input devices by correlating user input that is provided via one or more input mechanisms of a client device to touch events on the server device. The method may maintain a terminal session between a server device and a client device in which the client device simulates at least a portion of a display generated at the server device. The method may access a mapping between touch events on the server device and actuation of respective input mechanisms of the client device. The method may also interpret one or more control signals provided in response to actuation of an input mechanism based upon the mapping and may then cause a user interface state of the server device to updated based on the actuation of the input mechanism of the client device.

Method and apparatus for providing interoperability between devices

Mobile devices provide a variety of techniques for presenting messages from sources to a user. However, when the message pertains to the presence of the user at a location, the available communications techniques may exhibit deficiencies, e.g., reliance on the memory of the source and/or user of the existence and content of a message between its initiation and the user's visit to the location, or reliance on the communication accessibility of the user, the device, and/or the source during the user's location visit. Presented herein are techniques for enabling a mobile device, at a first time, to receive a request to present an audio message during the presence of the user at a location; and, at a second time, detecting the presence of the user at the location, and presenting the audio message to the user, optionally without awaiting a request from the user to present the message.

Location-based audio messaging

Various methods triggering a remote data entry interface are provided. One example method includes receiving, at a device, a data entry field selection message notifying that data entry is desired, inhibiting a presentation of a data entry input interface on a display of the device, and causing a remote interface trigger message to be sent to a remote device to direct the remote device to present a remote data entry input interface on a display of the remote device. Similar and related example methods and example apparatuses are also provided.

Method and apparatus for triggering a remote data entry interface

A method, apparatus and computer program product are provided to facilitate user interaction with a display that is capable of presenting at least portions of the user interfaces of multiple devices, such as by recognizing and interpreting a gesture as providing input to one of the devices. In the context of a method, an identification of one or more valid gestures of at least a first device is received in an instance in which a plurality of devices interact such that portions of the respective user interfaces are capable of being presented upon a display. The method also includes receiving information indicative of a gesture and determining whether the gesture is valid. Depending upon whether the gesture is a valid gesture, the method also includes causing an indication of the gesture to be provided to the first device.

Method and apparatus for interpreting a gesture

Various methods for determining an active input area are provided. One example method includes acquiring frame buffer data defining an image area that has been refreshed and detecting a cursor within the frame buffer data. Detecting the cursor may include determining that dimensions of the image area match dimensions of a previously acquired image area associated with a successful cursor detection, and the example method may further include directing transmission of coordinates and dimensions of the image area to a remote environment. Similar and related example methods and example apparatuses are also provided.

Method and apparatus for determining an active input area

Various methods for providing data entry content to a remote environment are provided. One example method includes receiving, at a device, a data entry field selection message notifying that a selection of a data entry field has occurred at a remote device, modifying a focus of a user interface of the device to the data entry field, retrieving current data content of the data entry field, and causing an indication to be provided to the remote device informing the remote device of the current data content of the data entry field to enable the remote device to display the current data content of the data entry field in a data entry input interface. Similar and related example methods and example apparatuses are also provided.

Method and apparatus for providing data entry content to a remote environment

An apparatus, method, and computer program product are described below that can provide and/or detect dynamic fiducial markers presented on a display of an apparatus. An apparatus providing the fiducial marker may initially provide for the presentation of the fiducial marker on a display, where the fiducial marker represents one or more properties of the apparatus, such as connectivity information for the apparatus. The apparatus may modify the presentation of the fiducial marker based on a change in one or more properties of the apparatus. An apparatus configured to detect dynamic fiducial markers provided on other device displays may also be configured to provide for the presentation of its own fiducial markers, and vice versa. Thus, in some cases, apparatuses may function as both a tangible user interface display and a tangible object (e.g., in a bi-directional communication scenario).

Apparatus and method for providing dynamic fiducial markers for devices

An apparatus, method, and computer program product are described that can detect the presence of a tangible object without using computer vision. The apparatus receives a signal from a device proximate the apparatus, where the signal includes at least one of a proximity component and an orientation component, and also receives a touch input from the associated display. The apparatus then determines whether there is an association between the signal and the touch input based on the proximity component and/or the orientation component. If the signal and the touch input are associated, it is an indication that the device is disposed on the display, operations may be executed, such as to facilitate interaction between the apparatus and the device. As a result, any object capable of providing a signal having a proximity component or an orientation component can be detected (e.g., without the use of cameras or fiducial markers).

Method and apparatus for determining the presence of a device for executing operations

An apparatus, method, and computer program product are described that provide for a replicated user interface, including a replicated active display area and a replicated boundary area, such that the replicated user interface can recognize the same types of user inputs that are recognized by a remote user interface, and the same operations may be executed upon receipt of such inputs. The apparatus can establish a communications link with the remote user interface and determine whether the remote user interface is configured to detect a user input at least partially received in a boundary area outside an active display area of the remote user interface. A replicated active display area and a replicated boundary area may then be provided for in response to a determination that the remote user interface is configured to detect a user input at least partially received in the boundary area of the remote user interface.

Apparatus and method for providing for remote user interaction

An apparatus, method, and computer program product are described that provide for a user to share content with other users who are proximate to his or her device in a simple and intuitive manner. In some embodiments, a 'wave' gesture is used to identify users of devices that nearby to the source user's device with whom the source user may communicate, such as to share content. Upon receiving a first orientation input, a scanning mode may be initiated during which one or more devices proximate the apparatus are determined. A second orientation input that is different from the first orientation input, and the scanning mode may be terminated in response. As a result, a communication with at least one selected device of the one or more devices determined to be proximate the apparatus may be facilitated.

Apparatus and method for detecting proximate devices

An apparatus for providing cooperative user interface layer management may include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code may be configured, with the processor, to cause the apparatus to perform at least maintaining a terminal session between a server device and a client device in which the client device emulates at least a portion of a display presented at the server device, receiving, at the server device, an indication identifying a user interface layer for which display of information related to the user interface layer is not supported at the client device, and determining a response to a user input provided at the client device based on whether the user input relates to the user interface layer identified by the indication. A corresponding method and computer program product are also provided.

Method and apparatus for providing cooperative user interface layer management with respect to inter-device communications

An apparatus, method, and computer program product are described that determine a position of a touch component of a user input received outside a touch sensitive area of a touch surface by correlating a position of the force component and a position of a touch component of a portion of the user input received within the touch sensitive area with a position of the force component of a portion of the user input received outside the touch sensitive area. In this way, the position of a touch component of the user input received outside the touch sensitive area, where the touch surface is not capable via hardware to detect the position of the touch component, may be determined, and operations may be executed based on the position of the touch component that is determined.

Apparatus and method for determining the position of user input

An apparatus, method, and computer program product are provided for enabling interoperability between devices, such as a mobile terminal and some other remote device or remote environment. The apparatus may include at least one processor and at least one memory including computer program code. The at least one memory and the computer program code may be configured, with the processor, to cause the apparatus to maintain a terminal session between a server device and a client device in which the client device emulates at least a portion of a display presented at the server device; receive an indication of a user input received at the client device identifying a function to be performed at the server device; determine a corresponding input to elicit the identified function; and cause the identified function to be performed at the server device.

An apparatus includes one local input/output device; and an interface configured to interface between an application hosted by the apparatus and the local input/output device and is configured to interface between the application hosted by the apparatus and a remote input/output device hosted by another apparatus; wherein the interface has a first state in which the interface is configured to couple the application and the local input/output device but not couple the application and the remote input/output device hosted by the another apparatus; wherein the interface has a second state in which the interface is configured to couple the application and the local input/output device and to couple the application and the remote input/output device hosted by another apparatus; and wherein the interface is configured to be responsive to a proximity detection trigger.

Apparatus, a method and a computer program

A method includes sending over the network from a source entity to a destination entity a sequence of a plurality of packets. Each packet in the sequence includes a same identifier corresponding to a network entity on the network. Sending includes modifying a property of the sequence of packets to uniquely identify the sequence of packets. The method includes receiving information indicating the identifier corresponds to the modification of the property. Another method includes examining a sequence of packets sent over a network from a source entity to a destination entity, each packet in the sequence comprising a same identifier corresponding to a network entity on the network. The method includes determining whether a property of the sequence of packets was modified when sent to uniquely identify the sequence of packets; and responsive to the determining, associating the identifier with the network identity. Apparatus and program products are also disclosed.

Growing community of inventors

Mountain View, CA, United States of America

Raja Bose