Nokia Technologies Oy

Nokia Corporation

Jörg Brakensiek

Quinn Able Jacobson

Raja Bose

Jonathan Bernard Lester

Keun-Young Park

Kenneth Tracton

Kimo Boissonnier

Methods and apparatus are provided to promote interoperability between devices having different user input devices by correlating user input that is provided via one or more input mechanisms of a client device to touch events on the server device. The method may maintain a terminal session between a server device and a client device in which the client device simulates at least a portion of a display generated at the server device. The method may access a mapping between touch events on the server device and actuation of respective input mechanisms of the client device. The method may also interpret one or more control signals provided in response to actuation of an input mechanism based upon the mapping and may then cause a user interface state of the server device to updated based on the actuation of the input mechanism of the client device.

Method and apparatus for providing interoperability between devices

Various methods for determining an active input area are provided. One example method includes acquiring frame buffer data defining an image area that has been refreshed and detecting a cursor within the frame buffer data. Detecting the cursor may include determining that dimensions of the image area match dimensions of a previously acquired image area associated with a successful cursor detection, and the example method may further include directing transmission of coordinates and dimensions of the image area to a remote environment. Similar and related example methods and example apparatuses are also provided.

Method and apparatus for determining an active input area

An apparatus, method, and computer program product are described below that can provide and/or detect dynamic fiducial markers presented on a display of an apparatus. An apparatus providing the fiducial marker may initially provide for the presentation of the fiducial marker on a display, where the fiducial marker represents one or more properties of the apparatus, such as connectivity information for the apparatus. The apparatus may modify the presentation of the fiducial marker based on a change in one or more properties of the apparatus. An apparatus configured to detect dynamic fiducial markers provided on other device displays may also be configured to provide for the presentation of its own fiducial markers, and vice versa. Thus, in some cases, apparatuses may function as both a tangible user interface display and a tangible object (e.g., in a bi-directional communication scenario).

Apparatus and method for providing dynamic fiducial markers for devices

An apparatus, method, and computer program product are described that can detect the presence of a tangible object without using computer vision. The apparatus receives a signal from a device proximate the apparatus, where the signal includes at least one of a proximity component and an orientation component, and also receives a touch input from the associated display. The apparatus then determines whether there is an association between the signal and the touch input based on the proximity component and/or the orientation component. If the signal and the touch input are associated, it is an indication that the device is disposed on the display, operations may be executed, such as to facilitate interaction between the apparatus and the device. As a result, any object capable of providing a signal having a proximity component or an orientation component can be detected (e.g., without the use of cameras or fiducial markers).

Method and apparatus for determining the presence of a device for executing operations

An apparatus, method, and computer program product are described that provide for a replicated user interface, including a replicated active display area and a replicated boundary area, such that the replicated user interface can recognize the same types of user inputs that are recognized by a remote user interface, and the same operations may be executed upon receipt of such inputs. The apparatus can establish a communications link with the remote user interface and determine whether the remote user interface is configured to detect a user input at least partially received in a boundary area outside an active display area of the remote user interface. A replicated active display area and a replicated boundary area may then be provided for in response to a determination that the remote user interface is configured to detect a user input at least partially received in the boundary area of the remote user interface.

Apparatus and method for providing for remote user interaction

A method where vibration information is received from a plurality of vibration sensors fixed to a steering wheel at given positions of the steering wheel. It is then determined, based on the received vibration information and expected propagation of vibration along the steering wheel, whether a user has caused vibration to the steering wheel and at which section of the steering wheel the vibration is caused. The section of the steering wheel where the vibration is caused to the steering wheel is referred to as a touch section. Responsive to the determination of the touch section, a user command is determined and a corresponding control command is sent to a controllable device so that a user can command the controllable device in a desired manner e.g. by tapping a particular section of the steering wheel.

Growing community of inventors

Mountain View, CA, United States of America

Jörg Brakensiek