Interdigital Ce Patent Holdings, Sas

Interdigital Ce Patent Holdings

Caroline Baillard

Pierrick Jouet

Anthony Laurent

Matthieu Fradet

Vincent Alleaume

Philippe Robert

Tao Luo

A camera captures part of a surrounding scene to obtain a user view, disambiguating information uniquely identifying at least one controllable device or group of controllable devices in a set of controllable devices of a given type or at least one location or direction for a mobile controllable device is obtained, the user view and the disambiguating information relating to at least one controllable device overlaid on the user view are displayed on a display, a command intended to control at least one controllable device is received, wherein a command including at least part of the disambiguating information and a message based on the command is sent towards a corresponding controllable device.

Augmented Reality method and system enabling commands to control real-world devices

A first communication device, e.g., having a camera, is pointed, by a first person, in direction of a second person with which the first person wants to communicate in an interactive session, using his communication device. The camera captures the face of the second person. If the second person does not have a device enabling interaction with the first device, a third person in proximity of the second person, having a device enabling interaction, is selected, and a request is transmitted to the second device in the hands of the third person to handover his device to the second person, displaying, for example, the face of the second person. When handover is detected, the second person may be identified by the device being handed over. The interaction between the first and the second device may be established.

Method and apparatus for establishing a communication between a first and a second communication device

Estimating lighting conditions in a mixed reality scene is a challenging task. Adding shadows cast by virtual objects in the scene contributes significantly to the user experience. To this end, there is proposed, among others, a method for an autonomously movable device having a camera. The device may move to a first position in the scene and capture a first image of a shadow of the device cast by a light source. The device may move to a second position in the scene and capture a second image of a shadow of the device cast by a light source. Features of the light source may be determined at each of the first and the second positions, and a lighting model may be determined for the scene based on the determined features of the light source in the scene.

Lighting model

A method of sharing and a method of presenting virtual content in a mixed reality scene rendered on at least two user devices having different viewing position and/or orientation onto the mixed reality scene and corresponding apparatus are described. At a first user device, a user is enabled to select a virtual content to be shared and a second user device with whom the virtual content is to be shared. Information related to the virtual content to be shared is provided, wherein the provided information comprises the 3D position of the virtual content to be shared. The information is received by the second user device and the shared virtual content is rendered with regard to the viewing position and/or orientation of the second user device onto the mixed reality scene.

Sharing virtual content in a mixed reality scene

A method for processing a 3D scene, and corresponding device, system and computer program are disclosed. In an example embodiment, the disclosed method includes: obtaining an image comprising at least a nadir view of a 3D scene, captured by at least one camera; detecting, in the image, at least one shadow cast by at least one object of the 3D scene acting as a support for the at least one camera; and determining a direction of at least one real light source from the at least one detected shadow and at least information representative of the object.

Method for processing a shadow in a 3D scene, and corresponding device, system and computer program

A method for a placement of a virtual object of an augmented or mixed reality application in a real-world 3D environment, comprises: selecting (), at a runtime of the augmented or mixed reality application, one of a finite set of at least two candidate insertion areas predetermined in the real-world 3D environment for the placement of the virtual object in the real-world 3D environment, based on criteria combining, for each of the candidate insertion areas, relationships between each of: the real-world 3D environment, the virtual object considered with respect to a placement of that virtual object in that candidate insertion area, and a user position; and inserting () the virtual object in the selected candidate insertion area.

Method and device for a placement of a virtual object of an augmented or mixed reality application in a real-world 3D environment

Dynamic virtual content(s) to be superimposed to a representation of a real 3D scene complies with a scenario defined before run-time and involving real-world constraints (). Real-world information () is captured in there al 3D scene and the scenario is executed at runtime () in presence of there al-world constraints. When there al-world constraints are not identified () from there al-world information, a transformation of the representation of the real 3D scene to a virtually adapted 3D scene is carried out () before executing the scenario, so that the virtually adapted 3D scene fulfills those constraints, and the scenario is executed in the virtually adapted 3D scene replacing the real 3D scene instead of there al 3D scene. Application to mixed reality.

Device and method for generating dynamic virtual contents in mixed reality

A method for rendering a non-photorealistic (NPR) content from a set (SI) of at least one image of a same scene is provided. The set of images (SI) is associated with a depth image comprising a set of regions. Each region corresponds to a region of a given depth. The method for rendering a non-photorealistic content includes generation of a segmented image having at least one segmented region generated with a given segmentation scale. The at least one segmented region corresponds to at least one region of the set of regions. A binary edge image is generated in which at least one binary edge region is generated with a given edge extraction scale, the at least one binary edge region corresponding to at least one region of the set of regions. The non-photorealistic content is rendered by combining the segmented image and the binary edge image.

Adaptive depth-guided non-photorealistic rendering method and device

Dynamic virtual content(s) to be superimposed to a representation of a real 3D scene complies with a scenario defined before runtime and involving real-world constraints (). Real-world information () is captured in the real 3D scene and the scenario is executed at runtime () in presence of the real-world constraints. When the real-world constraints are not identified () from the real-world information, a transformation of the representation of the real 3D scene to a virtually adapted 3D scene is carried out () before executing the scenario, so that the virtually adapted 3D scene fulfills those constraints, and the scenario is executed in the virtually adapted 3D scene replacing the real 3D scene instead of the real 3D scene. Application to mixed reality.

The present disclosure relates to methods, apparatus and systems for automatically adapt the zoom coefficient of the camera of a system when running an augmented reality application. A pose estimation is performed for the camera which captures the real scene and the boundaries of the AR scene are calculated. According to the camera frustum and the boundaries, three-dimension rectangles are computes to determine a zoom coefficient that would optimize the seeing of the seen and the optimal position for the camera. The zoom is automatically optically or digitally adapted and the optimal position is indicated to the user by visual, audio or haptic means.

Methods, devices and systems for automatic zoom when playing an augmented scene

An apparatus and a method for controlling the same by a user are suggested. The suggested apparatus comprises: a detecting unit for detecting a first event executed by a user in relation to a plurality of devices including the apparatus; a control unit for generating a second event according to the first event detected by the detecting unit; an output unit for presenting the second event to the user, wherein the control unit generates a command for executing the first event on the apparatus as a function of a response of the user to the second event detected by the detecting unit. The suggested apparatus and method are suitable to provide a second event, before executing a command corresponding to a first event from the user, for the user to confirm the intention of the first event.

Growing community of inventors

Saint Sulpice la Foret, France

Caroline Baillard