Samsung Electronics Co., Ltd.

Nokia Technologies Oy

Lu Luo

Christopher A Peri

Yingen Xiong

Simon J Gibbs

Jihee Kim

Abhijit Z Bendale

Jun Yang

Anthony S Liot

Xuan Bao

Zhihan Ying

Pranav K Mistry

Bo Li

Emmanuel Munguia Tapia

Hyun Jae Kang

Evan Welbourne

Won J Jeon

Euisuk Chung

Zhixian Yan

Stanislaw Antol

Sung Ho Park

Vidya Raghavan Setlur

Hawk Yin Pang

Raja Bose

David Alexander Dearman

Moiz Sonasath

Vivek Shrivastava

Yifei Jiang

Haipeng Zhang

Arnaud Renevier

Divi Schmidt

Sung-Ho Park

Ji-Hee Kim

Vivek Vishal Shrivastava

A system and method for adaptive volume-based scene reconstruction for XR platform application are provided. The system includes an image sensor and a processor to perform the method for display distortion calibration. The method includes determining a processor computation load. The method also includes, based on the determined computation load, adjusting one or more parameters for the 3D scene reconstruction to compensate for the determined computation load. The method further includes rendering a reconstructed 3D scene.

System and method for adaptive volume-based scene reconstruction for xr platform

A method includes obtaining, from a memory of an electronic device connected to a head mounted display (HMD), a first reference frame, wherein the first reference frame comprises a first set of pixels associated with a first time. The method includes, rendering, at the electronic device, a source image as a new frame, wherein the new frame includes a second set of pixels associated with a display to be provided by the HMD at a second time, and generating, by the electronic device, a differential frame, wherein the differential frame is based on a difference operation between pixels of the new frame with pixels of the first reference frame to identify pixels unique to the new frame. Still further, the method includes sending the differential frame to the HMD, and storing the new frame in the memory of the electronic device as a second reference frame.

System and method for reducing image data throughput to head mounted display

A method includes obtaining a request for one of multiple operational modes from an application installed on an extended reality (XR) device or an XR runtime/renderer of the XR device. The method also includes selecting a first mode of the operational modes, based at least partly on a real-time system performance of the XR device. The method also includes publishing the selected first mode to the XR runtime/renderer or the application. The method also includes performing a task related to at least one of image rendering or computer vision calculations for the application, using an algorithm associated with the selected first mode.

System and method for controlling operational modes for XR devices for performance optimization

In one embodiment, a method includes accessing a plurality of image frames captured by one or more cameras, classifying one or more first objects detected in one or more first image frames of the plurality of image frames as undesirable, applying a pixel filtering to the one or more first image frames to replace one or more first pixel sets associated with the one or more first objects with pixels from one or more second image frames of the plurality of image frames to generate a final image frame, providing the final image frame for display.

Intelligence-based editing and curating of images

A method includes rendering, on displays of an extended reality (XR) display device, a first sequence of image frames based on image data received from an external electronic device associated with the XR display device. The method further includes detecting an interruption to the image data received from the external electronic device, and accessing a plurality of feature points from a depth map corresponding to the first sequence of image frames. The plurality of feature points includes movement and position information of one or more objects within the first sequence of image frames. The method further includes performing a re-warping to at least partially re-render the one or more objects based at least in part on the plurality of feature points and spatiotemporal data, and rendering a second sequence of image frames corresponding to the partial re-rendering of the one or more objects.

Depth map re-projection on user electronic devices

A computer-implemented method of providing an emotion-aware reactive interface in an electronic device includes receiving an image of a user as an input and identifying a multi-modal non-verbal cue in the image. The method further includes interpreting the multi-modal non-verbal cue to determine a categorization and outputting a reactive interface event determined based on the categorization.

Emotion-aw are reactive interface

A method implemented by a client device includes accessing a plurality of image frames captured by one or more cameras of the client device and generating a working image frame based at least in part on one or more of the plurality of image frames. The method further includes classifying one or more first objects detected in the working image frame based at least in part on a determined desirability of the one or more first objects. The one or more first objects are determined to be undesirable. The method further includes applying a pixel filtering process to the working image frame to replace one or more first pixel sets associated with the first objects with pixels from one or more image frames of the plurality of image frames to generate a final image frame, and displaying the final image frame on a display of the client device.

A device may include a camera configured to capture a live image data comprising an image of an object, and a processor coupled to the camera. The processor may be configured to recognize content of a selected portion of the live image data based on a contextual information relevant to the object using computer vision technology, and generate a visual information based on the recognized content. The device may also include an interface circuitry coupled to the processor. The interface circuitry may be configured to present the live image data, and overlay the live image data with the visual information.

Augmented reality device and operation thereof

A method includes retrieving, by a device, contextual information based on at least one of an image, the device, user context, or a combination thereof. At least one model is identified from multiple models based on the contextual information and at least one object recognized in an image based on at least one model. At least one icon is displayed at the device. The at least one icon being associated with at least one of an application, a service, or a combination thereof providing additional information.

System and method for contextual driven intelligence

One embodiment provides a method comprising classifying one or more objects present in an input comprising visual data by executing a first set of models associated with a domain on the input. Each model corresponds to an object category. Each model is trained to generate a visual classifier result relating to a corresponding object category in the input with an associated confidence value indicative of accuracy of the visual classifier result. The method further comprises aggregating a first set of visual classifier results based on confidence value associated with each visual classifier result of each model of the first set of models. At least one other model is selectable for execution on the input based on the aggregated first set of visual classifier results for additional classification of the objects. One or more visual classifier results are returned to an application running on an electronic device for display.

Vision intelligence management for electronic devices

Methods, systems, and computer readable media for social grouping are provided to perform social grouping of a user's contacts based on the user's interactions with the contacts. A set of attributes associated with interactions between a user and a set of contacts may be determined by a first device. The set of attributes associated with the interactions may be related to the first device. The set of contacts may be organized into a set of groups based on the set of attributes.

Methods and systems for on-device social grouping

Social grouping using a device may include determining, by the device, a set of attributes associated with interactions between a user and a set of contacts, wherein the set of attributes associated with the interactions is related to the device. The contacts may be organized into groups. The groups may be hierarchically ordered with at least one of the groups being a subgroup of another one of the groups.

On-device social grouping for automated responses

An electronic system includes: a control unit configured to: generate an encrypted information based on encrypting an information type, generate a mapping table including the encrypted information, the information type, or a combination thereof, generate a restored information based on mapping a decomposed information of the encrypted information, categorized according to a decomposition rule, to a corresponding instance of the information type in the mapping table, and a user interface, coupled to the control unit, configure to display the restored information on an activity dashboard for receiving a user entry to calibrate the decomposition rule.

Electronic system with privacy mechanism and method of operation thereof

An apparatus, method, and computer program product are described that provide for a user to share content with other users who are proximate to his or her device in a simple and intuitive manner. In some embodiments, a 'wave' gesture is used to identify users of devices that nearby to the source user's device with whom the source user may communicate, such as to share content. Upon receiving a first orientation input, a scanning mode may be initiated during which one or more devices proximate the apparatus are determined. A second orientation input that is different from the first orientation input, and the scanning mode may be terminated in response. As a result, a communication with at least one selected device of the one or more devices determined to be proximate the apparatus may be facilitated.

Growing community of inventors

Sunnyvale, CA, United States of America

Lu Luo