Qualcomm Incorporated

Telefonaktiebolaget Lm Ericsson (publ)

Martin Renschler

Kexi Liu

Md Sazzadur Rahman

Moinul H Khan

Ramesh Chandrasekhar

Mehrad Tavakoli

Frederick Duke Kim

Babak Forutanpour

Ananthapadmanabhan Arasanipalai Kandhadai

Nhon Toai Quach

Patrik Nils Lundqvist

Bijan Forutanpour

Robert Sean Daley

Rashmi Kulkarni

Jonathan Wicks

Liangping Ma

Anantharaman Balasubramanian

Thomas Stockhammer

Prashanth Haridas Hande

Danlu Zhang

Ning Bi

Imed Bouazizi

Dilip Krishnaswamy

Robert S Tartz

Wesley James Holland

Shivakumar Balasubramanyam

Erik Colban

Vijay Naicker Subramaniam

Brian Lee Momeyer

Ronald Alton

Idreas Mir

Gheorghe Calin Cascaval

Cullum Baldwin

Maurice Franklin Ribble

Bennett Michael King

Samuel Benjamin Holmes

Mriganka Mondal

Michael Mager

Pooja Aggarwal

Sherman A Gregory

Thomas Kilpatrick, Ii

Damir Didjusto

Assaf Menachem

Sten Jorgen Ludvig Dahl

Dimosthenis Kaleas

Brian D Vogelsang

Robert John Vanreenen

Sanjeevan Sivalingham

Jill Sayuri Iwasaki

Jiaying Pan

Jeffrey D Beckley

Ricky Wai Kit Yuen

Gautham Datta Mayyuri

Michael J Mager

Todd Lemoine

Rajiv Vijayakumar

Arjun Chopra

Gautham Mayyuri

Paul Holdaway

Ajinkya Shyam Ambre

Vinayak Muralidharan

Maurice Ribble

An example device for exchanging media data via a network includes a memory configured to store media data; and one or more processors implemented in circuitry and configured to: retrieve data representative of an expected time between a first frame of media data and a second frame of the media data from a media application; receive the first frame of the media data at a first time; wait to process the second frame of the media data until a second time that is equal to or greater than the first time plus the expected time; and process the second frame of the media data at the second time.

Signaling media timing information from a media application to a network element

Systems, methods, and non-transitory media are provided for extended reality (XR) control of smart devices. An example method can include generating, by a first computing device, a cryptographic key; outputting, by the first computing device, a pattern that encodes the cryptographic key, the pattern including a visual pattern, an audio pattern, and/or a light pattern; receiving, by the first computing device from a second computing device, a signed message including a command to modify an operation of the first computing device; determining, by the first computing device, whether the signed message is signed with the cryptographic key encoded in the pattern; and based on a determination that the signed message is signed with the cryptographic key encoded in the pattern, modifying the operation of the first computing device according to the command in the signed message.

Extended reality control of smart devices

A method by a wearable device is described. The method includes receiving geometric information from a controller. The geometric information includes a point cloud and a key frame of the controller. The method also includes receiving first six degree of freedom (6DoF) pose information from the controller. The method further includes synchronizing a coordinate system of the wearable device with a coordinate system of the controller based on the point cloud and the key frame of the controller. The method additionally includes rendering content in an application based on the first 6DoF pose information.

Systems and methods for tracking a controller

Systems and techniques are provided for synchronizing a frame rate of pass-through content from a camera and a display refresh rate. An example method can include obtaining first and second frames captured by an image capture device (which may be part of a device, such as an extended reality (XR) device). A display refresh rate of a display is greater than a camera frame rate of the image capture device. The method may determine motion between the first frame and the second frame. The method can include predicting, based on the second frame and the determined motion, a third frame corresponding to a time after the second frame. The method can include displaying content (e.g., mixed reality content) including the predicted third frame and virtual content rendered for the XR device.

Camera frame extrapolation for video pass-through

Attention evaluation by an extended reality system, the system determining one or more regions of interest (ROI) for an image displayed to a user. The system may also receive eye tracking information indicating an area of the image that the user is looking at. The system may further generate focus statistics based on the area of the image at which the user is looking at and the one or more ROI; and output the generated focus statistics.

User attention determination for extended reality

Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.

Low latency frame delivery

Aspects of the disclosed technology relate to an apparatus including a memory and at least one processor. The at least one processor can obtain at least one image of a scene and determine a portion of interest within the scene based on a first input. The first input can include a non-touch input. The at least one processor can output, in response to the first input, content associated with the portion of interest and receive a second input from the user. The second input can include a non-eye gaze input and be associated with the content. An action can be initiated by the one or more processor based on the second input.

Method and apparatus for image processing and associated user interaction

The present disclosure relates to methods and devices for motion estimation which may include a GPU. In one aspect, the GPU may generate at least one first motion vector in a first subset of a frame, the first motion vector providing a first motion estimation for image data in the first subset of the frame. The GPU may also perturb the image data. Also, the GPU may generate at least one second motion vector based on the perturbed image data, the second motion vector providing a second motion estimation for the image data. Moreover, the GPU may compare the first motion vector and the second motion vector. Further, the GPU may determine at least one third motion vector for the motion estimation of the image data based on the comparison between the first motion vector and the second motion vector.

Motion estimation through input perturbation

An apparatus, a method, and a computer program product are provided. The apparatus detects an eye gaze on a first region in a real world scene, sets a boundary that surrounds the first region, the boundary excluding at least a second region in the real world scene, performs an object recognition procedure on the first region within the boundary, and refrains from performing an object recognition procedure on the at least the second region.

Apparatus and method for controlling an augmented reality device

A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.

Visual search in real world using optical see-through head mounted display with augmented reality and user interaction tracking

An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.

Scene-based foveated rendering of graphics content

A method, an apparatus, and a computer program product provide feedback to a user of an augmented reality (AR) device having an optical see-through head mounted display (HMD). The apparatus obtains a location on the HMD corresponding to a user interaction with an object displayed on the HMD. The object may be an icon on the HMD and the user interaction may be an attempt by the user to select the icon through an eye gaze or gesture. The apparatus determines whether a spatial relationship between the location of user interaction and the object satisfies a criterion, and outputs a sensory indication, e.g., visual display, sound, vibration, when the criterion is satisfied. The apparatus may be configured to output a sensory indication when user interaction is successful, e.g., the icon was selected. Alternatively, the apparatus may be configured to output a sensory indication when the user interaction fails.

Visual, audible, and/or haptic feedback for optical see-through head mounted display with user interaction tracking

A system and method provide for the selective authorization and admission of a client into a data sharing session with a host. A host may select one or more clients into the sharing session based on the proximity of the clients. When a client is selected, an identifier is provided from the client device to the host device, for example, utilizing an optical identifier such as a bar code or an audible identifier such as an encoded sound. The identifier is then utilized to establish a link between the client and the host. In this fashion any number of client devices may be selectively admitted into the sharing session in a quick and easy process enabling security for the host and anonymity for the client.

Selective admission into a network sharing session

Growing community of inventors

San Diego, CA, United States of America

Martin Renschler