Qualcomm Incorporated

Other

Eliza Yingzi Du

John Keith Schneider

Suryaprakash Ganti

David William Burns

Kwokleung Chan

Ming Yu Chen

Esra Vural

Saurav Bandyopadhyay

Jin Gu

Jonathan Charles Griffiths

Muhammed Ibrahim Sezan

Kostadin Dimitrov Djordjev

Samir Kumar Gupta

Laurence Geoffrey Lundblade

Mark Bapst

Stephen Michael Gojevic

Jack Conway Kitchens, Ii

Ashish Hinger

Nai-Kuei Kuo

Noam Dagan

Nao Sugawara Chuei

Ranjith Ranganathan

George Michael Milikich

Jon Azen

Lior Barenboim

Ian Brettell

Lior David

Ravit Dennis

Disclosed herein are methods and systems for an intelligent, interactive, and augmented reality (AR) cloud platform. The platform can be implemented in many applications, such as providing real-time intelligent and interactive control between user input data and the resulting AR data, providing real-time and effective AR-based communication, or providing real-time control of physical devices in a remote network.

Intelligent interactive and augmented reality cloud platform

Described is an intelligent real-time multiplayer content management and data analytics system for AR-based social platforms. The data management system described herein manages AR content and multiple user interactions with the AR content. Additionally, a new multiplayer multiple-stage information augmentation design based on real-time data analysis and live AR interaction is described. In this design, AR content design is very flexible and may be organized into one or more stages containing pre-defined content, on-line searched content, user-generated content, other user-generated content, real-time user interactively generated content, or some combination. The flexible content structure allows for a highly customizable AR social experience to maximize the system performance and user experience.

Intelligent real-time multiple-user augmented reality content management and data analytics system

Disclosed herein are methods and systems for intelligent and personalized advertisement in an augmented reality environment. In particular, a plurality of integrated images of an extracted real-life object in a virtual environment is provided at a server to a user. The plurality of integrated images comprises one or more advertisement elements that are determined using a comprehensive content matching mechanism. The comprehensive content matching mechanism is based on a plurality of factors intelligently determined and personalized comprising advertisement content, user preference information, and context information.

Server-based intelligent and personalized advertisement with augmented reality enhancement

Systems, remote servers, devices, and methods for an intelligent augmented reality (IAR) platform-based communications are disclosed. During a communication, real-time audio, video and/or sensor data are captured in real-time; and scene analysis and data analytics are also performed in real-time to extract information from raw data. The extracted information can be further analyzed to provide knowledge. Real-time AR data can be generated by integrating the raw data, AR input data, information input, and knowledge input, based on one or more criteria comprising a user preference, a system setting, an integration parameter, a characteristic of an object or a scene of the raw data, an interactive user control, or a combination thereof. In some embodiments, information and knowledge can be obtained by incorporating Big Data in the analysis.

Intelligent augmented reality (IAR) platform-based communication system via servers

Disclosed herein are methods and systems for combining, in real time, images of one or more real life objects that have been captured in real time based on a comprehensive characteristic-based mechanism with a virtual environment to provide an augmented reality environment to a user or user device. In particular, the captured images are provided to a remote server that is capable of performing the processing steps to create a plurality of integrated images. The plurality of integrated images can then be provided to the user device. Advantageously, the remote server can create the plurality of integrated images much more quickly due to the server's enhanced computing power and storage space as compared to the user device. The remote server may be an intermediate server between multiple user devices. The comprehensive content matching mechanism is based on a plurality of factors comprising advertisement content, user preference information, and context information.

Real-time image and signal processing in augmented reality based communications via servers

Disclosed herein are methods and systems for an intelligent, interactive, and augmented reality (AR) based user interface platform. The platform can be implemented in many applications, such as providing real-time intelligent and interactive control between user input data and the resulting AR data, providing real-time and effective AR-based communication, or providing real-time control of physical devices in a remote network.

Intelligent interactive and augmented reality based user interface platform

Described is a real-time content management and data analytics system for AR-based platforms. The data management system described herein manages AR content and user interactions with the AR content. Additionally, a new multiple-stage information augmentation design based on real-time data analysis and live AR interaction is described. In this design, AR content design is very flexible and may be organized into one or more stages containing pre-defined content, on-line searched content, user generated content, other user generated content, real-time user interactively generated content, or some combination. The flexibility content structure brings allows for a high customizable AR experience for each user to maximize user relevance and stickiness. An example application of the system described herein is for interactive advertisements.

Real-time AR content management and intelligent data analysis system

Disclosed herein are methods and systems for real-time content-matched advertisement in an augmented reality environment. In particular, a plurality of integrated images of an extracted real life object in a virtual environment is provided at a computer device to a user. The plurality of integrated images comprises one or more advertisement elements that are determined using a comprehensive content matching mechanism. The comprehensive content matching mechanism is based on a plurality of factors comprising advertisement content, user preference information, and context information.

Real-time and context based advertisement with augmented reality enhancement

Existing search methods/systems are often generic and sometimes offer no user specific information. Disclosed herein are methods and systems for providing personalized, interactive, and intelligent search information. In particular, a search query is provided to a remote server and the remote server uses intelligent analysis for better interpreting and understanding user input and interactive user feedback concerning both search query quality and search result quality are provided to improve search quality and user experience, especially for accurate and intelligent searches in an interactive system (e.g., in an AR system). Using a remote server for query processing is advantageous because of its superior capability, including superior computing capacity.

Server based methods and systems for conducting personalized, interactive and intelligent searches

Disclosed herein are methods and systems for real-time holographic augmented reality image processing. The processing includes the steps of receiving, at a cluster of servers and from an image capturing component, real-time image data; extracting one or more objects or a scene from the real-time image data based on results from real-time adaptive learning and one or more object/scene extraction parameters; extracting one or more human objects from the real-time image data based on results from real-time adaptive human learning and one or more human extraction parameters, receiving augmented reality (AR) input data; and creating holographic AR image data by projecting, for each image, the extracted object or scene, the extracted human object, and the AR input data using a multi-layered mechanism based on projection parameters. The real-time adaptive learning comprises object learning, object recognition, object segmentation, scene learning, scene recognition, scene segmentation, or a combination thereof. The real-time adaptive human learning comprises human characteristic learning, human recognition, human segmentation, human body movement tracking, or a combination thereof.

Photorealistic human holographic augmented reality communication with interactive control in real-time using a cluster of servers

Systems, devices and methods for an intelligent augmented reality (IAR) platform-based communications are disclosed. During a communication, real-time audio, video and/or sensor data are captured in real-time; and scene analysis and data analytics are also performed in real-time to extract information from raw data. The extracted information can be further analyzed to provide knowledge. Real-time AR data can be generated by integrating the raw data, AR input data, information input, and knowledge input, based on one or more criteria comprising a user preference, a system setting, an integration parameter, a characteristic of an object or a scene of the raw data, an interactive user control, or a combination thereof. In some embodiments, information and knowledge can be obtained by incorporating Big Data in the analysis.

Intelligent augmented reality (IAR) platform-based communication system

Existing search methods/systems are often generic and sometimes offer no user specific information. Disclosed herein are methods and systems for providing personalized, interactive, and intelligent search information. In particular, intelligent analysis for better interpreting and understanding user input and interactive user feedback concerning both search query quality and search result quality are provided to improve search quality and user experience, especially for accurate and intelligent searches in an interactive system (e.g., in an AR system).

Methods and systems for personalized, interactive and intelligent searches

Disclosed herein are methods and systems for real-time image and signal processing in an augmented reality environment; for example, for video conferencing in a virtual environment of the participants' choice. In particular, image information of a real life object is extracted by separating the object from its actual environment in one or more images that are captured in real-time using a comprehensive characteristic-based mechanism. The extracted real life object is then integrated with a virtual environment based on image relations between each pixel of the image information of the real life object and a corresponding pixel of each image of the plurality of images of the virtual environment through a pixel-by-pixel integration approach. The image relations comprise at least a depth relation or a transparency relation.

Methods and systems for real-time image and signal processing in augmented reality based communications

Systems and methods for multi-spectral ultrasonic imaging are disclosed. In one embodiment, a finger is scanned at a plurality of ultrasonic scan frequencies. Each scan frequency provides an image information set describing a plurality of pixels of the finger including a signal-strength indicating an amount of energy reflected from a surface of a platen on which a finger is provided. For each of the pixels, the pixel output value corresponding to each of the scan frequencies is combined to produce a combined pixel out put value for each pixel. Systems and methods for improving the data capture of multi-spectral ultrasonic imaging are also disclosed.

Multi-spectral ultrasonic imaging

Disclosed is an apparatus and method for automatically enabling a touchscreen of a mobile device based on detection of the presence of a human finger. A mobile device can capture an image of an object with a fingerprint sensor. The mobile device may then enable a touchscreen display of the mobile device in response to a determination that the object captured within the image is a specific type of object.

Growing community of inventors

Cupertino, CA, United States of America

Eliza Yingzi Du