Photorealistic human holographic augmented reality communication with interactive control in real-time using a cluster of servers

Abstract

Disclosed herein are methods and systems for real-time holographic augmented reality image processing. The processing includes the steps of receiving, at a cluster of servers and from an image capturing component, real-time image data; extracting one or more objects or a scene from the real-time image data based on results from real-time adaptive learning and one or more object/scene extraction parameters; extracting one or more human objects from the real-time image data based on results from real-time adaptive human learning and one or more human extraction parameters, receiving augmented reality (AR) input data; and creating holographic AR image data by projecting, for each image, the extracted object or scene, the extracted human object, and the AR input data using a multi-layered mechanism based on projection parameters. The real-time adaptive learning comprises object learning, object recognition, object segmentation, scene learning, scene recognition, scene segmentation, or a combination thereof. The real-time adaptive human learning comprises human characteristic learning, human recognition, human segmentation, human body movement tracking, or a combination thereof.