Adjusting pose of video object in 3d video stream from user device based on augmented reality context information from augmented reality display device

Abstract

An augmented reality. AR, computing server () includes a network interface (), a processor (), and a memory () storing instructions executable by the processor to perform operations. The network interface is configured to receive through a network a three-dimensional (3D) video stream from a user device during a conference session. The operations identify a video object captured in the 3D video stream, and determine a pose of the video object captured in the 3D video stream. The operations obtain AR context information from an AR display device indicating how the video object is to be posed relative to a physical object viewable through a see-through display of the AR display device, and adjust pose of the video object captured in the 3D video stream based on the AR context information. The operations output the video object to the see-through display for display. Related methods and computer program products are disclosed.