Microsoft Technology Licensing, LLC

Xerox Corporation

Other

Google Inc.

Micorsoft Corpration

Philip Andrew Chou

Zhengyou Zhang

Jin Li

Zicheng Liu

Dinei A Florencio

Gary E Kopec

Sanjeev Mehrotra

David Milstein

Cha Zhang

Linda Criddle

Yunnan Wu

Albert S Wang

David Andrew Howell

Rajesh Hegde

Timothy Mark Moore

Regis J Crinon

Venkata N Padmanabhan

Warren Vincent Barkley

Michael D Malueg

Tim M Moore

Kamal Jain

Cheng Huang

Minghua Chen

Christian F Huitema

Anders Edgar Klemets

Sudipta Sengupta

Li-wei He

Scott C Forbes

Alexander Mohr

Leslie T Niles

Andrew David Wilson

Hrvoje Benko

Kuansan Wang

Ricardo L De Queiroz

Neil Scott Fishman

Sasa Junuzovic

Jordi Ribas-Corbera

Mohan Vishwanath

Donald Marcus Gillett

Miroslav Ponec

Amer A Hassan

Lynn D Wilcox

Francine R Chen

Dan Teodosiu

Jiahe Helen Wang

Navin Chaddha

Karon A Weber

Christoffer Asgaard Rödbro

Alexandra K Heron

Kori Inkpen Quinn

Eyal Schwartz

Helen Jiahe Wang

Donald G Kimber

Alex D Poon

John T Spivey

Sharon Kay Cunnington

Suleyman Serdar Kozat

Wayne Stark

Urun Dogan

Ranveer Chandra

Xuedong D Huang

Ross Garrett Cutler

Desney S Tan

Christopher A Meek

Mary P Czerwinski

Jitendra Dattatraya Padhye

Michel Pahud

Dan S Bloomberg

Wenwu Zhu

Bongshin Lee

John C Tang

Rebecca Claire Weiss

Ashish Kapoor

George Dan Toderici

Hao Chen

Ganesh Ananthanarayanan

David Alexander Molnar

Dinesh Garg

Daniel Allen Rosenfeld

Nicholas M Johnston

Shao Liu

David C Steere

Dinei Afonso Ferreira Florencio

Leonard Smith, Jr

Yinpeng Chen

Shujie Liu

Nirupama Chandrasekaran

Keith W Ross

Kori M Inkpen

Sung Jin Hwang

Aaron C Hoff

Chao Zhang

Mohamed Jawad Khaki

Byungki Byun

Jay Thaler

Laszlo Lovasz

Felix Livni

Yao Zhao

James E Oker

Rajesh Hedge

Example embodiments of the present disclosure relate to systems and methods for compressing attributes of volumetric and hypervolumetric datasets. An example system performs operations including obtaining a reference dataset comprising attributes indexed by a domain of multidimensional coordinates; subdividing the domain into a plurality of blocks respectively associated with a plurality of attribute subsets; inputting, to a local nonlinear operator, a latent representation for an attribute subset associated with at least one block of the plurality of blocks; obtaining, using the local nonlinear operator and based on the latent representation, an attribute representation of one or more attributes of the attribute subset; and updating the latent representation based on a comparison of the attribute representation and the reference dataset.

Learned volumetric attribute compression using coordinate-based networks

Disclosed herein are exemplary embodiments of innovations in the area of point cloud encoding and decoding. Example embodiments can reduce the computational complexity and/or computational resource usage during 3D video encoding by selectively encoding one or more 3D-point-cloud blocks using an inter-frame coding (e.g., motion compensation) technique that allows for previously encoded/decoded frames to be used in predicting current frames being encoded. Alternatively, one or more 3D-point-cloud block can be encoded using an intra-frame encoding approach. The selection of which encoding mode to use can be based, for example, on a threshold that is evaluated relative to rate-distortion performance for both intra-frame and inter-frame encoding. Still further, embodiments of the disclosed technology can use one or more voxel-distortion-correction filters to correct distortion errors that may occur during voxel compression. Such filters are uniquely adapted for the particular challenges presented when compressing 3D image data. Corresponding decoding techniques are also disclosed.

Motion-compensated compression of dynamic voxelized point clouds

Aspects of the subject disclosure are directed towards providing contextual information (such as high resolution still images) during an audio or video call. A receiver of the contextual information may send commands to the sending device to specify a desired resolution and frame rate of such images. A receiving user also may determine how to display any video call frames and/or the contextual information on one or more display devices available to the receiving user. Other contextual information such as location-related data by which a user can determine and display a location of the other call participant (or participants) may be transmitted during the call.

Compositing and transmitting contextual information during an audio or video call

Innovations in scalable compression and decompression of point cloud data are described. For example, after an encoder uses a transform such as a region-adaptive hierarchical transform ('RAHT') on attributes of occupied points in point cloud data, the encoder separates transform coefficients into partitions. The partitions can be associated with different regions of a point cloud frame (spatial location scalability), different spatial resolutions of point cloud data (spatial resolution scalability), different reconstruction quality levels (SNR scalability), different point cloud frames organized in temporal layers (temporal resolution scalability), or different combinations of the preceding types of partitions. For decoding, a decoder can select all of the partitions or a subset of the partitions. The decoder decodes encoded data for the selected partitions, applying an inverse transform such as an inverse RAHT to transform coefficients for attributes of occupied points in point cloud data.

Scalable point cloud compression with transform, and corresponding decompression

Systems and methods for providing access to various resolutions of a video. In one instance, a selection is received of a video resolution from a plurality of video resolutions, wherein the plurality of video resolutions are associated with the video. A determination is then made as to whether to authorize access to the selected video resolution based on a digital right associated with the video resolution. Depending on the determination, the video is displayed at the selected video resolution. In addition, the video may include one or more video layers, and each video layer may correspond to a particular video resolution. Further still, one or more of the video layers may be encrypted and protected by a digital right. Moreover, the encryption technique used to encrypt the video layers of the video may be different for each of the video layers.

Techniques for managing visual compositions for a multimedia conference call

Innovations in compression and decompression of point cloud data are described. For example, an encoder is configured to encode point cloud data, thereby producing encoded data. In particular, the encoder applies a region-adaptive hierarchical transform ('RAHT') to attributes of occupied points, thereby producing transform coefficients. The encoder can also quantize the transform coefficients and perform adaptive entropy coding of the quantized transform coefficients. For corresponding decoding, a decoder is configured to decode the encoded data to reconstruct point cloud data. In particular, the decoder applies an inverse RAHT to transform coefficients for attributes of occupied points. The decoder can also perform adaptive entropy decoding and inverse quantization of the quantized transform coefficients. The adaptive entropy coding/decoding can use estimates of the distribution of values for the quantized transform coefficients. In this case, the encoder calculates the estimates and signals them to the decoder.

Region-adaptive hierarchical transform and entropy coding for point cloud compression, and corresponding decompression

Techniques for managing visual compositions for a multimedia conference call are described. An apparatus may comprise a processor to allocate a display object bit rate for multiple display objects where a total display object bit rate for all display objects is equal to or less than a total input bit rate, and decode video information from multiple video streams each having different video layers with different levels of spatial resolution, temporal resolution and quality for two or more display objects. Other embodiments are described and claimed.

A method comprising: collecting respective observations of end-end bandwidth experienced on different occasions by multiple past communications occurring over different respective observed paths over a network, each path comprising a respective plurality of network components; modelling each of the respective network components with a bandwidth probability function characterized by one or more parameters; and estimating a component bandwidth or component bandwidth probability density for each of the network components based on the modelling, by determining respective values for said parameters such that a combination of the component bandwidths or bandwidth probability densities for the network components in the observed paths approximately matches, according to an optimization process, the observations of the end-to-end bandwidth experienced by the past communications over the observed paths.

Estimating bandwidth in a network

Techniques for determining network paths for voice calls include analyzing network path measurements of the network paths to determine historical network performance data for the network paths, and identifying a group of top-k network paths based on those network paths having better network performance data other network paths. A particular network path may be selected using various techniques, such as selecting the network path with the best historical network performance, selecting a network path by applying a multi-armed bandit algorithm to select the path from the group of top-k network paths, or selecting a network path at random. The selected network path may be used to by a source-destination pair of computing devices for a voice call, and a record of that voice call may be used to update network performance information for the particular network path.

Data-driven network path selection

A tele-immersive environment is described that provides interaction among participants of a tele-immersive session. The environment includes two or more set-ups, each associated with a participant. Each set-up, in turn, includes mirror functionality for presenting a three-dimensional virtual space for viewing by a local participant. The virtual space shows at least some of the participants as if the participants were physically present at a same location and looking into a mirror. The mirror functionality can be implemented as a combination of a semi-transparent mirror and a display device, or just a display device acting alone. According to another feature, the environment may present a virtual object in a manner that allows any of the participants of the tele-immersive session to interact with the virtual object.

Providing a tele-immersive experience using a mirror metaphor

The description relates to remote collaboration via a telepresence experience. One example can include an interactive digital display. The example can also include a virtual user presentation component configured to generate a graphical user interface that includes a virtual representation of a remote user on the interactive digital display. The graphical user interface can be configured to present the remote user in a side by side or mirror image relationship to a local user of the interactive digital display.

Telepresence experience

A depth construction module is described that receives depth images provided by two or more depth capture units. Each depth capture unit generates its depth image using a structured light technique, that is, by projecting a pattern onto an object and receiving a captured image in response thereto. The depth construction module then identifies at least one deficient portion in at least one depth image that has been received, which may be attributed to overlapping projected patterns that impinge the object. The depth construction module then uses a multi-view reconstruction technique, such as a plane sweeping technique, to supply depth information for the deficient portion. In another mode, a multi-view reconstruction technique can be used to produce an entire depth scene based on captured images received from the depth capture units, that is, without first identifying deficient portions in the depth images.

Depth reconstruction using plural depth capture units

A mediation server for controlling contents of incoming and outgoing communication information exchanged as part of a conversation is provided. The mediation server may be a centralized server between an internal (private) network and an external network, utilized for enforcing the internal network's policy and detecting a potential security compromise in the internal network. Predefined evaluation criteria are utilized to enforce internal policy or security policy within the internal network. When communication information is exchanged, the mediation server may monitor potential policy or security breaches in the communication information utilizing the predefined evaluation criteria and execute an appropriate action to prevent potential policy or security breaches.

VoIP communication content control

Growing community of inventors

Bellevue, WA, United States of America

Philip Andrew Chou