Sony Group Corporation

Kiyoharu Sassa

Nikolaos Georgis

James Kuch

Keisuke Omori

An electronic apparatus and method for sequence stabilization of point cloud frames using motion information is disclosed. The electronic apparatus receives image data that includes images of objects. The image data corresponds to a duration in which in the objects are in a dynamic state. Based on the image data, the electronic apparatus generates a point cloud sequence and extracts motion information associated with the objects. The electronic apparatus determines a first set of 3D points of a first point cloud frame that is in a static state with respect to a second set of 3D points of a second point cloud frame, based on the motion information. The first and second point cloud frames are consecutive frames of point cloud sequence. The electronic apparatus further determines a difference between the first and the second set of 3D points and updates the first point cloud frame based on the difference.

Sequence stabilization of 3D point cloud frames using motion information

A method and system for synchronization of image data is provided. A plurality of image-capture devices is controlled to acquire a plurality of video clips of at least one object. Each video clip of the plurality of video clips is acquired by a corresponding image-capture device of the plurality of image-capture devices in a moving state. From the plurality of image-capture devices, a set of sensor data is acquired. Such data corresponds to the plurality of image-capture devices and is associated with a movement of the plurality of image-capture devices. Thereafter, relative offsets between the set of sensor data are determined by using cross-correlation and matching frames in each of the plurality of video clips is further determined, based on the relative offsets.

Accelerometer-assisted frame-accurate synchronization of mobile camera arrays

A minimal volumetric 3D transmission implementation enables efficient transmission of a 3D model to a client device. A volumetric 3D model is generated using a camera rig to capture frames of a subject. A viewer is able to select a view of the subject. A system determines an optimal subset of cameras of the camera rig to utilize to capture frames to generate the volumetric 3D model based on the viewer's selected view. The volumetric 3D model is transmitted to the user device. If the user changes the view, the process repeats, and a new subset of cameras are selected to generate the volumetric 3D model at a different angle.

Growing community of inventors

SAN JOSE, CA, United States of America

Kiyoharu Sassa