Sony Group Corporation

Sony Corporation of America

Brent Faust

Kenji Suzuki

Jong Hwa Lee

Cheng-Yi Liu

Xihe Zhang

Arun Chandrasekar

Joseph Moon

Gary Lyons

Edward Theodore Winter

Kevin Barnes

Jianfei Max Chen

An electronic device is provided that determines initial three-dimensional (3D) coordinates of a lighting device. The electronic device controls an emission of light from the lighting device based on control signals. The emitted light includes at least one of a pattern of alternating light pulses or a continuous light pulse. The electronic device controls a plurality of imaging devices to capture a first plurality of images that include information about the emitted light. Based on the determined initial 3D coordinates and the information about the emitted light included in the first plurality of images, the electronic device estimates a plurality of rotation values and a plurality of translation values of each imaging device. Based on the plurality of rotation values and the plurality of translation values, the electronic device applies a simultaneous localization and mapping process for each imaging device, for spatial synchronization of the plurality of imaging devices.

Electronic device and method for spatial synchronization of videos

Provided is an electronic device for a temporal synchronization, which determines a set of parameters associated with each imaging device of a plurality of imaging devices. The set of parameters include frame rate of each imaging device. The electronic device generates a synchronization signal that includes a preamble pulse of a first time duration set based on the frame rate and a sequence of alternating ON and OFF pulses. Each pulse of the sequence of alternating ON and OFF pulses is of a second time duration set based on the set of parameters. Based on the synchronization signal, lighting devices may be controlled to generate a pattern of alternating light pulses that is captured by each imaging device. The electronic device further acquires a plurality of images that includes information about the pattern of alternating light pulses. The electronic device further synchronizes the plurality of images, based on the information.

Electronic device and method for temporal synchronization of videos

An electronic device including circuitry is provided. The circuitry generates a synchronization signal. The circuitry controls drive of one or more light-emitting devices based on the synchronization signal to generate a pattern of alternating light pulses. The circuitry further acquires a plurality of videos of the pattern of alternating light pulses from a plurality of imaging devices. The one or more light-emitting devices are positioned in a field of view of each of the plurality of imaging devices. The circuitry determines a frame in each video of the plurality of videos that includes a specific portion of the pattern of alternating light pulses. The determined frame in each of the plurality of videos corresponds to the same time instant. The circuitry synchronizes the plurality of videos based on the determination.

Electronic device and method for synchronization of videos

Implementations generally relate to determining a kinematic sequence. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes converting two-dimensional (2D) coordinates of the plurality of points to three-dimensional (3D) coordinates, where the converting is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates.

Determining a kinematic sequence

Implementations generally relate to determining golf swing characteristics. In some implementations, a method includes obtaining a video of a person performing an action. The method further includes determining from the video a plurality of points associated with the person, where the determining of the plurality of points is performed for each frame of the video. The method further includes determining a plurality of three-dimensional (3D) coordinates for each point of the plurality of points, where the determining of the 3D coordinates is performed for each frame of the video. The method further includes determining a movement of the plurality of points based at least in part on the 3D coordinates. The method further includes determining one or more movement errors based at least in part on the movement of the plurality of points.

Determining golf swing characteristics

Implementations generally provide a user interface for video annotation tools. In some implementations, a method includes obtaining at least one video of at least one object performing at least one action displaying one or more portions of the at least one video in a user interface. The method further includes displaying a plurality of annotation tracks in the user interface, where each annotation track of the plurality of annotation tracks is associated with one or more of the at least one object and the at least one action in the at least one video. The method further includes obtaining one or more annotations associated with the at least one video based on the plurality of annotation tracks.

Growing community of inventors

San Diego, CA, United States of America

Brent Faust