Gopro, Inc.

Daryl Stimm

Kyler William Schwartz

David A Newman

William Edward MacDonald

Joven Matias

Adeel Abbas

Cesar Douady

Alexis Lefebvre

Ha Phan

Peter Tran

Andrew Russell

Timothy Bucklin

Steven Fortunato

Joshua Hamill

Scott Corbin

Michael Kraak

Evan Kosowski

Jonathan Leland Thorn

Robert McIntosh

Kevin Marcus Grant

Vadim Polonichko

Guillaume Oulès

Ryan Lustig

Joseph VanDalsem

Robert Mcintosh

Bruce Friedman

Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.). In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Methods and apparatus for re-stabilizing video in post-processing

Multiple sets of framing for a video may define different positioning of multiple viewing windows for a video. The multiple viewing windows may be used to provide different punchouts of the video within a graphical user interface. The graphical user interface may enable creation/change in the sets of framing for the video. The graphical user interface for the punchouts may include a single timeline representation for the video. Framing indicators that represent different sets of framing for the video may be presented along the single timeline representation at different times.

Systems and methods for presenting multiple views of videos

Media item(s) stored on an image capture device are identified for sharing. The image capture device runs a web server that hosts the media item(s) and runs a media access webpage for other computing device(s) to access the hosted media item(s). The image capture device creates a communication network having a network name and a network password, generates machine-readable optical code(s) that convey the network name and the network password of the communication network, and presents the machine-readable optical code(s) on an electronic display. A computing device that captures an image including the machine-readable optical code(s) connects to the communication network using the network name and the network password of the communication network conveyed by the machine-readable optical code(s). The media access webpage is provided to the computing device connected to the communication network, which enables a user of the computing device to access the hosted media item(s).

Systems and methods for sharing content through a captive portal

Framings of a video determines which spatial extents of the video are presented during playback of the video. A viewing path for the video is generated based on the framings of the video, and the number of framings for the video is reduced based on the viewing path for the video. The reduced number of framings for the video is provided for use in generating a presentation of the video.

Reducing number of video framing

A video having a wide field of view (e.g., spherical field of view) may be presented within a graphical user interface. The graphical user interface may include multiple punchouts of the wide field of view, with the number of punchouts set based on user interaction with a punchout-number element of the graphical user interface. Individual punchouts may be used as output of a virtual camera to provide views of differential spatial parts of the video. Presentation of different spatial parts of the video within different punchouts may be automatically synchronized based on the different spatial parts originating from a single video.

Systems and methods for presenting wide videos

A video may be captured by an image capture device in motion. A horizon-leveled view of the video may be generated by providing a punchout of the video. The punchout of the video may compensate for rotation of the image capture device during capture of the video. The placement of the punchout of the video may be changed based on different rotational positions of to provide a view in which a horizon depicted within the video is leveled.

Systems and methods for horizon leveling videos

Methods and apparatus for stabilizing image data based on a lens polynomial. Non-rectilinear footage can be captured and rectified in-camera; the rectified images may be stabilized to provide rectified stable video. In one exemplary embodiment, the footage is rectified and stabilized based on a lens polynomial and the camera's own movement. In some variants, the rectified stable video may be stored along with its margin track. In-camera rectified stable video provides several benefits over traditional techniques (e.g., the ability to share rectilinear content from the camera without additional post-processing, as well as reduced file sizes of the shared videos). Lens-aware post-processing can reuse portions of the in-camera rectified stable videos while providing additional benefits (e.g., the ability to re-frame the video in post-production).

Methods and apparatus for electronic image stabilization based on a lens polynomial

A video may include visual content having a progress length. A user may interact with a mobile device to set framings of the visual content at moments within the progress length. The framings of the visual content may be provided to a video editing application. The video editing application may utilize the framings set via the mobile device to provide preliminary framings of the visual content at the moments within the progress length.

Video framing based on device orientation

Methods and apparatus for processing of video content to optimize codec bandwidth. In one embodiment, the method includes capturing panoramic imaging content (e.g., a 360° panorama), mapping the panoramic imaging content into an equi-angular cubemap (EAC) format, and splitting the EAC format into segments for transmission to maximize codec bandwidth. In one exemplary embodiment, the EAC segments are transmitted at a different frame rate than the subsequent display rate of the panoramic imaging content. For example, the mapping and frame rate may be chosen to enable the rendering of 8K, 360° content at 24 fps, using commodity encoder hardware and software that nominally supports 4K content at 60 fps.

Methods and apparatus for maximizing codec bandwidth in video applications

Multiple framings of a video may define different positionings of a viewing window at different moments within the video. The positionings of the viewing window defined by the multiple framings may be used as fixed positionings of the viewing window in a viewing path. The viewing path may define changes in the positioning of the viewing window between the fixed positionings. A presentation of the video may be generated to include the extents of the video within the viewing window.

Systems and methods for determining viewing paths through videos

Positions of an image capture device during capture of a video may be transferred to a computing device before the video is transferred to the computing device. The positions of the image capture device may be used to determine a viewing window for the video before the video is obtained. The viewing window may be used to present a stabilized view of the video when the video is obtained. For example, a stabilized view of the video may be presented as the video is streamed to the computing device.

Systems and methods for stabilizing videos

Apparatus and methods for the non-uniform downsampling of captured panoramic images. In one embodiment, a computing device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, being configured to: receive captured images, the captured images obtained using two or more image sensors; non-uniformly downsample the received captured images; and encode the non-uniformly downsampled images. In some variants, the non-uniformly downsampled images take into account a desired area of interest within the captured images. In some implementations, the computing device includes an image capture device. Methods and non-transitory computer readable apparatus are also disclosed.

Apparatus and methods for non-uniform downsampling of captured panoramic images

An image capture device may be physically connected to a computing device using a data cable. The image capture device may masquerade as an ethernet card to the computing device over the physical connection. The image capture device may communicate with the computing device over the physical connection using a wireless communication protocol.

Direct communication between an image capture device and a computing device

Methods and apparatus for post-processing in-camera stabilized video. Embodiments of the present disclosure reconstruct and re-stabilize an in-camera stabilized video to provide for improved stabilization (e.g., a wider crop, etc.) In-camera sensor data may be stored and used to re-calculate orientation metadata in post-production. In-camera stabilization provides several benefits (e.g., the ability to share stabilized videos from the camera without additional post-processing as well as reduced file sizes of the shared videos). Camera-aware post-processing can reuse portions of the in-camera stabilized videos while providing additional benefits (e.g., the ability to regenerate the original captured videos in post-production and re-stabilize the videos). Camera-aware post-processing can also improve orientation metadata and remove sensor error. The disclosed techniques also enable assisted optical flow-based stabilization using the refined metadata.

Growing community of inventors

Encinitas, CA, United States of America

Daryl Stimm