Gopro, Inc.

Woodman Labs, Inc.

Menon Renewable Products, Inc.

Other

Applied Magic, Inc.

David A Newman

Scott Patrick Campbell

Balineedu Chowdary Adsumilli

Adeel Abbas

Daryl Stimm

Timothy Macmillan

Brian G Schunck

Otto Kenneth Sievert

Joshua Edward Bodinet

Timothy MacMillan

Timothy Bucklin

Sumit Chawla

Paul Mobbs

Joven Matias

Ha Phan

Adam Silver

Kasturi Rangam

Vadim Polonichko

Nicholas Ryan Gilmour

Zhinian Jing

Cesar Douady

Kyler William Schwartz

Jeffrey S Youel

Yajie Sun

Joseph VanDalsem

Ryan Lustig

William Edward MacDonald

Alexis Lefebvre

Mark Vaden

Rolf Fischer

Nicholas D Woodman

Suresh M Menon

Samantha S Orchard

Sara Guidi

Gurprit Cheema

Jessica Badger

Gregory Oaul Stewart

Michael Kraak

Stephen B Schmidt

Robert McIntosh

Jessica Bonner

Tyler Gee

David Lipson

Balu Adsumilli

Craig Davidson

Brian W Stevens

Jagadish C Sircar

Kashinatham Alisala

Phil Johnston, Ii

Robert Lee Wallin

Luc Sargent

Sean Hamilton

Systems, apparatus, and methods for stabilization and blending of exposures. So-called Electronic Image Stabilization (EIS) techniques use image manipulation software to compensate for camera motion. Unfortunately, existing EIS techniques cannot compensate for artifacts introduced by low shutter speed (e.g., blurs). Various embodiments of the present disclosure generate stabilized images from multiple exposures. In one exemplary embodiment, the stabilized exposures are blended using a linear sum of the color data for each pixel of the image. By stabilizing each exposure and linearly summing the light information, the camera shake can be removed, and the scene motion blur can be controlled. The stabilization and blending techniques enable a mathematical emulation of a selected shutter angle from many high-speed exposures.

Systems, apparatus, and methods for stabilization and blending of exposures

An image capture device changes between operation in a non-dive mode and a dive mode. When the image capture device is not under water, the image capture device is operated in the non-dive mode. The visual content captured by the image capture device is stabilized based on an above-water lens prescription and placement of a viewing window within the visual content. When the image capture device is under water, the image capture device is operated in the dive mode. In the dive mode, the lens prescription used for visual content stabilization is changed from the above-water lens prescription to the under-water lens prescription, and the size of the viewing window is scaled down.

Image capture device with a non-dive mode and a dive mode

An image capture device may detect depiction of a machine-readable optical code within visual content captured by the image capture device. The machine-readable optical code may convey information for lens calibration with another lens attached over the lens of the image capture device. Attachment of the other lens over the lens of the image capture device may change optical properties (e.g., field of view, focus distance, depth of focus, and/or distortion) of the image capture device. The image capture device may perform lens calibration based on the information for lens calibration conveyed by the machine-readable optical code. The image capture device may be dynamically calibrated to capture visual content through the combination of the lens and other lens attached over the lens.

Dynamic lens calibration

Apparatus and methods for enabling indexing and playback of media content before the end of a content capture. In one aspect, a method for enabling indexing of media data obtained as part of a content capture is disclosed. In one embodiment, the indexing enables playback of the media data during the capture and before cessation thereof. In one variant, the method includes generating an 'SOS track' for one or more images. The SOS track does not contain the same information as a full index, but provides sufficient information to allow an index to be subsequently constructed. In one implementation, the provided information includes identifiable markers relating to video data, audio data, or white space, but it does not provide an enumerated or complete “table of contents” as in a traditional index.

Methods and apparatus for enabling playback of content during an ongoing capture

Methods and apparatus for image processing of spherical content via hardware acceleration components. In one embodiment, an EAC image is subdivided into facets via existing software addressing and written into the memory buffers (normally used for rectilinear cubemaps) in a graphics processing unit (GPU). The EAC facets may be translated, rotated, and/or mirrored so as to align with the expected three-dimensional (3D) coordinate space. The GPU may use existing hardware accelerator logic, parallelization, and/or addressing logic to greatly improve 3D image processing effects (such as a multi-band blend using Gaussian blurs.)

Methods and apparatus for hardware accelerated image processing for spherical projections

Systems, apparatus, and methods for color space representation. Unlike television and other passively viewed content, action cameras enable the user to take an active role in content generation/modification. Ideally, image content can be transferred from action cameras to post-processing devices with minimal signal loss (noise introduction), however existing device ecosystems are often bottlenecked by commodity codecs and/or intermediary networks. Various embodiments of the present disclosure use an improved 'transport' compression technique to preserve desirable signal codeword and noise codeword relationships for color space representation.

Systems, apparatus, and methods for color space representation

Media items (e.g., images, videos) may be captured by one or more image capture devices. One or more of the media items may be identified as including/likely including depiction of a user based on proximity of capture of the media item(s) in time and location to the user. The identified media item(s) may be provided to the user.

Systems and methods for sharing media items capturing subjects

An image capture device may be moved while capturing a distance-lapse video. Distance traveled by the image capture device may be used to determine when video frames of the distance-lapse video are generated. Video frames of the distance-lapse video may be generated when the image capture device travels over a certain amount of distance. Distance interval, rather than time interval, may be used to generate the distance-lapse video.

Systems and methods for generating distance-lapse videos

Methods and apparatus for metadata-based cinematography, production effects, shot selection, and/or other content augmentation. Effective cinematography conveys storyline, emotion, excitement, etc. Unfortunately, most amateur filmmakers lack the knowledge and ability to create cinema quality media. Various aspects of the present disclosure are directed to, among other things, rendering media based on instantaneous metadata. Unlike traditional post-processing techniques that rely on human subjectivity, some of the various techniques described herein leverage the camera's actual experiential data to enable cinema-quality post-processing for the general consuming public. Instantaneous metadata-based cinematography and shot selection advisories and architectures are also described.

Methods and apparatus for metadata-based processing of media content

Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object 'jitter' can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Apparatus and methods for pre-processing and stabilization of captured image data

Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. A video summary can be generated including one or more of the identified best scenes. The video summary can be generated using a video summary template with slots corresponding to video clips selected from among sets of candidate video clips. Best scenes can also be identified by receiving an indication of an event of interest within video from a user during the capture of the video. Metadata patterns representing activities identified within video clips can be identified within other videos, which can subsequently be associated with the identified activities.

Scene and activity identification in video summary generation

In a video capture system, a virtual lens is simulated when applying a crop or zoom effect to an input video. An input video frame is received from the input video that has a first field of view and an input lens distortion. A selection of a sub-frame representing a portion of the input video frame is obtained that has a second field of view smaller than the first field of view. The sub-frame is processed to remap the input lens distortion to a desired lens distortion in the sub-frame. The processed sub-frame is output.

Virtual lens simulation for video and photo cropping

An image capture device may receive GPS data during capture of video frames. GPS data may be used to increase accuracy of GPS time of the image capture device. GPS time of the image capture device at a later moment in the capture duration may be used to determine the times of earlier captured video frames.

GPS timing for video frames

Systems, apparatus, and methods for encoding telemetry data as audio waveforms. Action cameras may be used to capture telemetry data, which in some applications, may be more useful than its audio/visual media capture. For example, a user may desire the 'look-and-feel' of one camera but would like to use the telemetry track information from an action camera. In so-called “piggybacking” operation, the user may rigidly affix the two cameras and use the video track with the telemetry track in post-processing. Unfortunately, time-aligning the two tracks can result in relative drift over time. Various embodiments of the present disclosure transfer telemetry data as data-over-audio. The data-over-audio may be sampled according to the recipient device and recorded at capture. Subsequent post-processing may be performed with the time-aligned tracks.

Systems, apparatus, and methods for encoding telemetry data as audio waveforms

Video frames are captured by an image capture device and stabilized to generate stabilized video frames. Multiple stabilized video frames are combined into single motion blurred video frames. Combination of multiple stabilized video frames into single motion blurred video frames produces motion blur within the single motion blurred video frames that is both physical and real.

Systems and methods for simulating motion blur

Growing community of inventors

San Diego, CA, United States of America

David A Newman