Apple Inc.

Arwen V Bradley

Jason Klivington

Rudolph Van Der Merwe

Douglas P Mitchell

Samuel Noble

Charles A Mezak

Piotr J Stanczyk

Etienne H Guerard

Joseph M Triscari

Duncan Robert Kerr

Yang Yang

Behkish J Manzari

Paul M Hubel

Matan Stauber

Farhan A Baqai

Vignesh Jagadeesh

Todd Stephen Sachs

Claus Molgaard

Amir Hoffnung

Jacques P Gasselin De Richebourg

Alex Tremain Nelson

Emilie Kim

Afshin Dehghan

Paul Thomas Schneider

Claus Moelgaard

Shuang Gao

Robert A Bailey

Zahra Sadeghipoor Kermani

Vasilios E Anton

Nikhil P Singh

Ran Margolin

Sebastien Marineau-Mes

Sébastien Beysserie

Joe Triscari

Techniques are disclosed for editing captured media to overcome operational difficulties that may arise during capture operations. According to these techniques, content may be captured with a pair of cameras, a first camera having a wider field of view than a second camera. Object(s) may be detected from captured content from the wider field of view camera. The captured content may be processed from the wider field of view camera in a location of at least one detected object. Typically, operators may attempt to frame content using content from the narrower field of view camera. As a result, operators may be unaware that desired content is captured using a second, wider field of view camera. Results from the processed wider field of view data may be proposed to operators for review and, if desired, retention.

Video analysis and management techniques for media capture and retention

Techniques and devices for generating multiple output video variations for an input video based on a shared resource architecture. The shared resource architecture reuses and shares computational and gating results from one or more operations to create the multiple output video variations. The shared resource architecture applies a frame-time normalization of the trimmed and stabilized video to produce a trimmed stabilized normalized video and, thereafter, uses the trimmed stabilized normalized video to precompute one or more video parameters that can be shared with multiple output video variations. The shared resource architecture can then generate multiple output video variations using the shared video parameters.

Seamless output video variations for an input video

In various implementations a method includes obtaining a plurality of source images, stabilizing the plurality of source images to generate a plurality of stabilized images, and averaging the plurality of stabilized image to generate a synthetic long exposure image. In various implementations, stabilizing the plurality of source images includes: selecting one of the plurality of source images to serve as a reference frame; and registering others of the plurality of source images to the reference frame by applying a perspective transformation to others of the plurality of the source images.

Synthetic long exposure image with optional enhancement using a guide image

Techniques and devices for creating a Forward-Reverse Loop output video and other output video variations. A pipeline may include obtaining input video and determining a start frame within the input video and a frame length parameter based on a temporal discontinuity minimization. The selected start frame and the frame length parameter may provide a reversal point within the Forward-Reverse Loop output video. The Forward-Reverse Loop output video may include a forward segment that begins at the start frame and ends at the reversal point and a reverse segment that starts after the reversal point and plays back one or more frames in the forward segment in a reverse order. The pipeline for the generating Forward-Reverse Loop output video may be part of a shared resource architecture that generates other types of output video variations, such as AutoLoop output videos and Long Exposure output videos.

Seamless forward-reverse video loops

Techniques and devices for creating an AutoLoop output video include performing postgate operations. The AutoLoop output video is created from a set of frames. After generating the AutoLoop output video based on a plurality of loop parameters and at least a portion of the frames, postgate operations determine one or more dynamism metrics based on a variability metric and a dynamic range metric for a plurality of pixels within the video loop. Postgate operations compare the dynamism metrics to one or more postgate threshold values and reject the video loop based on the comparison of the dynamism metrics to the postgate threshold values.

Automated seamless video loop

Techniques and devices for creating an AutoLoop output video include identifying optimal loops within short videos or within a series of image. The AutoLoop output video may be automatically created using casually shot, handheld videos, and may include an AutoLoop pipeline that may comprise obtaining an input video, stabilizing the input video, detecting optimal loop parameters and baking out the AutoLoop output video with crossfade and playing back the AutoLoop output video. Video stabilization can include a cascade of video stabilization algorithms including a tripod-direct mode and a tripod-sequential mode. After stabilization, an AutoLoop operation may determine optimal loop parameters. Once optimal loop parameters are determined, a crossfade may be added to smooth out any temporal and spatial discontinuities in the AutoLoop output video.

Techniques and devices for creating an AutoLoop output video include performing pregate operations. The AutoLoop output video is created from a set of frames. Prior to creating the AutoLoop output video, the set of frames are automatically analyzed to identify one or more image features that are indicative of whether the image content in the set of frames is compatible with creating a video loop. Pregate operations assign one or more pregate scores for the set of frames based on the one or more identified image features, where the pregate scores indicate a compatibility to create the video loop based on the identified image features. Pregate operations automatically determine to create the video loop based on the pregate scores and generate an output video loop based on the loop parameters and at least a portion of the set of frames.

Techniques and devices for creating an AutoLoop output video by adding synthetic camera motion to the AutoLoop output video. The AutoLoop output video is created from a set of frames. After generating the AutoLoop output video based on a plurality of loop parameters and at least a portion of the frames, synthetic camera motion is combined with the AutoLoop output video. The synthetic camera loop is based on the subset of the input frames and exhibits some amount of camera motion for the subset of the input frames. Once the synthetic camera loop is generated, the synthetic camera loop and the video loop is combined to enhance the AutoLoop output video.

Growing community of inventors

Portland, OR, United States of America

Arwen V Bradley