Adobe, Inc.

Sven Duwenhorst

Holger Classen

Nico Becherer

Soenke Schnepel

Stefan Wiegand

Volker W Duddeck

Martin Schmitz

Jonathan Worthen Brandt

James Anderson Moorer

Matthew Davey

Bjoern-Ole Ebers

A computer-implemented method for audio signal processing includes analyzing a foreground audio signal to determine metrics corresponding to audio slices of the foreground audio signal. Each such metric indicates a value for an audio property of a respective audio slice. The method further includes computing a total metric for an audio slice as a function of a set of the metrics corresponding to a set of the audio slices including the audio slice. The method further includes adding a key frame to a track based on the total metric. The track includes the foreground audio signal and a background audio signal, and a location of the key frame corresponds to a location of the audio slice on the track. The key frame indicates a change to the audio property of the background audio signal at the location on the track, and the key frame is utilizable for audio ducking.

Automatic audio ducking with real time feedback based on fast integration of signal levels

Various embodiments describe audio signal processing. In an example, a computer system generates metrics, such as RMS levels, for audio slices from a foreground audio signal. A summed-area table is generated from the metrics. An observation window is used to determine whether to add a key frame or not. The observation window includes a set of audio slices. A total metrics, such as an average RMS level, is computed for the audio slices in the observation window. Based on the total metric, the computer system adds a key frame. The key frame references audio ducking parameters applicable to a background audio signal.

A color palette for an image is obtained, which is a set of different colors that are determined to be the dominant colors in the image. The color palette can be displayed to a user, and a user input in the form of an adverbial expression to change the color palette is received. The adverbial expression can indicate various different changes to the color palette, such as more or less of a particular color, making a color brighter or darker, making all colors in the color palette shallower or deeper, increasing or reducing the contrast of colors in the color palette, and so forth. The adverbial expression can be transformed into a new color palette and a color based image search can be initiated to identify images based on the colors in the new color palette, or an image can be modified based on the adverbial expression.

Adverbial expression based color image operations

The present specification relates to systems, methods, and apparatus including computer program products for editing digital audio data. In some implementations, a method is provided that includes the actions of receiving digital audio data; dividing the audio data into first audio data and second audio data; performing on-line processing of the first and second audio data including segmenting the first audio data according to one or more partitioning parameters into discrete time partitions, sequentially analyzing for each discrete time partition the first audio data of the corresponding discrete time partition, and modifying the second audio data according to the analysis of the first audio data; and outputting the modified second audio data.

Leveling audio signals

Methods and apparatus are presented for a morphing search tool that provides a single user interface through which a user may both modify a displayed image and perform an image similarity query based on the modified image. The morphing search tool may allow a user to repeat this process until a desired image is found and displayed. Further, the image repository to be searched may be specified by a user and the images to be modified and searched for may be any type of image. The morphing search tool may be integrated within a merchant website, an image management system, or as a stand alone application.

Single user interface for selecting, modifying, and querying images

One exemplary embodiment involves generating a plurality of facets and descriptors of all items available via an electronic shop service based on the images depicting each of the items. The facets that may be generated include a color facet, a shape facet, a texture facet, and/or other facets. The embodiment further involves receiving search criteria from a user that includes a number of search criteria elements. Each element of the search criteria may be represented by an image. The embodiment involves generating a search criteria descriptor based on the images received in connection with the search criteria. Additionally, the embodiment involves identifying items associated with images that correspond with the search criteria descriptor and providing the images of the identified items in a user interface.

Image search refinement using facets

This specification describes technologies relating to modifying digital audio data using a meta-parameter. A method is provided that includes receiving digital audio data; receiving an input modifying a meta-parameter to a particular meta-parameter value associated with two or more parameters according to a particular mapping, each of the two or more parameters being associated with the digital audio data; modifying at least a first parameter of the two or more parameters based on the particular meta-parameter value and the particular mapping such that a first meta-parameter value causes a modification of the first parameter associated with a volume control of the digital audio data and a second meta-parameter value causes a modification of a second parameter of the two or more parameters associated with dynamic range control of the digital audio data; and generating modified digital audio data from the two or more modified parameters of the digital audio data.

Meta-parameter control for digital audio data

Systems and methods are disclosed to adjust the loudness or another audio attribute for one or more audio clips. Intra-track audio levels can automatically be equalized, for example, to achieve a homogeneous audio level for all clips within an audio track. Information about such audio adjustments may be identified and stored as information without destructively altering the underlying clip content. For example, keyframes may define changes to a fader that will be applied at different points along a track's timeline to achieve the audio adjustments when the track is played. An audio editing application can provide a feature for automatically determining appropriate keyframes, allow manual editing of keyframes, and use keyframes to display control curves that represent graphically the time-based adjustments made to track-specific faders, play test audio output, and output combined audio, among other things.

Systems and methods for adjusting audio attributes of clip-based audio content

One exemplary embodiment involves receiving identifications of audio problems in a segment of audio and identifications of corrections for applying to attempt to correct the audio problems, wherein the audio problems were identified by a device applying one or more audio problem detection algorithms to the segment of audio. The exemplary embodiment further involves displaying a user interface comprising representations of the audio problems and representations of the corrections and, in response to receiving a command through the user interface to initiate application of a correction of the corrections, initiating application of the correction.

Systems and methods for semi-automatic audio problem detection and correction

Each of multiple images is analyzed to determine how the colors of the pixels of the image are distributed throughout the color space of the image. Different covariance based characteristics of the image are determined that identify a direction, as well as magnitude in each direction, of the distribution of colors of the image pixels. These different covariance based characteristics that are determined for an image can be saved as associated with the image, allowing the characteristics to be accessed and used as a basis for searching the images to identify particular types of images. These different covariance based characteristics can also be used to order the images identified by a search.

Covariance based color characteristics of images

Systems and methods to automatically equalize coloration in speech recordings is provided. In example embodiments, a reference spectral shape based on a reference signal is determined. An estimated spectral shape for an input signal is derived. Using the estimated spectral shape and the reference spectral shape a comparison is performed to determine gain settings. The gain settings comprise a gain value for each filter of a filter system. Using gain values associated with the gain setting, automatic equalization is performed on the input signal.

Automatic equalization of coloration in speech recordings

This specification describes technologies relating to visual representations indicating segments of audio data. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of receiving digital audio data including hierarchical segment information, the hierarchical segment information identifying one or more segments of the audio data for each of multiple of segment types and displaying a visual representation of the audio data at a first zoom level in an interface, the visual representation displaying audio data as a function of time on a time axis and a feature on a feature axis, the visual representation further including a display of identifiers for each segment of one or more segments of a first segment type. Other embodiments of this aspect include corresponding systems, apparatus, and computer program products.

Colorization of audio segments

A method, apparatus and computer program product for mixing audio is presented. A plurality of tracks is displayed in a user interface, each track of the plurality of tracks including at least one audio clip. Each audio clip is designated as either a foreground clip or a background clip. The foreground clips are analyzed and loudness corrected. The background clips are analyzed and a distance value between the loudness corrected foreground clips and the background clips is defined. Keyframes are added to some of the audio clips, the keyframes providing a fade between levels of the background clips to take into account the loudness corrected foreground clips and a sequenced audio file is produced from the corrected foreground clips, the background clips and the keyframes.

Method and apparatus for audio mixing

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for visualizing and adjusting parameters of clips in a timeline. In one aspect, a method includes generating a clip for one or more media elements having parameters, each clip being a visual representation of an associated media element; displaying an interface for representing each clip relative to a timeline; displaying first and second parameter lanes associated with a first clip and having associated first and second parameter lane control elements; receiving an input modifying one or more of the first and second parameter lane control elements; and adjusting the parameters of the media element associated with the first clip according to one or more properties of the first and second parameter lane control elements.

Growing community of inventors

Hamburg, Germany

Sven Duwenhorst