Oath Inc.

Yahoo Assets LLC

International Business Machines Corporation

Verizon Media Inc.

Yahoo Holdings, Inc.

Verizon Patent and Licensing Inc.

Yale Song

Jordi Vallmitjana

Alejandro Jaimes

Benoit M Schillings

Bin Ni

Jian Zhou

Guy Dassa

Adam Bryan Mathes

Joao Vitor Baldini Soares

Arunkumar Balasubramanian

Jeffrey Scholz

Minho Lee

Kirk Lieb

Rick Hawes

Vahe Oughourlian

Jennelle Nystrom

Hardik Ruparel

Matt Edelman

Ching-Yung Lin

Michael Kerby Chen

Amanda Joy Stent

Zhen Wen

Haojian Jin

Zheng Wen

Liangliang Cao

Michael Gygli

Miriam Redi

Paloma De Juan

Michael Chen

Gloria Zen

Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically analyze a live streaming media file, and identify portions of the media that are highlights. The content classified as a highlight can be shared across social media platforms, and indexed for searching respective to attributes of the video content. The streaming and highlight media content is renderable in a novel, modified video player that enables variable playback speeds for how content is classified, and enables on-demand selections of specific content portions and adjustable rendering displays during streaming.

Computerized system and method for automatic highlight detection from live streaming media and rendering within a specialized media player

Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide an image processing framework that sub-divides computer vision techniques into three computationally efficient steps: detection, classification and matching. These steps provide an improved image processing framework that can analyze live stream data of a media file, in real-time, in order to identify and track specific digital objects depicted therein. This enables not only image processing detection results, but also the capabilities of augmenting the video stream with additional data related to the detected object.

Computer vision on broadcast video

Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically detecting and rendering highlights from streaming videos in real-time. As a streaming video is being broadcast over the Internet, the disclosed systems and methods determine each type of scene from the streaming video, and automatically score highlight scenes. The scored highlight scenes are then communicated to users as compiled video segments, which can be over any type of channel or platform accessible to a user's device and network that enables content rendering and user interaction.

Computerized system and method for automatically detecting and rendering highlights from streaming videos

Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically extracting and creating an animated Graphics Interchange Format (GIF) file from a media file. The disclosed systems and methods identify a number of GIF candidates from a video file, and based on analysis of each candidate's attributes, features and/or qualities, as well as determinations related to an optimal playback setting for the content of each GIF candidate, at least one GIF candidate is automatically provided to a user for rendering.

Computerized system and method for automatically extracting GIFs from videos

Disclosed are systems and methods for improving interactions with and between computers in content searching, generating, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods automatically generate a thumbnail image from a frame of a video file, where the thumbnail image displays content of a selected frame determined to be high-quality and highly-relevant to the content of the video file. Frames of a video file are analyzed, and the frame that is the most contextually relevant to the video and of the highest visual quality is selected, where a thumbnail image is generated and displayed on a site or application over a network.

Computerized system and method for automatically generating high-quality digital content thumbnails from digital video

Techniques for multimodal data fusion having a multimodal hierarchical dictionary learning framework that learns latent subspaces with hierarchical overlaps are provided. In one aspect, a method for multi-view data fusion with hierarchical multi-view dictionary learning is provided which includes the steps of: extracting multi-view features from input data; defining feature groups that group together the multi-view features that are related; defining a hierarchical structure of the feature groups; and learning a dictionary using the feature groups and the hierarchy of the feature groups. A system for multi-view data fusion with hierarchical multi-view dictionary learning is also provided.

Multimodal data fusion by hierarchical multi-view dictionary learning

Disclosed herein is an automated approach for summarizing media content using descriptive information associated with the media content. For example and without limitation, the descriptive information may comprise a title associated with the media content. One or more segments of the media content may be identified to form a media content summary based on each segment's respective similarity to the descriptive information, which respective similarity may be determined using a media content and auxiliary data feature spaces. A shared dictionary of canonical patterns generated using the media content and auxiliary data feature spaces may be used in determining a media content segment's similarity to the descriptive information.

Topical-based media content summarization system and method

Disclosed are systems and methods for improving interactions with and between computers in content searching, hosting and/or providing systems supported by or configured with devices, servers and/or platforms. The disclosed systems and methods provide a novel machine-in-the-loop, image-to-video bootstrapping framework that harnesses a training set built upon an image dataset and a video dataset in order to efficiently produce an accurate training set to be applied to frames of videos. The disclosed systems and methods reduce the amount of time required to build the training dataset, and also provide mechanisms to apply the training dataset to any type of content and for any type of recognition task.

Machine-in-the-loop, image-to-video computer vision bootstrapping

Disclosed herein is a content-adaptive digital media content adjustment system, method and architecture. Playback rate of a media content item comprising audio and video content can be increased by removing a portion of the content item's audio content and a corresponding portion of the content item's video content. An increased playback rate of a multimedia content item is accomplished by decreasing the length of the multimedia content item by removing portions of the multimedia content item's audio and video content.

Content-adaptive digital content adjustment method and system

Disclosed are systems and methods for improving interactions with and between computers in content generating, searching, hosting and/or providing systems supported by or configured with personal computing devices, servers and/or platforms. The systems interact to identify and retrieve data within or across platforms, which can be used to improve the quality of data used in processing interactions between or among processors in such systems. The disclosed systems and methods provide systems and methods for automatically extracting and creating an animated Graphics Interchange Format (GIF) file from a media file. The disclosed systems and methods identify a number of GIF candidates from a video file, and based on analysis of each candidate's attributes, features and/or qualities, at least one GIF candidate is automatically selected for rendering.

Automatic video segment selection method and apparatus

A method is provided, that initiates with providing a video over a network to a plurality of client devices, wherein each client device is configured to render the video and track movements of a pointer during the rendering of the video. Movement data that is indicative of the tracked movements of the pointer is received over the network from each client device. The movement data from the plurality of client devices is processed to determine aggregate pointer movement versus elapsed time of the video. The aggregate pointer movement is analyzed to identify a region of interest of the video. A preview of the video is generated based on the identified region of interest.

Pointer activity as an indicator of interestingness in video

Growing community of inventors

New York, NY, United States of America

Yale Song