Hulu, LLC

Cailiang Liu

Zhibing Wang

Tao Xiong

Dong Wang

Bo Liu

Dong Guo

Xiaohui Xie

Heng Su

Yupeng Liao

Chenguang Zhang

Fanding Li

Yin Zheng

Joyce Zhang

Betina J Chan-Martin

Chenyang Cui

Hongxiang Chen

In some embodiments, a method trains a first prediction network to predict similarity between images in videos. The training uses boundaries detected in the videos to train the prediction network to predict images in a same scene to have similar feature descriptors. The first prediction network generates feature descriptors that describe library images from videos in a video library offered to users of a video delivery service. A search image is received and the prediction network predicts one or more library images for one or more videos that are predicted to be similar to the received image. The one or more library images for the one or more videos are provided as a search result.

Scene level video search

In one embodiment, a method includes sending videos to users that use a video delivery service. The videos include shows that have episodes released sequentially. The method records historical records of video views for the video based on the sending of the videos to the users. For a show, a show-specific model is determined to predict future video views by performing: determining historical records of video views for different episodes of the show; training the show-specific model with the historical records, wherein the show-specific model models a decay curve with a regularizing term to regularize a decay speed; using the show-specific model to predict future video views for a future time range for episodes of the show; and outputting the future video views to an ad system configured to sell ads for the show.

Video view estimation for shows delivered using a video delivery service

In one embodiment, a method determines known features for existing face tracks that have identity labels and builds a database using these features. The face tracks may have multiple different views of a face. Multiple features from the multiple faces may be taken to build the face models. For an unlabeled face track without identity information, the method determines its sampled features and finds labeled nearest neighbor features with respect to multiple feature spaces from the face models. For each face in the unlabeled face track, the method decomposes the face as a linear combination of its neighbors from the known features from the face models. Then, the method determines weights for the known features to weight the coefficients of the known features. Particular embodiments use a non-linear weighting function to learn the weights that provides more accurate labels.

Face track recognition with multi-sample multi-view weighting

Particular embodiments configure a video delivery system to provide different modes for seeking in a video. The different modes may segment the video on different boundaries based on different characteristics of the video. For example, the different modes may seek by scene, by shot, and by dialogue. The boundaries for scenes, shots, and dialogue may start the video on logical points that do not break up the flow of the video. In another embodiment, the media player may save a seek history for a user and allow the user to scan the previous seek requests to go back to the seek times of previous seek requests. In one embodiment, the previous seek times are adjusted via the boundary information to show thumbnails for a shot, scene, or dialogue that correspond to the boundaries in the video rather than the original seek time.

Video delivery system configured to seek in a video using different modes

A method for annotating general objects contained in video content is provided. The method sends video data to a client device and receives a first annotation from the client device defining a boundary around a portion of a first frame of the video data. Then, the first annotation is tracked through multiple frames of the video content. Other annotations determined to be associated with annotation that match the first annotation within a threshold are determined where the other annotations are received from other client devices and located in the first frame or other frames from the first frame. The method combines the other annotations and the first annotation into an object track and associates a tag with the object track. The tag is input by at least one of the client devices.

Annotating general objects in video

A video segment including interactive links to information about an actor appearing in the segment may be prepared in an automatic or semi-automatic process. A computer may detect an actor's face appearing in a frame of digital video data by processing the video file with a facial detection algorithm. A user-selectable link may be generated and activated along a track of the face through multiple frames of the video data. The user-selectable link may include a data address for obtaining additional information about an actor identified with the face. The video data may be associated with the user-selectable link and stored in a computer memory. When later viewing the video segment via a media player, a user may select the link to obtain further information about the actor.

Growing community of inventors

Beijing, China

Cailiang Liu