Fuji Xerox Co., Ltd.

Fujifilm Corporation

John E Adcock

Laurent Denoue

Matthew L Cooper

Scott Carter

David Michael Hilbert

Lynn D Wilcox

Andreas Girgensohn

Jonathan T Foote

Donald G Kimber

Francine R Chen

Qiong Liu

Yuwen Wu

Yasuhiko Nagaoka

Daniel Billsus

Sugiharto Sudiro Widjaja

Jeffery Jon Sunzeri

Jonathan James Trevor

Gene Golovchinsky

Xinding Sun

Stacy Branham

Frank M Shipman, Iii

Chunyuan Liao

Yukiyo Uehori

John J Doherty

Hiroshi Sakaida

Kandha Sankarapandian

Ram Sriram

Ish Rishabh

Hamed Pirsiavash

David Hillbert

Timothy E Black

Systems and methods for generating an overview for videos by reconstructing a representation of underlying content and linking from points in the overview to specific points in the video. Mechanisms are provided to create three different types of navigable overviews for different types of how-to and instructional videos. A two-dimensional overview is generated when content is two-dimensional, such as instructional videos on electronic whiteboard or other flat content. The three-dimensional overview is created when the content is three-dimensional, such as how-to videos illustrating the use of specific three-dimensional tangible articles. In three-dimensional case, when 3D model is available, the video segments are directly linked to corresponding points on the model. When a model is not available, a rough overview is first created from the captured video and camera orientation metadata. When the user selects a specific location within the overview, the related video segment is automatically played to the user.

Systems and methods for creating and using navigable spatial overviews for video through video segmentation based on time metadata and camera orientation metadata

Systems and methods for creating and using navigable spatial overviews for video

Embodiments of the present invention enable the extraction, classification, storage, and supplementation of presentation video. A media system receives a video signal carrying presentation video. The media system processes the video signal and generates images for slides of the presentation. The media system then extracts text from the images and uses the text and other characteristics to classify the images and store them in a database. Additionally, the system enables viewers of the presentation to provide feedback on the presentation, which can be used to supplement the presentation.

Capturing and storing elements from a video presentation for later retrieval in response to queries

In one aspect, the present invention is directed to a method and an apparatus for organizing digital media, particularly digital photos, using face recognition. According to a first aspect of the present invention, a computer-based method for organizing digital photos comprises: extracting objects of interest from a plurality of photographs; cropping said plurality of photographs to generate images of isolated objects of interest; applying a recognition algorithm to determine the similarity of isolated objects of interest with a reference; displaying a plurality of objects arranged as a function of the determined similarity; and receiving user input to associate said objects with a particular classification.

Method and apparatus for organizing digital media based on face recognition

A method for generating content links between a first digital file and a second digital file by detecting a content feature of a first digital file segment of the first digital file during playback of the first digital file segment of the first digital file, searching an index of a plurality of content features for a plurality of segments including a second digital file segment of the second digital file, and dynamically generating a link between the first digital file one segment of the first digital file and the second digital file segment of the second digital file when a content feature of the first digital file segment of the first digital file is related to the content feature of the at least one segment of the second digital file.

Hypervideo browsing using links generated based on user-specified content features

Systems and methods for determining the location of a microphone by using sounds played from loudspeakers at known locations. Systems and methods may thereby require a minimal level of infrastructure, using sounds that would naturally be played in the environment. Systems and methods may thereby allow devices such as smart-phones, tablets, laptops or portable microphones to determine their location in indoor settings, where Global Positioning Satellite (GPS) systems may not work reliably.

Localization using modulated ambient sounds

A method for navigating instructional video presentations is disclosed. The method includes determining a pause mode of a video presentation, and playing the video presentation on a display device. The video presentation has one or more predetermined pause positions. The method also includes, while playing the video presentation, determining that the video presentation has reached one of the one or more pause positions. The method further includes, in accordance with a determination that the video presentation is in a first pause mode, pausing the video presentation at the one of the one or more pause positions and maintaining a display of a paused frame of the video presentation, and, in accordance with a determination that the video presentation is in a second pause mode distinct from the first pause mode, continuing to play the video presentation through the one of the one or more pause positions.

Systems and methods for instructional video navigation and note taking

Capturing a sequence of images of a multi-page printed document is performed by a handheld device, such as a Smartphone. The device has one or more processors, memory, and a digital image sensor. The device monitors preview images of a first printed page of the multi-page printed document, where the preview images are generated by the digital image sensor. Without user indication of when to capture an image, the device captures a still image of the first printed page when a first quality metric of the preview images exceeds a first quality threshold. The device repeats the monitoring and capturing of additional pages until receiving indication from the user that capturing images is complete. In response to receiving indication from the user that capturing images is complete, the device concatenates the captured still images into a single digital document and stores the single digital document.

Systems and methods for efficiently capturing high-quality scans of multi-page documents with hand-held devices

Example embodiments described herein are directed to utilizing image matching technology to allow people to use their mobile device to setup scan workflows (or 'Scan Flows') in advance of a future scanning operation. Using an application on a mobile device, the user takes a photo of the first page of a document that he/she will scan at some later time and associates the image of the document with a simple workflow (e.g., where to store the document once the document has been scanned). Additional workflow actions may include automatic document sharing and notification, automatic document segmentation, and automatic document cropping.

Mobile scan setup and context capture prior to scanning

A system helps filter and correct video captured and streamed from a mobile device. In particular, the system detects and streams content shown on screens, allowing anyone to stream screen content immediately without needing to develop hooks into external software (i.e. without installing a screen recorder software in the computer). The system can use a variety of user-selectable techniques to detect the screen, and utilizes the mobile device's touchscreen to allow users to manually override detected corners. However, some of these approaches could potentially be applied to other types of content, such as identifying TV screens, appliance LCD screens, other mobile devices' screens, multifunction devices. (e.g. a remote technician could help troubleshoot a malfunctioning MFD by having the end-user point his cellphone to the LCD screen of the MFD).

Efficient, user-friendly system to stream screens inside video using a mobile device

Provides a system for detecting an intersection between more than one panoramic video sequence and detecting the orientation of the sequences forming the intersection. Video images and corresponding location data are received. If required, the images and location data is processed to ensure the images contain location data. An intersection between two paths is then derived from the video images by deriving a rough intersection between two images, determining a neighborhood for the two images, and dividing each image in the neighborhood into strips. An identifying value is derived from each strip to create a row of strip values which are then converted to the frequency domain. A distance measure is taken between strips in the frequency domain, and the intersection is determined from the images having the smallest distance measure between them. The orientation between the two paths may also be determined in the frequency domain by using the phases of signals representing the images in the Fourier domain or performing a circular cross correlation of two vectors representing the images.

Intersection detection in panoramic video

System and method that utilizes light sources, for example projectors embedded in mobile camera phones, to allow users to interact with documents on large displays without requiring users to install any third-party software. With this approach, multiple users can select interactors on the large display by displaying different images via their projector.

System and method for panning and selecting on large displays using mobile devices without client software

Described is a system and methods for embedding standard video-taking heuristics into video-recording devices to help improve the quality of captured video for consumer devices. The described approach uses a combination of audio, visual, and haptic feedback that responds to video as it is recorded. This feedback can help users compose better shots as well as help them develop an understanding of the fundamentals of good video-taking.

System and method for exposing video-taking heuristics at point of capture

A system and method for identifying key frames of a presentation video that include stationary informational content. A sequence of frames is obtained from a presentation video and differences of pixel values between consecutive frames of the sequence of frames are computed. Sets of consecutive frames that are stationary are identified, wherein consecutive frames that are stationary have a proportion of changed pixel values below a first predetermined threshold, and wherein pixel values are deemed to be changed when the difference between the pixel values for corresponding pixels in consecutive frames exceeds a second predetermined threshold. Next, a set of key frames that include stationary informational content is retained. The set of key frames that include stationary informational content is then displayed for user interaction.

Growing community of inventors

Menlo Park, CA, United States of America

John E Adcock