Xerox Corporation

Scott L Minneman

Steve R Harrison

Thomas P Moran

Donald G Kimber

Lynn D Wilcox

Gordon P Kurtenbach

John C Tang

William J Van Melle

Jonathan R Cohen

Maribeth Joy Back

Polle Trescott Zellweger

Richard J Goldstein

Sara A Bly

Steven R Harrison

David Goldberg

Ian E Smith

William C Janssen

Michael J Black

David A Nichols

Matthew G Gorbet

L Charles Hebel

Margaret Crane

Jon Winet

Dale MacDonald

Xuan Ju

The systems and methods of this invention use an index and digital audio and/or video recordings of an activity to provide access to recently recorded material. For example, users initiate audio and/or video recordings. An index, e.g., an agenda, outlines the structure of the to be recorded event. The user selects an index item as an activity that corresponds to an index item is recorded. The recordings are then associated with the index. The user can then randomly access the recordings for playback, editing or further recording. The systems and methods of this invention additionally provide the means for correlating events and the corresponding index items with the recordings.

Systems and methods for using structured representations to index recordings of activity

A method and apparatus analyzes and annotates a technical talk typically illustrated with overhead slides, wherein the slides are recorded in a video sequence. The video sequence is condensed and digested into key video frames adaptable for annotation to time and audio sequence. The system comprises a recorder for recording a technical talk as a sequential set of video image frames. A stabilizing processor segregates the video image frames into a plurality of associated subsets each corresponding to a distinct slide displayed at the talk and for median filtering of the subsets for generating a key frame representative of each of the subsets. A comparator compares the key frame with the associated subsets to identify differences between the key frame and the associates subset which comprise nuisances and affordances. A gesture recognizer locates, tracks and recognizes gestures occurring in the subset as gesture affordances and identifies a gesture video frame representative of the gesture affordance. An integrator compiles the key frames and gesture video frames as a digest of the video image frames which can also be annotated with the time and audio sequence.

Method and apparatus for generating a condensed version of a video sequence including desired affordances

By using dynamic text and an interface utilizing a familiar metaphor, reading speed and comprehension can be increased. In particular, the interface, which is based on a familiar metaphor, such as driving, allows a user to concentrate on the real task at hand, reading, as opposed to manipulation of the interface. Thus, using a combination of a familiar metaphor and rapid serial presentation, dynamic text can be efficiently negotiated.

Systems and methods providing an interface for navigating dynamic text

Identifier tags are embedded in pages of a document. Each of these identifier tags identifies the particular page that a reader is viewing. By correlating the currently read page to information stored memory, dynamic content corresponding to the currently read page can be activated. Additionally, proximity sensors are associated with one or more portions of the document. Thus, the range of dynamic content can also be activated by placing an object within the sensible area of the proximity sensors. This dynamic content can include, for example, lighting, sound effects, environmental conditions, or the like.

Systems and methods that detect proximity information using electric field sensing devices and a page identification using embedded identification tags

The present invention provides a method and system of publicly co-creating a narrative document by parallel and on-going communication of a plurality of signals comprising public reactions to portions of the document, the signals being generated via one or more repurposed signaling devices. A display illustrates an introductory portion of the document intended to engender a public interest in the document and an emotive or intellectual reaction thereto. The document can comprise a dependent set of associated document elements which are sequentially variable for variation of document content to evolve different document narratives. The public viewing the display communicates, via the device or devices, a signal indicative of their reactions and for effecting a prospective scene selection in the document content that, in turn will vary the narrative.

Public interactive document

A system for capturing and controlling access to concurrently recorded timestreams of a session. A session is of a collaborative activity such as a meeting. Timestreams of the session are captured by various recording devices. The timestreams are analyzed to create a set of events for each timestream. An event is subsequently used as an index for replaying the session. Playback of the timestreams is done in order to recall dialogs or other events that occurred during the meeting. The timestreams are played back contemporaneously. A timeline interface having the events mapped thereon is used to traverse through the different portions of the session.

Computer controlled display system using a timeline to control playback

A system for the capture and playback of temporal data representing a collaborative activity such as a meeting. Such temporal data is captured by one or more capture devices (e.g. audio recordings or an electronic whiteboard). Temporal data is comprised of timestreams and events. Timestreams are sets of timestamped data which represent some recordable aspect of the meeting. Events are contained within a timestream that represent natural activities that occurred during the course of the session. Events are used to create indices which provide direct access to a point or span in time during the collaborative activity. Playback of a session is performed under the control of a session access device. Coupled to the session access device are a plurality of players for playing back timestreams. The session access device utilizes event information to create a user interface for controlling session replay. The user interface is comprised of a plurality of windows. Each window may represent a player, a playback controller or an editor.

System for the capture and replay of temporal data representing

A method of recording a real-time multimedia presentation and replaying a missed portion at an accelerated rate until the missed portion catches up to the current point in the presentation. The multimedia presentation may consist of audio, video, graphics, and text. A graphical timeline is provided to allow the user easy access to different points in the recorded presentation. All the media formats are synchronized at the accelerated rate and the audio is accelerated without changing its pitch.

Method for controlling real-time presentation of audio/visual data on a

The present invention comprises a display unit (10) which displays a composite image (38); a stylus (24) which is used to 'write' on the composite image (38); a way of detecting (20) the position of the stylus (24) over the composite image (38); a video camera (12) mounted a short distance away from the video display (11) and aimed at the composite image (38); a light (23) which provides uniform illumination to the composite image (38); a mechanism for preventing video feedback (26); and a computer (22). A special configuration of cables (16, 28, 30, 32, 34) is used to interconnect the display (10), the stylus (24), the position detector (20), the video camera (12) and the computer (22). Two or more workstations (11) can be electrically connected to each other via cables (34) or over a network (76). Many variations of this invention can be created by connecting other components into the computer network (76). Various combinations of video mixers (39) and video buses (78) can be utilized instead of directly connecting the video cameras (12) to the computers (22) with cables (16). Three dimensional effects can be created by employing a second video camera (112), adjacent to the first (12), in combination with a pair of shuttering spectacles (102). Images of additional objects (98) can be provided by extra cameras (70) electrically connected in several different ways to the network. To enhance communication between operators (25) separated by large distances, microphones (74), loudspeakers (72), auxiliary cameras (70) and auxiliary video displays (66) can be provided at each workstation (11). Large scale versions of this invention can be constructed. In large scale versions the video display unit (10) is replaced with a large screen (88) and a video projector (90).

Video computational shared drawing space

Remote interactive use of a plurality of writing surfaces, such as special wall mounted whiteboards and the like, is facilitated by an apparatus which includes, for each writing surface, a translucent screen acting as the writing surface itself, a video camera located behind the translucent screen for receiving an image of indications imparted upon the translucent screen, and a video projector for projecting onto the back side of the translucent screen a composite of the images imparted upon each of the translucent screens. Backlighting of a user is employed to allow presentation of the processes of imparting, using and referring to the indicia together with the indicia itself. Proper ambient lighting also provides a limited three dimensional view of the user. Audio portions of interactive work may be captured by a microphone and transmitted to speakers in conjunction with the video portion of the interactive work. An audio/video mixing resource may be employed to combine the images of indicia and audio from various worksites for presentation. Low bandwidth of the present system facilitates compression and use with emerging commercial communications standards (e.g., ISDN).

Growing community of inventors

San Francisco, CA, United States of America

Scott L Minneman