Xerox Corporation

Xerox Parc

Fuji Xerox Co., Ltd.

L Noah Flores

David L Hecht

Richard G Stearns

Glen W Petrie

David A Jared

Matthew G Gorbet

Kenneth H P Chang

Sven E Karlsson

Patrick Chiu

Lynn D Wilcox

Jun Miyazaki

Matt Gorbet

Shilajeet Banerjee

W Glen Petrie

Makoto Sasaoka

Thomas M Webster

Recorded video is accessed from printed notes or summaries derived from the video. Summaries may be created automatically by analyzing the recorded video, and annotations are made by a user on a device for note-taking with digital ink and video. The notes and/or summaries are printed along with data glyphs that provide time based indexes or offsets into the recorded video. The indexes or offsets are retrieved by scanning the glyph on the printout. The glyph information can be embedded in the printouts in many ways. One method is to associate block glyphs with annotations or images on the printed pages. Another method is to provide an address carpet in an annotated timeline. Yet another method is to provide a two-dimensional address carpet with X-Y position mapped to time which can be used to provide selected access to the video. The accessed video may be played back on the note-taking device on a pen computer, or on a summary interface on a Web browser-type device.

System and method for video access from notes or summaries

An embedded data code comprises periodic tiles having occlusions. In one embodiment, each tile is comprised of glyphs encoding a first code system. The occlusions are comprised of information, such as glyphs encoding a second code system, graphics, or text. The occlusions may occur periodically in each tile. A reading device may be used to capture an image of a portion of the substrate that includes a tile. A processor then analyzes the image to determine the tile code pattern and decode the tiled code.

Method and apparatus for implementing occlusion glyph code tilings

A system and method for generating information based on decoded embedded data from a substrate is implemented by reading embedded data from a substrate, decoding the embedded data to determine registration of the substrate relative to a reference in an apparatus, and developing and presenting human-sensible information based on the registration information. In one embodiment, the human-sensible information is visual information registered with the substrate. The human-sensible information may also comprise, for example, tactile, audible, or other sensory information.

Operations on images having glyph carpets

A viewport lens displays registered information registered using embedded data. An image capture device captures an image from the substrate that includes embedded data. The embedded data in the captured image is decoded to create information regarding the substrate, such as location, orientation, or a label. Based on the information regarding the substrate, information is generated that is registered with the substrate. In one embodiment, the information is registered with the substrate by optically combining the generated information with substrate information in a viewport lens.

Method and apparatus for display of spatially registered information using embedded data

A mouse incorporating a camera captures an image of embedded data from a substrate under the mouse. The embedded data in the image is decoded to determine address or location information coded in the embedded data. Based on the decoded information and other user input signals, such as mouse button selection signals, the computer executes operations. The mouse also has a display controlled by the computer for providing visual feedback to a user. The display might generate an image of the substrate area under the mouse, making it appear to the user as if they are looking through the mouse directly onto the substrate. The display may also generate visual feedback regarding operations occurring in the computer, such as selection or other computer operations.

Method and apparatus for implementing a camera mouse

A method of decoding a plurality of glyphs comprising the steps of scanning a group of glyphs to form image data for expected glyph locations, assigning for each location a first value indicative of the likelihood that location contains a glyph in a first state, assigning for each location a second value indicative of the likelihood that location contains a glyph in a second state, determining the difference between the first and second values for each potential glyph location, establishing a distribution analysis of the determined differences and using that distribution analysis at least in part to control decoding of the plurality of glyphs.

Use of correlation histograms for improved glyph decoding

An angular orientation of a lattice image pattern is found by forming a composite image of superimposed portions of a lattice image by aligning centroids of a lattice element in each portion, and determining a lattice axis from a line fit through centroids of lattice elements in the composite image. The composite image is formed by selecting a seed pixel, finding a local minimum near the seed pixel and then finding a centroid based on the local minimum. From the centroid, it is determined whether the glyph centroid has sufficient contrast to be included in the composite image. The composite image is formed by superimposing subsamples of the lattice image based on glyph centroids. The composite image is then analyzed to determine a lattice axis through centroids in the composite image, and determining a quadrant image based on the lattice axis.

Method and apparatus for decoding angular orientation of lattice codes

A user interface is implemented using visual indicia and a background for the visual indicia that encodes address information. The background appears visually as a stipple pattern, but is implemented using glyphs which form an address carpet that encodes address information uniquely identifying each location of the user interface. An image capture device is used to capture an area of the address carpet that is at or near visual indicia of interest to the user while selecting a location in the visual indicia. The image capture device captures the area of interest, and transmits the image area to a computer for processing. The computer first determines the proper orientation of the image, and then decodes the information encoded by the glyphs. The decoding results in an X, Y address identifying the location of the captured area in the address carpet and, by reference, the address of the selected location. Based on the address, the computer may perform an operation associated with the area.

Glyph address carpet methods and apparatus for providing location information in a multidimensional address space

A camera pen is made from a pen-like housing contains a camera and has a button for sending a signal to a computer which directs the camera to capture an image. The pen-like housing includes landing gear on one end. The landing gear has an opening which forms a flat surface that is angled such that when a user places the camera pen on a surface, the angle at which the pen rests on the surface is ergonomically comfortable for the user. Furthermore, the camera is oriented toward the opening so that when the user presses the button indicating a desire to capture an image, the camera captures the image in the opening. By combining a camera with a pen-like device, the user can comfortably capture image information from a surface.

Methods and apparatus for camera pen

A captured image includes a portion of a set of two-dimensional address codes. The portion of address codes can be decoded to determine a discrete pointer uniquely defining the portion. The captured image is first processed to determine the orientation of the portion, and then decoded based on the orientation to determine the discrete pointer. To determine the orientation of the portion, the portion is first analyzed to determine values at discrete locations within the portion. The values at each location form a matrix of binary data. The values of the matrix are then correlated to determine an orientation of the captured portion of two dimensional address codes. After determining the orientation of the portion, the values can be further analyzed to determine a discrete pointer that identifies the location of the portion within the address space defined by the two-dimensional address codes.

Methods and apparatus for robust decoding of glyph address carpets

An optically readable record for storing encoded information comprises (1) a recording medium, (2) a self-clocking data code for encoding the information, with this data code being composed of glyphs that are written in a two dimensional code field on the recording medium on centers that are spatially distributed in nominal accordance with a predetermined spatial formatting rule. The glyphs are defined by respective symbols that are selected from a finite set of optically discriminable symbols to encode the information. Further, there is at least one additional glyph pattern that is written on the recording medium in nominal accordance with the aforementioned spatial formatting rule, with this additional code pattern being discriminable from the data code and being selected to disambiguate data codes that are rotated and/or reflected.

Orientational disambiguation for self-clocking glyph codes

A self-clocking glyph code is provided for encoding n-bit long digital values (where n&gt;1) in a logically ordered sequence of composite glyphs that are written, printed, or otherwise recorded on a hardcopy recording medium in accordance with a predetermined spatial formatting rule. As used herein, a 'composite glyph' is a graphical symbol that has a plurality of predefined, substantially orthogonal, graphical characteristics; each of which is capable of assuming any one of a plurality of predefined graphical states. An n-bit long digital value is distributively encoded in a glyph of this type by decomposing its n-bits, prior to or during the encoding, into a plurality of shorter, ordered, non-overlapping bit strings. The digital values of these bit strings, in turn, are encoded in the states of respective graphical characteristics of the composite glyph in a predetermined logical order, thereby preserving the logical ordering of the bit strings.

Self-clocking glyph code having composite glyphs for distributively

An optically readable record for storing encoded information comprises (1) a recording medium, (2) a self-clocking data code for encoding the information, with this data code being composed of glyphs that are written in a two dimensional code field on the recording medium on centers that are spatially distributed in nominal accordance with a predetermined spatial formatting rule, where the glyphs are defined by respective symbols that are selected from a finite set of optically discriminable symbols to encode the information, and (3) a self-clocking synchronization code pattern that is written on the recording medium to fully frame at least a portion of the data code, with this the synchronization code pattern defining multiple paths of self-clocking glyphs for reaching any given glyph of synchronization code pattern from any other glyph thereof.

Framing codes for robust synchronization and addressing of self-clocking

An optically readable record for storing encoded information comprises (1) a recording medium, (2) a self-clocking data code for encoding the information, with this data code being composed of glyphs that are written in a two dimensional code field on the recording medium on centers that are spatially distributed in nominal accordance with a predetermined spatial formatting rule, where the glyphs are defined by respective symbols that are selected from a finite set of optically discriminable symbols to encode the information, and (3) at least one additional glyph pattern that is written on said recording medium in nominal accordance with the spatial formatting rule, the additional code pattern providing physical addressing information for random access from any given location within the glyph pattern to any other given location within the same glyph pattern or another glyph pattern on the same or a differnt recording medium.

Growing community of inventors

Woodside, CA, United States of America

L Noah Flores