Seiko Epson Corporation

Jia Li

Guoyi Fu

Mikhail Brusnitsyn

Eunice Poon

Irina Kezele

Qadeer Baig

Seungsik Kwak

Hui Zhou

Yang Yang

Shinya Sato

Syed Alimul Huda

Dibyendu Mukherjee

Hiu Lok Szeto

Margarit Simeonov Chenchev

Sujay Sukumaran

A method of determining and displaying movement of an object in an environment using a moving camera includes identifying later environment features located in the environment in a later image, earlier environment features located in the environment in an earlier image, and earlier object features located on the object in the earlier image. The method further includes estimating object features in the later image using the earlier object features and a determined camera movement. The method further includes locating, in the later image, matched object features that are actual object features in the later image at a same location as the estimated object features. The method further includes determining that the object has moved between the earlier image and the later image if a number of matched object features does not exceed a threshold.

Dynamic object tracking

A head-mounted display, a method, and a non-transitory computer readable medium are provided. An embodiment of a method for obtaining training sample views of an object includes the step of storing, in a memory, multiple views of an object. The method also includes the step of deriving similarity scores between adjacent views and then a sampling density is varied based on the similarity scores.

Adaptive sampling of training views

A head-mounted display device includes an image display section, an imaging section, an image setting section configured to set an image, an operation input section, an object specification section configured to derive a spatial relationship of a specific object included in an imaged outside scene with respect to the imaging section, and a parameter setting section. The image setting section causes the image display section to display a setting image based at least on the derived spatial relationship and a predetermined parameter group so as to allow a user to visually perceive the setting image, and the parameter setting section adjusts at least one parameter in the parameter group so as to allow the user to visually perceive a condition that at least a position and pose of the setting image and those of the specific object are substantially aligned with each other.

Controlling a display of a head-mounted display device

A method comprising: acquiring, from a camera, a video sequence of a real object; deriving a pose of the real object included in at least one image frame using a 3D model corresponding to the real object in the case where the at least one image frame is selected from the video sequence; tracking or deriving the pose of the real object included in image frames in the video sequence in forward and/or backward directions from the at least one image frame; and storing, for at least one of the tracked or derived pose, appearance information obtained from the corresponding image frame and data of a 2D model obtained from a projection of the 3D model using the corresponding tracked pose so that the appearance information and the data of the 2D model are associated with the corresponding tracked or derived pose.

Methods and systems for training an object detection algorithm

A head-mounted display device includes an image display section, an imaging section, an image setting section, an object specification section configured to specify a specific object from within an outside scene captured by the imaging section, and a parameter setting section. The image setting section causes the image display section to display a marker image. After the parameter setting section determines that a user's head is substantially in a static condition, the image setting section provides information on time left for the imaging section to capture the outside scene. The parameter setting section obtains an image captured by the imaging section when the time expires.

A head-mounted display device includes an image display having an optical element to transmit light from an outside scene, a display element to display an image, a camera, a memory configured to store data of a marker image, and one or more processors. The one or more processors display an image on the image display and derive at least one of a camera parameter of the camera and a spatial relationship, based at least on an image that is captured by the camera in a condition that allows a user to visually perceive that the marker image displayed by the image display and a real marker corresponding to the marker image align at least partially with each other. The real marker includes a first set of feature elements within a rectangle, and the marker image includes a second set of feature elements.

Head-mounted display device and computer program

A head-mounted display device includes an image display section configured to display an image, an imaging section, a memory section configured to store data of a marker image, an image setting section configured to cause the image display section to display an image based at least on the data, and a parameter setting section. The parameter setting section derives at least one of camera parameters of the imaging section and a spatial relationship, the spatial relationship being between the imaging section and the image display section, based at least on an image that is captured by the imaging section in the case where the imaging section acquires a captured image of a real marker.

A virtual image display device configuring a display device includes a display section configured to display an image while enabling visual recognition of an outside scene. The virtual image display device includes an image pickup section configured to pickup an image in an image pickup range that overlaps a range visually recognized through the display section. The virtual image display device includes a coupling section including at least one movable section and configured to couple the image pickup section to the display section. The display device is capable of acquiring a motion amount in the movable section with a control section.

Display device, control method for display device, and computer program

An image of a scanned book is segmented using a feature image to map pixels corresponding to a page area and to create page objects and detect borders of the page. A book spine region is detected by locating a plain background area between two of the page objects, analyzing the page borders to detect their shape, and analyzing their shape to detect the book spine end points. Using the page borders, the feature image is examined to detect top-to-bottom and bottom-to-top declines in pixel values to determine the corners of a shadow distortion in the original scanned image. Squeeze and curvature distortion are also detected. A Bezier curve is used to model each of the three distortions detected on the page. The detected distortion is corrected by first defining a trapezoidal correction area. The intensity, squeeze, and curvature corrections are then applied along lines within the trapezoidal correction area.

Method of detecting and correcting digital images of books in the book spine area

Frontal face images are classified into four categories such as Asian, Caucasian, African and others. A new representation of face appearance, named BITF (Block Intensity and Texture Feature), is employed as the discrimination feature. An ensemble of three component classifiers, each trained with a different number of BITF features as inputs, is designed to achieve a reliable classification. Further reliability is obtained by taking into consideration other secondary features to boost the classification performance.

Ethnicity classification using multiple features

The present invention is a system and method for decoding an image of a bar code. Decoding the barcode includes tokenizing a plurality of pixels in the image of the barcode based upon a plurality of thresholds to form a first set of tokens. Decoding the barcode also includes re-tokenizing the plurality of pixels in the image of the barcode based upon the intensity of the pixels in the plurality of tokens, and the relativity intensity of neighboring tokens, to form a second set of tokens.

Method and apparatus for correcting decoding errors in machine-readable symbols

The present invention is directed towards systems and methods for decoding a bar code. Decoding the bar code includes segmenting the bar code into black tokens, white tokens and gray boundary pixels. Decoding the bar code also includes calculating a boundary position of each token with sub-pixel positional accuracy using intensity values of pixels in a boundary region.

Method and apparatus for creating pixel tokens from machine-readable symbols to improve decoding accuracy in low resolution images

Methods and apparatus for detecting skew in a document image, such as a check image, to produce a de-skewed image are described. One example method includes detecting one or more lines in the image and determining whether the one or more lines are reliable. Reliability of a line may be based on at least one of line length, straightness, and the presence of holes in the line. If one or more lines are reliable, the method may calculate a skew angle of the image based on the one or more reliable lines' orientations with respect to an orientation of the image. A comparison may also be made between lines detected in different regions of the check to determine if a difference between skew angles corresponding to each of the compared lines is lower than an error threshold.

Growing community of inventors

Aurora, Canada

Jia Li