Shizuoka University

Yoshinobu Ebisawa

A line-of-sight detection device includes a camera, a light source that causes corneal reflection, and an image processing device that obtains information on a pupil shape of an eye, a position of a pupil center, and a position of the cornea reflection and obtains a line of sight of a subject. The image processing device includes a first optical axis acquisition unit that acquires a first optical axis candidate using the position of the pupil center and the position of the cornea reflection, a second optical axis acquisition unit that obtains a second optical axis candidate using the pupil shape, an optical axis information acquisition unit that generates information for acquiring the optical axis, a calibration information unit that provides calibration information, and a visual axis acquisition unit that obtains a visual axis as a line of sight by calibrating an optical axis using the calibration information.

Line-of-sight detection device

A pupil detection system according to an embodiment includes a vector calculation unit configured to calculate a plurality of candidate vectors each connecting a corneal sphere center and a pupil center by a stereo method based on a first pupil image of a subject which is picked up by a first camera and a second pupil image of the subject which is picked up by a second camera, and a determination unit configured to select, from among the plurality of candidate vectors, a candidate vector satisfying a vector condition in which an angle between the pupil center and a reference line is equal to or less than a predetermined threshold and determine that a pupil is located at a pupil center corresponding to the selected candidate vector.

Pupil detection system, gaze detection system, pupil detection method, and pupil detection program

A corneal reflection position estimation system according to an embodiment includes: an image acquisition unit configured to continuously acquire an image of an eye of a subject by controlling a camera equipped with a light source, the image acquisition unit being configured to acquire a plurality of pupil images taken by using light from the light source and then acquire one unilluminated image taken without using light from the light source; and an estimation unit configured to calculate positions of corneal reflection or corneal sphere centers, which correspond to the plurality of pupil images, as reference positions, calculate a movement vector of the corneal reflection or the corneal sphere center based on a plurality of the reference positions, and estimate the corneal reflection position in the unilluminated image based on at least the movement vector.

Corneal reflection position estimation system, corneal reflection position estimation method, corneal reflection position estimation program, pupil detection system, pupil detection method, pupil detection program, gaze detection system, gaze detection method, gaze detection program, face orientation detection system, face orientation detection method, and face orientation detection program

A pupil detection light source device includes an aperture disposed to face a subject to allow light from a pupil of the subject to pass therethrough, an illumination light for obtaining a light pupil image toward the subject from the inside or the vicinity of the aperture when seen from the subject, and an illumination light for forming a reflection image with glasses obtained by canceling a reflection image with glasses of the light pupil image using an image difference toward the subject from the inside or the vicinity of the aperture when seen from the subject.

Pupil detection light source device, pupil detection device and pupil detection method

A pupil detection method includes a step of acquiring images by taking a facial image of a subject using each of a left camera and a right camera, a step of extracting one or more image candidate points serving as candidates for pupils from the images, a step of extracting points corresponding to a combination of image candidate points corresponding to the same point in a three-dimensional space as space candidate points, a step of selecting a pair of two space candidate points from the extracted space candidate points and calculating a distance between the selected pair, a step of excluding a pair of space candidate points where the calculated distance is not within a specified range, and a step of determining one or more pairs of space candidate points from the pairs not excluded and determining that a pair of pupils of the subject exist at the positions.

Pupil detection method, corneal reflex detection method, facial posture detection method, and pupil tracking method

A gaze point detection devicehas four cameras, light sources, control circuits, and an image processor. The image processorcalculates vectors r, each of which is from a corneal reflection point to the center of a pupil, on a plane that is vertical to base lines. The image processoralso calculates angles &#x3b8; of the line of sight on the basis of the vectors r and by using a function f including M parameters. Moreover, the image processordetermines the M parameters based on the angles &#x3b8;, and detects a point of gaze Q based on the line of sight direction calculated using the determined parameters. The number of cameras is set at M&#xd7;&#xbd; or higher.

Method for detecting point of gaze and device for detecting point of gaze

A gaze point detection devicecomprises two stereo camerasfor acquiring a face image of a subject A, light sourcesdisposed on the outside of apertures, a control circuit, and an image processor. The image processorcalculates a vector r from a corneal reflection point to a pupil on a plane perpendicular to reference lines of the stereo cameras, computes an angle &#x3b8; of lines of sight of the subject A with respect to the respective reference lines by using a function f, corrects the function fsuch that directions of lines of sight are closer to each other, and calculates the line of sight directions to detect a gaze point Q on a display screen.

Gaze point detection method and gaze point detection device

An autism diagnosis support apparatusaccording to the present invention is an autism diagnosis support apparatus that detects a symptom of autism based on a state of a subject looking at a target, including: an eye-gaze point detection unitthat detects a line-of-sight direction of the subject looking at the target; a color camerathat takes an image of the target; a pupil position detection unitthat measures a pupil coordinate of the target; and a data analysis unitthat calculates a relationship between the line-of-sight direction of the subject and a pupil position of the target using the line-of-sight direction and the pupil coordinate and outputs the relationship along with the image of the target.

Autism diagnosis support apparatus

A pupil detection device includes a camera, a light source disposed at the camera, an optical system, and an image processing system, which are disposed so that the examinee's face is irradiated with the light from the light source from the camera, and a face image including a pupil is formed in the camera. The light source includes a first light source, having a first wavelength that makes a bright pupil image by reflection in the examinee's pupil, and a second light source having a second wavelength that makes a dark pupil image by reflection in the examinee's pupil, but otherwise exhibiting the same illumination effect as the first light source. The camera includes a first image data acquisition system using the first illumination light source, and a second image data acquisition system using the second illumination light source.

Pupil detection device and pupil detection method

A gaze point detecting devicedetects a gaze point of an object person by projecting a display image displayed by an LCDto outside via a finderand capturing an eye image of the object person by a CCDin response to illumination light irradiated toward outside from the finder, and the device comprises an optical systemarranged spaced only a focal length apart from a display surfaceon an optical path of an image displaying optical system between the LCDand the finder; the optical systembeing arranged on an optical path of an imaging optical system between the finderand the CCD; a telecentric optical system including a diaphragmarranged spaced only a focal length apart from the optical systemon the optical path; and a controllerthat detects a position of the gaze point of the object person based on the eye image captured by the CCD

View point detecting device

An object of the present invention is, when determining a line-of-sight vector of a subject, to identify a three-dimensional position of a pupil center or corneal reflection center thereof. The line-of-sight vector is determined by measuring a distance from a camera to the pupil center or corneal reflection center of the subject using a two-dimensional CMOS distance image sensor by a light time-of-flight method and obtaining position information of the pupil center and corneal reflection center of the subject using the distance image sensor. If a position and a direction of the camera are identified, a camera-pupil center vector is determined from image information of the pupil center of the subject. Since the camera-pupil center distance has been measured, a pupil center position in a three-dimensional space is determined from the above information. Combining this with two line-of-sight vectors determines a position where line-of-sight vectors intersect, or a view-point.

Eyeshot detection device using distance image sensor

Method and device for detecting a line-of-sight of a subject and a three-dimensional view-point measurement device. The method uses a first camera, that measures the position of a pupil relative to a coordinate system, a second camera having a light source arranged at a known position in the coordinate system, and forming a corneal reflection center to obtain data of a size of vector r from the corneal reflection center to the pupil center and an angle &#x3c6; of the vector r relative to a coordinate axis of the coordinate system, and a calculation means for calculating a line-of-sight direction based on information from each camera. In determining a relational formula, a subject is made to gaze at a known point to perform measurement and a relational formula is determined. In a line-of-sight determining stage, the subject is measured again using the relational formula. A three-dimensional view-point measurement device can be configured so as to simultaneously measure the lines-of-sights of both eyes with two cameras and two light sources.

Growing community of inventors

Hamamatsu, Japan

Yoshinobu Ebisawa