Seiko Epson Corporation

Hiu Lok Szeto

Syed Alimul Huda

Kiever Xiang Chen

Jia Li

Yang Yang

Shinya Sato

Tong Qiu

A method includes acquiring, from the camera, a camera data sequence including a first image frame of a real object in a scene, tracking a pose of the real object with respect to the camera along the camera data sequence, and displaying an XR object on the display by rendering the XR object based at least on the pose. Flag data is set, in a memory area of the at least one memory, indicative of whether or not the displayed XR object is consistent in pose with the real object. The method includes outputting, to a separate computing device having another processor, second image frames in the camera data sequence acquired when the flag data indicates that the displayed XR object is consistent in pose with the real object.

Methods and devices for extended reality device training data creation

A computer program causes a head-mounted display device including an camera and an image display section capable of being transparent at least against light from a scene to realize functions of: an image setting function of displaying, with the image display section, a marker image that is capable of being perceived to be at least partially aligned with a real marker; a detection function of detecting the real marker from an image captured with the camera; a parameter setting function of setting at least one parameter for allowing an AR object displayed with the display section to be perceived to correspond to an object in the scene; a determination function of determining whether a user's head is in a substantially static condition, and a collecting function of collecting, from the image or another image captured with the camera, calibration data that is to be used in the parameter setting function in response to an instruction, in the case where the user's head is determined to be in the substantially static condition by the determination function.

Computer program for calibration of a head-mounted display device and head-mounted display device using the computer program for calibration of a head-mounted display device

A method of detecting an object in a real scene using a computer includes specifying a 3D model corresponding to the object. The method further includes acquiring, from a capture camera, an image frame of a reference object captured from a first view angle. The method further includes generating a 2D synthetic image by rendering the 3D model in a second view angle that is different from the first view angle. The method further includes generating training data using (i) the image frame, (ii) the 2D synthetic image, (iii) the run-time camera parameter, and (iv) the capture camera parameter. The method further includes storing the generated training data in one or more memories.

Training assistance using synthetic images

A method comprising: acquiring, from a camera, a video sequence of a real object; deriving a pose of the real object included in at least one image frame using a 3D model corresponding to the real object in the case where the at least one image frame is selected from the video sequence; tracking or deriving the pose of the real object included in image frames in the video sequence in forward and/or backward directions from the at least one image frame; and storing, for at least one of the tracked or derived pose, appearance information obtained from the corresponding image frame and data of a 2D model obtained from a projection of the 3D model using the corresponding tracked pose so that the appearance information and the data of the 2D model are associated with the corresponding tracked or derived pose.

Methods and systems for training an object detection algorithm

A method tracks a pose of an object in a field of view of a camera; derives movement of the display apparatus or movement in the field of view using at least one of: the sensor data and the image data; determines, using the processor, whether or not the derived movement exceeds a first threshold; if the derived movement exceeds the first threshold, continues tracking the pose of the object; and if the movement does not exceed the first threshold: (1) stops tracking the pose of the object and (2) displays, using the display, the image based on a previously derived pose of the object.

Growing community of inventors

Richmond Hill, Canada

Hiu Lok Szeto