Fujitsu Corporation

Carnegie Mellon University

Koichiro Niinuma

Takashi Shinzaki

Takahiro Matsuda

Taichi Murase

Teruyuki Sato

Atsunori Moteki

Toshiyuki Yoshitake

Akinori Taguchi

Jeffrey F Cohn

Masafumi Tada

Laszlo A Jeni

Itir Onal Ertugrul

Hiroyuki Kobayashi

Yukihiro Abiko

Satoshi Semba

Shigefumi Yamada

Motonobu Mihara

Yuushi Toyoda

Nobuyuki Hara

Kazuya Uno

Yoshihide Fujita

Ryosuke Kawamura

Arata Shimizu

Masahiro Hirata

Masao Hirocho

Kazutoshi Sakaguchi

Masayuki Nishino

A method may include obtaining a dataset including a target Action Unit (AU) combination and labeled images of the target AU combination with at least a first category of intensity for each AU of the target AU combination and a second category of intensity for each AU of the target AU combination. The method may also include determining that the first category of intensity for a first AU has a higher number of labeled images than the second category of intensity for the first AU, and based on the determination, identifying a number of new images to be synthesized in the second category of intensity for the first AU. The method may additionally include synthesizing the number of new images with the second category of intensity for the first AU, and adding the new images to the dataset.

Image synthesis for balanced datasets

A method may include obtaining a base facial image, and obtaining a first set of base facial features within the base facial image, the first set of base facial features associated with a first facial AU to be detected in an analysis facial image. The method may also include obtaining a second set of base facial features within the base facial image, the second set of facial features associated with a second facial AU to be detected. The method may include obtaining the analysis facial image, and applying a first image normalization to the analysis facial image using the first set of base facial features to facilitate prediction of a probability of the first facial AU. The method may include applying a second image normalization to the analysis facial image using the second set of base facial features to facilitate prediction of a probability of the second facial AU.

Image normalization for facial analysis

A non-transitory computer-readable storage medium storing a program that causes a computer to execute a process, the process including obtaining gaze data that indicates a position of a gaze of a user at each of a plurality of times, determining a first movement regarding the gaze of the user based on the gaze data, displaying, on a screen of a display device, gaze information indicating a position of the gaze at each of a plurality of times from a time at which a second movement occurs when the first movement includes the second movement, and displaying, on the screen, gaze information indicating a position of the gaze at each of a plurality of times during a specified time period when the first movement does not include the second movement.

Non-transitory computer-readable storage medium, display control method, and display control apparatus

A non-transitory computer-readable storage medium storing a program that causes a processor of a head mounted display to execute a process, the process includes obtaining a result of measurement performed by an acceleration sensor included in the head mounted display; and determining whether a user with the head mounted display is chewing a food or the user is speaking based on the result of the measurement performed by the acceleration sensor.

Head mounted display, display control device, processing method, display method, and storage medium

A non-transitory computer-readable storage medium storing a program that causes a computer to execute a process including estimating a first three-dimensional position of a wearable display device and a first arrangement of the wearable display device, estimating a second three-dimensional position of the physical object and a second arrangement of the physical object;

Non-transitory computer-readable storage medium, computer-implemented method, and virtual reality system

A degree of interest evaluation device includes a memory and a processor coupled to the memory. The processor is configured to: in cases in which input of an operation has been received while content is displayed on an information processing terminal, measure the operation time of the operation; measure a time-wise change of the content being displayed during the operation time; decide on a message to be displayed in accordance with the time-wise change; and display the message decided on in association with the content.

Degree of interest evaluation device

A recording medium on which a user assistance program is recorded which makes a computer perform: based on image information obtained by photographing a plurality of users who use a given service, calculating state quantities of the plurality of respective users corresponding to the image information; counting, for each time period, a number of users whose amounts of change in the calculated respective state quantities are equal to or more than a given threshold value among the plurality of users; and detecting a time period in which the counted number of users satisfies a given condition.

Recording medium on which user assistance program is recorded, information processing device, and user assistance method

A method of extracting a region in a distance image including pixels, the method includes: for each of adjacent pixel pairs in the distance image, generating a third pixel group that includes a first pixel group to which a first pixel belongs and a second pixel group to which a second pixel belongs based on a difference between pixel values of the first pixel and the second pixel included in the adjacent pixel pair; dividing the distance image into regions by determining whether to generate a third region represented by the third pixel group by merging a first region represented by the first pixel group and a second region represented by the second pixel group, based on a positional relationship of points represented by pixels included in the third pixel group; and selecting a region that satisfies a predetermined condition from among the regions.

Method of extracting a region in a distance image, storage medium, and head mounted display apparatus

A display control method includes: based on information acquired from an information processing terminal that accesses content provided by an information processing device, computing a degree of interest and a degree of perplexity, with respect to the content, of a user using the information processing terminal; and, based on the computed degree of interest and the computed degree of perplexity, displaying a symbol corresponding to the information processing terminal at a corresponding position in a region that has degree of interest and degree of perplexity as axes.

Display control device and method

A computer-readable recording medium storing an intensity of interest evaluation program that causes a computer to execute a procedure is provided. The procedure includes: using a movement amount detection sensor installed to an information processing terminal to detect a value of a movement amount of an information processing terminal in a period in which content is being displayed on the information processing terminal; and evaluating a intensity of interest toward the content based on a length of a first period within the period in which the detected value of the movement amount of the information processing terminal is a predetermined value or less.

Intensity of interest evaluation device, method, and computer-readable recording medium

An image processing apparatus including a memory, and a processor configured to make a display device display an image captured by an image capturing device, measure a time for which a hand region remains still when detecting the hand region in a first specific shape corresponding to a designation operation of designating a part in the image, identify the part designated by the designation operation when the time for which the hand region remains still reaches a predetermined time, and make a display device display an image resulting from execution of predetermined image processing for the identified part when at least one of a hand region in a second specific shape and a specific movement of a hand region is detected in the image captured by the image capturing device.

Image processing apparatus, non-transitory computer-readable recording medium, and image processing method

A device includes a display configured to display images in accordance with a virtual viewpoint position in a virtual reality space, a distance sensor configured to acquire distance information of a distance in a measuring range in a real space from the distance sensor to a hand of a user wearing the device, and a processor. The processor is configured to acquire a hand image of a hand region based on the distance information, the hand region corresponding to the hand, detect a shape of the hand and an inclination of the hand from the hand image, generate, in accordance with the inclination, when the shape of the hand is a first shape, a display image in which the virtual viewpoint position in the virtual reality space has been moved to another virtual viewpoint position, and control the display to display the display image.

Head mounted display device and control method

An image processing device includes a processor; and a memory which stores a plurality of instructions, which when executed by the processor, cause the processor to execute: acquiring an image which includes a first region and a second region of a user; detecting, from a group of candidate areas for the first region and the second region included in the image, the candidate area corresponding to the first region based on biometric characteristics of the first region; determining a connection direction between the first region and the second region based on outer edges of the candidate area corresponding to the first region; and selecting the candidate area corresponding to the second region from the group of candidate areas based on the connection direction.

Hand detection device and hand detection method

Head mounted display with transitional graphical user interface set

A biometric authentication device including: a data-for-matching generation portion generating a data for matching from biometric information; an update-demand determine portion determining whether a registered data registered for matching with the data for matching needs updating or not, based on a difference between biometric quality of the registered data and biometric quality of the data for matching; and a registered data replace portion replacing the registered data by a generated data for updating, according to a determination result of the update-demand determine portion.

Growing community of inventors

Kawasaki, Japan

Koichiro Niinuma