Image-linked sound output method and device

Abstract

A player can be notified both visually and aurally that his/her action is recognized. A velocity vector-calculating unit calculates a velocity vector of the movement of an object manipulated by a player moving toward an assumable contact surface W by using an image of the movement of the player captured by a camera. A travel time calculating unit calculates the travel time required for the object to reach the contact surface W by using the velocity vector and a distance between the object and the contact surface W. A lag time acquisition unit acquires a lag time that sound output from a speaker takes to reach the player. A sound control unit allows the player to hear the sound substantially at the same time the object contacts the contact surface by outputting a predetermined sound after the time passes which is obtained by subtracting the lag time from the travel time.