The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
May. 14, 2013
Filed:
Dec. 01, 2009
Dae Hee Kim, Seoul, KR;
Dai-jin Kim, Gyeongsangbuk-do, KR;
Jin Lee, Gyeongsangbuk-do, KR;
Jong-ju Shin, Gyeongsangbuk-do, KR;
Jin-seok Lee, Gyeongsangbuk-do, KR;
Dae Hee Kim, Seoul, KR;
Dai-Jin Kim, Gyeongsangbuk-do, KR;
Jin Lee, Gyeongsangbuk-do, KR;
Jong-Ju Shin, Gyeongsangbuk-do, KR;
Jin-Seok Lee, Gyeongsangbuk-do, KR;
Hyundai Motor Company, Seoul, KR;
Kia Motors Corporation, Seoul, KR;
Abstract
The present invention provides a combined lip reading and voice recognition multimodal interface system, which can issue a navigation operation instruction only by voice and lip movements, thus allowing a driver to look ahead during a navigation operation and reducing vehicle accidents related to navigation operations during driving. The combined lip reading and voice recognition multimodal interface system in accordance with the present invention includes: an audio voice input unit; a voice recognition unit; a voice recognition instruction and estimated probability output unit; a lip video image input unit; a lip reading unit; a lip reading recognition instruction output unit; and a voice recognition and lip reading recognition result combining unit that outputs the voice recognition instruction