The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Feb. 20, 2018

Filed:

Nov. 10, 2015
Applicants:

Nanjing University, Nanjing, CN;

College of William and Mary, Willamsburg, VA (US);

Inventors:

Lei Xie, Nanjing, CN;

Yafeng Yin, Nanjing, CN;

Qun Li, Williamsburg, VA (US);

Sanglu Lu, Nanjing, CN;

Assignees:

NANJING UNIVERSITY, Nanjing, CN;

COLLEGE OF WILLIAM AND MARY, Williamsburg, VA (US);

Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G06F 3/042 (2006.01); G06T 5/30 (2006.01); G06T 7/00 (2017.01); H04N 5/225 (2006.01); G06T 7/40 (2017.01); G06K 9/00 (2006.01); G06K 9/38 (2006.01); G06K 9/46 (2006.01);
U.S. Cl.
CPC ...
G06T 5/30 (2013.01); G06F 3/0426 (2013.01); G06K 9/00355 (2013.01); G06K 9/38 (2013.01); G06K 9/4652 (2013.01); G06T 7/004 (2013.01); G06T 7/0081 (2013.01); G06T 7/0085 (2013.01); G06T 7/408 (2013.01); H04N 5/2257 (2013.01); G06T 2207/10016 (2013.01); G06T 2207/10024 (2013.01); G06T 2207/30196 (2013.01);
Abstract

Systems, methods and techniques are provided for interacting with mobile devices using a camera-based keyboard. The system comprises a processor system including at last one processor. The processor system is configured to at least capture a plurality of images in connection with the keyboard and at least one hand typing on the keyboard via the camera. Based on the plurality of captured images, the processor system is further configured to locate the keyboard, extract at least a portion of the keys on the keyboard, extract a hand, and detect a fingertip of the extracted hand. After that, a keystroke may be detected and localized through tracking the detected fingertip in at least one of the plurality of captured images, and a character corresponding to the localized keystroke may be determined.


Find Patent Forward Citations

Loading…