Method of and apparatus for multi-modal information presentation to computer users with dyslexia, reading disabilities or visual impairment

Abstract

A method of providing language assistance to a computer user with dyslexia, reading disabilities or visual impairment by presenting text-based information via multiple media channels. The method of the present invention includes the steps of: accessing a source of text-based data that can originate from a computer text document, displaying text-based data in a text window with a standard font size, displaying the text-based data in another text window with a magnified font size, sequentially highlighting the text-based data in the magnified text window one word at a time; generating synthesized speech signals representative of the highlighted text; rendering the synthesized speech signals audible synchronously with the displaying of the highlighted text; displaying images that correspond to the context of the highlighted text; and generating sound effects that are pertinent to the context of the highlighted text such that text-based information and corresponding graphical and audible information can be perceived simultaneously by the user. This technique effectively provides multiple channels of information to a user. The present invention is particularly useful for displaying text-based information to users having reading disabilities such as dyslexia, or for increasing the entertainment value of viewing a text document. The present invention may be used for assisting users in editing documents and in retrieving information from the World Wide Web.