Toyota Motor Engineering & Manufacturing North America, Inc.

Rajiv Dayal

Tiffany L Chen

Douglas Alan Moore

Joseph M A Djugash

Patrick K Ching

Yasuhiro Ota

Christopher P Lee

Kenichi Yamamoto

Brandon D Northcutt

Allison Thackston

Youenn Colin

Fredrick W Mau, Ii

Allison V L Thackston

Nagisa Adachi

A vision-assist device may include at least one image sensor for generating image data corresponding to an environment, a user input device for receiving user input regarding one or more physical characteristics of a user, and a processor. The processor may be programmed to receive the image data from the at least one image sensor, receive the user input from the user input device, and adjust an alignment of the at least one image sensor based on the received image data and the user input. Methods for aligning an image sensor are also provided.

Aligning vision-assist device cameras based on physical characteristics of a user

Systems and methods for communicating with a guide animal are provided. One embodiment of a method includes determining a first command to provide to a user to proceed to a destination, determining a second command to provide to the guide animal to correspond with the first command, and outputting the first command to direct the user toward the destination. Some embodiments include outputting the second command to direct the guide animal toward the destination, where the second command is outputted to be imperceptible by the user but is perceptible by the guide animal.

Systems and methods for communicating with a guide animal

A device for providing guidance or feedback to a user. The device includes a camera configured to detect image data indicating a user performance of an activity. The system includes a guidance unit connected to the camera. The guidance unit is configured to identify the activity based on image processing of the image data or an identification of the activity from the user. The guidance unit is also configured to determine a criteria associated with the activity. The guidance unit is also configured to determine a user performance of the activity based on the image data. The guidance unit is also configured to determine feedback based on a comparison of the criteria and the user performance of the activity, the feedback indicating an improvement or suggestion for the user. The system also includes an output unit connected to the guidance unit, the output unit configured to output the feedback.

System and method for providing guidance or feedback to a user

A system for determining output text based on spoken language and sign language includes a camera configured to detect image data corresponding to a word in sign language. The system also includes a microphone configured to detect audio data corresponding to the word in spoken language. The system also includes a processor configured to receive the image data from the camera and convert the image data into an image based text word. The processor is also configured to receive the audio data from the microphone and convert the audio data into an audio based text word. The processor is also configured to determine an optimal word by selecting one of the image based text word or the audio based text word based on a comparison of the image based text word and the audio based text word.

System and method for providing optimal braille output based on spoken and sign language

A wearable computing device includes an input/output port for communicating with an external mobile device, a microphone for receiving speech data, a speaker for outputting audio feedback data, and a mobile processor. The mobile processor is designed to receive detected speech data corresponding to a request to open an application on the external mobile device, transmit the request to the external mobile device, and receive a description of content within the application from the external mobile device. The mobile processor is also designed to transmit the description to the speaker to be output, receive detected speech data corresponding to a request for the external mobile device to perform an action within the application, and transmit the request to the external mobile device. The mobile processor is also designed to receive results of the action from the external mobile device and transmit the results to the speaker to be output.

Smart necklace with stereo vision and onboard processing

A system for providing, to a user, navigation directions to a point of interest. The system includes a device having an output unit configured to output the navigation directions to the point of interest. The device is configured to communicate, to an unmanned vehicle, a point of interest identification. The system also includes the unmanned vehicle having a camera configured to detect image data. The unmanned vehicle is configured to determine whether the point of interest identification is detected from the image data. The unmanned vehicle is also configured to determine a point of interest location when the point of interest identification is detected from the image data. The unmanned vehicle is also configured to determine point of interest navigation data based on the point of interest location. The unmanned vehicle is also configured to communicate, to the device, the point of interest navigation data.

Systems and methods for providing environment information using an unmanned vehicle

Blind aid device

Vision-assist devices and methods are disclosed. In one embodiment, a vision-assist device includes an image sensor for generating image data corresponding to a scene, a processor, and an auditory device. The processor is programmed to receive the image data from the image sensor, perform object recognition on the image data to determine a classification of a detected object that is present within the scene, and determine a confidence value with respect to the classification of the detected object. The confidence value is based on a confidence that the classification of the detected object matches an actual classification of the detected object. The processor further generates an auditory signal based on the confidence value. The audio device receives the auditory signal from the processor and produces an auditory message from the auditory signal. The auditory message is indicative of the classification of the detected object and the confidence value.

Vision-assist devices and methods of detecting a classification of an object

A wearable computing device includes an input device, a global positioning system (GPS) sensor, an inertial measurement unit (IMU), a camera, and a memory that is designed to store a database of landmarks and corresponding locations. The device includes a mobile processor that is designed to receive first user input indicating that the user is traveling from a starting location to a destination location and second user input indicating that new landmarks are present. The processor is designed to determine locations of the new landmarks based on the current location, the inertial measurement data, and/or the detected image data. The processor is designed to update the database to include the new landmarks and corresponding locations. The processor is designed to update the database to include an ordered list of landmarks including the new landmarks in order of their appearance from the starting location to the destination location.

Wearable system for providing walking directions

A smart necklace includes a first pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a second pod having a proximate connector and a component electrically coupled to the proximate connector that can receive input data or output data. The necklace also includes a curved main unit having a first connector removably, pivotably and electrically coupled to the proximate connector of the first pod and a second connector configured to be removably, pivotably and electrically coupled to the proximate connector of the second pod. The main unit also includes a mobile processor for receiving the input data from at least one of the first pod or the second pod, determining output data based on the input data, and outputting the output data via the first pod or the second pod.

Modular smart necklace

A smart necklace includes a body defining at least one cavity and having a neck portion and first and a second side portions. The necklace includes a pair of stereo cameras that is configured to detect image data including depth information corresponding to a surrounding environment of the smart necklace. The necklace further includes a positioning sensor configured to detect positioning data corresponding to a positioning of the smart necklace. The necklace includes a non-transitory memory positioned in the at least one cavity and configured to store map data and object data. The smart necklace also includes a processor positioned in the at least one cavity, coupled to the pair of stereo cameras, the positioning sensor and the non-transitory memory. The processor is configured to determine output data based on the image data, the positioning data, the map data and the object data.

A wearable smart device for providing hazard warning information to a user. The wearable smart device includes a microphone configured to detect audio data associated with a potential hazard. The wearable smart device also includes a camera configured to detect image data associated with the potential hazard. The wearable smart device also includes a processor coupled to the microphone and the camera and configured to determine whether the potential hazard presents a real hazard based on the detected audio data and the detected image data.

Wearable smart device for hazard detection and warning based on image and audio data

In one embodiment, a method for assisting a visually-impaired user is provided. The method includes determining, based upon an input from at least one sensor, a body position or posture of a user. The method also compares, using a processor, the determined body position to a plurality of body positions or postures to identify whether the determined body position or posture is acceptable. The method further includes providing a feedback signal indicating a change in body position or posture to assist the visually impaired user.

Growing community of inventors

Santa Clara, CA, United States of America

Rajiv Dayal