Honda Motor Co., Ltd.

Honda Giken Kogyo Kabushiki Kaisha

Victor Ng-Thow-Hing

Cuong Tran

Karlin Y Bark

Hector H Gonzalez-Banos

Behzad Dariush

Lee Beckwith

Timothy Michael Stutts

Kikuo Fujimura

Nuri Kim

Darryl Gerard Thelen

Joel A Wormer

Tom Zamojdo

Chris Grabowski

Ravi Kiran Sarvadevabhatla

Jingyu Yan

Pengcheng Luo

Qingquan Wu

Kris Hauser

Allen Y Yang

Jianbo Peng

Evan Drumwright

Wei Shao

Srinath Sridhar

Thor List

Kristinn R Thorisson

A method and system for providing augmented reality based directions. The method and system include receiving a voice input based on verbal cues provided by one or more vehicle occupants in a vehicle. The method and system also include receiving a gesture input and a gaze input based on gestural cues and gaze cues provided by the one or more vehicle occupants in the vehicle. The method and system additionally include determining directives based on the voice input, the gesture input and the gaze input and associating the directives with the surrounding environment of the vehicle. Additionally, the method and system include generating augmented reality graphical elements based on the directives and the association of the directives with the surrounding environment of the vehicle. The method and system further include displaying the augmented reality graphical elements on a heads-up display system of the vehicle.

System and method for providing augmented reality based directions based on verbal and gestural cues

Multi-level navigation monitoring and control is provided. A system includes a lane marking manager determining a first boundary line, a second boundary line, and a centerline of a current lane of travel. The system also includes a confidence level determiner assigning a first confidence level to the first boundary line, a second confidence level to the second boundary line, and a third confidence level to the centerline. Further, the system includes a user interface outputting representations of the first boundary line, the second boundary line, and the centerline based, at least in part, on the first confidence level, the second confidence level, and the third confidence level.

Multi-level navigation monitoring and control

One or more embodiments of techniques or systems for managing locations are provided herein. According to one embodiment, a system includes a heads up display (HUD) that receives an image associated with a location. The image may be captured by a camera of a vehicle. The system also includes a sensor component that detects a physical gesture performed by a user. Furthermore, the system includes an action component that correlates the physical gesture with an action associated with the image. The action component also performs the action. The action is one of saving the image to a storage component or deleting the image.

Managing points of interest

Various exemplary embodiments relate to a command interpreter for use in a vehicle control system in a vehicle for interpreting user commands, a vehicle interaction system including such a command interpreter, a vehicle including such a vehicle interaction system, and related method and non-transitory machine-readable storage medium, including: a memory and a processor, the processor being configured to: receive, from at least one human via a first input device, a first input having a first type; receive a second input having a second type via a second input device, wherein the second type comprises at least one of sensed information describing a surrounding environment of the vehicle and input received from at least one human; interpret both the first input and the second input to generate a system instruction; and transmit the system instruction to a different system of the vehicle.

Interpretation of ambiguous vehicle instructions

A vehicle-to-vehicle communication system providing a spatiotemporal look ahead and method thereof is provided. A trailing vehicle having a look ahead capability can communicate with a preceding vehicle. The preceding vehicle can measure a distance to a leading vehicle and provide that information through vehicle-to-vehicle communications to the trailing vehicle. The trailing vehicle can then display an augmented reality indicator above the vehicle through its head-up display indicating how far the leading vehicle is in front of the preceding vehicle. An icon representing the leading vehicle can be displayed within the augmented reality indicator representing the leading vehicle. Braking actions by the leading vehicle can be communicated to the trailing vehicle through the augmented reality indicator.

Vehicle-to-vehicle communication system providing a spatiotemporal look ahead and method thereof

A system and method for interaction in a vehicle includes establishing a bi-directional interaction session between a first display and a second display via a communication link, wherein each of the first display and the second display are communicatively coupled to the vehicle and the first display is operated by a first user and the second display is operated by a second user. Upon receiving a first interaction input associated generating a first augmented reality object based on the first interaction input and transmitting via the communication link the first augmented reality object to the second display. Upon receiving a second interaction input, generating a second augmented reality object based upon the second interaction input and transmitting via the communication link the second augmented reality object to the first display.

System and method for in-vehicle interaction

A vehicle having a sensor and a head-up display is provided. The sensor can detect pedestrians at an intersection. The head-up display can depict an augmented reality indicator represented as the intersection and the pedestrians. The augmented reality indicator can be displayed directly in a driver's field of view centralized to provide a situational environment for the driver. The head-up display can show pedestrians outside the driver's field of view.

Pedestrian intersection alert system and method thereof

A system for warning of potential hazards when a vehicle is turning has a sensor coupled to the vehicle and configured to capture data of objects located around the vehicle. A control unit is coupled to the sensor for processing the data captured by the sensor to generate graphical representations of objects captured by the sensor, graphical representations of projected paths of moving objects captured; and a graphical representation of a projected turning path of the vehicle.

System and method for warning a driver of pedestrians and other obstacles when turning

Navigating through objects or items in a display device using a first input device to detect pointing of a user's finger to an object or item and using a second input device to receive the user's indication on the selection of the object or the item. An image of the hand is captured by the first input device and is processed to determine a location on the display device corresponding to the location of the fingertip of the pointing finger. The object or the item corresponding to the location of the fingertip is selected after the second input device receives predetermined user input from the second input device.

Information query by pointing

A method and system for providing situational awareness in a vehicle. The method and system include receiving environmental sensor data and vehicle performance sensor data. The method and system also include compiling the environmental sensor data and the vehicle performance data. The method and system additionally include determining one or more situational risks that are posed to the vehicle that occur within a surrounding environment of the vehicle based on the compiled environmental sensor data and the vehicle performance data. The method and system further include generating one or more projected graphical objects that represent the one or more situational risks that are determined to be posed to the vehicle.

System and method for providing situational awareness in a vehicle

A system for indicating braking intensity to a main vehicle has an observational device monitoring positional and speed data of at least one vehicle proximate the main vehicle. A control unit is coupled to the observational device. The control unit processes the positional and speed data monitored by the observational device and generates graphical representations of the at least one vehicle proximate the main vehicle and graphical representations of a braking intensity level of the at least one vehicle proximate the main vehicle.

System and method for warning a driver of a potential rear end collision

A system or method for generating gestures in a robot during generation of a speech output by the robot by analyzing a speech text and selecting appropriate gestures from a plurality of candidate gestures. The speech text is analyzed and tagged with information relevant to generating of the gestures. Based on the speech text, the tagged information and other relevant information, a gesture identifier is selected. A gesture template corresponding to the gesture identifier is retrieved and then processed by adding relevant parameter to generate a gesture descriptor representing a gesture to be taken by the robot. A gesture motion is planned based on the gesture descriptor and analysis of timing associated with the speech, wherein the amplitude, frequency or speed of the selected gesture is modified based on random numbers of specific range depending on the status of the robot. Actuator signals for controlling the actuators such as arms and hands are generated based on the planned gesture motion.

Synchronized gesture and speech production for humanoid robots using random numbers

A heads-up display device for displaying graphic elements in view of a user while the user views an environment through a display screen. The heads-up display device includes at least one projector that projects a graphic element on a dynamic, frontal focal plane in view of the user while the user views the environment through the display screen, and at least one projector that projects a graphic element on a static, ground-parallel focal plane in view of the user while the user views the environment through the display screen. A controller determines a target graphic element position and a graphic element size based on the target graphic element position for the graphic element projected on the frontal focal plane, so as to provide the user with an immersive three-dimensional heads-up display.

Volumetric heads-up display with dynamic focal plane

Generating a virtual model of environment in front of a vehicle based on images captured using an image capturing. The Images captured on an image capturing device of a vehicle are processed to extract features of interest. Based on the extracted features, a virtual model of the environment is constructed. The virtual model includes one or more surfaces. Each of the surfaces may be used as a reference surface to attach and move graphical elements generated to implement augmented reality (AR). As the vehicle moves, the graphical elements move as if the graphical elements are affixed to the one of the surfaces. By presenting the graphical elements to move together with real objects in front of the vehicle, a driver perceives the graphical elements as being part of the actual environment and reduces distraction or confusion associated with the graphical elements.

Growing community of inventors

Sunnyvale, CA, United States of America

Victor Ng-Thow-Hing