Honda Research Institute Europe Gmbh

Honda Motor Co., Ltd.

Matti Krüger

Christiane Wiebel-Herboth

Julian Eggert

Masayuki Sato

Takahiro Matsuoka

Heiko Wersing

Michael Gienger

Tsuyoshi Nojiri

Martin Weigel

A method for assisting a person to perform a task in a dynamic environment comprises a step of acquiring data on the dynamic environment, and of predicting at least one behavior of an object or event in the dynamic environment based on the acquired data. The method proceeds by determining a relevance measure of the at least one behavior of the object or event based on the prediction. Then a modulation signal is generated, wherein the modulation signal changes at least one signal parameter as a function of the determined relevance. The modulation signal is then used to modulate at least one directional stimulus signal, wherein the at least one modulated directional stimulus signal further depends on a direction of the predicted at least one behavior of the object or event with respect to the assisted person. The at least one modulated stimulus signal is then output to the assisted person.

Assistance system with relevance-dependent stimulus modulation

The disclosure regards a method and a system for assisting a person in assessing an environment. The method includes selecting a set of one or more entities present in the environment, obtaining coordinates in the environment and extents of each entity of the set, estimating a location and shape of each entity of the set on the basis of the obtained coordinates and extends of the respective entity, determining an area of interest on the basis of the estimated location and shape of each entity of the set, evaluating the area of interest with respect to one or more variables of interest in order to evaluate a deviation between a current state of the area of interest and a target state, and communicating the deviation from the target state to the person using coherent stimuli for stimulating the person's body.

Method and system for assisting a person in assessing an environment

The method for assisting a person in operating in a dynamic environment may form part of a mobility assistance system. The method comprises a step of acquiring sensor data comprising a time sequence of at least two consecutive images of the dynamic environment from at least one sensor, for example a camera. Optical flows are calculated based on the at least two consecutive images. Feature scores associated to spatial positions for selected regions in an image space are determined in order to generate a feature score field. An output signal including directional stimulus information is generated based on the generated feature score field, wherein the directional stimulus information comprises information on relative spatial relations between the selected regions. The generated output signal is provided to at least one actuator, which signals the directional stimulus information to the person.

Optical flow based assistance for operation and coordination in dynamic environments

A method for assisting operation of an ego-vehicle in addressing a dynamic environment in which at least one further traffic object is present, an assistance system and a vehicle are provided. Information on the presence of the at least one other traffic object in the environment of the ego-vehicle is obtained. Then, information whether the other traffic participant has detected the ego-vehicle is obtained. Based on this information, a signal including information about whether the other traffic participant has detected the ego-vehicle is generated and supplied to an output device. An output signal is output based on the information whether the other traffic participant has detected the ego-vehicle, such that a parameter of the output signal is indicative of a detection probability of the detection of the ego-vehicle by the other traffic participant, an elapsed time since the detection and/or a complexity of the dynamic environment.

Method for assisting operation of an ego-vehicle, method for assisting other traffic participants and corresponding assistance systems and vehicles

The invention assists a person in acting in a dynamic environment. A method and a system for assisting a person operating an ego-vehicle a person supporting the operation of the ego-vehicle in a dynamic environment such as a traffic environment is proposed. The method encompasses determining a gaze direction of the person and identifying a target object based thereon, generating prediction information predicting a future behavior of the target object and the ego-vehicle, estimating a time-to-event or a distance or a distance variation for the ego-vehicle and the target object and generating a signal for driving an actuator and indicative of the estimated time-to-event, distance or distance variation. The actuator causes a stimulation being perceivable by the person by its perceptual capabilities based on the generated signal. The method determines whether assistance for assessing the dynamic situation is requested, for example by monitoring a gaze behavior of the person.

Gaze-guided communication for assistance in mobility

The invention regards a method and a system for assisting a person in acting in a dynamic environment. At first, information on states at least two entities in a common environment is obtained. A future behaviour of each of the entities is then predicted based on the obtained information and a time to event for at least one predetermined event involving the at least two entities and a position of occurrence of the event relative to the person is estimated. Then, a signal indicative of the relative direction of the predicted event with respect to the person and indicative of the time to event for driving an actuator is generated, the signal causing a stimulation being perceivable by the person by its perceptual capabilities, wherein the time to event is encoded such that the signal's saliency is the higher the smaller the time to event is.

Growing community of inventors

Offenbach, Germany

Matti Krüger