Softbank Robotics Europe

Aldebaran Robotics

Aldebaran Robotics S.a

David Houssin

Jérôme Monceaux

Gabriele Barbieri

Bruno Maisonnier

Gwennaël Gate

Taylor Veltrop

Alexandre Mazel

Jean Testard

Ilmo Gourdin

Magali Patris

Rémy Pataillot

Jocelyn Martin

Remy Pataillot

A method of handling a software application on a robot comprising a plurality of installed software application, a software application being associated with a predefined semantic description, the method comprises the steps of extracting one or more patterns from an audio dialog with a human user; an audio dialog comprising sentences and a pattern comprising predefined sentences; comparing one or more patterns with the semantic descriptions of the software applications; selecting a software application based on the performed comparisons; and executing the selected software application. Described developments comprise software application execution rules, predefined or dynamically defined execution rules, the audio listing of the installed applications depending on environmental parameters, the optional use of complimentary display means and the installation of a missing application. Associated systems are described.

Executing software applications on a robot

A method of performing dialog between a humanoid robot and user comprises: i) acquiring input signals from respective sensors, at least one being a sound sensor and another being a motion or image sensor; ii) interpreting the signals to recognize events generated by the user, including: the utterance of a word or sentence, an intonation of voice, a gesture, a body posture, a facial expression; iii) determining a response of the humanoid robot, comprising an event such as: the utterance of a word or sentence, an intonation of voice, a gesture, a body posture, a facial expression; iv) generating, an event by the humanoid robot; wherein step iii) comprises determining the response from events jointly generated by the user and recognized at step ii), of which at least one is not words uttered by the user. A computer program product and humanoid robot for carrying out the method is provided.

Method of performing multi-modal dialogue between a humanoid robot and user, computer program product and humanoid robot for implementing said method

A method for performing a dialog between a machine, preferably a humanoid robot, and at least one human speaker, comprises the following steps, implemented by a computer: a) identifying the human speaker; b) extracting from a database a speaker profile comprising a plurality of dialog variables, at least one value being assigned to at least one of the dialog variables; c) receiving and analyzing at least one sentence originating from the speaker; and d) formulating and emitting at least one response sentence as a function at least of the sentence received and interpreted in step c) and of one dialog variable of the speaker profile.

Method for dialogue between a machine, such as a humanoid robot, and a human interlocutor utilizing a plurality of dialog variables and a computer program product and humanoid robot for implementing such a method

A humanoid robot is provided, the robot being capable of holding a dialog with at least one user, the dialog using two modes of voice recognition, one open and the other closed, the closed mode being defined by a concept characterizing a dialog sequence. The dialog may also be influenced by events that are neither speech nor a text. The robot is capable of executing behaviors and generating expressions and emotions. It has the advantage of considerably reducing programming time and latency of execution of dialog sequences, providing a fluency and naturalness close to human dialogs.

Robot capable of incorporating natural dialogues with a user into the behaviour of same, and methods of programming and using said robot

A computer-implemented method of handling an audio dialog between a robot and a human user comprises: during the audio dialog, receiving audio data and converting the audio data into text data; in response to the verification of one or more dialog mode execution rules of the text data, selecting a modified dialog mode; wherein a dialog mode comprises one or more dialog contents and one or more dialog voice skins; wherein a dialog content comprises a collection of predefined sentences, the collection comprising question sentences and answer sentences; and wherein a dialog voice skin comprises voice rendering parameters comprising frequency, tone, velocity and pitch. Described developments comprise modifying dialog contents and/or dialog voice skin, using dialog execution rules (for example depending on the environment perceived by the robot) and moderating dialog contents.

Methods and systems of handling a dialog with a robot

A humanoid robot is provided with a manager for its physical and virtual resources, a method of use and a method for programming said manager. Said resources () are requested so as to execute behaviors. The resources and the behaviors are organized into hierarchical subsets, optionally defined in object trees. Conflicts of use of the resources by the behaviors are resolved locally, the behavior reserving resources being able to be programmed so as to offer options to the user of locking the resources by the reserving behavior, of release in favor of the first other requesting behavior, of partial execution of the behavior in progress or of pausing. A software toolkit makes it possible to program the Resource manager of the invention in a graphical manner in the development environment which allows the programming of the behaviors.

Growing community of inventors

Paris, France

David Houssin