Midea Group Co., Ltd.

Haibin Huang

Chen Zhang

Xin Liu

Dongyan Wang

Chi Zhang

Xiaofeng Xu

A natural language processing (NLP) apparatus includes a housing, a built-in voice input interface; a built-in data communication interface configured to establish data communication with multiple types of appliances; a built-in NLP module, and a built-in control device. A first voice input is received through the built-in voice input interface; if the target appliance is a first appliance of a first appliance type, the first voice input is processed using a first NLP model of the built-in NLP module to obtain a first machine command, and the first machine command is sent via the built-in data communication interface to the first appliance; and if the target appliance is a second appliance of a second appliance type, the first voice input is processed using a second NLP model of the built-in NLP module, and the second machine command is sent via the built-in data communication interface to the second appliance.

System and method for providing portable natural language processing interface across multiple appliances

A method and system of customizing a portable voice-based control user interface for multiple types of appliances are disclosed. The method performed at a user device includes establishing a data communication connection with a voice control apparatus; detecting a first user request to update a NLP module of the voice control apparatus; establishing a connection to a NLP model server; displaying a listing of appliance types and a respective listing of appliance functions for each appliance type, in a graphical user interface of the user device; receiving user selection of a first set of appliance functions for a first appliance type and a second set of appliance functions for a second appliance type; downloading, from the NLP model server, a first NLP model for the first set of appliance functions for the first appliance type, and a second NLP model for the second set of appliance functions for the second appliance type; and integrating the first NLP model and second NLP model into the NLP module of the voice control apparatus.

System and method for customizing portable natural language processing interface for appliances

A method and system of controlling a digital assistant with dynamically switchable endpoint devices, comprising: dynamically selecting a respective input endpoint device and a respective controlled device for each of a plurality of voice-based requests from a user to the computing system, including: at a first point in time, acquiring respective instances of a first voice input from a first set of two or more input endpoint devices; obtaining a representative copy of the first voice input based on the respective instances of the first voice input that have been acquired from the first set of two or more input endpoint devices; determining a first actionable intent based on the representative copy of the first voice input; and dispatching a first encoded instruction to a first controlled endpoint device selected from the plurality of controlled endpoint devices in accordance with the first actionable intent.

Voice-based user interface with dynamically switchable endpoints

A method and system of providing a portable voice-based control user interface for multiple types of appliances are disclosed. The method includes activating a built-in voice communication interface of a voice control apparatus; selecting a first target appliance to receive voice-based commands; receiving a first voice input; in accordance with a determination that the first target appliance is a first appliance of a first appliance type, processing the first voice input using a first NLP model corresponding to the first appliance type to obtain a first machine command, and sending the first machine command to the first appliance; and in accordance with a determination that the first target appliance is a second appliance of a second appliance type, processing the first voice input using a second NLP model corresponding to the second appliance type to obtain a second machine command, and sending the second machine command to the second appliance.

Growing community of inventors

San Jose, CA, United States of America

Haibin Huang