User-adaptive restaurant management system

Abstract

A user-adaptive order processing terminal includes a display, a microphone, a configuration manager, and a motion sensor. The display displays electronic menu items in a first area for selection by a user, where the electronic menu items are accessed via selection of one or more sub-menu items. The microphone detects audio spoken by the user. The configuration manager captures the audio from the microphone, transmits the audio via first messages to a backend server, receives second messages from the backend server providing text that corresponds to the audio, accesses suggested menu items that correspond to the text, and modifies a second area of the display to present the suggested menu items for selection, where the suggested menu items would otherwise be presented in the first area through selection of the one or more sub-menu items. The motion sensor subsequently detects distance to and motions performed by the user, where the configuration manager captures movements of the user from the motion sensor, transmit the motions via third messages to the backend server, receives fourth messages from the backend server providing 3-dimensional (3D) gestures that correspond to the movements, and adds one or more of the suggested menu items to an electronic order in accordance with the 3D gestures.