Method and system for ambient intelligence based user interaction

Abstract

This disclosure relates generally to system and method for ambient intelligence based user interaction. Prior methods for touchless user interaction are sensitive to ambient temperature in a lab environment, susceptible to noise from metallic surfaces and ambient radio waves and are dependent on ambient lighting. Embodiments of the present disclosure provides a multi-modal sensor fusion method which captures touchless gestures from a user or a group of users with their physical context information fused and tagged to these gestures for user interaction. Further pose graphs are generated for user interaction systems using a data association technique and Gaussian mixture model technique. The disclosed method provides a hands-free interface to operate instruments in a smart space, using principles of ambient intelligence.