Social and scene target awareness and adaptation of an occlusion system for increased social and scene interaction in an optical see-through augmented reality head mounted display

Abstract

To improve the social interaction and interaction with external objects for a user wearing an AR head-mounted display (HMD), cameras on the HMD detect that other users ('social targets') are looking at and/or speaking to the user. The region around the social target in the AR user's view is determined and in response an optical occlusion system in the HMD is changed to allow more outside light to reveal the HMD user's eyes to the other users, The HMD optionally decreases the brightness of the virtual images presented in the HMD to allow the HMD user to improve his real world social and scene interaction.