Rensselaer Polytechnic Institute

Jonas Braasch

John T Wen

Utkarsh Sinha

Selmer Bringsjord

Richard J Radke

David Whalen

Daniel C Kruse

Devavrat Jivani

Lu Lu

Nikhil Deshpande

Andrew Cunningham

Pauline Oliveros

Jeffrey Parkman Carter

Gyanendra Sharma

Alana Gloria DeLoach

William H Keddy-Hector

Jonathan Mathews

A time-of-flight (TOF) array including a plurality of cameras is positioned with a coplanar Higher Order Ambisonics (HOA) array including a plurality of microphones above a target area such as a room or space for analyzing speaker activity in that area. The HOA microphone array iteratively samples sound energy level frames captured by the microphones to identify a sound vector associated with the global maximum energy level in the sound energy level frame. This sound vector is fused with the data from the TOF camera array that identified the positions of sound sources in the target area to associate produced sound corresponding with the sound vector with a physical active sound source in the target area. A beamformer can then be used to save audio corresponding to the sound vector and discard audio not associated with the sound vector to produce a sound recording associated with the active sound source.

Multi-sensor systems and methods for providing immersive virtual environments

A system, method and program product for generating sound masking in an open-plan space. A method is disclosed that includes: establishing a set of acoustic criteria for the space that specifies minimum output levels at a set of specified frequencies; mixing sound samples to create an audio output stream for use as sound masking when broadcast over at least one speaker using a power amplifier; and processing the audio output stream, wherein the processing includes: analyzing the audio output stream with a spectrum analyzer to determine if the minimum output levels at the set of specified frequencies are met; and level adjusting the audio output stream with an equalizer to ensure that minimum output levels at the set of specified frequencies are met but do not exceed a given threshold above the minimum level.

Sound masking in open-plan spaces using natural sounds

A robotic assistant, associated software and methodology for operating the same. The described robotic assistant includes: a motorized base having at least two motor driven wheels controlled by a first control platform; a dual arm robot mounted on the motorized base, the dual arm robot having a first arm and a second arm controlled by a second control platform; a remote sip and puff mouth controller having three degrees of operational freedom; and a computer system that receives command signals from the remote sip and puff mouth controller, and includes an algorithm that translates the command signals into a first type of control signal for directing the motorized base to move, and a second type of control signal for directing the dual arm robot to move.

Mobile human-friendly assistive robot

A sound processing system, method and program product for estimating parameters from binaural audio data. A system is provided having: a system for inputting binaural audio; and a binaural signal analyzer (BICAM) that: performs autocorrelation on both the first channel and second channel to generate a pair of autocorrelation functions; performs a first layer cross-correlation between the first channel and second channel to generate a first layer cross-correlation function; removes the center peak from the first layer cross-correlation function and a selected autocorrelation function to create a modified pair; performs a second layer cross-correlation between the modified pair to determine a temporal mismatch; generates a resulting function by replacing the first layer cross correlation function with the selected autocorrelation function using the temporal mismatch; and utilizes the resulting function to determine ITD parameters and interaural level difference ILD parameters of the direct sound components and reflected sound components.

Binaurally integrated cross-correlation auto-correlation mechanism

Systems and methods capable of providing adaptive and responsive accompaniment to music with fixed chord progressions, such as jazz and pop, are provided. A system can include one or more sound-capturing devices, a signal analyzer to analyze captured sound signals, and an electronic sound-producing component that produces electronic sounds as an accompaniment.

Interactive, expressive music accompaniment system

Growing community of inventors

Latham, NY, United States of America

Jonas Braasch