The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.

The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.

Date of Patent:
Feb. 03, 2026

Filed:

Nov. 13, 2023
Applicants:

MD Amirul Islam, Toronto, CA;

Seyed Shahabeddin Nabavi, Toronto, CA;

Irina Kezele, North York, CA;

Yang Wang, Winnipeg, CA;

Yuanhao Yu, Markham, CA;

Jin Tang, Markham, CA;

Inventors:

MD Amirul Islam, Toronto, CA;

Seyed Shahabeddin Nabavi, Toronto, CA;

Irina Kezele, North York, CA;

Yang Wang, Winnipeg, CA;

Yuanhao Yu, Markham, CA;

Jin Tang, Markham, CA;

Assignee:
Attorney:
Primary Examiner:
Int. Cl.
CPC ...
G10L 19/02 (2013.01); G10L 25/18 (2013.01); G10L 25/30 (2013.01); H04N 19/20 (2014.01);
U.S. Cl.
CPC ...
G10L 19/0204 (2013.01); G10L 25/18 (2013.01); G10L 25/30 (2013.01); H04N 19/20 (2014.11);
Abstract

System, method and/or computer readable medium for audio visual sound source Separation that applies cross-modal meta consistency learning. Inputs include an audio spectrogram that represents first sounds second sounds, a first video of a first sound producing object, and a second video of a second sound producing object. Audio features and audio tokens are generated by applying audio encoders to the audio spectrogram. Visual tokens are generated by applying a visual encoder to the first video and the second video. Respective audio-visual features are obtained based on combining the audio token with the respective visual tokens. Based on the respective audio-visual features, first and second separated audio masks are generated by applying a decoder.


Find Patent Forward Citations

Loading…