The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
May. 12, 2026
Filed:
Oct. 10, 2024
International Business Machines Corporation, Armonk, NY (US);
Aaron Keith Baughman, Cary, NC (US);
Leonid Karlinsky, Acton, MA (US);
Gozde Akay, Fredericton, CA;
Eduardo Morales, Key Biscayne, FL (US);
International Business Machines Corporation, Armonk, NY (US);
Abstract
Systems, methods, and computer program products for automatically syncing commentary with videos are described herein. A method comprises reading a sequence of frames of a video; generating frame documents based on the sequence of frames; reading commentary associated with the video; providing the commentary as input to a language model; reading embeddings generated by the language model based on the commentary; generating a commentary document in accordance with the embeddings; determining a semantic distance between the commentary document and each of the frame documents; selecting a subset of the set of frame documents having the lowest semantic distance to the commentary document; identifying a consecutive subsequence of the sequence of frames associated with the subset; providing at least two frames of the consecutive subsequence and the embeddings as input to a diffusion model; and reading a first frame generated by the diffusion model.