The patent badge is an abbreviated version of the USPTO patent document. The patent badge does contain a link to the full patent document.
The patent badge is an abbreviated version of the USPTO patent document. The patent badge covers the following: Patent number, Date patent was issued, Date patent was filed, Title of the patent, Applicant, Inventor, Assignee, Attorney firm, Primary examiner, Assistant examiner, CPCs, and Abstract. The patent badge does contain a link to the full patent document (in Adobe Acrobat format, aka pdf). To download or print any patent click here.
Patent No.:
Date of Patent:
Mar. 24, 2026
Filed:
Jul. 14, 2023
Robert Bosch Gmbh, Stuttgart, DE;
Carnegie Mellon University, Pittsburgh, PA (US);
Jonathan Francis, Pittsburgh, PA (US);
Luca Bondi, Pittsburgh, PA (US);
Gyan Tatiya, Medford, MA (US);
Ingrid Navarro, Pittsburgh, PA (US);
Robert Bosch GmbH, , DE;
Carnegie Mellon University, Pittsburgh, PA (US);
Abstract
A method of controlling navigation of a device in an environment using machine learning (ML) models includes receiving visual and audio observation data of the environment as sensed by the device, determining classification scores for objects and regions in the environment based on the visual and audio observation data, encoding visual information based on the classification scores, determining audio-semantic feature embeddings based at least in part on the classification scores, the audio-semantic feature embeddings indicating spatial relationships between objects in the environment, between regions in the environment, and between objects and regions in the environment, and determining and outputting, based on the encoded visual information and the audio-semantic feature embeddings, a state representation corresponding to a state of the device within the environment.