Multimodal vehicle sensor fusion and streaming

Abstract

Systems and methods for encrypting and streaming AV sensor data and AV derived data. In particular, systems and methods are provided for receiving AV sensor data at a streaming platform and providing the received data to multiple endpoints. In some examples, the multiple endpoints are multiple viewers viewing the AV sensor data. In various examples, an AV transmits the AV sensor data to the streaming platform, and the AV sensor data can be transmitted from the streaming platform to multiple endpoints without any effect on AV central processing unit or bandwidth constraints. The AV sensor data can include multiple data streams that are layered and compressed for efficient streaming, and the streaming platform can receive real-time streamed data from the AV even as bandwidth and connection constraints vary. In various examples, the bit rate of the video ingestion from the AV can be changed based on bandwidth availability.