Caterpillar Inc.

Ryan Baumann

Christopher M Sprock

Sanat Arun Talmaki

Praveen Halepatali

Systems and methods for analyzing and optimizing worksite operations based on video and or audio data are disclosed. One method includes receiving one or more models relating to a worksite, receiving first sensor data associated with the machine at the worksite, receiving second sensor data associated with an operation of the machine at the worksite, wherein the second sensor data is sourced from a sensor that is different from a sensor sourcing the first sensor data, determining, by the one or more processors, a machine state based at least on the first data and the second data, comparing the determined machine state to a modeled machine state represented by the received one or more models to classify site operations and/or detect an irregularity in site operations or an inefficiency in site operations, and generating a response based at least on the detected irregularity or inefficiency.

System and method for determination of machine state based on video and audio analytics

Systems and methods for managing and optimizing mixed fleet worksite operations based on video and or audio data are disclosed. One method includes receiving one or more models relating to a fleet of machines at the worksite, wherein the fleet of machines comprises an in-network machine and an out-of-network machine, receiving first sensor data associated with the out-of-network machine at the worksite, receiving second sensor data associated with the in-network machine at the worksite, determining a machine state of each of the in-network machine and the out-of-network machine based at least on the first sensor data and the second sensor data, comparing the determined machine states to a modeled machine state represented by the received one or more models to classify site operations and/or detect an irregularity in site operations or an inefficiency in site operations, and generating a response based at least on the detected irregularity or inefficiency.

Growing community of inventors

Peoria, IL, United States of America

Ryan Baumann