Nvidia Corporation

Zoran Nikolic

Mark Henry Costin

Ram Ganapathi

Eric Viscito

Branislav Kisacanin

Eric Kangning Zhang

In various examples, techniques for using hardware feature trackers in autonomous or semi-autonomous systems are described. Systems and methods are disclosed that use a processor(s) to determine flow vectors associated with pixel locations in a first image. The systems also use the processor(s) to determine a location of a feature point in a second image based at least on one or more of the flow vectors and a subpixel location of the feature point in the first image. In some examples, the processor(s) may include an optical flow accelerator (OFA) that includes a hardware unit storing a lookup table that is used to determine the location of the feature point in the second image. In some examples, the processor(s) may include an OFA to determine the flow vectors and a vision processor to determine the location of the feature point in the second image.

Hardware-based feature tracker for autonomous systems and applications

This disclosure presents an assisted driving vehicle system, including autonomous, semi-autonomous, and technology assisted vehicles, that can share sensor data among two or more controllers. A sensor can have one communication channel to a controller, thereby saving cabling and circuitry costs. The data from the sensor can be sent from one controller to another controller to enable redundancy and backup in case of a system failure. Sensor data from more than one sensor can be aggregated at one controller prior to the aggregated sensor data being communicated to another controller thereby saving bandwidth and reducing transmission times. The sharing of sensor data can be enabled through the use of a sensor data distributor, such as a converter, repeater, or a serializer/deserializer set located as part of the controller and communicatively coupled to another such device in another controller using a data interface communication channel.

Sharing sensor data between multiple controllers to support vehicle operations

Apparatuses, systems, and techniques to generate one or more confidence values associated with one or more objects identified by one or more neural networks. In at least one embodiment, one or more confidence values associated with one or more objects identified by one or more neural networks are generated based on, for example, one or more neural network outputs.

Confidence generation using a neural network

This disclosure presents an assisted driving vehicle system, including autonomous, semi-autonomous, and technology assisted vehicles, that can share sensor data among two or more controllers. A sensor can have one communication channel to a controller, thereby saving cabling and circuitry costs. The data from the sensor can be sent from one controller to another controller to enable redundancy and backup in case of a system failure. In another embodiment, sensor data from more than one sensor can be aggregated at one controller prior to the aggregated sensor data being communicated to another controller thereby saving bandwidth and reducing transmission times. The sharing of sensor data can be enabled through the use of a sensor data distributor, such as a converter, repeater, or a serializer/deserializer set located as part of the controller and communicatively coupled to another such device in another controller using a data interface communication channel.

Growing community of inventors

Santa Clara, CA, United States of America

Zoran Nikolic