Nvidia Corporation

Feng Hu

Niranjan Avadhanam

Yuzhuo Ren

Sakthivel Sivaraman

Hairong Jiang

Sujay Yadawadkar

Siyue Wu

Ratin Kumar

Ankit Pashiney

Simon John Baker

Apparatuses, systems, and techniques are described to determine locations of objects using images including digital representations of those objects. In at least one embodiment, a gaze of one or more occupants of a vehicle is determined independently of a location of one or more sensors used to detect those occupants.

Gaze detection using one or more neural networks

Systems and methods for a self-adjusting vehicle mirror. The mirror automatically locates the face of the driver or another passenger, and orients the mirror to provide the driver/passenger face with a desired view from the mirror. The mirror may continue to reorient itself as the driver or passenger shifts position, to continuously provide a desired field of view even as he or she changes position over time. In certain embodiments, the mirror system of the disclosure can be a self-contained system, with the mirror, mirror actuator, camera, and computing device all contained within the mirror housing as a single integrated unit.

Automatically-adjusting mirror for use in vehicles

Systems and methods are disclosed related to restraint device (e.g., seatbelt) localization. In one embodiment, the disclosure relates to systems and methods for seatbelt detection and modeling. A vehicle may be occupied by one or more occupants wearing one or more seatbelts. A camera or other sensor is placed within the vehicle to capture images of the one or more occupants. A system analyzes the images to detect and model seatbelts depicted in the images. Specifically, the system may scan the images and areas of the images that may correspond to seatbelts. The system may assemble candidate areas of the images that may correspond to seatbelts, and refine the candidate areas based on various constraints. The system may build models based on the refined candidate areas that indicate the seatbelts. The system may visualize the models indicating the seatbelts using the images.

Restraint device localization

Systems and methods for machine learning based seatbelt position detection and classification. A number of fiducial markers are placed on a vehicle seatbelt. A camera or other sensor is placed within the vehicle, to capture images or other data relating positions of the fiducial markers when the seatbelt is in use. One or more models such as machine learning models may then determine the spatial positions of the fiducial markers from the captured image information, and determine the worn state of the seatbelt. In particular, the system may determine whether the seatbelt is being worn in one or more improper states, such as not being worn or being worn in an unsafe or dangerous manner, and if so, the system may alert the vehicle to take corrective action. In this manner, the system provides constant and real-time monitoring of seatbelts to improve seatbelt usage and safety.

Machine learning-based seatbelt detection and usage recognition using fiducial marking

Systems and methods for automatic camera calibration without using a robotic actuator or similar hardware. An electronic display screen projects an image of a simulated three-dimensional calibration pattern, such as a checkerboard, oriented in a particular pose. The camera captures an image of the calibration pattern that is displayed on the screen, and this image together with the transform of the simulated three-dimensional calibration pattern are used to calibrate the camera. Multiple different pictures of different poses are employed to determine the optimal set of poses that produces the lowest reprojection error. To aid in selecting different poses, i.e., spatial positions and orientations of the simulated three-dimensional calibration pattern, poses may be selected from only that portion of the camera's field of view which is expected to be typically used in operation of the camera.

Growing community of inventors

Santa Clara, CA, United States of America

Feng Hu