Magna Electronics Inc.

James Turk

Alexander Velichko

Galina Okouneva

Anam M Yunus

Tao-I Hsu

A vehicular trailering assist system includes at least one camera disposed at a trailer hitched to a hitch of a vehicle, and an electronic control unit (ECU). The ECU determines, during a first stage of a calibration maneuver of the vehicle and trailer, image coordinates of at least one ground feature point. The ECU, responsive to determining image coordinates of the at least one ground feature point, estimates orientation parameters of the camera based at least on the determined image coordinates and intrinsic camera parameters. As the vehicle and trailer travel further along the ground surface during a second stage of the calibration maneuver of the vehicle and trailer, and based on the estimated orientation parameters of the at least one camera, the vehicular trailering assist system determines misalignment of the at least one camera at the trailer.

Vehicular trailering assist system with targetless determination of misalignment of at least one trailer camera

A vehicular vision system includes a plurality of cameras including a rear camera disposed at a rear portion of a vehicle and having at least a rearward field of view and a front camera disposed at a front portion of the vehicle and having at least a forward field of view. Responsive to processing at an electronic control unit of provided vehicle data, the vehicular vision system determines a vehicle motion vector during maneuvering of the vehicle. Responsive to image processing at the electronic control unit of frames of captured image data, the vehicular vision system determines an object present in the field of view of a camera of the plurality of cameras and determines movement of the object relative to the vehicle. The vehicular vision system compares the determined relative movement of the object to the determined vehicle motion vector to determine misalignment of the camera.

Vehicular vision system having a plurality of cameras

A vehicular trailering assist system includes at least one camera disposed at a trailer hitched to a hitch of a vehicle, and an electronic control unit (ECU). The ECU determines, during a first stage of a calibration maneuver of the vehicle and trailer, image coordinates of at least one ground feature point. The ECU, responsive to determining image coordinates of the at least one ground feature point, estimates orientation parameters of the camera based at least on the determined image coordinates and known intrinsic camera parameters. Responsive to estimating the orientation parameters of the camera, and based on the determined parameters of the camera, the ECU determines location of the at least one camera at the trailer.

Vehicular trailering assist system with targetless calibration of trailer cameras

A method for determining misalignment of a vehicular camera includes equipping a vehicle with a vehicular vision system having an electronic control unit and a plurality of cameras disposed at the vehicle so that each camera has a respective field of view exterior of the vehicle. Responsive to processing at the electronic control unit of received vehicle data during driving of the vehicle, the vehicular vision system determines a vehicle motion vector during driving of the vehicle. Frames of image data captured by the plurality of cameras are processed to determine an object motion vector of a detected object based on positions of the detected object in frames of image data captured by the camera. The determined object motion vector is compared to the determined vehicle motion vector to determine via the vehicular vision system that the camera of the plurality of cameras is misaligned.

Method for determining misalignment of a vehicular camera

A method for calibrating a vehicular camera of a vehicular vision system includes placing a target with a first portion having a first geometric pattern and a second portion having a second geometric pattern within the field of view of the vehicular camera, and capturing image data with the camera representative of the field of view of the vehicular camera. Two edges of both portions of the target are detected, and edge pixels of the detected edges are determined. First and second vanishing points of the target in the captured image data are determined based on the determined edge pixels of the respective first and second portions of the target. Camera orientation is determined based on location of the determined first vanishing point relative to location of the determined second vanishing point. The vehicular camera is calibrated based on the determined camera orientation.

Vehicular vision system with camera calibration using calibration target

A method for determining misalignment of a vehicular camera and calibrating the misaligned camera includes providing a plurality of cameras at a vehicle and providing a control having an electronic control unit that includes a processor for processing image data captured by the plurality of cameras. Frames of image data captured by the plurality of cameras are processed to determine objects present in the field of view of at least one of the cameras. Responsive to processing vehicle data during driving of the vehicle, a vehicle motion vector is determined. Movement of an object relative to the vehicle is determined via processing of at least two frames of captured image data during driving of the vehicle. Responsive to determination of a difference between the relative movement of the object and the vehicle motion vector, misalignment of a misaligned camera is determined, and calibration of the misaligned camera is adjusted.

A vision system for a vehicle includes a camera disposed at an outside rearview mirror assembly and having a field of view exterior of the vehicle. A control includes an electronic control unit having an image processor operable to process image data captured by the camera. Responsive to image processing of captured image data, the control is operable to determine objects present in the field of view of the camera. Responsive to processing at the electronic control unit of received vehicle data, the control determines a vehicle motion vector during driving of the vehicle. The control determines movement of an object relative to the vehicle via image processing of at least two frames of captured image data during driving of the vehicle. The control compares the determined relative movement of the object to the determined vehicle motion vector to determine misalignment of the camera.

Vehicle vision system using kinematic model of vehicle motion

A vision system for a vehicle includes a plurality of cameras disposed at the vehicle and respective fields of view exterior of the vehicle. An electronic control unit includes an image processor operable to process image data captured by any or all of the cameras. Responsive to image processing of captured image data, the electronic control unit is operable to determine objects present in the field of view of at least one of the cameras. Responsive to vehicle data, the electronic control unit determines a vehicle motion vector during driving of the vehicle by a driver of the vehicle. The electronic control unit compares the determined relative movement of a determined object to the determined vehicle motion vector and, responsive to a difference between the determined relative movement of the object and the determined vehicle motion vector, the electronic control unit determines a misalignment of the at least one camera.

A vision system of a vehicle includes a camera disposed at the vehicle and having a field of view exterior of the vehicle. The camera is operable to capture frames of image data. Responsive to image processing by an image processor of captured image data, a control is operable to determine objects present in the field of view of the camera. Responsive to vehicle data, the control determines a vehicle motion vector during driving of the vehicle by a driver of the vehicle. The control determines movement of an object relative to the vehicle via image processing of at least two frames of captured image data during driving of the vehicle by the driver of the vehicle. The control compares the determined relative movement of the object to the determined vehicle motion vector, and responsive to the comparison, the control may determine a misalignment of the camera.

Growing community of inventors

Oakville, Canada

James Turk