Magna Electronics Inc.

Jagmal Singh

Sebastian Pliefke

Holger Hess

Sergio D Biarge

Sergio Duque Biarge

Jorge J Jácome Muñoz

Kalin Kabakchiev

Roaldje Nadjiasngar

A method of calibrating a vehicular vision system includes mounting a camera at a vehicle moving along a vehicle assembly line. Responsive to processing of image data captured by the camera, ground features adjacent to the vehicle are determined and the determined ground features are tracked over two or more frames of captured image data using optical flow. A misalignment of the camera is determined via tracking the determined ground features as the vehicle moves along the straight path portion of the end of line test portion of the vehicle assembly line. Responsive to determination of misalignment of the camera at the vehicle, the vehicular vision system is calibrated using an assumption that the determined ground features lie in a plane parallel to a planar portion of a ground surface adjacent the straight path portion of the end of line test portion of the vehicle assembly line.

System and method for calibrating vehicular vision system

A vehicle hatch clearance determining system includes a plurality of cameras disposed at the vehicle and a control having a processor for processing image data captured by the cameras. During a parking event, and responsive to processing of captured image data, the system detects objects, gathers information pertaining to detected objects exterior the vehicle and generates an environmental model based at least in part on the gathered information. With the vehicle parked, the system determines location of the vehicle relative to at least one detected object of the environmental model and determines if the model includes an object in a region that would be swept by a hatch of the parked vehicle when the hatch is being opened or closed. Responsive to determination that the object is in the region that would be swept by the hatch, the system stops movement of the hatch to avoid impact with the object.

Vehicle hatch clearance determining system

A method for calibrating a vehicular radar sensing system includes disposing two spaced apart calibrating radars at respective transmitting locations that are spaced from a vehicle calibration location at an end of line portion of a vehicle assembly line, and moving a vehicle along the vehicle assembly line, the vehicle including an electronic control unit (ECU) and a vehicular radar operable to sense exterior of the vehicle. Signals are transmitted via the first and second calibrating radars at the transmitting locations and, with the vehicle at the vehicle calibration location, the plurality of radar receivers of the vehicular radar receive the transmitted signals transmitted by the first and second calibrating radars, and the vehicular radar generates an output that is processed at the ECU. Responsive to processing at the ECU of the output of the vehicular radar, misalignment of the vehicular radar at the vehicle is determined.

System and method for calibrating vehicular radar sensing system

A calibration system for calibrating a LIDAR sensing system of a vehicle includes a plurality of light reflecting targets disposed at a ground surface at an end of line calibration region of a vehicle assembly facility. The light reflecting targets are arranged at the ground surface in a predetermined pattern. When a vehicle equipped with a LIDAR sensing system is at the calibration region, the light reflecting targets are in the field of sensing of at least one LIDAR sensor of the LIDAR sensing system of the vehicle. Responsive to processing of data sensed by the at least one LIDAR sensor, the calibration system determines the locations of the light reflecting targets and determines misalignment of the LIDAR sensor and calibrates the LIDAR sensing system to accommodate the determined misalignment.

Vehicle LIDAR sensor calibration system

A vehicle hatch clearance determining system includes a plurality of cameras disposed at the vehicle and a control having a processor for processing image data captured by the cameras to determine structure and objects present in the fields of view of the cameras while the vehicle is being driven during a parking event. The control, responsive to processing of captured image data, determines and stores information pertaining to structure and objects present in the fields of view of the cameras during the parking event. When the vehicle is parked, the control determines if stored information includes structure or an object at or near the parking location and in a region that may be swept by the vehicle hatch when it is opened or closed. Responsive to determination of a potential collision of the hatch with structure or an object, the clearance determining system controls the hatch and/or generates an alert.

A sensing system for a vehicle includes at least one radar sensor disposed at the vehicle and having a field of sensing exterior of the vehicle. The at least one radar sensor includes multiple transmitting antennas and multiple receiving antennas. The transmitting antennas transmit signals and the receiving antennas receive the signals reflected off objects. Multiple scans of radar data sensed by the at least one radar sensor are received at a control, and a vehicle motion estimation is received at the control. The control, responsive to received scans of sensed radar data, detects the presence of one or more objects exterior the vehicle and within the field of sensing of the at least one radar sensor. The control, responsive to the received scans of sensed radar data and the received vehicle motion estimation, matches objects detected in the scans and determines angles toward the detected objects.

Vehicle radar sensing system with enhanced accuracy using interferometry techniques

A calibration system for calibrating a radar sensing system for a vehicle includes at least one calibrating radar transmitter spaced from a location where the vehicle may be positioned. The vehicle includes a radar sensor disposed at the vehicle so as to sense exterior of the vehicle. The radar sensor includes a plurality of transmitters that transmit radio signals and a plurality of receivers that receive radio signals that are transmitted radio signals reflected from an object. A processor is operable to process an output of the receivers. With the vehicle positioned at the location, the at least one calibrating transmitter transmits signals that are received by the receivers of the radar sensor. Responsive to processing by the processor of the output of the receivers when receiving signals transmitted by the at least one calibrating transmitter, the calibration system determines if the radar sensor is misaligned at the vehicle.

Calibration system for vehicle radar system

A method of calibrating a vehicular camera includes mounting a camera at a vehicle moving along a vehicle assembly line. Responsive to processing of image data captured by the camera, features at the ground adjacent to the vehicle are determined and the determined features are tracked over two or more frames of captured image data. Responsive to processing of frames of captured image data during movement of the vehicle along a straight path, a misalignment of the camera is determined. The misaligned camera is calibrated using an assumption that the determined ground features lie in a plane parallel to a planar portion of the ground surface adjacent the straight path portion of the vehicle assembly line. The determination of misalignment and the calibration of the camera are performed without use of a target pattern at the vehicle assembly line.

Targetless vehicle camera calibration system

A camera calibration system for cameras of a vehicle includes a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle, with the fields of view of two of the cameras overlapping. While the vehicle is moving, an image processor of a control processes image data captured by the two cameras to determine and track matching features in an overlapping region of the fields of view of the two cameras. The control, responsive to image processing of image data captured by the two cameras, determines motion of matching features and minimizes a cost function of the error in the matching of the features. The camera calibration system uses the determined minimized cost function to refine calibration results of the two cameras using a feedback loop.

Vehicle camera calibration system

A vehicular camera calibration system includes a camera disposed at a vehicle and having a field of view exterior of the vehicle and being operable to capture image data. Responsive to processing of image data captured by the camera, the camera calibration system determines features at the ground adjacent to the vehicle and tracks the determined features over two or more frames of captured image data. Responsive to processing of frames of captured image data during movement of the vehicle along a straight path on a planar surface, the camera calibration system is operable to determine a misalignment of the camera. The camera calibration system calibrates the misaligned camera by using an assumption that the determined features lie in a plane parallel to the planar surface along which the vehicle is traveling. The camera calibration system calibrates the camera by reducing ambiguity in vectors normal to the planar surface.

A method for calibrating a camera of a vehicular vision system includes capturing a first frame of image data by the camera during a first ignition cycle of the vehicle, and, responsive to ending the first ignition cycle of the vehicle, saving to memory the first frame of captured image data. A second frame of image data is captured by the camera during a second ignition cycle of the vehicle following the first ignition cycle. The first frame of captured image data is compared by an image processor to the second frame of captured image data to determine a change in orientation of the camera. Responsive to determination of the change in orientation of the camera, processing by the image processor of frames of image data captured by the camera during the second ignition cycle is adjusted to accommodate the determined change in orientation of the camera.

Vehicle vision system with camera calibration

A camera calibration system for a vehicle includes a plurality of cameras disposed at a vehicle and having respective fields of view exterior of the vehicle. An image processor is operable to process image data captured by the cameras. The image processor is operable, via processing of image data captured by the cameras, to determine a change in orientation of at least one of the cameras. The image processor determines the change in orientation from a previous orientation during a previous ignition cycle of the vehicle and a current orientation at the onset of a current or subsequent ignition cycle of the vehicle.

A method for calibrating a camera of a vehicular vision system includes providing a camera and an image processor at the vehicle. A monoview noncoplanar three dimensional calibration pattern distributed on a semi-sphere is determined via processing of image data captured by the camera. Responsive to determination of the monoview noncoplanar three dimensional calibration pattern distributed on the semi-sphere, extrinsic parameters of the camera and intrinsic parameters of the camera are estimated. The system performs at least one of (i) a linear refinement of the estimated extrinsic parameters and intrinsic parameters and (ii) a non-linear refinement of the estimated extrinsic parameters and intrinsic parameters. Responsive to processing by the image processor of image data captured by the camera, the camera is calibrated at least in part by using the determined monoview noncoplanar three dimensional semi-spherical calibration pattern.

Vehicle vision system with calibration algorithm

A vision system of a vehicle includes a camera configured to be disposed at a vehicle so as to have a field of view exterior of the vehicle. The camera may include a fisheye lens. An image processor is operable to process image data captured by the camera. The vision system provides enhanced camera calibration using a monoview noncoplanar three dimensional calibration pattern. The system may include a plurality of cameras configured to be disposed at the vehicle so as to have respective fields of view exterior of the vehicle.

Growing community of inventors

Aschaffenburg, Germany

Jagmal Singh