Stoneridge, Inc.

Stoneridge Electronics Ab

Liang Ma

Troy Otis Cooprider

Mohammad Gudarzi

Wenpeng Wei

Yifan Men

Utkarsh Sharma

Dominik Marx

Banuprakash Murthy

Nguyen Phan

Saif Imran

Yu He

A method of checking wing position in a CMS includes performing a calibration of a wing position supporting a camera relative to a vehicle to provide a desired field of view by capturing multiple images at different lighting conditions, extracting and storing a reference feature from each of the multiple images, triggering a wing position check, capturing a current image from the camera having a current position of the reference feature; sensing a current lighting condition at which the current image is captured, determining that one of the different lighting conditions is more similar to the current lighting condition, comparing the current position of the reference feature to the stored reference feature from the one of the multiple images generated under the one of the different lighting conditions, and outputting a result of the wing position check if a difference from the comparing step exceeds a threshold value.

Camera monitor system with camera wing unfolding status detection based upon image processing

A method for adjusting a human machine interface (HMI) element location in a commercial vehicle display includes displaying, on an electronic display of a commercial vehicle, images from a camera secured to the commercial vehicle that depict a trailer of the commercial vehicle and its surrounding environment; determining a reference location of a reference point of the trailer in the images; superimposing an HMI element in the images on the electronic display at an HMI location determined relative to the reference location; and detecting that the reference location has changed in the images, and adjusting the HMI location in response thereto. A camera monitoring system (CMS) for a vehicle and a method for a camera mirror system are also disclosed.

Camera mirror system including automatic angular adjustment for commercial vehicle displays

An method for automatically panning a view for a commercial vehicle includes analyzing a portion of a first view at a first time to determine a position of a vehicle feature within the first view, wherein the first view is a subset of a second view, estimating an expected position of the vehicle feature in the first view at a second time subsequent to the first time, defining a region of interest centered on the expected position of the vehicle feature in the second view and analyzing the region of interest to determine an exact position of the vehicle feature at the second time, and determining a current trailer angle based on a position of the vehicle feature within the second view.

Auto panning camera mirror system including image based trailer angle detection

A camera monitor system includes a camera arm that has a camera with an image capture unit that is configured to capture an image of a desired field of view. A display is configured to display the desired field of view, and an IR LED illuminates at least a portion of the desired field of view. A controller is in communication with the image capture unit and the IR LED and select at least first and second regions of interest (ROI) from the captured image. The first ROI is indicative of an amount of ambient light. The controller determines a luminance of each of said first and second ROIs. The controller regulates an IR LED state of the IR LED based upon the first ROI luminance, and adjusts the IR LED state based upon the second ROI luminance.

Automatic IR LED control for camera mirror system

A method for determining a trailer detection parameter of a trailer including receiving an image from at least one camera at a controller. The at least one camera defines a field of view including at least a portion of a vehicle trailer. The method determines a trailer angle of the vehicle trailer relative to a tractor, identifies at least one feature in an image of the trailer, determines a two-dimensional distance from the at least one feature to a predefined position on the image, and converts the two-dimensional distance to a three-dimensional distance based at least in part on the determined angle. The three-dimensional distance is a trailer detection parameter of the trailer.

Image based trailer wheelbase determination

A method for tracking a trailer end in an image using a controller includes receiving an image from at least one camera, identifying a trailer end in the image and tracking a motion of the trailer end through the image for a period of time using a controller. A motion model is generated based on the motion of the trailer end through the image using the controller. The controller responds to the trailer end exiting the image by maintaining motion of the trailer end per the motion model for a delay time period and establishing an estimated trailer end position dictated by the motion model at the end of the delay time period in response to the time period elapsing and the trailer end not being visible using the controller.

Trailer end tracking in a camera monitoring system

A camera monitoring system (CMS) for a vehicle, including a CMS controller including a memory and a processor, the CMS controller being connected to a plurality of cameras disposed about a vehicle and configured to receive a video feed from each of the cameras in the plurality of cameras, the CMS controller including at least one side camera configured to define a rear side view and at least one rear camera configured to generate a rear facing view, the memory storing a trailer end detection module configured to identify a trailer end within at least one image generated by the plurality of cameras, and the memory further storing a trailer striking area prediction module configured to define a striking area geometry using a set of predicted future positions of prediction points in a prediction set, the prediction points being defined along an edge of the trailer.

Trailer striking area prediction using camera monitoring system

A camera monitor system including a first mirror replacement assembly including a housing supporting a rear facing camera and a rear facing range sensor, a controller in communication with the mirror replacement assembly, the controller including a processor and a memory, the memory storing instructions for identifying at least one object in an image feed from the camera and determining an angular position of the object using image analysis, identifying a distance of the at least one object from the mirror replacement assembly using the range sensor; and fusing the distance and the angular position of the object into a single data set, and a display connected to the controller and configured to display a mirror replacement view including at least a portion of the image feed.

Camera monitor system including integrated range sensor

A method for estimating a trailer wheel position includes identifying a first set of wheel locations in a first image. Each of the wheel locations in the first set of wheel locations is associated with a corresponding trailer angle. The first set of wheel locations is clustered and a primary cluster in the first set of wheel locations is identified. A best fit curve is applied to the primary cluster. The best fit curve is a curve associating wheel position to trailer angle. An estimated wheel position is determined by applying a determined trailer angle to the best fit curve in response to the wheel being hidden in the first image. The estimated wheel position is output to at least one additional vehicle system.

Camera monitor system for commercial vehicles including wheel position estimation

A process for identifying a road feature in an image includes receiving an image at a controller, identifying a region of interest within the image and converting the region of interest from red-green-blue (RGB) to a single color using the controller. A set edges is detected within the region of interest, and at least one line within the set of edges is identified using the controller. The at least one line is compared with a set of known and expected road marking features, and the set of at least one first line in the at least one line is identified as corresponding to a road feature in response to the at least the first line matching the set of known and expected road marking features.

Camera mirror system display for commercial vehicles including system for identifying road markings

A method of providing a trailer end line for a tractor-trailer includes determining a fixed point on a tractor, determining a trailer angle of a trailer, determining a trailer line that is arranged at the trailer angle from the fixed point, determining an intersection point between the trailer line and a trajectory of a reference point on the trailer, determining a trailer end point along the trailer line and offset from the intersection point, and displaying a trailer end awareness line based upon the determined trailer end point.

Dynamic longitudinal and lateral adjustment of awareness lines for commercial vehicle camera mirror system

A method for automatically panning a view for a commercial vehicle includes determining a plurality of estimated trailer angles. Each estimated trailer angle is determined using a distinct estimation method, and method assigns a confidence value to each estimated trailer angle in the plurality of estimated trailer angles. The method determines a weighted sum of the plurality of estimate trailer angles, and automatically pans the view based at least in part on the weighted sum and a current vehicle operation.

Auto panning camera mirror system including weighted trailer angle estimation

A method for automatically panning a view for a commercial vehicle includes receiving a video feed from at least one camera defining a field of view. A plurality of objects in the video feed, includes at least one wheel and at least one line, are identified. A path of each object in the plurality of objects is tracked through an image plane of the video feed. A trailer angle corresponding to each path is identified, the identified trailer angle is associated with the corresponding path, thereby generating a plurality of trailer angle measurements. The plurality of paths are down selected to a single path and identifying a single trailer angle measurement corresponding to the single path.

Growing community of inventors

Rochester, MI, United States of America

Liang Ma