Gm Global Technolgoy Operations, Inc.

Kent S Lybecker

Wende Zhang

Ryan M Frakes

Jinsong Wang

Bakhtiar Brian Litkouhi

Jeffrey S Piasecki

Travis S Hester

Charles A Green

William Joseph Chundrlik, Jr

Alexander Kade

Mark R Willey

Thomas D Hagen

William C Bisnack

Benjamin H Baker

Alan W Finch

Nicholas P Nagrant

Dennis B Kazensky

James Clem

James J Czewski

Patrick D Walmsley

Brian Li

Craig H Zinser

A system and method for determining when to display frontal curb view images to a driver of a vehicle, and what types of images to display. A variety of factors&#x2014;such as vehicle speed, GPS/location data, the existence of a curb in forward-view images, and vehicle driving history&#x2014;are evaluated as potential triggers for the curb view display, which is intended for situations where the driver is pulling the vehicle into a parking spot which is bounded in front by a curb or other structure. When forward curb-view display is triggered, a second evaluation is performed to determine what image or images to display which will provide the best view of the vehicle's position relative to the curb. The selected images are digitally synthesized or enhanced, and displayed on a console-mounted or in-dash display device.

Enhanced front curb viewing system

A system and method for creating an enhanced virtual top-down view of an area in front of a vehicle, using images from left-front and right-front cameras. The enhanced virtual top-down view not only provides the driver with a top-down view perspective which is not directly available from raw camera images, but also removes the distortion and exaggerated perspective effects which are inherent in wide-angle lens images. The enhanced virtual top-down view also includes corrections for three types of problems which are typically present in de-warped images&#x2014;including artificial protrusion of vehicle body parts into the image, low resolution and noise around the edges of the image, and a 'double vision' effect for objects above ground level.

Enhanced top-down view generation in a front curb viewing system

A method of displaying a captured image on a display device. A real image is captured by an image capture device. The image capture device uses a field-of-view lens that distorts the real image. A camera model is applied to the captured real image. The camera model maps objects in the captured real image to an image sensor plane of the image capture device to generate a virtual image. The image sensor plane is reconfigurable to virtually alter a shape of the image sensor plane to a non-planar surface. The virtual image formed on the non-planar image surface of the image sensor is projected to the display device.

Imaging surface modeling for camera modeling and virtual view synthesis

A system and method for creating an enhanced perspective view of an area in front of a vehicle, using images from left-front and right-front cameras. The enhanced perspective view removes the distortion and exaggerated perspective effects which are inherent in wide-angle lens images. The enhanced perspective view uses a camera model including a virtual image surface and other processing techniques which provide corrections for two types of problems which are typically present in de-warped perspective images&#x2014;including a stretching effect at the peripheral area of a wide-angle image de-warped by rectilinear projection, and double image of objects in an area where left-front and right-front camera images overlap.

Enhanced perspective view generation in a front curb viewing system

A method for dynamically registering a graphic upon a cropped image obtained from a camera device includes capturing an original image obtained from the camera device. Intrinsic calibration information for the camera device, extrinsic information for the camera device and vehicle information are monitored. The cropped image is generated based on cropping parameters to exclude undesirable content from the original image. The intrinsic calibration information is adjusted based on a relationship to the cropping parameters. The graphic is dynamically registered upon the cropped image based on the adjusted intrinsic calibration information for the camera device, the monitored extrinsic information for the camera device and the monitored vehicle information.

Dynamic guideline overlay with image cropping

A system and method for providing lane sensing on a vehicle by detecting roadway lane-markers, where the system employs multiple cameras providing images around the vehicle. The method includes detecting left-side and right-side lane boundary lines in the camera images, and then determining whether the lane boundary lines in the images are aligned from one image frame to a next image frame and are aligned from image to image. If the boundary lines are not aligned, then calibration of one or more of the cameras is performed, and if the lines are aligned, then a model fitting process is used to specifically identify the location of the boundary lines on the roadway.

Full speed lane sensing using multiple cameras

A system and method for providing lane sensing on a vehicle by detecting roadway lane-markers, where the system employs a surround view camera system providing a top-down view image around the vehicle. The method includes detecting left-side and right-side lane boundary lines in the top-down view image, and then determining whether the lane boundary lines in the image are aligned from one image frame to a next image frame and are aligned from image to image in the top-down view image. If the boundary lines are not aligned, then calibration of one or more of the cameras is performed, and if the lines are aligned, then a model fitting process is used to specifically identify the location of the boundary lines on the roadway.

Full speed lane sensing with a surrounding view system

A vehicle imaging system includes an image capture device capturing an image exterior of a vehicle. The captured image includes at least a portion of a sky scene. A processor generates a virtual image of a virtual sky scene from the portion of the sky scene captured by the image capture device. The processor determines a brightness of the virtual sky scene from the virtual image. The processor dynamically adjusts a brightness of the captured image based the determined brightness of the virtual image. A rear view mirror display device displays the adjusted captured image.

Dynamic rearview mirror adaptive dimming overlay through scene brightness estimation

An apparatus for capturing an image includes a plurality of lens elements coaxially encompassed within a lens housing. A split-sub-pixel imaging chip includes an IR-pass filter coating applied on selected sub-pixels. The sub-pixels include a long exposure sub-pixel and a short-exposure sub-pixel for each of a plurality of green blue and red pixels.

Split sub-pixel imaging chip with IR-pass filter coating applied on selected sub-pixels

Method for applying super-resolution to images captured by a camera device of a vehicle includes receiving a plurality of image frames captured by the camera device. For each image frame, a region of interest is identified within the image frame requiring resolution related to detail per pixel to be increased. Spatially-implemented super-resolution is applied to the region of interest within each image to enhance image sharpness within the region of interest.

Image super-resolution for dynamic rearview mirror

An apparatus for capturing an image includes a plurality of lens elements coaxially encompassed within a lens housing. One of the lens elements includes an aspheric lens element having a surface profile configured to enhance a desired region of a captured image. At least one glare-reducing element coaxial with the plurality of lens elements receives light subsequent to the light sequentially passing through each of the lens elements. An imaging chip receives the light subsequent to the light passing through the at least one glare-reducing element. The imaging chip includes a plurality of green, blue and red pixels.

Camera hardware design for dynamic rearview mirror

A method for generating a glare-reduced image from images captured by a camera device of a subject vehicle includes obtaining a short-exposure image and a long-exposure image and generating a resulting high dynamic range image based on the short-exposure and long-exposure images. Pixel values are monitored within both the short- and long-exposure images. A light source region is identified within both the short- and long-exposure images based on the monitored pixel values. A glaring region is identified based on the identified light source region and one of calculated pixel ratios and calculated pixel differences between the monitored pixel values of the long- and short-exposure images. The identified glaring region upon the resulting high dynamic range image is modified with the identified light source region within the short-exposure image. The glare-reduced image is generated based on the modified identified glaring region upon the resulting HDR image.

Glaring reduction for dynamic rearview mirror

A method for displaying a captured image on a display device. A real image is captured by a vision-based imaging device. A virtual image is generated from the captured real image based on a mapping by a processor. The mapping utilizes a virtual camera model with a non-planar imaging surface. Projecting the virtual image formed on the non-planar image surface of the virtual camera model to the display device.

A method for displaying images of a camera associated with a vehicle includes the steps of displaying the images in a first mode if a first condition is satisfied, and displaying the images in a second mode if a second condition is satisfied.

Methods and systems for displaying vehicle rear camera images in different modes

According to various exemplary embodiments, an apparatus is provided for mounting a rearview display and one or more electronic components in a vehicle. An example of the apparatus comprises an inside rearview assembly for mounting an electronic component near a windshield of a vehicle including a mirror and an adjustable support connected to the mirror. The rearview assembly also includes a bracket configured to mount on the windshield, including an attaching structure configured to attach the bracket to the windshield and a support frame coupled to the attaching structure. The support frame has a portion set off from the windshield to accommodate the electronic component between the windshield and the set off portion. The support frame is connected to the adjustable support.

Growing community of inventors

Rochester, MI, United States of America

Kent S Lybecker