Gm Global Technolgoy Operations, Inc.

Daimlerchrysler Corporation

Other

Joseph G Machak

Mohannad F Murad

Sai Vishnu Aluru

Fan Bai

Matt C Videtich

Akram M Abdel-Rahman

Daniel C McGarry

Donald Raymond Gignac

Samer Zakhem

Charles R Baker

Gerard R Kreiner

Wende Zhang

Fred W Huntzicker

Michael A Wuergler

Yun Qian Miao

Shiv G Patel

Guangyu J Zou

Andrew W Averhart

John M Gaynier

Sravan Daruri

Ernest P Minissale

Justin K Francisco

Nathan P Makarewicz

Mohamed A Naiel

Gary F Kajdasz

Lisa A Gronowski

Lisa M Paganini

Eyal Lubelski

Ndikum Atang

Daniel Xie

A self-cleaning sensor system of a motor vehicle includes an object sensor having a lens surface facing a region located external to the motor vehicle. The object sensor generates a signal associated with an image or a video of the region. The system further includes multiple lens treatment devices for applying remedies for removing an obscurity formed on the lens surface. The system further includes a computer having one or more processors and a computer readable medium storing instructions. The processor is programmed to determine a classification of the obscurity, in response to the processor receiving the signal from the object sensor. The processor is further programmed to generate an actuation signal, and the associated lens treatment device applies the remedy, in response to the associated lens treatment device receiving the actuation signal from the processor.

Self-cleaning sensor system of a motor vehicle

Vehicles and related systems and adaptive display adjustment methods include obtaining image data captured using an initial frame rate from an imaging system onboard the vehicle, obtaining current vehicle state information, determining a representative exposure setting for the imaging system based at least in part on the current vehicle state information, determining an estimated illuminance of a surrounding environment of the vehicle based at least in part on the image data and the representative exposure setting and automatically configuring the imaging system for a different, updated frame rate based on the estimated illuminance. Thereafter, the method continues by obtaining subsequent image data captured using the updated frame rate, providing a graphical user interface including a graphical representation of the subsequent image data on a display device associated with the vehicle, and dynamically adjusting a display characteristic after configuring the imaging system for the updated frame rate.

Vehicle systems and methods for environmental camera view display adaptation

Systems, methods, and apparatus are provided for real-time adjustment of image quality parameters. The system includes a controller configured to: acquire an image frame, having a fixed-pixel region that defines a region-of-interest, from one or more imaging devices; apply image processing techniques to determine a modified fixed-pixel region that excludes non-relevant object pixels; alter one or more image quality parameters based on statistics of pixels in the modified fixed-pixel region; and provide the altered one or more image quality parameters to the one or more imaging devices for use with subsequent image frames; wherein the one or more imaging devices produce an image that is tuned, based on the altered one or more image quality parameters, to the portions of the image in the region-of-interest that does not include the non-relevant object pixels.

Viewing system to dynamic real time optimize image quality for every customer viewport

Methods and systems are provided for generating image data from a vehicle having a plurality of cameras. A method includes: activating, by the processor, initial video feed from each of the plurality of cameras; determining, by the processor, configuration parameters for each of the plurality of cameras based on the initial video feed; in response to a trigger event, performing frame synchronization of subsequent video feed from each of the plurality of cameras based on the configuration parameters; and generating, by the processor, the image data based on the frame synchronization.

Methods and systems for automated frame synchronization after initial video feed

Vision sensor systems and methods detect banding and flicker. The method includes receiving camera data and identifying a light source location in a frame of camera data and assigning a luminance measure at the light source as a signal reference. A region of interest (ROI) is then associated with the light source. The frame is incremented, and then a signal to noise ratio (SNR) at the light source is calculated. A number, N of frames may be processed to identify banding when it is present, and to identify flicker when it is present. Responsive to identifying banding or identifying flicker, a response for a display system or for a machine vision system is generated.

Systems and methods for LED flickering and banding detection

In various embodiments, methods, systems, and vehicles are provided for distance determinations using cameras from different vehicles. The system includes a first camera onboard a first vehicle, providing a first image, the first image having therein an object of interest (OOI) for which a distance from the first vehicle is desired; and a second camera, providing second camera data including a second image having therein the OOI. The system further includes a control module configured to process and time synchronize first camera data and second camera data to generate a distance determination for the OOI, using the first camera data, the second camera data, and a distance between the first and second camera.

Method and apparatus for acquiring depth information using cameras from different vehicles

In various embodiments, methods, systems, and vehicles are provided that include obtaining first camera images from a first camera onboard a first vehicle; generating, via one or more computer processors, a first situation awareness graph with respect to objects near the first vehicle, using the first camera images; obtaining second camera images from a second camera of a second device that is in proximity to the first vehicle; generating, via one or more computer processors, a second situation awareness graph with the respect to the objects, using the second camera images; and generating, via one or more computer processor, a global situation awareness graph with respect to the objects, by merging the first situation awareness graph with the second situation awareness graph, using respective first and second weights for the first and second situation awareness graphs.

Method and apparatus for generating situation awareness graphs using cameras from different vehicles

Methods and systems are provided for controlling camera images for a camera of a vehicle are provided. In certain examples, a vehicle includes a camera, an input unit, and a processor. The input unit is configured to obtain data pertaining to a light pattern in proximity to the vehicle. The processor is configured to at least facilitate: (i) determining the light pattern in proximity to the vehicle using the data; and (ii) providing instructions for selectively binning the camera images based on the light pattern, the selectively binning including binning first pixels together for a particular image or portion thereof, but leaving second pixels for the particular image un-binned, based on the light pattern.

Camera imager binning technique

A method and system to perform dynamic demosaicing for a camera in a vehicle involve an array of image sensors of the camera to obtain light intensity values. Each image sensor of the array of image sensors represents a pixel. An array of filters of the camera overlays the array of image sensors and restricts a wavelength range for which the one image sensor of the array of image sensors obtains the light intensity value. The array of filters includes at least two different types of filters corresponding with two different wavelength ranges. A processor estimates a current state associated with the vehicle and selects a demosaicing algorithm based on the current state such that, for each pixel, the demosaicing algorithm facilitates an estimate of the light intensity value at a different wavelength range than the wavelength range for which the corresponding image sensor obtained the light intensity value.

Dynamic demosaicing of camera pixels

One general aspect includes a method of sound masking, the method including: receiving, via a processor, a privacy request from a user; generating, via the processor, a masking sound configured to mask speech of the user in response to the privacy request; and providing, via the processor, the masking sound as an audio output through an audio system.

Method and system to mask occupant sounds in a ride sharing environment

Methods and systems are provided for assessing possible misalignment of cameras installed on vehicles. In accordance with one example, a camera is mounted on a body of the vehicle, and is configured to generate camera images. Each of the camera images includes a plurality of pixels. A processor is configured to at least facilitate analyzing the pixels of the camera images with respect to color, brightness, or both; and determining whether the camera is misaligned in its mounting on the vehicle based on the analyzing of the color, the brightness, or both, of the pixels.

Camera misalignment determination methods and systems

Methods and systems are provided for providing notifications on camera displays for vehicles. In accordance with one embodiment, camera is mounted on a body of the vehicle, and is configured to generate camera images. A processor is configured to at least facilitate generating a display image based on a processing of the camera images, for display on a display screen within the vehicle; determining a fixed region of the display image corresponding to a fixed part of the vehicle; and providing notifications on the display image in the fixed region of the display image.

Methods and systems for providing notifications on camera displays for vehicles

A method and apparatus for detecting a status of a vehicle door are provided. The method includes detecting a status of a door based on at least one image received from a camera of a vehicle, determining a function to be performed from among a plurality of functions based on the detected status of the door, and performing the determined function. The method and apparatus may be implemented in a vehicle to display graphical indicators warning of a door being ajar or as a supplemental detection system to a hardwired door status sensor.

Method and apparatus for door status detection

Methods and systems are provided for transmitting video data from a vehicle. In one exemplary embodiment, a vehicle processor receives a video transmission command that has been generated in response to a user selection of a video transmission input device, and the vehicle processor transmits video data captured by one or more vehicle cameras in response to the received video transmission command, wherein transmission of video data is at least partly over a telecommunications network to a remote server.

Video activation button

A color filter array apparatus is provided. The apparatus includes a first color filter array comprising color filters arranged in a first pattern and a second color filter array comprising color filters arranged in a second pattern. The first pattern and second pattern may be arranged to optimize the detection or viewing of first and second objects, respectively.

Growing community of inventors

Oakland Township, MI, United States of America

Joseph G Machak