Ford Global Technolgoies, LLC

Michigan State University

Jian Wan

Kwaku O Prakah-Asante

Nanxin Wang

Curtis Sai-Hay To

Prayat Anil Hegde

Jeffrey Allen Greenberg

Kenneth Michael Mayer

Michael Alan Blommer

Harald C Martinez

Brett Stottlemyer

Gianna Gomez-Levi

John Robert Van Wiemeersch

Gary Steven Strumolo

Clay Wesley Maranville

Jayanthi Rao

Anthony Gerald King

Ryan Joseph Gorski

Xiaoming Liu

Xi Yin

Reates Curry

Doug Vandervoort

Neha Singhal

Yousef Atoum

Mike Blommer

Ziyuan Zhang

Luan Tran

Christian Von Hausen

Stephan Sieczka

Jack Malone

David Pulliam

Mike Bloomer

Prayat Anil Hedge

Dima Khanafer

A vehicle including a vehicle door, a detection unit and a vehicle processor is disclosed. The detection unit may be configured to detect an object presence in proximity to the vehicle and object information associated with an object. The vehicle processor may be configured to obtain the object information from the detection unit when the detection unit detects the object presence, and determine that the object may be approaching towards the vehicle door based on the object information. The vehicle processor may further output the object information to a user device responsive to determining that the object may be approaching towards the vehicle door.

Systems and methods for facilitating users to exit from a vehicle

A vehicle for travelling on a roadway with a driver has a driver monitor, a head lamp system, and a controller. The driver monitor senses a driver gaze angle relative to a vehicle heading along the roadway and senses a driver head angle relative to the vehicle heading. The a headlamp system has a steerable headlamp configured to illuminate the roadway with a light beam along a selectable projection angle. The controller is configured to compare the driver gaze angle to a first threshold angle, determine a difference between the driver gaze angle and the driver head angle, and when the driver gaze angle is greater than the first threshold angle and the difference is less than a second threshold angle, then adjust the projection angle to a target angle based on the driver gaze angle.

Adaptively steered vehicle headlamps using driver gaze direction and head direction

A vehicle including a head-up display (HUD), a transceiver and a detection unit is disclosed. The transceiver may be configured to receive vehicle information and information associated with a geographical area in which the vehicle may be located. The detection unit may be configured to detect a user eye gaze direction. The vehicle may further include a processor configured to obtain the vehicle information, the information associated with the geographical area and the user eye gaze direction responsive to obtaining a trigger signal. The processor may determine an object in the geographical area that a user may be viewing based on the vehicle information, the information associated with the geographical area and the user eye gaze direction. The processor may further render an object identifier associated with the object on the HUD till the vehicle travels past the object, responsive to determining the object.

Systems and methods for annotating points of interest on head-up display

A set of training images are input into a neural network that outputs a pixel-wise phase matrix identifying pixels in the training images. Based on the pixel-wise phase matrix, a spatial light modulator (SLM) is actuated to output, onto a vehicle windshield, an augmented reality (AR) image including a plurality of sub-images each output in one of a plurality of focal planes. Each training image corresponds to one respective sub-image. A feedback image of the AR image is obtained via an image sensor. An offset is determined based on comparing the training images to the feedback image. Parameters of a loss function are updated based on the offset, and the updated parameters are provided to the neural network to obtain an updated offset.

Multi-plane augmented reality image generation

A computer includes a processor and memory, the memory can store instructions executable by the processor to display a first calibration symbol to appear at a first location of a virtual image plane viewable from a measured location of the eyes or head of an operator and display a second calibration symbol to appear at a second location of the virtual image plane according to an offset distance from the first location. The instructions additionally can additionally be to adjust the offset distance in response to adjusting the second location by receiving input from the operator to align the first calibration symbol with the second calibration symbol.

Position tracking sensor in a head up display

Systems and methods for virtual vehicle parking assistance are disclosed herein. An example method includes determining a current vehicle position and vehicle dimensions of a vehicle, determining parking space dimensions of a parking space, receiving a desired parking position for the vehicle through an augmented reality interface, the augmented reality interface including a three-dimensional vehicle model based on the vehicle dimensions, the augmented reality interface being configured to allow a user to virtually place the three-dimensional vehicle model in the parking space to determine the desired parking position, determining a virtual parking procedure for the vehicle based on the desired parking position selected by the user and the parking space dimensions of a parking space and causing the vehicle to autonomously park based on the virtual parking procedure.

Systems and methods for virtual vehicle parking assistance background

A roadway complexity awareness system for a vehicle, comprising a processor, an augmented reality interface disposed in communication with the processor, and a memory for storing executable instructions. The processor is programmed to execute the instructions to receive roadway status information from an infrastructure processor associated with a roadway, obtain, from a vehicle sensory system, sensory information indicative of roadway route complexity, and determine a likelihood of roadway route complexity based on the roadway status information and the sensory information. The system may select an augmented reality message indicative of the roadway route complexity, and generate the augmented reality message using an augmented reality interface device, wherein the augmented reality message is visible to a vehicle operator.

User-tailored roadway complexity awareness

A method and system for providing integrated augmented reality (AR) images and content to multiple vehicle occupants having AR devices and methods of generating user-based AR expressions including content control of user generated content.

Integrated augmented reality system for sharing of augmented reality content between vehicle occupants

A User-centric Enhanced Pathway (UEP) system may provide vehicle pathway guidance while driving using an augmented reality display system in the event of sun glare. The system uses a route observer module programmed to predict sun glare, by obtaining real-time information about the interior and exterior vehicle environment, heading, speed, and other data. The route observer module may also use an inward-facing camera to determine when the driver is squinting, which may increase the probability function that predicts when the driver is experiencing sun glare. When sun glare is predicted, the route observer sends the weighted prediction function and input signals to a decision module that uses vehicle speed, location, and user activity to determine appropriate guidance output for an enhanced pathway using an Augmented Reality (AR) module. The AR module may adjust brightness, contrast, and color of the AR information based on observed solar glare.

Enhanced augmented reality vehicle pathway

Gait, the walking pattern of individuals, is one of the most important biometrics modalities. Most of the existing gait recognition methods take silhouettes or articulated body models as the gait features. These methods suffer from degraded recognition performance when handling confounding variables, such as clothing, carrying and view angle. To remedy this issue, a novel AutoEncoder framework is presented to explicitly disentangle pose and appearance features from RGB imagery and a long short-term memory integration of pose features over time produces the gait feature.

Systems and methods for gait recognition via disentangled representation learning

A method includes determining a location of a roadside object relative to a vehicle interior based on one or more of a vehicle Global Positioning System (GPS) location, a vehicle heading, and environmental data, and generating a first virtual representation of the roadside object in an augmented reality (AR) world coordinate system. A processor synchronizes a vehicle coordinate system with the AR world coordinate system, in which a virtual representation of the roadside object is generated. The method further includes orienting a driver AR wearable device with the synchronized vehicle coordinate system, determining an identity associated with a user of the driver AR wearable device, and generating, based at least in part on the identity associated with the user of the driver AR wearable device, a virtual representation of the roadside object in an AR world coordinate system aligned with the vehicle GPS location and the vehicle heading.

Augmented reality wearable system for vehicle occupants

Image data of a vehicle occupant are collected from a plurality of cameras. A dimensional model of substantially an entire body of the vehicle occupant is generated based on the image data. A gesture performed by the vehicle occupant is recognized based on the dimensional model. A vehicle subsystem is adjusted based on the gesture.

Virtual vehicle occupant rendering

An electronic method for parametric modeling of a conceptual vehicle design. The method includes (a) receiving dimensional input including one or more vehicle level parameters and one or more component level parameters; (b) receiving geometrical input including one or more non-dimensional design inputs; and (c) generating a parametric concept model based on dimensional input and the geometrical input.

Parametric modeling method and system for conceptual vehicle design

A computer-implemented method for rapidly designing a vehicle package is disclosed. The method receives virtual vehicle package model data, converts the data into mechanical vehicle package model data and transmits the data to a mechanical vehicle package model system. A method is also disclosed for adjusting the mechanical model, converting the adjustment into data readable by a computer aided design system and transmitting the data to the computer aided design system for generating or modifying the virtual vehicle package. A system for designing a vehicle package is disclosed having a mechanical vehicle package model, a computer aided design system, a translator embodied in a computer system in communication with the computer aided design system and a mechanical vehicle package model in communication with the translator.

Growing community of inventors

Novi, MI, United States of America

Jian Wan