Toyota Research Institute, Inc.

Soonho Kong

Jonathan Decastro

Frank Permenter

Dennis Park

Nikos Arechiga Gonzalez

Nikos Arechiga

Nikos Arechiga-Gonzalez

Avinash Balachandran

Sarah Koehler

Kevin M Zaseck

Sagar Behere

Systems and methods for automatically generating solver code for a nonlinear model predictive controller are disclosed. In one embodiment, a method of automatically generating solver code for a nonlinear model predictive control solver includes receiving an optimal control problem code, wherein the optimal control problem code represents an optimal control problem comprising a cost function, one or more constraints, and a continuous time model representing dynamics of a system. The method further includes receiving a discretization method preference, a linearization point preference, and a parameter specification, and encoding the optimal control problem into an optimization problem by discretizing the optimal control problem according to the discretization method preference, and linearizing the optimal control problem according to the linearization point preference. The method further includes generating the solver code from the optimization problem.

Systems and methods for automatically generating solver code for nonlinear model predictive control solvers

A method performed by an autonomous vehicle includes identifying a condition preventing the autonomous vehicle from proceeding along an intended route. The method also includes prompting a passenger of the autonomous vehicle to interact with a driver of a first vehicle in response to identifying the condition. The method further includes receiving, from the passenger, an input at an interface of the autonomous vehicle indicating a successful interaction or an unsuccessful interaction with the driver. The method also includes controlling the autonomous vehicle to proceed along the intended route based on the input indicating the successful interaction with the driver.

Actively adapting to driving environments based on human interactions

A driver monitor system and method for predicting impairment of a user of a vehicle. The system includes video cameras, an input device for inputting a list of medications being taken by the driver. Processing circuitry predicts side effects of the medications based on the half-life of the medication, detecting eye gaze movement, eye lid position, and facial expression of the user using images from the video camera, predicting whether the user is transitioning into an impaired physical state that is a side effect of the medications, verifying the side effect of the medications, determining whether the user is fit to drive using the verified side effects of the medications, and outputting to the vehicle an instruction to operate the vehicle in a level of automation that makes up for the at least one side effect or to perform a safe pull over operation of the vehicle.

Predictive impairment monitor system and method

Aspects of the disclosure provide a parking method and system for a vehicle. For example, the parking system can include a processor and an output circuit. As another example, the parking system can include the processor and a compelling unit. The processor can be configured to determine whether a first weather condition, such as snowing, raining, icing and hailing, at a first parking location meets a first criterion, and identify, when the first weather condition meets the first criterion, a second parking location at which a second weather condition meets a second criterion different from the first criterion. The output unit can be configured to output an alert to the vehicle parked at the first parking location indicating that the vehicle is to be moved to the second parking location. The compelling unit can be configured to compel the vehicle to move to the second parking location.

Predictive parking due to weather

An artificial intelligence perception system for detecting one or more objects includes one or more processors, at least one sensor, and a memory device. The memory device includes an image capture module, an object identifying module, and a logical scaffold module. The image capture module and the object identifying module cause the one or more processors to obtain sensor information of a field of view from a sensor, identify an object within the sensor information, and determine at least one property of the object. The logical scaffold module causes the one or more processors to determine, by a logical scaffold, when the at least one property of the object as determined by the object identifying module is one of a true condition or a false condition.

System and method for detecting errors and improving reliability of perception systems using logical scaffolds

A method for controlling an autonomous vehicle includes navigating the autonomous vehicle based on a set of rules. The method also includes identifying an abnormality in a current driving situation. The method further includes prompting a passenger of the autonomous vehicle to interact with a driver of a first vehicle in response to identifying the abnormality. The method still further includes controlling the autonomous vehicle to violate one or more rules of the set of rules in response to an indication of a successful interaction with the driver.

System, methods, and other embodiments described herein relate to improving situational awareness of a user. In one embodiment, a method includes, in response to acquiring, in a personal device, sensor data from a set of sensors that perceive a surrounding environment of the user, identifying from the sensor data one or more objects in the surrounding environment relative to the user. The method includes determining a threat to the user from the one or more objects according to at least trajectories of the one or more objects embodied in the sensor data. The method includes generating, via the personal device, an indicator to inform the user of the one or more objects according to the threat.

Growing community of inventors

Arlington, MA, United States of America

Soonho Kong