Toyota Research Institute, Inc.

X Development LLC

Google Inc.

Boston Dynamics, Inc.

Julian MacNeille Mason

Nikolaos Michalakis

James Joseph Kuffner

Rohit Ramesh Saboo

Jared Stephen Russell

Matthew W Amacker

Hiroshi Yasuda

Kurt Konolige

James M Adler

Katarina R C Miller

James J Kuffner

Methods, apparatus, systems, and computer-readable media are provided that relate to using one or more vision sensors to capture images of a loaded pallet in association with application of stretch wrap to the loaded pallet by an automated pallet wrapping machine. The images are used to generate an image-based identifier for the loaded pallet that is then used for pallet identification by mobile robots and/or other automated agents in a warehouse or other environment. In some implementations, the images are captured by the vision sensor when the pallet is in the wrapping area of the automated pallet wrapping machine and while the vision sensor and/or the pallet are rotating. In some implementations, the image-based identifier may be assigned to pallet attributes and/or a de-palletizing scheme of the loaded pallet.

Generating an image-based identifier for a stretch wrapped loaded pallet based on images captured in association with application of stretch wrap to the loaded pallet

Systems and methods for predicting wait time in a parking area are disclosed herein. The systems and methods include determining how long a sensing vehicle has been within a parking area without parking. Using this information, the method determines the estimated wait time for the parking area and transmits guidance to one or more recipient vehicles. This helps with efficient selection of parking areas, saving gas and preventing congestion on roadways.

Parking monitoring for wait time prediction

A method for improving an autonomous driving system for an autonomous vehicle is disclosed. The method includes sub-sampling a frame generated by an output of a sensor and transmitting, to a remote device, the sub-sampled frame and classification data corresponding to the sub-sampled frame. The method also includes receiving, from the remote device, an adjustment to the autonomous driving system in response to the transmitted sub-sampled frame and classification data. The method further includes controlling an action of the autonomous vehicle based on the adjusted autonomous driving system.

Debugging an autonomous driving machine learning model

An apparatus for autonomous driving includes data collecting devices and processing circuitry. The data collecting devices collects initial data including first data related to a driving condition that includes a driving environment surrounding a vehicle and motion of the vehicle and second data related to driving the vehicle under the driving condition. The processing circuitry determines, based on the initial data, the driving environment and a vehicle driving mode including a first type of driving environment and a respective autonomous driving mode and an off-road driving environment and a respective non-autonomous driving mode. The data collecting devices collect additional data including first data related to the driving condition and second data related to driving the vehicle under the driving condition when the vehicle driving mode is the non-autonomous driving mode, and trains the vehicle to implement autonomous driving under the off-road driving environment based on the additional data.

Apparatus and method for autonomous driving

Systems and methods of information corroboration are disclosed herein. The systems and methods can include receiving an initial report from at least one detecting party and receiving at least one secondary report from at least one corroborating party. The initial information set and the secondary information set can then be compared and applied to create a reliability factor for the initial information set. The reliability of the initial information set can be determined using the reliability factor; and providing virtual compensation to at least one of the at least one detecting party and the at least one corroborating party, when the initial information set is determined to be reliable.

Systems and methods of incentivized data sharing

A method, an apparatus, and a non-transitory computer readable medium for parking assistance are provided. The method includes identifying a parking space based on information acquired from a plurality of sensors, connecting to a sensor associated with the identified parking space, acquiring measurement data from the sensor indicative of a vehicle position relative to the sensor, determining a parking trajectory based on the measurement data, and controlling at least a subsystem of a vehicle based on the parking trajectory.

System, method, and apparatus for parking assistance

Aspects of the disclosure provide a method for collectively determining an object by a group of vehicles. The method can include receiving sensor data indicating an object at a first vehicle of the group of vehicles communicating with each other, determining the object to reach a first conclusion based on the sensor data at the first vehicle, transmitting the sensor data and the first conclusion to second vehicles of the group of vehicles from the first vehicle, determining the object to reach a second conclusion at each second vehicle based on the sensor data, transmitting second conclusions from the respective second vehicles to the other second vehicles and the first vehicle, and determining the object based on the first and second conclusions at the first vehicle or the second vehicles.

Collective determination among autonomous vehicles

A computing system for a vehicle includes one or more processors for controlling operation of the computing system, and a memory for storing data and program instructions usable by the one or more processors. The one or more processors are configured to execute instructions stored in the memory to process sensor information to determine a condition of a portion of a ground surface adjacent at least one door opening of the vehicle, and to control an operation of the vehicle responsive to the condition of the portion of the ground surface adjacent the at least one door opening of the vehicle.

System for alerting a vehicle occupant to a ground surface condition adjacent a vehicle door

This disclosure describes various embodiments for resource optimization in a vehicle. In an embodiment, a system for resource optimization in a vehicle is described. The system may comprise a memory; a processor coupled to the memory; and a resource optimization module. The resource optimization module may be configured to: monitor usage of local computing resources of the vehicle, the local computing resources comprising the processor and available bandwidth of a transmission medium; determine an availability of the local computing resources; evaluate data captured by one or more sensors of the vehicle; and determine whether to process the data locally or remotely based, at least in part, on the availability of the local computing resources and the data captured by the one or more sensors.

Resource optimization in vehicles

System, methods, and other embodiments described herein relate to end-user modification of the driving behavior of a vehicle when operating in an autonomous driving mode. One embodiment stores disengagement data associated with an autonomous driving mode of the vehicle; outputs, to an end user from the stored disengagement data, a report of a disengagement that occurred along a particular route identified by the end user due to incorrect identification, by a sensor system of the vehicle, of an object; receiving, from the end user, a corrective input that includes labeling the object; and modifying automatically one or more autonomous driving modules of the vehicle in accordance with the corrective input to prevent future disengagements when the vehicle is traveling along the particular route in the autonomous driving mode.

Systems and methods for end-user modification of driving behavior of autonomous vehicle

The systems and methods described herein disclose regulation of vehicle access based on operator proficiency. The systems and methods for regulating vehicle access by an operator include determining, using driving capacity information, a driving capacity metric for an operator in a vehicle. A vehicle system of the vehicle can then be evaluated for a vehicle system proficiency. The driving capacity metric and the vehicle system proficiency can then be compared. Then, using the comparison, a proficiency level of the operator can be determined for the at least one vehicle system. Finally, access to the at least one vehicle system can be provided to the operator based on the proficiency level.

Systems and methods for operator skill mitigation

Provided is a parking navigation method and system including a vehicle including an in-vehicle computer system having at least one processor and associated memory device, wireless communication circuit, and display. The memory device storing an application program having instructions, the instructions when executed perform a method including: detecting, via the wireless communication circuit, entry into a parking structure, the parking structure including a capability of identifying open parking spaces, synchronizing the vehicle with the parking structure, determining an available parking space in the parking structure, generating a route to the available parking space, displaying a map having a route to the parking space.

Parking scheduler and car router system

Vehicle control systems and methods for controlling a vehicle using behavior profiles of neighboring vehicles are disclosed. In one embodiment, a vehicle control system of a vehicle includes one or more processors and one or more non-transitory memory modules communicatively coupled to the one or more processors and storing machine-readable instructions that, when executed, cause the one or more processors to perform at least at the following: detect a neighboring vehicle within an environment, determine an autonomous software version executed by the neighboring vehicle, determine a behavior profile associated with the autonomous software version, and control one or more vehicle systems of the vehicle based at least in part on the behavior profile associated with the autonomous software version.

Vehicle control systems and methods of controlling vehicles using behavior profiles

Methods and systems for dynamically maintaining a map of robotic devices in an environment are provided herein. A map of robotic devices may be determined, where the map includes predicted future locations of at least some of the robotic devices. One or more robotic devices may then be caused to perform a task. During a performance of the task by the one or more robotic devices, task progress data may be received from the robotic devices, indicative of which of the task phases have been performed. Based on the data, the map may be updated to include a modification to the predicted future locations of at least some of the robotic devices. One or more robotic devices may then be caused to perform at least one other task in accordance with the updated map.

Growing community of inventors

Redwood City, CA, United States of America

Julian MacNeille Mason