Lyft, Inc.

Teleo, Inc.

Woven Planet North America, Inc.

Vinay Shet

David Tse-Zhou Lu

Ying Liu

Shaojing Li

Shaohui Sun

Weiyi Hou

Robert Charles Kyle Pinkerton

Lina Dong

Somesh Khandelwal

Ivan Kirigin

Sameer Qureshi

Asif Haque

Gerard Joyce

Mark Douglas Huyler

Ramesh Rangarajan Sarukkai

Renee Park

Romain Clément

Saurabh Saraf

Emil Constantin Praun

Clemens Marschner

Thomas Schiwietz

Holger H Rapp

Wolfgang Hess

Patrick Dubroy

Ramesh Sarukkai

A method and system may receive data generated by a plurality of remotely situated vehicles. Various operations are performed with respect to portions of the received data to generate first output representing one or more vehicle actions. Various operations are performed with respect to portions of the received data to generate second output representing one or more control center actions.

Deported compute for teleoperation and autonomous systems

A method and system may generate a quality control profile to indicate an expertise level and one or more skills of a teleoperator(s). The control center evaluates optimization criteria for a workflow to assign performance of microtasks of the workflow to select teleoperators from a pool of teleoperators. Each teleoperator accesses teleoperation functionality for remote control of a plurality of types of equipment at one or more defined geographic areas and each teleoperator is remotely located from the defined geographic areas. The control center generates queues for each of the select teleoperators that include corresponding assigned microtasks.

Systems and methods of assigning microtasks of workflows to teleoperators

Systems, methods, and non-transitory computer-readable media can access a plurality of schema-based encodings providing a structured representation of an environment captured by one or more sensors associated with a plurality of vehicles traveling through the environment. The plurality of schema-based encodings can be clustered into one or more clusters of schema-based encodings. At least one scenario associated with the environment can be determined based at least in part on the one or more clusters of schema-based encodings.

Approaches for encoding environmental information

Systems, methods, and non-transitory computer-readable media can determine sensor data captured by at least one sensor of a vehicle while navigating an environment over a period of time. Information describing one or more agents associated with the environment during the period of time can be determined based at least in part on the captured sensor data. A schema-based encoding describing the environment during the period of time can be generated based at least in part on the determined information and a scenario schema, wherein the schema-based encoding provides a structured representation of the environment during the period of time.

Systems, methods, and non-transitory computer-readable media can determine a road segment. A set of features associated with the road segment can be determined based at least in part on data captured by one or more sensors of a vehicle. A level of similarity between the road segment and each of a set of road segment types can be determined by comparing the set of features to features associated with each of the set of road segment types. The road segment can be classified as a road segment type based on the level of similarity. Scenario information associated with the road segment can be determined based on the classified road segment type.

Road segment similarity determination

Systems, methods, and non-transitory computer-readable media can receive a geometric map and a semantic map associated with a geographic area, the semantic map comprising semantic data associated with vehicle navigation. A first semantic position estimate associated with a first piece of semantic data contained in the semantic map is generated based on semantic data location information associated with the first piece of semantic data. A final position for the first semantic position estimate is received. One or more three-dimensional semantic labels are applied to the geometric map based on the final position of the first semantic position estimate. A warped semantic map is generated. Generating the warped semantic map comprises warping the semantic map based on the one or more three-dimensional semantic labels.

Systems and methods for aligning map data

A method and system may receive tiled video feed data sourced from one or more remotely situated vehicles. A teleoperator user interface is generated to include a concurrent display of a plurality of distinct video tiles from the tiled video feed data. A respective video tile displayed in the teleoperator user interface may include visual safety cues. A user interface segment that is displaying a respective video tile may be modified in response to teleoperator input.

Built-in safety of control station and user interface for teleoperation

The disclosed computer-implemented method may include (i) identifying, by a server computer system, a provider computing device for use in capturing street-level image data, where the provider computing device controls a camera positioned to capture street-level imagery outside the vehicle, (ii) determining, by the server computer system, a configuration that controls use of the provider computing device to provide street-level image data captured by the camera to the server computer system, (iii) sending, by the server computer system, the configuration to the computing device, and (iv) receiving, from the computing device, street-level image data captured by the computing device using the camera responsive to the configuration. Various other methods, systems, and computer-readable media are also disclosed.

Systems and methods for coordinated collection of street-level image data

Systems, methods, and non-transitory computer-readable media can access a first set of schema-based encodings associated with a first environment, wherein a schema-based encoding provides a structured representation of an environment based on a scenario schema. First information representing scenario information associated with the first environment can be generated based at least in part on the first set of schema-based encodings. One or more attributes for the first environment can be determined based at least in part the first information.

Systems, methods, and non-transitory computer-readable media can determine a set of features associated with a road segment based at least in part on data captured by one or more sensors of a vehicle. At least one scenario that is associated with the set of features can be determined. The at least one scenario can be associated with the road segment. The associated at least one scenario and the road segment can be maintained in a scenario information database.

Growing community of inventors

Fremont, CA, United States of America

Vinay Shet