Gm Global Technolgoy Operations, Inc.

Carnegie Mellon University

Intelligrated Headquarters, LLC

Katharina Muelling

Upali Priyantha Mudalige

Praveen Palanisamy

John M Dolan

Matthew R Wicks

Gabriel Goldman

Yilun Chen

Herman Herman

Michael L Girtman

John E Simons

Thomas Michael Ferner

Jose Gonzalez-Mora

D W Wilson Hamilton

Zhiqian Qiao

Jose Gonzales-Mora

DW Wilson Hamilton

Various example embodiments described herein relate to an item manipulation system including a control system and a robotic arm coupled to the control system. The item manipulation system includes an end effector communicatively coupled to the control system and defines a first end and a second end. The first end of the end effector is rotatably engaged to the robotic arm. The item manipulation system also includes a gripper unit attached to the second end of the end effector. The gripper unit is configured to grip the item. The gripper unit includes at least one flexible suction cup and at least one rigid gripper. Each of the flexible suction cup and the at least one rigid gripper engage a surface of the item based on vacuum suction force generated through the at least one flexible suction cup or the at least one rigid gripper.

Method and system for manipulating articles

The present disclosure relates to a material handling system for manipulating items. The material handling system includes a repositioning system comprising a robotic tool which includes a robotic arm portion and an end effector. The robotic tool is configured to manipulate an item in a first orientation and reorient the item to a second orientation. The material handling system further includes a vision system having one or more sensors positioned within the material handling system. The vision system is configured to generate inputs corresponding to the characteristics of the items. The material handling system may further include a controller executing instructions to cause the material handling system to identify the item in the first orientation, based on the one or more characteristics of the item, initiate, by the repositioning system, picking of the item in the first orientation, and re-orient the item in the second orientation.

Method and system for manipulating items

Systems and methods are provided for end-to-end learning of commands for controlling an autonomous vehicle. A pre-processor pre-processes image data acquired by sensors at a current time step (CTS) to generate pre-processed image data that is concatenated with additional input(s) (e.g., a segmentation map and/or optical flow map) to generate a dynamic scene output. A convolutional neural network (CNN) processes the dynamic scene output to generate a feature map that includes extracted spatial features that are concatenated with vehicle kinematics to generate a spatial context feature vector. An LSTM network processes, during the (CTS), the spatial context feature vector at the (CTS) and one or more previous LSTM outputs at corresponding previous time steps to generate an encoded temporal context vector at the (CTS). The fully connected layer processes the encoded temporal context vector to learn control command(s) (e.g., steering angle, acceleration rate and/or a brake rate control commands).

Method and system for end-to-end learning of control commands for autonomous vehicle

Systems and methods are provided that employ spatial and temporal attention-based deep reinforcement learning of hierarchical lane-change policies for controlling an autonomous vehicle. An actor-critic network architecture includes an actor network that process image data received from an environment to learn the lane-change policies as a set of hierarchical actions, and a critic network that evaluates the lane-change policies to calculate loss and gradients to predict an action-value function (Q) that is used to drive learning and update parameters of the lane-change policies. The actor-critic network architecture implements a spatial attention module to select relevant regions in the image data that are of importance, and a temporal attention module to learn temporal attention weights to be applied to past frames of image data to indicate relative importance in deciding which lane-change policy to select.

Spatial and temporal attention-based deep reinforcement learning of hierarchical lane-change policies for controlling an autonomous vehicle

The present application generally relates to a method and apparatus for generating an action policy for controlling an autonomous vehicle. In particular, the system performs a deep learning algorithm in order to determine the action policy and an automatically generated curriculum system to determine a number of increasingly difficult tasks in order to refine the action policy.

Method and apparatus for automatically generated curriculum sequence based reinforcement learning for autonomous vehicles

Growing community of inventors

Pittsburgh, PA, United States of America

Katharina Muelling