Carnegie Mellon University

Alonzo James Kelly

Herman Herman

Anthony Joseph Stentz

Mark Ollis

Robert Craig Coulter

Jean-Sebastien Valois

Peter W Rander

John E Bares

Eric Meyhofer

Christopher Chandler Fromme

Christopher L Baker

Frank Higgins

Bryan G Campbell

David K Herdle

Randon Warner

Timothy Ennis Hegadorn

Yu Zhong

Christopher Randolph Baker

Richard McCargo Moore, Jr

David G Galati

Justin C Haines

Andrew Strat

Stuart Edwin Lawrence, Iii

The invention disclosed herein describes a supervised autonomy system designed to precisely model, inspect and process the surfaces of complex three-dimensional objects. The current application context for this system is laser coating removal of aircraft, but this invention is suitable for use in a wide variety of applications that require close, precise positioning and maneuvering of an inspection or processing tool over the entire surface of a physical object. For example, this system, in addition to laser coating removal, could also apply new coatings, perform fine-grained or gross inspection tasks, deliver and/or use manufacturing process tools or instruments, and/or verify the results of other manufacturing processes such as but not limited to welding, riveting, or the placement of various surface markings or fixtures.

Supervised autonomous robotic system for complex surface inspection and processing

A method and system for controlling an apparatus including receiving data indicative of an actual state of the apparatus, defining a first viewpoint relative to at least one of the environment and the apparatus, determining a first predicted state of the apparatus at time T, determining a first predicted state of the environment at time T, producing a first virtualized view from the first viewpoint, sending a first control signal to the apparatus after producing the first virtualized view, defining a second viewpoint relative to at least one of the apparatus and the environment, determining a second predicted state of the apparatus at time T+delta T, determining a second predicted state of the environment at time T+delta T, producing the second virtualized view from the second viewpoint, sending a second control signal to the apparatus after producing the second virtualized view, and changing the actual state of the apparatus based on the first control signal.

Apparatuses, systems, and methods for apparatus operation and remote sensing

A computer-assisted method for localizing a rack, including sensing an image of the rack, detecting line segments in the sensed image, recognizing a candidate arrangement of line segments in the sensed image indicative of a predetermined feature of the rack, generating a matrix of correspondence between the candidate arrangement of line segments and an expected position and orientation of the predetermined feature of the rack, and estimating a position and orientation of the rack based on the matrix of correspondence.

System and method for object localization

A computer-assisted method for determining a position and orientation a sensor relative to a scene. The sensor has a plurality of degrees of freedom in position and orientation relative to the scene. The method includes sensing an image of the scene, the sensed image having a plurality of regions such that a sum of degrees of independent constraint of the plurality of regions equals or exceeds the degrees of freedom in position and orientation of the sensor relative to the scene, comparing the plurality of regions of the sensed image to a plurality of regions of a first image of the scene stored in a map, the first stored image representative of a position and orientation of the sensor relative to the scene, and determining sensor position and orientation based on the comparing.

Infrastructure independent position determining system

A mining machine having a position sensing and control apparatus is claimed. The mining machine has a vehicle body having forward and rearward ends and movable along a mine floor. A cutter head is mounted on the forward end of the mining machine for upward and downward movement relative to the vehicle body. A conveyor mounted on the vehicle body conveys material cut by the cutter head. The position sensing and control apparatus has at least one light source and at least one imaging device mounted on the machine. The position sensing and control apparatus captures images of natural features of an interior surface of a mine, digitizes the images and determines the distance between the imaging device and the natural feature to determine positional change of the machine.

Vision-based motion sensor for mining machine control

A method and apparatus for determining position is comprised of the steps of capturing an image related to the present position and comparing the captured image with one or more images from an iconic map. The iconic map is a map which stores images of a substantially flat surface over which a robot or vehicle is to operate. The stored images contain randomly occurring characteristics such as the fibers in a carpet, brush marks appearing in brushed concrete, and the like. Although such naturally occurring features are essentially random, when analyzed in small enough images, each image becomes unique. The position is determined based upon the image from the map which provides the highest correlation. Speed, wheel slippage, and other parameters can be calculated using the disclosed method.

Growing community of inventors

Pittsburgh, PA, United States of America

Alonzo James Kelly