Fanuc America Corporation

Fanuc Robotics America Corporation

Gmf Robotics Corporation

Fanuc Robotics North America, Inc.

Fanul Robotics America, Inc.

Kenneth W Krause

Judy Evans

Rick E Wunderlich

Leo Keselman

Derek Jung

Ashok Prajapati

Glenn Nowak

H Dean McGee

Ganesh Kalbavi

Claude Dinsmoor

Glenn F Nowak

Bruce E Coldren

Michael B Longo

Jason Tsai

Scott J Clifford

Ho Cheung Wong

Gordon Geheb

Min-Ren Jean

Randy A Graca

Bradley O Niederquell

Donald D DeMotte

Gary J Rutledge

Scott M Dreslinski

Isaac Eckert

Jim Huber

Berthold K Horn

Chia P Day

Charles R Strybis

Bruce Coldren

Isaac Robinson Stephan Thangaiah Albert

Eric Flanagin

Gerald A Ross

Charles F Slabe

Louis L Whitcomb

Sam Yung-Sen Lee

A dynamic messaging system for factory automation devices that provides flexible data transport, presentation and scheduling. Custom message instructions are provided to robot controllers using configuration templates which are loadable without rebooting the controller or affecting ongoing operations of the robot. The configuration templates contain data definitions only and no executable code. Custom data messages are sent from the robot controller based on triggers, including periodic timers, transmission of a current message, change of device elements and programmatic requests. Custom message attributes such as transmission rate and priority can be set, and messages may include file attachments. A message template creator, external to the robot controller, creates the configuration templates, ensures message uniqueness and generates data ingestion schema. The schema are used by a cloud data parser to translate and load data into data tables, where the customer can analyze data from the messages using applications in a web portal.

Dynamic messaging system for factory automation device

Methods and systems include ways to implement change analysis of an automated production line including at least one robot. Monitoring a plurality of operating parameters associated with the automated production line including the at least one robot is followed by recording at least one change to the plurality of operating parameters. A notification is then provided identifying the at least one change to the plurality of operating parameters. The notification can include mapping the at least one change onto a graphical representation of the automated production line, thereby identifying a portion of the automated production line affected by the at least one change. As a result, at least one of the operating parameters can be adjusted in response to the notification. An action can also be performed in response to the notification. In this manner, the change analysis can optimize operation of the automated production line.

Program and variable change analysis method and system

An augmented reality (AR) system for visualizing and modifying robot operational zones. The system includes an AR device such as a headset in communication with a robot controller. The AR device includes software for the AR display and modification of the operational zones. The AR device is registered with the robot coordinate frame via detection of a visual marker. The AR device displays operational zones overlaid on real world images of the robot and existing fixtures, where the display is updated as the user moves around the robot work cell. Control points on the virtual operational zones are displayed and allow the user to reshape the operational zones. The robot can be operated during the AR session, running the robot's programmed motion and evaluating the operational zones. Zone violations are highlighted in the AR display. When zone definition is complete, the finalized operational zones are uploaded to the robot controller.

Visualization and modification of operational bounding zones using augmented reality

A system and method for calibrating the position of a machine having a stationary part to a stationary marker. The process first images the machine and the marker, and then identifies a visible part of the machine in the images that has been 3D modeled. The process then calculates a location of the stationary part of the machine using the modeled position of the visible part and the known kinematics and position of the machine. The process then identifies the stationary marker in the images, and establishes a relationship between the stationary marker and the stationary part of the machine, which can be used for calibration purposes. In one embodiment, the machine is a robot and the process is performed by an AR application.

Actuated mechanical machine calibration to stationary marker

An augmented reality (AR) system for production-tuning of parameters for a visual tracking robotic picking system. The robotic picking system includes one or more robots configured to pick randomly-placed and randomly-oriented parts off a conveyor belt and place the parts in an available position, either on a second moving conveyor belt or on a stationary device such as a pallet. A visual tracking system identifies position and orientation of the parts on the feed conveyor. The AR system allows picking system tuning parameters including upstream, discard and downstream boundary locations to be visualized and controlled, real-time robot pick/place operations to be viewed with virtual boundaries, and system performance parameters such as part throughput rate and part allocation by robot to be viewed. The AR system also allows virtual parts to be used in simulations, either instead of or in addition to real parts.

Augmented reality visualization for robotic picking system

A method and system for calibration of an augmented reality (AR) device's position and orientation based on a robot's positional configuration. A conventional visual calibration target is not required for AR device calibration. Instead, the robot itself, in any pose, is used as a three dimensional (3D) calibration target. The AR system is provided with a CAD model of the entire robot to use as a reference frame, and 3D models of the individual robot arms are combined into a single object model based on joint positions known from the robot controller. The 3D surface model of the entire robot in the current pose is then used for visual calibration of the AR system by analyzing images from the AR device camera in comparison to the surface model of the robot in the current pose. The technique is applicable to initial AR device calibration and to ongoing device tracking.

Robot calibration for AR and digital twin

Methods and systems include ways to implement change analysis of an automated production line including at least one robot. Monitoring a plurality of operating parameters associated with the automated production line including the at least one robot followed by recording at least one change to the plurality of operating parameters. A notification is then provided identifying the at least one change to the plurality of operating parameters. The notification can include mapping the at least one change onto a graphical representation of the automated production line, thereby identifying a portion of the automated production line affected by the at least one change. As a result, at least one of the operating parameters can be adjusted in response to the notification. An action can also be performed in response to the notification. In this manner, the change analysis can optimize operation of the automated production line.

Program and variable change analysis

A system and a method for displaying a three-dimensional robotic workcell data includes generating the robotic workcell data, a display device including a web browser for receiving the robotic workcell data in a standard format and displaying a three-dimensional rendering of the robotic workcell data, and manipulating the three-dimensional rendering on the display device.

System, method, and apparatus to display three-dimensional robotic workcell data

A method and an apparatus for displaying three-dimensional workcell data includes a hand-held pendant that is provided with 3-D workcell data representing a model of a machine and associated components in a workcell. The hand-held pendant has a display that generates a 3-D visual representation of the workcell data. The pendant can be operated by a user to manipulate the visual representation to change a user viewpoint and to show motion of the machine with associated process information.

Robot teach device with 3-D display

A robot control system includes a line tracking encoder that measures a reference position of a conveyor line and transmits a tracking signal representing tracking data including the reference position of the conveyor line. A master controller is in communication with the encoder to receive the tracking signal, process the tracking data represented by the tracking signal, and generate a data packet in response to processing of the tracking data. A slave controller is in communication with the master controller and at least one robot for receiving the data packet and controlling the movement of the at least one robot in response to the data packet. A communications network directly interconnects the master controller and the slave controller and transmits the data packet from the master controller to the slave controller.

Line tracking data over Ethernet

An apparatus provides selective communication between multiple programmable robot controllers and one or more teaching devices connected by a network. The network controls communication between the teaching devices and the controllers including active tasks and passive tasks for preventing communication of active tasks between any of the controllers and more than one of any of the teaching devices. The network permits communication of the passive tasks between any of the controllers and one of the teaching devices communicating active tasks with another one of the controllers.

Flexible connection of teaching devices to programmable controllers

A control system includes controllers that are coupled mutually by a communications network, on which information, transmitted from a master controller to a slave controller, is used to make timing corrections on the slave controller in order to synchronize event timers on the slave controller with that of the master controller. Timing accuracy for the occurrence of the event commanded by each controller is synchronized in narrow range of time, preferably within a few milliseconds depending on the specific application and system.

Synchronizing controllers linked by a communications network

A robotic system for a robot includes a programmable controller coupled to the robot and a teach pendant coupled to the programmable controller. The teach pendant is adapted to control the robot and includes a processor capable of operating the teach pendant and a display coupled to the processor. The teach pendant also includes a web browser. The web browser is adapted to accept input data in a standard format and display the input data on the display.

Robotic system with teach pendant

A method and system for automatically determining the position and orientation of an object by utilizing as few as a single digital image generated by as few as a single camera without the use of a structured light. The digital image contains at least three non-colinear geometric features of the object. The three features may be either coplanar or non-coplanar. The features or targets are viewed such that perspective information is present in the digital image. In a single camera system the geometric features are points, and in a multi-camera system, the features are typically combinations of points and lines. The location of the features are determined and processed within a programmed computer together with reference data and camera calibration data to provide at least three non-parallel 3-D lines. The 3-D lines are utilized by an iterative algorithm to obtain data relating to the position and orientation of the object in 3-D space. The resultant data is subsequently utilized to calculate an offset of the object from the camera. The offset is then transformed into the coordinate system or frame of a peripheral device such as a robot, programmable controller, numerically controlled machine, etc. Finally, the programmed computer transfers the transformed offset to the peripheral device which utilizes the transformed offset to modify its preprogrammed path.

Method and system for automatically determining the position and

A method and system are provided for automatically locating an object at a vision station by performing an edge-detecting algorithm on at least a portion of the gray-scale digitized image of the object. Preferably, the algorithm comprises an implementation of the Hough transform which includes the iterative application of a direction-sensitive, edge-detecting convolution to the digital image. Each convolution is applied with a different convolution mask or filter, each of which is calculated to give maximum response to an edge of the object in a different direction. The method and system have the ability to extract edges from low contrast images. Also, preferably, a systolic array processor applies the convolutions. The implementation of the Hough transform also includes the steps of shifting the resulting edge-enhanced images by certain amounts in the horizontal and vertical directions, summing the shifted images together into an accumulator buffer to obtain an accumulator image and detecting the maximum response in the accumulator image which corresponds to the location of an edge. If the object to be found is permitted to rotate, at least one other feature, such as another edge, must be located in order to specify the location and orientation of the object. The location of the object when correlated with the nominal position of the object at the vision station provides the position and attitude of the object. The resultant data may be subsequently transformed into the coordinate frame of a peripheral device, such as a robot, programmable controller, numerical controlled machine, etc. for subsequent use by a controller of the peripheral device.

Growing community of inventors

Rochester Hills, MI, United States of America

Kenneth W Krause