Manufacturing AUTOMATION

SwRI shows robotic machine vision solution for shiny objects at Automate

April 9, 2019
By Manufacturing AUTOMATION

SwRI and ROS-Industrial integrated intelligent part reconstruction within the ROS2 framework to improve industrial robotics 3D image perception for path planning with way-point dense operations such as parts sanding.

April 9, 2019 – Southwest Research Institute (SwRI) and ROS-Industrial have developed a solution that enables industrial robots to scan and manipulate metallic objects that had previously been too “shiny” for machine vision to process.

SwRI is exhibiting the solution at the Automate trade show in Chicago this week (April 8-11). The project integrates intelligent part reconstruction using the second generation of the Robot Operating System (ROS2) framework to improve 3D image perception when robots autonomously sand and finish parts.

“This is a great case study in the benefits and challenges of integrating ROS2 into industrial robotics,” says Matt Robinson, an SwRI manager who supports ROS-Industrial. “It also shows how advanced perception algorithms can enable faster, more reliable scanning of metallic objects.”

The ROS-Industrial consortia leverage ROS to create ROS-I, an industrial form of the open-source software used by major manufacturers around the world.


The latest ROS-I solution uses ROS2 to integrate cameras affixed to a robotic arm, collecting point cloud data at a high frame-rate to create a 3D output mesh that optimizes path planning. Machine vision cameras and algorithms have historically struggled to render accurate 3D images of metallic objects due to the “visual noise” that scatters off highly reflective surfaces. This significant challenge limits automation of welding and surface finishing processes in aerospace and automotive manufacturing.

SwRI, in collaboration with ROS-Industrial, overcomes this challenge by integrating truncated sign distance field algorithms that stitch together several images, or point clouds, at a higher rate. The solution uses TrajOpt, or trajectory optimization for motion planning, within the ROS-Industrial Scan-N-Plan framework, to enable real-time trajectory planning from 3D scan data.

Robinson says the project also underscores the benefits of a ROS-based approach, as this solution is hardware agnostic. The sensors and robot may be changed out with relatively little effort. ROS-Industrial, known for its open-source interoperability, provides manufacturers with standard software drivers for end effectors and fine-motor movement hardware that typically use earlier ROS software.

“This project was ultimately a successful bridge from ROS to ROS2,” Robinson says. “But we know it’s going to be a big task to move toward ROS2 as so many dependent packages and capabilities are still in ROS.”

SwRI initiated the development of ROS-Industrial in 2012 through an SwRI internal research program conducted with industry collaborators. SwRI maintains the ROS-Industrial software repository and manages the ROS-Industrial Consortium.

The ROS-Industrial consortia — with branches in the Americas, Europe and now Asia — provide cost-shared applied research and development for advanced factory automation. Consortia members drive new capabilities in ROS-I by championing focused technical projects based on their near-term automation requirements.

Print this page


Story continue below