Method

Pipeline

We propose a two stage detection system for identifying surface deformities such as dents and dings. The first stage uses structured light scanning to capture detailed geometric data and detect deviations from the expected surface profile. In the second stage, a machine learning classification pipeline filters out false positives such as screws, rivets, and seams by distinguishing true deformities from non-defective features. This approach enhances the overall accuracy and reliability of automated inspection processes.

pipeline of our two-stage detection system

First Stage Detector

In the first stage of the pipeline, a laser line is projected onto the surface of the plane
to capture signals that may reveal subtle dents, which are often difficult to detect
visually. The deformation of the laser line serves as an indicator of potential dents.
After capturing the laser-projected image, we compute a greenness score for each
pixel to extract the laser line. Next, we calculate the average projection distance of
each pixel on the laser line relative to the main line direction, determined via PCA.
Since the laser line may be distorted by surface dents or other artifacts, it typically
deviates from a perfectly straight path. We then plot these projection distances as a
curve and heuristically identify local minima as candidate dent locations
on the plane.

Illustration of deformation curve

Second Stage Deformity Classifier

Dents and Dings Detection

After detecting deformities, we extract pixel patches around the identified regions and pass them through a machine learning classifier, such as YOLOv8, to categorize them as either Dents or No Dents. The No Dents category includes features like rivets, seams, and screws, which are not considered true surface deformities. This classification step helps refine the results by eliminating irrelevant detections.

Second Stage Pipeline