{"id":33,"date":"2025-05-08T00:25:48","date_gmt":"2025-05-08T00:25:48","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/?page_id=33"},"modified":"2025-12-10T21:31:53","modified_gmt":"2025-12-10T21:31:53","slug":"method","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/","title":{"rendered":"Method"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Pipeline<\/h2>\n\n\n\n<p>We propose a two stage detection system for identifying surface deformities such as dents and dings. The first stage uses structured light scanning to capture detailed geometric data and detect deviations from the expected surface profile. In the second stage, a machine learning classification pipeline filters out false positives such as screws, rivets, and seams by distinguishing true deformities from non-defective features. This approach enhances the overall accuracy and reliability of automated inspection processes.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"724\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1-1024x724.png\" alt=\"\" class=\"wp-image-80\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1-1024x724.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1-300x212.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1-768x543.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1-1536x1085.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1-2048x1447.png 2048w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n<\/div>\n\n\n<p class=\"has-text-align-center\">Pipeline of our two-stage detection system<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">First Stage Detector<\/h2>\n\n\n\n<p>In the first stage of the pipeline, a laser line is projected onto the surface of the plane<br>to capture signals that may reveal subtle dents, which are often difficult to detect<br>visually. The deformation of the laser line serves as an indicator of potential dents.<br>After capturing the laser-projected image, we calculate the average projection distance of<br>each pixel on the laser line relative to the main line direction, determined via PCA.<br>Since the laser line may be distorted by surface dents or other artifacts, it typically<br>deviates from a perfectly straight path. We then plot these projection distances as a<br>curve and heuristically identify local minima as candidate dent locations<br>on the plane.<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"430\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/05\/deformation_curve-1024x430.png\" alt=\"\" class=\"wp-image-36\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/05\/deformation_curve-1024x430.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/05\/deformation_curve-300x126.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/05\/deformation_curve-768x323.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/05\/deformation_curve-1536x646.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/05\/deformation_curve-2048x861.png 2048w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n<\/div>\n\n\n<p class=\"has-text-align-center\">Illustration of deformation curve<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Two Camera Stereo Setup<\/h2>\n\n\n\n<p>In practice, the deformation of the laser line is often minimal (approximately 1\u20132 pixels). To improve the accuracy of the first stage, we require a very clean laser-line image. However, the second-stage ML classifier still needs the full scene with background information. To satisfy both requirements, we capture images using two cameras: one with low exposure and one with normal exposure. The low-exposure camera produces an image in which only the laser line is visible\u2014ideal for the first-stage pipeline\u2014while the normal-exposure image is used as input for the second-stage ML classifier.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"447\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-4-1024x447.png\" alt=\"\" class=\"wp-image-91\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-4-1024x447.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-4-300x131.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-4-768x335.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-4-1536x671.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-4-2048x894.png 2048w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n\n\n\n<p class=\"has-text-align-center\">Two Camera Stereo Setup: low-exposure and normal-exposure<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Second Stage Deformity Classifier<\/h2>\n\n\n\n<p>After detecting deformities, we extract pixel patches around the identified regions in the normal exposure image and pass them through a machine learning classifier, such as YOLOv11, to categorize them as either Dents and Dings or False Positives. The False Positive category includes features like rivets, seams, and screws, which are not considered true surface deformities. This classification step helps refine the results by eliminating irrelevant detections.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"281\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-5-1024x281.png\" alt=\"\" class=\"wp-image-92\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-5-1024x281.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-5-300x82.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-5-768x211.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-5-1536x422.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/image-5-2048x563.png 2048w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n\n\n\n<p class=\"has-text-align-center\">Second Stage Pipeline to remove False Positives<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Pipeline We propose a two stage detection system for identifying surface deformities such as dents and dings. The first stage uses structured light scanning to capture detailed geometric data and detect deviations from the expected surface profile. In the second stage, a machine learning classification pipeline filters out false positives such as screws, rivets, and &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Method&#8221;<\/span><\/a><\/p>\n","protected":false},"author":249,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-33","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Method - Finding Dents and Dings With a Drone using Structured Light<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Method - Finding Dents and Dings With a Drone using Structured Light\" \/>\n<meta property=\"og:description\" content=\"Pipeline We propose a two stage detection system for identifying surface deformities such as dents and dings. The first stage uses structured light scanning to capture detailed geometric data and detect deviations from the expected surface profile. In the second stage, a machine learning classification pipeline filters out false positives such as screws, rivets, and &hellip; Continue reading &quot;Method&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/\" \/>\n<meta property=\"og:site_name\" content=\"Finding Dents and Dings With a Drone using Structured Light\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-10T21:31:53+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2328\" \/>\n\t<meta property=\"og:image:height\" content=\"1645\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/method\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/method\\\/\",\"name\":\"Method - Finding Dents and Dings With a Drone using Structured Light\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/method\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/method\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/wp-content\\\/uploads\\\/sites\\\/132\\\/2025\\\/12\\\/Pipeline_full_updated-1-1024x724.png\",\"datePublished\":\"2025-05-08T00:25:48+00:00\",\"dateModified\":\"2025-12-10T21:31:53+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/method\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/method\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/method\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/wp-content\\\/uploads\\\/sites\\\/132\\\/2025\\\/12\\\/Pipeline_full_updated-1.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/wp-content\\\/uploads\\\/sites\\\/132\\\/2025\\\/12\\\/Pipeline_full_updated-1.png\",\"width\":2328,\"height\":1645},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/method\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Method\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/\",\"name\":\"Finding Dents and Dings With a Drone using Structured Light\",\"description\":\"MSCV Capstone Project | Students: Aman Goel, Yang Wang | Advisors: Christoph Mertz (CMU), Kapil Rawal (Near Earth Autonomy) | Sponsor: Near Earth Autonomy\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team5\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Method - Finding Dents and Dings With a Drone using Structured Light","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/","og_locale":"en_US","og_type":"article","og_title":"Method - Finding Dents and Dings With a Drone using Structured Light","og_description":"Pipeline We propose a two stage detection system for identifying surface deformities such as dents and dings. The first stage uses structured light scanning to capture detailed geometric data and detect deviations from the expected surface profile. In the second stage, a machine learning classification pipeline filters out false positives such as screws, rivets, and &hellip; Continue reading \"Method\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/","og_site_name":"Finding Dents and Dings With a Drone using Structured Light","article_modified_time":"2025-12-10T21:31:53+00:00","og_image":[{"width":2328,"height":1645,"url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/","name":"Method - Finding Dents and Dings With a Drone using Structured Light","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1-1024x724.png","datePublished":"2025-05-08T00:25:48+00:00","dateModified":"2025-12-10T21:31:53+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-content\/uploads\/sites\/132\/2025\/12\/Pipeline_full_updated-1.png","width":2328,"height":1645},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/method\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/"},{"@type":"ListItem","position":2,"name":"Method"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/","name":"Finding Dents and Dings With a Drone using Structured Light","description":"MSCV Capstone Project | Students: Aman Goel, Yang Wang | Advisors: Christoph Mertz (CMU), Kapil Rawal (Near Earth Autonomy) | Sponsor: Near Earth Autonomy","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-json\/wp\/v2\/pages\/33","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-json\/wp\/v2\/users\/249"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-json\/wp\/v2\/comments?post=33"}],"version-history":[{"count":3,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-json\/wp\/v2\/pages\/33\/revisions"}],"predecessor-version":[{"id":93,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-json\/wp\/v2\/pages\/33\/revisions\/93"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team5\/wp-json\/wp\/v2\/media?parent=33"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}