{"id":28,"date":"2025-05-08T18:38:26","date_gmt":"2025-05-08T18:38:26","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/?page_id=28"},"modified":"2025-05-10T01:28:13","modified_gmt":"2025-05-10T01:28:13","slug":"introduction","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/","title":{"rendered":"Introduction"},"content":{"rendered":"\n<p style=\"text-align: justify\">Thermal infrared (TIR) imaging from unmanned aerial vehicles (UAVs) offers an all weather, none contact modality essential for applications such as wildfire monitoring, industrial safety inspections, and nighttime search and rescue operations. Unlike visible light imagery whose reconstruction pipelines falter under low illumination, haze, or fog, TIR data remains robust across diverse environmental conditions. Yet, despite advances in drone deployment and IR sensor miniaturization, most thermal footage is confined to two dimensional video streams, limiting its utility for spatial analysis, volumetric mapping, and temporal monitoring.<\/p>\n\n\n\n<p>Reconstructing accurate 3D thermal scenes from UAV captures involves several core challenges: <\/p>\n\n\n\n<p>First, <strong>low spatial resolution and sensor noise<\/strong> in raw IR frames obscure fine geometric structure and blur object boundaries, as seen in Figure 1.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/cmu.box.com\/shared\/static\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif\" alt=\"\" \/><figcaption class=\"wp-element-caption\" style=\"text-align: center\">Figure 1: IR Frames are <strong>Noisy<\/strong> and have <strong>Low Resolution<\/strong>.<\/figcaption><\/figure>\n\n\n\n<p> Second, <strong>feature scarcity<\/strong> the lack of rich texture and contrast in thermal images impedes reliable cross view correspondence and alignment.<\/p>\n\n\n\n<p> Third, <strong>coverage gaps and drift<\/strong> arise when stitching multiple drone passes, yielding holes and misregistrations that degrade global consistency, as seen in Figure 2. <\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/cmu.box.com\/shared\/static\/obxbcatnj7f3s0n2faggttqzp00vl7de.gif\" alt=\"\" style=\"width:674px;height:auto\" \/><figcaption class=\"wp-element-caption\" style=\"text-align: center\">Figure 2: Alignment <strong>drift<\/strong>, might require <strong>multiple<\/strong> passes.<\/figcaption><\/figure>\n\n\n\n<p>Finally, <strong>dynamic thermal phenomena<\/strong>, such as spreading fire fronts or moving heat sources, violate static scene assumptions and introduce temporal artifacts in na\u00efve reconstructions.<\/p>\n\n\n\n<p style=\"text-align: justify\">To overcome these obstacles, we propose a 3D Gaussian Splatting Thermal Reconstruction Pipeline, a unified, real\u2011time pipeline for 3D thermal scene reconstruction. Our framework comprises three key modules:<\/p>\n\n\n\n<ol class=\"wp-block-list\" start=\"1\">\n<li><strong>Thermal image enhancement<\/strong>, employing adaptive edge preserving filtering and learned priors to sharpen boundaries and restore detail in raw IR frames.<\/li>\n\n\n\n<li><strong>Physics induced Gaussian splatting<\/strong>, which models atmospheric transmission variability and inter object thermal conduction by fitting learnable 3D Gaussians with neural predicted physical parameters.<\/li>\n<\/ol>\n\n\n\n<p style=\"text-align: justify\">By investigating and integrating these components, we aim to transform disjoint 2D thermal video into coherent volumetric heat maps enabling precise, real\u2011time 3D thermal reconstructions even in feature poor and dynamic environments.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Thermal infrared (TIR) imaging from unmanned aerial vehicles (UAVs) offers an all weather, none contact modality essential for applications such as wildfire monitoring, industrial safety inspections, and nighttime search and rescue operations. Unlike visible light imagery whose reconstruction pipelines falter under low illumination, haze, or fog, TIR data remains robust across diverse environmental conditions. Yet, &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Introduction&#8221;<\/span><\/a><\/p>\n","protected":false},"author":261,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-28","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Introduction - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Introduction - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction\" \/>\n<meta property=\"og:description\" content=\"Thermal infrared (TIR) imaging from unmanned aerial vehicles (UAVs) offers an all weather, none contact modality essential for applications such as wildfire monitoring, industrial safety inspections, and nighttime search and rescue operations. Unlike visible light imagery whose reconstruction pipelines falter under low illumination, haze, or fog, TIR data remains robust across diverse environmental conditions. Yet, &hellip; Continue reading &quot;Introduction&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/\" \/>\n<meta property=\"og:site_name\" content=\"End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-10T01:28:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cmu.box.com\/shared\/static\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/\",\"name\":\"Introduction - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cmu.box.com\\\/shared\\\/static\\\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif\",\"datePublished\":\"2025-05-08T18:38:26+00:00\",\"dateModified\":\"2025-05-10T01:28:13+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#primaryimage\",\"url\":\"https:\\\/\\\/cmu.box.com\\\/shared\\\/static\\\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif\",\"contentUrl\":\"https:\\\/\\\/cmu.box.com\\\/shared\\\/static\\\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introduction\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/\",\"name\":\"End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction\",\"description\":\"By: Lamia Alsalloom | Advised By: Prof. Sebastian Scherer\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Introduction - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/","og_locale":"en_US","og_type":"article","og_title":"Introduction - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","og_description":"Thermal infrared (TIR) imaging from unmanned aerial vehicles (UAVs) offers an all weather, none contact modality essential for applications such as wildfire monitoring, industrial safety inspections, and nighttime search and rescue operations. Unlike visible light imagery whose reconstruction pipelines falter under low illumination, haze, or fog, TIR data remains robust across diverse environmental conditions. Yet, &hellip; Continue reading \"Introduction\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/","og_site_name":"End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","article_modified_time":"2025-05-10T01:28:13+00:00","og_image":[{"url":"https:\/\/cmu.box.com\/shared\/static\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/","name":"Introduction - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#primaryimage"},"thumbnailUrl":"https:\/\/cmu.box.com\/shared\/static\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif","datePublished":"2025-05-08T18:38:26+00:00","dateModified":"2025-05-10T01:28:13+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#primaryimage","url":"https:\/\/cmu.box.com\/shared\/static\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif","contentUrl":"https:\/\/cmu.box.com\/shared\/static\/266ys4iinp2ddq3bgz6fcrb8jq46gddi.gif"},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/"},{"@type":"ListItem","position":2,"name":"Introduction"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/","name":"End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","description":"By: Lamia Alsalloom | Advised By: Prof. Sebastian Scherer","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/pages\/28","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/users\/261"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/comments?post=28"}],"version-history":[{"count":18,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/pages\/28\/revisions"}],"predecessor-version":[{"id":202,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/pages\/28\/revisions\/202"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/media?parent=28"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}