{"id":6,"date":"2025-05-07T17:37:57","date_gmt":"2025-05-07T17:37:57","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/?page_id=6"},"modified":"2025-05-10T00:14:55","modified_gmt":"2025-05-10T00:14:55","slug":"related-work","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/","title":{"rendered":"Related Work"},"content":{"rendered":"\n<p style=\"text-align: justify\">Thermal scene reconstruction has recently seen substantial advances driven by the convergence of radiance field modeling, generative diffusion techniques, and physically grounded thermal modeling. Our work builds upon and extends three foundational directions: dynamic 3D reconstruction from drone imagery, thermodynamics aware modeling for time varying thermal phenomena, and perceptual guidance for infrared image super-resolution.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Dynamic Drone based Reconstruction.<\/strong><\/h3>\n\n\n\n<p><p style=\"text-align: justify\">Tang et al. introduced <strong>DroneSplat<\/strong> [Fig.\u202f1a], a robust 3D Gaussian Splatting (3DGS) framework tailored to aerial imagery collected by drones in uncontrolled environments. They address two critical challenges: dynamic distractors (e.g., vehicles, people) and sparse viewpoints typical of single flight drone captures. Their method integrates adaptive masking via segmentation and statistical residuals, and uses a voxel guided optimization strategy initialized by multi-view stereo. This combination allows the system to suppress non-static elements and improve novel view rendering under limited coverage. Figure\u202f2a shows how DroneSplat improves geometric consistency and removes artifacts compared to standard 3DGS [Fig. 2b] in dynamic scenes.<\/p><\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/cmu.box.com\/shared\/static\/ta902iwcluaf832slhw6t70hzhrswiod.jpg\" alt=\"\" style=\"width:850px;height:auto\" \/><figcaption class=\"wp-element-caption\">Figure 1.a:  <em>Comparison between DroneSplat and vanilla 3D Gaussian Splatting (3DGS) on drone captured imagery.<\/em> Given input views (top left) from in-the-wild drone footage, DroneSplat accurately reconstructs static scene geometry and removes dynamic distractors such as moving vehicles. Renderings from both input and novel viewpoints (middle and bottom rows) show that DroneSplat produces cleaner, temporally consistent reconstructions, while 3DGS exhibits ghosting artifacts and distortion in dynamic regions. The bottom visualization shows the sparse camera trajectories used to generate the 3D model. Figure adapted from Tang et al. [2025]<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/cmu.box.com\/shared\/static\/wd9cdg62eia9840d944fqgzfdjmn71jw.gif\" alt=\"\" style=\"width:360px;height:auto\" \/><figcaption class=\"wp-element-caption\" style=\"text-align: center\">Figure\u202f2a: DroneSplat<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/cmu.box.com\/shared\/static\/cdujp0orq94p2ocek6iceotq68letrwq.gif\" alt=\"\" style=\"width:351px;height:auto\" \/><figcaption class=\"wp-element-caption\" style=\"text-align: center\">Figure\u202f2b: 3DGS<\/figcaption><\/figure>\n\n\n\n<div style=\"height:38px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Thermodynamics guided 4D Thermal Modeling.<\/strong><\/h3>\n\n\n\n<p><p style=\"text-align: justify\">While prior work has focused largely on static thermal reconstruction, Yang et al. proposed <strong>NTR-Gaussian<\/strong> [Fig.\u202f3a], a framework that models thermal dynamics over time. By leveraging aerial TIR imagery and synthetic RGB frames, their method predicts temperature evolution across night scenes using 4D Gaussian Splatting informed by physical laws. A pair of networks estimate emissivity, heat capacity, and convective heat transfer, enabling temperature to be inferred at any future time using numerical integration. This approach represents the first physically consistent modeling of time varying thermal fields in outdoor 3D scenes. Figure\u202f3b shows the thermodynamic theory behind NTR-Gaussian, showing the interplay between solar absorption and nighttime radiative convective heat dissipation.<\/p><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/cmu.box.com\/shared\/static\/7udn3lh0psvlvblhza0vl2lqv0b6x0a6.png\" alt=\"\" \/><figcaption class=\"wp-element-caption\">Figure 3a: On the <strong>left:<\/strong> The NTR-Gaussian framework learns a time varying thermal representation using discrete, time stamped aerial TIR images aligned with synthetic RGB views, leveraging 3D Gaussian Splatting for continuous spatiotemporal modeling. On the <strong>right:<\/strong> The NTR dataset includes multi temporal aerial TIR and corresponding synthetic RGB imagery across four distinct outdoor scenes, enabling training and evaluation of dynamic thermal reconstruction methods. <em>Figure adapted from Yang et al. [2025]<\/em><\/figcaption><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img decoding=\"async\" src=\"https:\/\/cmu.box.com\/shared\/static\/wdm93grbuzja24qw24ornho7ik9oldt5.png\" alt=\"\" style=\"width:673px;height:auto\" \/><figcaption class=\"wp-element-caption\">Figure\u202f3b: <em>Thermodynamic theory of outdoor temperature variation<\/em>: During the day, objects absorb heat from solar radiation, at night, they primarily release it through radiative emission and convective exchange. Figure adapted from Yang et al. [2025]<\/figcaption><\/figure>\n\n\n\n<div style=\"height:40px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Perceptually guided Diffusion for Infrared Super-Resolution.<\/strong><\/h3>\n\n\n\n<p><p style=\"text-align: justify\">Li et al. proposed <strong>DifIISR<\/strong>, a diffusion based model for infrared image super-resolution (IISR) that goes beyond visual fidelity to incorporate perceptual relevance for downstream tasks like segmentation and detection. The method introduces gradient based guidance during the reverse diffusion process, using both visual frequency priors and perceptual features from pretrained models such as VGG and SAM. As a result, DifIISR achieves improved performance not just in PSNR and SSIM, but also in high level tasks under low light or noisy infrared conditions. Figure\u202f4a demonstrates how their method preserves fine texture and semantic integrity compared to prior IISR methods.<\/p><\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/cmu.box.com\/shared\/static\/9efyqkbrp2xwcqns4bfq3z67w3cshptc.png\" alt=\"difiisr\" \/><figcaption class=\"wp-element-caption\">Figure 4a: <em>Qualitative comparison of infrared image super-resolution methods.<\/em> DifIISR demonstrates superior visual quality and structural consistency compared to existing methods. Figure adapted from Li et al. [2025].<\/figcaption><\/figure>\n\n\n\n<div style=\"height:45px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Conclusion<\/strong> <\/h3>\n\n\n\n<p style=\"text-align: justify\">To build a real-time 3D thermal Gaussian splatting pipeline, it is essential to integrate the complementary strengths of the three aforementioned directions. First, handling dynamic aerial imagery in uncontrolled environments requires robust scene modeling under sparse and inconsistent viewpoints, as addressed by DroneSplat. Second, accurate thermal reconstruction demands temporal and temperature aware representations grounded in physical principles, as demonstrated by NTR-Gaussian. Finally, the inherent limitations of infrared imagery such as low contrast, noise, and loss of detail, must be mitigated through perceptually guided enhancement techniques, as introduced in DifIISR. <strong>These works highlight essential tasks that we aim to adapt and integrate into a unified system for real-time, high fidelity 3D thermal reconstruction.<\/strong><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Thermal scene reconstruction has recently seen substantial advances driven by the convergence of radiance field modeling, generative diffusion techniques, and physically grounded thermal modeling. Our work builds upon and extends three foundational directions: dynamic 3D reconstruction from drone imagery, thermodynamics aware modeling for time varying thermal phenomena, and perceptual guidance for infrared image super-resolution. Dynamic &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Related Work&#8221;<\/span><\/a><\/p>\n","protected":false},"author":261,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-6","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Related Work - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Related Work - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction\" \/>\n<meta property=\"og:description\" content=\"Thermal scene reconstruction has recently seen substantial advances driven by the convergence of radiance field modeling, generative diffusion techniques, and physically grounded thermal modeling. Our work builds upon and extends three foundational directions: dynamic 3D reconstruction from drone imagery, thermodynamics aware modeling for time varying thermal phenomena, and perceptual guidance for infrared image super-resolution. Dynamic &hellip; Continue reading &quot;Related Work&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/\" \/>\n<meta property=\"og:site_name\" content=\"End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction\" \/>\n<meta property=\"article:modified_time\" content=\"2025-05-10T00:14:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/cmu.box.com\/shared\/static\/ta902iwcluaf832slhw6t70hzhrswiod.jpg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/related-work\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/related-work\\\/\",\"name\":\"Related Work - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/related-work\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/related-work\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/cmu.box.com\\\/shared\\\/static\\\/ta902iwcluaf832slhw6t70hzhrswiod.jpg\",\"datePublished\":\"2025-05-07T17:37:57+00:00\",\"dateModified\":\"2025-05-10T00:14:55+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/related-work\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/related-work\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/related-work\\\/#primaryimage\",\"url\":\"https:\\\/\\\/cmu.box.com\\\/shared\\\/static\\\/ta902iwcluaf832slhw6t70hzhrswiod.jpg\",\"contentUrl\":\"https:\\\/\\\/cmu.box.com\\\/shared\\\/static\\\/ta902iwcluaf832slhw6t70hzhrswiod.jpg\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/related-work\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Related Work\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/\",\"name\":\"End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction\",\"description\":\"By: Lamia Alsalloom | Advised By: Prof. Sebastian Scherer\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team16-2\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Related Work - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/","og_locale":"en_US","og_type":"article","og_title":"Related Work - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","og_description":"Thermal scene reconstruction has recently seen substantial advances driven by the convergence of radiance field modeling, generative diffusion techniques, and physically grounded thermal modeling. Our work builds upon and extends three foundational directions: dynamic 3D reconstruction from drone imagery, thermodynamics aware modeling for time varying thermal phenomena, and perceptual guidance for infrared image super-resolution. Dynamic &hellip; Continue reading \"Related Work\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/","og_site_name":"End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","article_modified_time":"2025-05-10T00:14:55+00:00","og_image":[{"url":"https:\/\/cmu.box.com\/shared\/static\/ta902iwcluaf832slhw6t70hzhrswiod.jpg","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/","name":"Related Work - End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/#primaryimage"},"thumbnailUrl":"https:\/\/cmu.box.com\/shared\/static\/ta902iwcluaf832slhw6t70hzhrswiod.jpg","datePublished":"2025-05-07T17:37:57+00:00","dateModified":"2025-05-10T00:14:55+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/#primaryimage","url":"https:\/\/cmu.box.com\/shared\/static\/ta902iwcluaf832slhw6t70hzhrswiod.jpg","contentUrl":"https:\/\/cmu.box.com\/shared\/static\/ta902iwcluaf832slhw6t70hzhrswiod.jpg"},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/related-work\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/"},{"@type":"ListItem","position":2,"name":"Related Work"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/","name":"End-to-End Infrared UAV Mapping: An Integrated Framework for Thermal Scene Reconstruction","description":"By: Lamia Alsalloom | Advised By: Prof. Sebastian Scherer","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/pages\/6","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/users\/261"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/comments?post=6"}],"version-history":[{"count":45,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/pages\/6\/revisions"}],"predecessor-version":[{"id":168,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/pages\/6\/revisions\/168"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team16-2\/wp-json\/wp\/v2\/media?parent=6"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}