{"id":11,"date":"2025-05-08T03:12:45","date_gmt":"2025-05-08T03:12:45","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/?page_id=11"},"modified":"2025-12-12T23:55:11","modified_gmt":"2025-12-12T23:55:11","slug":"introduction","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/","title":{"rendered":"Introduction"},"content":{"rendered":"\n<p>High-quality 3D reconstruction increasingly depends heavily on precise camera poses, especially for methods such as Gaussian Splatting and NeRF that use photometric supervision. Even minor errors in pose estimation can lead to misalignments, distortions, or unstable training.&nbsp;<\/p>\n\n\n\n<p>At the same time, <strong>360\u00b0 cameras<\/strong> are becoming increasingly popular for mapping and spatial capture because they provide <span style=\"margin: 0px;padding: 0px\">full<strong>\u00a0omnidirectional<\/strong><\/span><strong> coverage<\/strong> and far <strong>more visual overlap<\/strong> than conventional cameras. However, existing SLAM systems like OpenVSLAM and Stella VSLAM are built for real-time navigation rather than dense photometric accuracy, and modern consumer 360\u00b0 devices\u2014despite higher resolutions and improved optics\u2014still lack depth sensors or strong IMUs, limiting the precision of their pose estimates.<\/p>\n\n\n\n<p>Our project fills this gap by introducing a complete <strong>offline pose-optimization pipeline specifically tailored to 360\u00b0 video<\/strong>. By combining <strong>learning-based feature detection<\/strong>, <strong>robust matching<\/strong>, and a physically constrained <strong>rig-based Structure-from-Motion<\/strong> formulation, our system transforms coarse SLAM trajectories into precise, subpixel-accurate poses suitable for Gaussian Splatting. This enables 360\u00b0 capture to reach its full potential as a practical and accessible method for generating high-quality 3D reconstructions.&nbsp;<\/p>\n\n\n\n<p>Furthermore, we enhance the Gaussian Splatting pipeline by incorporating learned image embeddings to better handle lighting and exposure variations, and by introducing depth priors to improve robustness under sparse input imagery. These additions lead to significant improvements in reconstruction quality, as demonstrated by gains in standard photometric evaluation metrics.<\/p>\n\n\n\n<p>Through reconstruction of diverse real-world captures, we demonstrate significant improvements in reconstruction quality, establishing our pipeline as a crucial step toward reliable 360\u00b0 based scene modeling.<\/p>\n\n\n\n<p><\/p>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>High-quality 3D reconstruction increasingly depends heavily on precise camera poses, especially for methods such as Gaussian Splatting and NeRF that use photometric supervision. Even minor errors in pose estimation can lead to misalignments, distortions, or unstable training.&nbsp; At the same time, 360\u00b0 cameras are becoming increasingly popular for mapping and spatial capture because they provide &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Introduction&#8221;<\/span><\/a><\/p>\n","protected":false},"author":233,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-11","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Introduction - Adaptive Data Collection For High Fidelity Gaussian Splatting<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Introduction - Adaptive Data Collection For High Fidelity Gaussian Splatting\" \/>\n<meta property=\"og:description\" content=\"High-quality 3D reconstruction increasingly depends heavily on precise camera poses, especially for methods such as Gaussian Splatting and NeRF that use photometric supervision. Even minor errors in pose estimation can lead to misalignments, distortions, or unstable training.&nbsp; At the same time, 360\u00b0 cameras are becoming increasingly popular for mapping and spatial capture because they provide &hellip; Continue reading &quot;Introduction&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/\" \/>\n<meta property=\"og:site_name\" content=\"Adaptive Data Collection For High Fidelity Gaussian Splatting\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-12T23:55:11+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/\",\"name\":\"Introduction - Adaptive Data Collection For High Fidelity Gaussian Splatting\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/#website\"},\"datePublished\":\"2025-05-08T03:12:45+00:00\",\"dateModified\":\"2025-12-12T23:55:11+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introduction\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/\",\"name\":\"Adaptive Data Collection For High Fidelity Gaussian Splatting\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Introduction - Adaptive Data Collection For High Fidelity Gaussian Splatting","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/","og_locale":"en_US","og_type":"article","og_title":"Introduction - Adaptive Data Collection For High Fidelity Gaussian Splatting","og_description":"High-quality 3D reconstruction increasingly depends heavily on precise camera poses, especially for methods such as Gaussian Splatting and NeRF that use photometric supervision. Even minor errors in pose estimation can lead to misalignments, distortions, or unstable training.&nbsp; At the same time, 360\u00b0 cameras are becoming increasingly popular for mapping and spatial capture because they provide &hellip; Continue reading \"Introduction\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/","og_site_name":"Adaptive Data Collection For High Fidelity Gaussian Splatting","article_modified_time":"2025-12-12T23:55:11+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/","name":"Introduction - Adaptive Data Collection For High Fidelity Gaussian Splatting","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/#website"},"datePublished":"2025-05-08T03:12:45+00:00","dateModified":"2025-12-12T23:55:11+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/"},{"@type":"ListItem","position":2,"name":"Introduction"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/","name":"Adaptive Data Collection For High Fidelity Gaussian Splatting","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/pages\/11","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/users\/233"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/comments?post=11"}],"version-history":[{"count":29,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/pages\/11\/revisions"}],"predecessor-version":[{"id":253,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/pages\/11\/revisions\/253"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/media?parent=11"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}