{"id":36,"date":"2025-05-08T20:19:21","date_gmt":"2025-05-08T20:19:21","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/?page_id=36"},"modified":"2025-12-12T23:59:20","modified_gmt":"2025-12-12T23:59:20","slug":"results","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/","title":{"rendered":"Overview"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Dataset<\/h2>\n\n\n\n<p>We evaluate our method on <strong>8 real-world equirectangular video walks captured using an Insta360 camera mounted on a handheld tripod. These sequences represent natural outdoor motion with varying lighting conditions and scene geometry.<\/strong><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Evaluation Setup<\/h2>\n\n\n\n<p>Gaussian Splatting (GS) reconstructions are evaluated on a <strong>held-out split<\/strong>, with <strong>10% of images reserved for evaluation<\/strong>. All pipelines are trained and evaluated using the same splits to ensure fair comparison.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Pipelines Compared<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Stella-VSLAM<\/strong> (baseline)<\/li>\n\n\n\n<li><strong>Rig-based SfM<\/strong><\/li>\n\n\n\n<li><strong>Rig-based SfM with depth priors<\/strong><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Metrics<\/h2>\n\n\n\n<p>Reconstruction quality is evaluated using standard image-based metrics:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>PSNR<\/strong><\/li>\n\n\n\n<li><strong>SSIM<\/strong><\/li>\n\n\n\n<li><strong>LPIPS<\/strong><\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">Final Metrics<\/h2>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><tbody><tr><td><\/td><td>LPIPS<\/td><td>PSNR<\/td><td>SSIM<\/td><\/tr><tr><td>Stella-VSlam<\/td><td>0.4844<\/td><td>19.79<\/td><td>0.6909<\/td><\/tr><tr><td>Rig-based-SfM<\/td><td>0.3948<\/td><td>22.48<\/td><td>0.7465<\/td><\/tr><tr><td>Rig-based-SfM-Depth-Priors<\/td><td>0.3931<\/td><td>22.65<\/td><td>0.7469<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<hr class=\"wp-block-separator has-alpha-channel-opacity\" \/>\n\n\n\n<h1 class=\"wp-block-heading\">Detailed Description<\/h1>\n\n\n\n<h3 class=\"wp-block-heading\">Dataset Collection<\/h3>\n\n\n\n<p>We initially explored using existing 360\u00b0 datasets such as <strong>KITTI-360<\/strong> and <strong>Matterport3D<\/strong>. However, neither dataset was suitable for our pipeline:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Matterport3D<\/strong> does not provide the temporal image sequences required for our optimization pipeline.<\/li>\n\n\n\n<li><strong>KITTI-360<\/strong> is designed for multi-camera fusion; stitching its dual fisheye cameras introduces missing regions above the vehicle due to camera placement.<\/li>\n<\/ul>\n\n\n\n<p>As a result, we collected our own dataset using an <strong>Insta360 X4<\/strong> camera. Videos were recorded at <strong>5.7K and 8K resolutions<\/strong> during outdoor walking trajectories. Frames are temporally sampled from the videos and passed into the pipeline. Based on empirical analysis, we sample <strong>one frame per second<\/strong>, aligned with keyframes produced by the baseline Stella-VSLAM system.<\/p>\n\n\n\n<p>The final dataset consists of <strong>8 video walks<\/strong>, each <strong>3\u20138 minutes long<\/strong>, captured both <strong>with and without loop closure<\/strong>. This enables evaluation of global bundle adjustment behavior across all three pipelines.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Evaluation Protocol<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">Baseline: Stella-VSLAM<\/h3>\n\n\n\n<p>We directly use camera poses output by Stella-VSLAM to train Gaussian Splatting and evaluate reconstruction quality on the held-out test split.<br>To account for exposure and lighting variations, <strong>image\u2013embedding\u2013based appearance modeling<\/strong> is enabled during GS training.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Rig-based SfM (No Depth Priors)<\/h3>\n\n\n\n<p>The same video sequences are processed using our <strong>rig-based SfM pipeline<\/strong>, running <strong>bundle adjustment only<\/strong>, without scale-aligned monocular depth estimation.<br>Reconstruction quality is evaluated using the same metrics.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">Full Pipeline (End-to-End)<\/h3>\n\n\n\n<p>We run the complete system with all preprocessing and optimization components enabled:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Rig-based bundle adjustment<\/li>\n\n\n\n<li>Scale-aligned monocular depth estimation<\/li>\n\n\n\n<li>GS training enhancements (image embeddings and depth priors)<\/li>\n<\/ul>\n\n\n\n<p>Final reconstruction quality is evaluated on the same held-out dataset.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Results and Analysis<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">LPIPS<\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"351\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-1024x351.png\" alt=\"\" class=\"wp-image-207\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-1024x351.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-300x103.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-768x263.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-1536x526.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-2048x702.png 2048w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/figure>\n\n\n\n<p>Rig-based SfM methods significantly outperform the Stella-VSLAM baseline in perceptual similarity.<br>Both rig-based variants achieve very similar performance, with the <strong>depth-prior pipeline achieving slightly lower LPIPS values<\/strong>, indicating improved perceptual fidelity.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">PSNR<\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"341\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-2-1024x341.png\" alt=\"\" class=\"wp-image-209\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-2-1024x341.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-2-300x100.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-2-768x256.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-2-1536x512.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-2-2048x683.png 2048w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/figure>\n\n\n\n<p>The <strong>depth-prior pipeline achieves the highest PSNR<\/strong>, with improved stability during the middle stages of GS training (\u224810k iterations).<br>We observe a drop in PSNR after ~15k iterations for both rig-based SfM pipelines, likely due to <strong>overfitting to view-dependent effects<\/strong> such as specular highlights and shading changes. This behavior can be mitigated by adjusting learning rates or reducing training iterations.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">SSIM<\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"343\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-3-1024x343.png\" alt=\"\" class=\"wp-image-210\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-3-1024x343.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-3-300x101.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-3-768x258.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-3-1536x515.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-3-2048x687.png 2048w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/figure>\n\n\n\n<p>SSIM scores for both rig-based SfM pipelines are nearly identical and substantially higher than those of the Stella-VSLAM baseline, indicating improved structural consistency in the reconstructions.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Analysis<\/h2>\n\n\n\n<p>Rig-based SfM significantly improves Gaussian Splatting reconstruction quality over raw Stella-VSLAM poses, yielding large gains across PSNR, SSIM, and LPIPS. Incorporating depth priors further provides consistent, albeit modest, improvements, particularly in perceptual quality, without introducing metric regressions. These results highlight that pose accuracy is the dominant factor in GS performance, while depth priors act as a stabilizing signal that enhances perceptual fidelity under challenging capture conditions.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Dataset We evaluate our method on 8 real-world equirectangular video walks captured using an Insta360 camera mounted on a handheld tripod. These sequences represent natural outdoor motion with varying lighting conditions and scene geometry. Evaluation Setup Gaussian Splatting (GS) reconstructions are evaluated on a held-out split, with 10% of images reserved for evaluation. All pipelines &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Overview&#8221;<\/span><\/a><\/p>\n","protected":false},"author":233,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-36","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Overview - Adaptive Data Collection For High Fidelity Gaussian Splatting<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Overview - Adaptive Data Collection For High Fidelity Gaussian Splatting\" \/>\n<meta property=\"og:description\" content=\"Dataset We evaluate our method on 8 real-world equirectangular video walks captured using an Insta360 camera mounted on a handheld tripod. These sequences represent natural outdoor motion with varying lighting conditions and scene geometry. Evaluation Setup Gaussian Splatting (GS) reconstructions are evaluated on a held-out split, with 10% of images reserved for evaluation. All pipelines &hellip; Continue reading &quot;Overview&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/\" \/>\n<meta property=\"og:site_name\" content=\"Adaptive Data Collection For High Fidelity Gaussian Splatting\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-12T23:59:20+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-scaled.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"877\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/results\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/results\\\/\",\"name\":\"Overview - Adaptive Data Collection For High Fidelity Gaussian Splatting\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/results\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/results\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/wp-content\\\/uploads\\\/sites\\\/120\\\/2025\\\/12\\\/image-1024x351.png\",\"datePublished\":\"2025-05-08T20:19:21+00:00\",\"dateModified\":\"2025-12-12T23:59:20+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/results\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/results\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/results\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/wp-content\\\/uploads\\\/sites\\\/120\\\/2025\\\/12\\\/image-scaled.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/wp-content\\\/uploads\\\/sites\\\/120\\\/2025\\\/12\\\/image-scaled.png\",\"width\":2560,\"height\":877},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/results\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Overview\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/\",\"name\":\"Adaptive Data Collection For High Fidelity Gaussian Splatting\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team4\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Overview - Adaptive Data Collection For High Fidelity Gaussian Splatting","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/","og_locale":"en_US","og_type":"article","og_title":"Overview - Adaptive Data Collection For High Fidelity Gaussian Splatting","og_description":"Dataset We evaluate our method on 8 real-world equirectangular video walks captured using an Insta360 camera mounted on a handheld tripod. These sequences represent natural outdoor motion with varying lighting conditions and scene geometry. Evaluation Setup Gaussian Splatting (GS) reconstructions are evaluated on a held-out split, with 10% of images reserved for evaluation. All pipelines &hellip; Continue reading \"Overview\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/","og_site_name":"Adaptive Data Collection For High Fidelity Gaussian Splatting","article_modified_time":"2025-12-12T23:59:20+00:00","og_image":[{"width":2560,"height":877,"url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-scaled.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/","name":"Overview - Adaptive Data Collection For High Fidelity Gaussian Splatting","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-1024x351.png","datePublished":"2025-05-08T20:19:21+00:00","dateModified":"2025-12-12T23:59:20+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-scaled.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-content\/uploads\/sites\/120\/2025\/12\/image-scaled.png","width":2560,"height":877},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/results\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/"},{"@type":"ListItem","position":2,"name":"Overview"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/","name":"Adaptive Data Collection For High Fidelity Gaussian Splatting","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/pages\/36","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/users\/233"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/comments?post=36"}],"version-history":[{"count":21,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/pages\/36\/revisions"}],"predecessor-version":[{"id":256,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/pages\/36\/revisions\/256"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team4\/wp-json\/wp\/v2\/media?parent=36"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}