{"id":226,"date":"2024-05-12T23:29:43","date_gmt":"2024-05-12T23:29:43","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/?page_id=226"},"modified":"2024-12-14T04:50:00","modified_gmt":"2024-12-14T04:50:00","slug":"results-aviral-agrawal","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/","title":{"rendered":"Results"},"content":{"rendered":"<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"515\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-1024x515.png\" alt=\"\" class=\"wp-image-306\" style=\"width:763px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-1024x515.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-300x151.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-768x386.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-1536x772.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-2048x1029.png 2048w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption class=\"wp-element-caption\">Fig9. Results obtained from baseline models and Clear-Splatting (ours) approach<\/figcaption><\/figure>\n<\/div>\n\n<div class=\"page\" title=\"Page 3\">\n<div class=\"layoutArea\">\n<div class=\"column\">\n<p>We compare ClearSplatting-2.0 against Dex-NeRF, Res-NeRF, 3DGS, and ClearSplatting by computing the MAE and RMSE (figure 10).<\/p>\n<div class=\"page\" title=\"Page 3\">\n<div class=\"layoutArea\">\n<div class=\"column\">\n<p>Here i \u2208 [0,&#8230;,N] is the frame number, r is the pixel location, and \u03a9r is the set of all pixel locations across frames. D\u02c6(r) is the inferred depth in meters, D(r) is the GT depth in meters. We crop each image before evaluation to focus on the transparent object and not bias the results with the background.<\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"415\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/05\/metrics-1024x415.png\" alt=\"\" class=\"wp-image-199\" style=\"width:286px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/05\/metrics-1024x415.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/05\/metrics-300x122.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/05\/metrics-768x311.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/05\/metrics-1536x622.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/05\/metrics.png 1974w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption class=\"wp-element-caption\">Fig10. Metrics used for quantitative evaluation<\/figcaption><\/figure>\n<\/div>\n\n<p>The objective results based on the metrics, RMSE and MAE, can be found in the tables below.<\/p>\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"732\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_rmse-1024x732.png\" alt=\"\" class=\"wp-image-309\" style=\"width:673px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_rmse-1024x732.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_rmse-300x214.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_rmse-768x549.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_rmse.png 1483w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption class=\"wp-element-caption\">Fig 10. Depth RMSE results<\/figcaption><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"732\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_mse-2-1024x732.png\" alt=\"\" class=\"wp-image-313\" style=\"width:674px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_mse-2-1024x732.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_mse-2-300x214.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_mse-2-768x549.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_mse-2.png 1483w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption class=\"wp-element-caption\">Fig 11. Depth MSE results<\/figcaption><\/figure>\n\n\n<p>From Figure 9, 10, and 11, we see that Clear-Splatting outperforms NeRF-based baselines as well as other 3DGS-based baselines. The results suggest that Clear-Splatting improves on the NeRF-based approaches with a <strong>67.09%<\/strong> lower RMSE and an <strong>87.80%<\/strong> lower MAE in depth estimation. ClearSplatting-2.0 beats Clear-Splatting by upto <strong>33%<\/strong> lower RMSE and by upto<strong> 32%<\/strong> lower MSE in depth estimation.<\/p>\n<p>From Figure 9, we see that the depth maps obtained using NeRF approaches do not have crisp boundaries in contrast to those obtained using 3DGS, ClearSplatting, and ClearSplatting-2.0. Furthermore, the depth maps obtained from baseline 3DGS has holes which can potentially lead to incorrect gripper pose estimation. ClearSplatting-2.0 is able to considerably close the holes obtained in the baselines and consequently lead to better gripper pose estimation. \u00a0<\/p>","protected":false},"excerpt":{"rendered":"<p>We compare ClearSplatting-2.0 against Dex-NeRF, Res-NeRF, 3DGS, and ClearSplatting by computing the MAE and RMSE (figure 10). Here i \u2208 [0,&#8230;,N] is the frame number, r is the pixel location, and \u03a9r is the set of all pixel locations across frames. D\u02c6(r) is the inferred depth in meters, D(r) is the GT depth in meters. &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Results&#8221;<\/span><\/a><\/p>\n","protected":false},"author":210,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-226","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Results - MS Computer Vision Capstone | Team 10<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Results - MS Computer Vision Capstone | Team 10\" \/>\n<meta property=\"og:description\" content=\"We compare ClearSplatting-2.0 against Dex-NeRF, Res-NeRF, 3DGS, and ClearSplatting by computing the MAE and RMSE (figure 10). Here i \u2208 [0,&#8230;,N] is the frame number, r is the pixel location, and \u03a9r is the set of all pixel locations across frames. D\u02c6(r) is the inferred depth in meters, D(r) is the GT depth in meters. &hellip; Continue reading &quot;Results&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/\" \/>\n<meta property=\"og:site_name\" content=\"MS Computer Vision Capstone | Team 10\" \/>\n<meta property=\"article:modified_time\" content=\"2024-12-14T04:50:00+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-1024x515.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/results-aviral-agrawal\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/results-aviral-agrawal\\\/\",\"name\":\"Results - MS Computer Vision Capstone | Team 10\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/results-aviral-agrawal\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/results-aviral-agrawal\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/wp-content\\\/uploads\\\/sites\\\/108\\\/2024\\\/12\\\/results_pics-min-2-1024x515.png\",\"datePublished\":\"2024-05-12T23:29:43+00:00\",\"dateModified\":\"2024-12-14T04:50:00+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/results-aviral-agrawal\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/results-aviral-agrawal\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/results-aviral-agrawal\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/wp-content\\\/uploads\\\/sites\\\/108\\\/2024\\\/12\\\/results_pics-min-2.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/wp-content\\\/uploads\\\/sites\\\/108\\\/2024\\\/12\\\/results_pics-min-2.png\",\"width\":3582,\"height\":1800},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/results-aviral-agrawal\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Results\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/\",\"name\":\"Interpretability using Diffusion\",\"description\":\"\",\"alternateName\":\"iud\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team10\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Results - MS Computer Vision Capstone | Team 10","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/","og_locale":"en_US","og_type":"article","og_title":"Results - MS Computer Vision Capstone | Team 10","og_description":"We compare ClearSplatting-2.0 against Dex-NeRF, Res-NeRF, 3DGS, and ClearSplatting by computing the MAE and RMSE (figure 10). Here i \u2208 [0,&#8230;,N] is the frame number, r is the pixel location, and \u03a9r is the set of all pixel locations across frames. D\u02c6(r) is the inferred depth in meters, D(r) is the GT depth in meters. &hellip; Continue reading \"Results\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/","og_site_name":"MS Computer Vision Capstone | Team 10","article_modified_time":"2024-12-14T04:50:00+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-1024x515.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/","name":"Results - MS Computer Vision Capstone | Team 10","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2-1024x515.png","datePublished":"2024-05-12T23:29:43+00:00","dateModified":"2024-12-14T04:50:00+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-content\/uploads\/sites\/108\/2024\/12\/results_pics-min-2.png","width":3582,"height":1800},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/results-aviral-agrawal\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/"},{"@type":"ListItem","position":2,"name":"Results"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/","name":"Interpretability using Diffusion","description":"","alternateName":"iud","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-json\/wp\/v2\/pages\/226","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-json\/wp\/v2\/users\/210"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-json\/wp\/v2\/comments?post=226"}],"version-history":[{"count":8,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-json\/wp\/v2\/pages\/226\/revisions"}],"predecessor-version":[{"id":343,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-json\/wp\/v2\/pages\/226\/revisions\/343"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team10\/wp-json\/wp\/v2\/media?parent=226"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}