{"id":67,"date":"2024-05-10T04:55:27","date_gmt":"2024-05-10T04:55:27","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/?page_id=67"},"modified":"2024-12-14T04:06:06","modified_gmt":"2024-12-14T04:06:06","slug":"about","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/","title":{"rendered":"Introduction"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\" style=\"font-size:28px\"><strong>Motivation<\/strong><\/h2>\n\n\n\n<p>State estimation and reconstruction play pivotal roles in various cutting-edge applications such as autonomous vehicles, AR\/VR devices, and robotics. For instance, in the case of an autonomous vehicle, it&#8217;s crucial to create a detailed map of its surroundings while accurately determining its location within that map. <\/p>\n\n\n\n<p>In particular we want to create dense maps as <strong>Dense reconstructions<\/strong> significantly enhance interactivity and utility &#8211; especially for AR\/VR and robotics as humans and robots start to share workspace<\/p>\n\n\n<div class=\"wp-block-image\">\n<figure class=\"aligncenter size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"816\" height=\"613\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a.png\" alt=\"\" class=\"wp-image-53\" style=\"width:419px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a.png 816w, https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a-300x225.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a-768x577.png 768w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n<\/div>\n\n\n<p>However, existing classical dense SLAM methods predominantly rely on modular pipelines, which suffer from minimal information sharing and a lack of utilization of priors. Consequently, these methods are susceptible to environmental changes and require extensive fine-tuning for different settings.<\/p>\n\n\n\n<p>Through this work we want to design a robust method for explicit learning based dense visual SLAM that can achieve online Real time, high accuracy visual odometry and dense mapping in urban and in the wild setting. For the scope of this project &#8211; we want to focus on urban SLAM setting as it is tougher setting then indoor and is relatively under explored.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" style=\"font-size:28px\"><strong>Background<\/strong><\/h2>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p style=\"font-size:15px\"><strong>Precise correspondences enable precise reconstruction<\/strong>:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Given precise correspondences- reconstruction is a geometrically grounded task&nbsp;<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Instead of teaching the network to reason about geometry, we focus on learning precise correspondences, which can be utilized for reconstruction<\/li>\n<\/ul>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"553\" height=\"222\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/12\/1.png\" alt=\"\" class=\"wp-image-236\" style=\"width:673px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/12\/1.png 553w, https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/12\/1-300x120.png 300w\" sizes=\"auto, (max-width: 553px) 100vw, 553px\" \/><\/figure>\n<\/div>\n<\/div>\n\n\n\n<div class=\"wp-block-group is-vertical is-layout-flex wp-container-core-group-is-layout-8cf370e7 wp-block-group-is-layout-flex\">\n<p><\/p>\n\n\n\n<p><\/p>\n\n\n\n<p><strong>Our solution : Match Anything<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>One architecture for both dense and sparse matching<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Simple architecture trained with large scale data<\/li>\n<\/ul>\n<\/div>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"601\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/12\/2-1024x601.png\" alt=\"\" class=\"wp-image-237\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/12\/2-1024x601.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/12\/2-300x176.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/12\/2-768x451.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/12\/2.png 1297w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n","protected":false},"excerpt":{"rendered":"<p>Motivation State estimation and reconstruction play pivotal roles in various cutting-edge applications such as autonomous vehicles, AR\/VR devices, and robotics. For instance, in the case of an autonomous vehicle, it&#8217;s crucial to create a detailed map of its surroundings while accurately determining its location within that map. In particular we want to create dense maps &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Introduction&#8221;<\/span><\/a><\/p>\n","protected":false},"author":221,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-67","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Introduction - Towards Universal State Estimation and Reconstruction in the Wild<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Introduction - Towards Universal State Estimation and Reconstruction in the Wild\" \/>\n<meta property=\"og:description\" content=\"Motivation State estimation and reconstruction play pivotal roles in various cutting-edge applications such as autonomous vehicles, AR\/VR devices, and robotics. For instance, in the case of an autonomous vehicle, it&#8217;s crucial to create a detailed map of its surroundings while accurately determining its location within that map. In particular we want to create dense maps &hellip; Continue reading &quot;Introduction&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/\" \/>\n<meta property=\"og:site_name\" content=\"Towards Universal State Estimation and Reconstruction in the Wild\" \/>\n<meta property=\"article:modified_time\" content=\"2024-12-14T04:06:06+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/\",\"name\":\"Introduction - Towards Universal State Estimation and Reconstruction in the Wild\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/wp-content\\\/uploads\\\/sites\\\/113\\\/2024\\\/05\\\/a.png\",\"datePublished\":\"2024-05-10T04:55:27+00:00\",\"dateModified\":\"2024-12-14T04:06:06+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/wp-content\\\/uploads\\\/sites\\\/113\\\/2024\\\/05\\\/a.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/wp-content\\\/uploads\\\/sites\\\/113\\\/2024\\\/05\\\/a.png\",\"width\":816,\"height\":613},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introduction\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/\",\"name\":\"Towards Universal State Estimation and Reconstruction in the Wild\",\"description\":\"Student:Bhuvan Jhamb, Chenwei Lyu | Advisors: Nikhil Keetha, Yuchen Zhang, Dr. Sebastian Scherer\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team15\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Introduction - Towards Universal State Estimation and Reconstruction in the Wild","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/","og_locale":"en_US","og_type":"article","og_title":"Introduction - Towards Universal State Estimation and Reconstruction in the Wild","og_description":"Motivation State estimation and reconstruction play pivotal roles in various cutting-edge applications such as autonomous vehicles, AR\/VR devices, and robotics. For instance, in the case of an autonomous vehicle, it&#8217;s crucial to create a detailed map of its surroundings while accurately determining its location within that map. In particular we want to create dense maps &hellip; Continue reading \"Introduction\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/","og_site_name":"Towards Universal State Estimation and Reconstruction in the Wild","article_modified_time":"2024-12-14T04:06:06+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/","name":"Introduction - Towards Universal State Estimation and Reconstruction in the Wild","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a.png","datePublished":"2024-05-10T04:55:27+00:00","dateModified":"2024-12-14T04:06:06+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-content\/uploads\/sites\/113\/2024\/05\/a.png","width":816,"height":613},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/"},{"@type":"ListItem","position":2,"name":"Introduction"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/","name":"Towards Universal State Estimation and Reconstruction in the Wild","description":"Student:Bhuvan Jhamb, Chenwei Lyu | Advisors: Nikhil Keetha, Yuchen Zhang, Dr. Sebastian Scherer","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-json\/wp\/v2\/pages\/67","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-json\/wp\/v2\/users\/221"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-json\/wp\/v2\/comments?post=67"}],"version-history":[{"count":22,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-json\/wp\/v2\/pages\/67\/revisions"}],"predecessor-version":[{"id":304,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-json\/wp\/v2\/pages\/67\/revisions\/304"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team15\/wp-json\/wp\/v2\/media?parent=67"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}