{"id":10,"date":"2022-12-15T15:11:23","date_gmt":"2022-12-15T15:11:23","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/?page_id=10"},"modified":"2022-12-20T18:07:08","modified_gmt":"2022-12-20T18:07:08","slug":"experimental-setup","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/","title":{"rendered":"Experimental Setup"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">Dataset<\/h2>\n\n\n\n<p>We use Nvidia&#8217;s Dynamic Scene Dataset [1] for our experiments. It contains multiple scenes containing objects moving in the foreground, each consisting of 12 images captured from a monocular camera. <\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21-1024x381.png\" alt=\"\" class=\"wp-image-62\" width=\"859\" height=\"319\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21-1024x381.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21-300x112.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21-768x286.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21.png 1300w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption>Truck scene at different timesteps<\/figcaption><\/figure><\/div>\n\n\n\n<p>The images are taken at different times, as can be seen from the truck&#8217;s position shown by the red circles in the above figure. They are also taken from slightly different viewpoints, as shown in the green circles in the figure below.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-40-1024x384.png\" alt=\"\" class=\"wp-image-63\" width=\"858\" height=\"321\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-40-1024x384.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-40-300x112.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-40-768x288.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-40.png 1300w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption>Truck scene at different viewpoints<\/figcaption><\/figure><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">General Approach<\/h2>\n\n\n\n<p>Most of the work done by the research community has the flow of information shown in the figure below.<\/p>\n\n\n\n<div class=\"wp-block-image\"><figure class=\"aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-20-03-24-1024x366.png\" alt=\"\" class=\"wp-image-65\" width=\"836\" height=\"298\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-20-03-24-1024x366.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-20-03-24-300x107.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-20-03-24-768x274.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-20-03-24-1536x549.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-20-03-24.png 1903w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><figcaption>General approach to insert objects into a scene<\/figcaption><\/figure><\/div>\n\n\n\n<p>An image of the scene is provided as input to the scene encoder to build a scene representation. Similarly, an image of the object to be inserted into the scene is passed through an object encoder to build an object representation. The two representations are merged using a renderer to finally render thhe object in the given scene.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">References<\/h2>\n\n\n\n<ol class=\"wp-block-list\"><li>Jae Shin Yoon, Kihwan Kim, Orazio Gallo, Hyun Soo Park, and Jan Kautz. Novel view synthesis of dynamic scenes with globally coherent depths from a monocular camera. In CVPR, 2020.<\/li><\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Dataset We use Nvidia&#8217;s Dynamic Scene Dataset [1] for our experiments. It contains multiple scenes containing objects moving in the foreground, each consisting of 12 images captured from a monocular camera. The images are taken at different times, as can be seen from the truck&#8217;s position shown by the red circles in the above figure. &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Experimental Setup&#8221;<\/span><\/a><\/p>\n","protected":false},"author":145,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-10","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Experimental Setup - Sensor Simulation with Dynamic Objects<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Experimental Setup - Sensor Simulation with Dynamic Objects\" \/>\n<meta property=\"og:description\" content=\"Dataset We use Nvidia&#8217;s Dynamic Scene Dataset [1] for our experiments. It contains multiple scenes containing objects moving in the foreground, each consisting of 12 images captured from a monocular camera. The images are taken at different times, as can be seen from the truck&#8217;s position shown by the red circles in the above figure. &hellip; Continue reading &quot;Experimental Setup&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/\" \/>\n<meta property=\"og:site_name\" content=\"Sensor Simulation with Dynamic Objects\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-20T18:07:08+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21-1024x381.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/experimental-setup\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/experimental-setup\\\/\",\"name\":\"Experimental Setup - Sensor Simulation with Dynamic Objects\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/experimental-setup\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/experimental-setup\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/wp-content\\\/uploads\\\/sites\\\/72\\\/2022\\\/12\\\/Screenshot-from-2022-12-20-19-56-21-1024x381.png\",\"datePublished\":\"2022-12-15T15:11:23+00:00\",\"dateModified\":\"2022-12-20T18:07:08+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/experimental-setup\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/experimental-setup\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/experimental-setup\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/wp-content\\\/uploads\\\/sites\\\/72\\\/2022\\\/12\\\/Screenshot-from-2022-12-20-19-56-21.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/wp-content\\\/uploads\\\/sites\\\/72\\\/2022\\\/12\\\/Screenshot-from-2022-12-20-19-56-21.png\",\"width\":1300,\"height\":484},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/experimental-setup\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Experimental Setup\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/\",\"name\":\"Sensor Simulation with Dynamic Objects\",\"description\":\"MSCV Capstone Project | Students: Dakshit Agrawal, Jiajie Xu | Advisors: Ioannis Gkioulekas (CMU), Yuning Chai (Cruise), Ashish Shrivastava (Cruise), Siva Karthik Mustikovela (Cruise) | Sponsor: Cruise\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team1\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Experimental Setup - Sensor Simulation with Dynamic Objects","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/","og_locale":"en_US","og_type":"article","og_title":"Experimental Setup - Sensor Simulation with Dynamic Objects","og_description":"Dataset We use Nvidia&#8217;s Dynamic Scene Dataset [1] for our experiments. It contains multiple scenes containing objects moving in the foreground, each consisting of 12 images captured from a monocular camera. The images are taken at different times, as can be seen from the truck&#8217;s position shown by the red circles in the above figure. &hellip; Continue reading \"Experimental Setup\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/","og_site_name":"Sensor Simulation with Dynamic Objects","article_modified_time":"2022-12-20T18:07:08+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21-1024x381.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/","name":"Experimental Setup - Sensor Simulation with Dynamic Objects","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21-1024x381.png","datePublished":"2022-12-15T15:11:23+00:00","dateModified":"2022-12-20T18:07:08+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-content\/uploads\/sites\/72\/2022\/12\/Screenshot-from-2022-12-20-19-56-21.png","width":1300,"height":484},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/experimental-setup\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/"},{"@type":"ListItem","position":2,"name":"Experimental Setup"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/","name":"Sensor Simulation with Dynamic Objects","description":"MSCV Capstone Project | Students: Dakshit Agrawal, Jiajie Xu | Advisors: Ioannis Gkioulekas (CMU), Yuning Chai (Cruise), Ashish Shrivastava (Cruise), Siva Karthik Mustikovela (Cruise) | Sponsor: Cruise","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-json\/wp\/v2\/pages\/10","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-json\/wp\/v2\/users\/145"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-json\/wp\/v2\/comments?post=10"}],"version-history":[{"count":11,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-json\/wp\/v2\/pages\/10\/revisions"}],"predecessor-version":[{"id":85,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-json\/wp\/v2\/pages\/10\/revisions\/85"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team1\/wp-json\/wp\/v2\/media?parent=10"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}