{"id":40,"date":"2021-12-08T00:24:59","date_gmt":"2021-12-08T00:24:59","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/?p=40"},"modified":"2022-04-18T05:05:55","modified_gmt":"2022-04-18T05:05:55","slug":"motivation","status":"publish","type":"post","link":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/","title":{"rendered":"Motivation"},"content":{"rendered":"\n<p>Autonomous vehicles (AVs) must detect objects <em>in advance<\/em> for timely action to ensure driving safety. That said, AVs must accurately detect <em>far-field<\/em> objects while running at high speeds. Because a 60mph vehicle requires 60-meter stopping distance, AVs must detect far-field obstacles to avoid a potential collision into them. Interestingly, detecting far-field objects is also relevant for navigation in urban settings at modest speeds during precarious maneuvers, such as unprotected left turns where opposing traffic might be moving at 35mph, resulting in a relative speed of 70mph. These real-world scenarios motivate us to study the problem of far-field 3D object detection (<strong>Far3Det<\/strong>).<br><\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10.png\" alt=\"\" class=\"wp-image-94\" width=\"767\" height=\"199\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10.png 804w, https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10-300x78.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10-768x200.png 768w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Status Quo<\/h2>\n\n\n\n<p>3D detection has been greatly advanced under AV research, largely owing to modern benchmarks that collect data using LiDAR (e.g., nuScenes, Waymo, and KITTI), which faithfully measures the 3D world and allows for precise localization in the 3D world. However, these benchmarks evaluate detections only up to a certain distance (i.e., within 50 meters from the ego-vehicle), presumably because near-field objects are more important that have an immediate impact on AVs&#8217; motion plans. However, the aforementioned scenarios demonstrate that Far3Det, the 3D detection of objects beyond this distance (&gt;= 50m), is also crucial.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Autonomous vehicles (AVs) must detect objects in advance for timely action to ensure driving safety. That said, AVs must accurately detect far-field objects while running at high speeds. Because a 60mph vehicle requires 60-meter stopping distance, AVs must detect far-field obstacles to avoid a potential collision into them. Interestingly, detecting far-field objects is also relevant &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Motivation&#8221;<\/span><\/a><\/p>\n","protected":false},"author":109,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[],"class_list":["post-40","post","type-post","status-publish","format-standard","hentry","category-motivation"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Motivation - Multimodal Fusion for Autonomous Driving<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Motivation - Multimodal Fusion for Autonomous Driving\" \/>\n<meta property=\"og:description\" content=\"Autonomous vehicles (AVs) must detect objects in advance for timely action to ensure driving safety. That said, AVs must accurately detect far-field objects while running at high speeds. Because a 60mph vehicle requires 60-meter stopping distance, AVs must detect far-field obstacles to avoid a potential collision into them. Interestingly, detecting far-field objects is also relevant &hellip; Continue reading &quot;Motivation&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/\" \/>\n<meta property=\"og:site_name\" content=\"Multimodal Fusion for Autonomous Driving\" \/>\n<meta property=\"article:published_time\" content=\"2021-12-08T00:24:59+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-04-18T05:05:55+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10.png\" \/>\n<meta name=\"author\" content=\"shubham2\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"shubham2\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/\"},\"author\":{\"name\":\"shubham2\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/#\\\/schema\\\/person\\\/487fcc27c049c1e156ea6af8155d1353\"},\"headline\":\"Motivation\",\"datePublished\":\"2021-12-08T00:24:59+00:00\",\"dateModified\":\"2022-04-18T05:05:55+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/\"},\"wordCount\":200,\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/wp-content\\\/uploads\\\/sites\\\/51\\\/2022\\\/04\\\/image-10.png\",\"articleSection\":[\"Motivation\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/\",\"name\":\"Motivation - Multimodal Fusion for Autonomous Driving\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/wp-content\\\/uploads\\\/sites\\\/51\\\/2022\\\/04\\\/image-10.png\",\"datePublished\":\"2021-12-08T00:24:59+00:00\",\"dateModified\":\"2022-04-18T05:05:55+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/#\\\/schema\\\/person\\\/487fcc27c049c1e156ea6af8155d1353\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/wp-content\\\/uploads\\\/sites\\\/51\\\/2022\\\/04\\\/image-10.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/wp-content\\\/uploads\\\/sites\\\/51\\\/2022\\\/04\\\/image-10.png\",\"width\":804,\"height\":209},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/2021\\\/12\\\/08\\\/motivation\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Motivation\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/\",\"name\":\"Multimodal Fusion for Autonomous Driving\",\"description\":\"Students: Jeet Kanjani, Shubham Gupta | Advisors: Martin Li, Shu Kong, Francesco Ferroni, James Hays, Deva Ramanan | Sponser: Argo AI\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/#\\\/schema\\\/person\\\/487fcc27c049c1e156ea6af8155d1353\",\"name\":\"shubham2\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1bcd6b9c96e7821421ecc71b1e5515ed2ccd73703079dd952ec388bba0fe16c4?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1bcd6b9c96e7821421ecc71b1e5515ed2ccd73703079dd952ec388bba0fe16c4?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/1bcd6b9c96e7821421ecc71b1e5515ed2ccd73703079dd952ec388bba0fe16c4?s=96&d=mm&r=g\",\"caption\":\"shubham2\"},\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2021teamf\\\/author\\\/shubham2\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Motivation - Multimodal Fusion for Autonomous Driving","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/","og_locale":"en_US","og_type":"article","og_title":"Motivation - Multimodal Fusion for Autonomous Driving","og_description":"Autonomous vehicles (AVs) must detect objects in advance for timely action to ensure driving safety. That said, AVs must accurately detect far-field objects while running at high speeds. Because a 60mph vehicle requires 60-meter stopping distance, AVs must detect far-field obstacles to avoid a potential collision into them. Interestingly, detecting far-field objects is also relevant &hellip; Continue reading \"Motivation\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/","og_site_name":"Multimodal Fusion for Autonomous Driving","article_published_time":"2021-12-08T00:24:59+00:00","article_modified_time":"2022-04-18T05:05:55+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10.png","type":"","width":"","height":""}],"author":"shubham2","twitter_card":"summary_large_image","twitter_misc":{"Written by":"shubham2","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/#article","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/"},"author":{"name":"shubham2","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/#\/schema\/person\/487fcc27c049c1e156ea6af8155d1353"},"headline":"Motivation","datePublished":"2021-12-08T00:24:59+00:00","dateModified":"2022-04-18T05:05:55+00:00","mainEntityOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/"},"wordCount":200,"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10.png","articleSection":["Motivation"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/","name":"Motivation - Multimodal Fusion for Autonomous Driving","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10.png","datePublished":"2021-12-08T00:24:59+00:00","dateModified":"2022-04-18T05:05:55+00:00","author":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/#\/schema\/person\/487fcc27c049c1e156ea6af8155d1353"},"breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-content\/uploads\/sites\/51\/2022\/04\/image-10.png","width":804,"height":209},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/2021\/12\/08\/motivation\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/"},{"@type":"ListItem","position":2,"name":"Motivation"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/","name":"Multimodal Fusion for Autonomous Driving","description":"Students: Jeet Kanjani, Shubham Gupta | Advisors: Martin Li, Shu Kong, Francesco Ferroni, James Hays, Deva Ramanan | Sponser: Argo AI","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/#\/schema\/person\/487fcc27c049c1e156ea6af8155d1353","name":"shubham2","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/1bcd6b9c96e7821421ecc71b1e5515ed2ccd73703079dd952ec388bba0fe16c4?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/1bcd6b9c96e7821421ecc71b1e5515ed2ccd73703079dd952ec388bba0fe16c4?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/1bcd6b9c96e7821421ecc71b1e5515ed2ccd73703079dd952ec388bba0fe16c4?s=96&d=mm&r=g","caption":"shubham2"},"url":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/author\/shubham2\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/posts\/40","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/users\/109"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/comments?post=40"}],"version-history":[{"count":4,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/posts\/40\/revisions"}],"predecessor-version":[{"id":95,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/posts\/40\/revisions\/95"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/media?parent=40"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/categories?post=40"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2021teamf\/wp-json\/wp\/v2\/tags?post=40"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}