{"id":180,"date":"2020-05-14T22:46:06","date_gmt":"2020-05-14T22:46:06","guid":{"rendered":"http:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/?p=180"},"modified":"2020-05-14T23:12:14","modified_gmt":"2020-05-14T23:12:14","slug":"project-overview","status":"publish","type":"post","link":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/","title":{"rendered":"Project Overview"},"content":{"rendered":"\n
\"\"<\/figure><\/div>\n\n\n\n

In this Argo AI<\/a> sponsored research project, we explore multimodal object detection for autonomous driving. Specifically, we focus on detection with RGB and infrared signals in the driving scenes.<\/p>\n\n\n\n

It is well known that infrared images are more robust to lighting (e.g., dynamic range and night), weather conditions (e.g., fog and snow), etc. Therefore, the joint force from RGB and infrared images allows for potential opportunities for better object detection. Arising in this study, there are novel challenges, solving which will be of great value to the community, such as how to train a better model with unaligned RGB and infrared images. We also expect to collect a large-scale dataset to release, along with our codebase to foster broad research in the community.
<\/p>\n","protected":false},"excerpt":{"rendered":"

In this Argo AI sponsored research project, we explore multimodal object detection for autonomous driving. Specifically, we focus on detection with RGB and infrared signals in the driving scenes. It is well known that infrared images are more robust to lighting (e.g., dynamic range and night), weather conditions (e.g., fog and snow), etc. Therefore, the … <\/p>\n

Continue reading “Project Overview”<\/span><\/a><\/p>\n","protected":false},"author":75,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3,1],"tags":[],"class_list":["post-180","post","type-post","status-publish","format-standard","hentry","category-project-description","category-uncategorized"],"yoast_head":"\nProject Overview - Object Detection in Infrared Images<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Project Overview - Object Detection in Infrared Images\" \/>\n<meta property=\"og:description\" content=\"In this Argo AI sponsored research project, we explore multimodal object detection for autonomous driving. Specifically, we focus on detection with RGB and infrared signals in the driving scenes. It is well known that infrared images are more robust to lighting (e.g., dynamic range and night), weather conditions (e.g., fog and snow), etc. Therefore, the … Continue reading "Project Overview"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/\" \/>\n<meta property=\"og:site_name\" content=\"Object Detection in Infrared Images\" \/>\n<meta property=\"article:published_time\" content=\"2020-05-14T22:46:06+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2020-05-14T23:12:14+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/cropped-argo-logo@3x-2-1.png\" \/>\n\t<meta property=\"og:image:width\" content=\"252\" \/>\n\t<meta property=\"og:image:height\" content=\"150\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"jinghaos\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"jinghaos\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/\"},\"author\":{\"name\":\"jinghaos\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/#\\\/schema\\\/person\\\/c16366fd88b347a46937db0758c87811\"},\"headline\":\"Project Overview\",\"datePublished\":\"2020-05-14T22:46:06+00:00\",\"dateModified\":\"2020-05-14T23:12:14+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/\"},\"wordCount\":127,\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/wp-content\\\/uploads\\\/sites\\\/33\\\/2020\\\/05\\\/cropped-argo-logo@3x-2-1.png\",\"articleSection\":[\"Project Description\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/\",\"name\":\"Project Overview - Object Detection in Infrared Images\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/wp-content\\\/uploads\\\/sites\\\/33\\\/2020\\\/05\\\/cropped-argo-logo@3x-2-1.png\",\"datePublished\":\"2020-05-14T22:46:06+00:00\",\"dateModified\":\"2020-05-14T23:12:14+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/#\\\/schema\\\/person\\\/c16366fd88b347a46937db0758c87811\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/wp-content\\\/uploads\\\/sites\\\/33\\\/2020\\\/05\\\/cropped-argo-logo@3x-2-1.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/wp-content\\\/uploads\\\/sites\\\/33\\\/2020\\\/05\\\/cropped-argo-logo@3x-2-1.png\",\"width\":252,\"height\":150},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/2020\\\/05\\\/14\\\/project-overview\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Project Overview\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/\",\"name\":\"Object Detection in Infrared Images\",\"description\":\"Students: Yi-Ting Chen, Jinghao Shi | Advisor: Deva Ramanan, Christoph Mertz, Shu Kong | Sponsor: Argo AI\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/#\\\/schema\\\/person\\\/c16366fd88b347a46937db0758c87811\",\"name\":\"jinghaos\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2cdee69321ee807d347167709a2d86038ded99350324f9b5fd560b64b1462e54?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2cdee69321ee807d347167709a2d86038ded99350324f9b5fd560b64b1462e54?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/2cdee69321ee807d347167709a2d86038ded99350324f9b5fd560b64b1462e54?s=96&d=mm&r=g\",\"caption\":\"jinghaos\"},\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamc\\\/author\\\/jinghaos\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Project Overview - Object Detection in Infrared Images","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/","og_locale":"en_US","og_type":"article","og_title":"Project Overview - Object Detection in Infrared Images","og_description":"In this Argo AI sponsored research project, we explore multimodal object detection for autonomous driving. Specifically, we focus on detection with RGB and infrared signals in the driving scenes. It is well known that infrared images are more robust to lighting (e.g., dynamic range and night), weather conditions (e.g., fog and snow), etc. Therefore, the … Continue reading \"Project Overview\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/","og_site_name":"Object Detection in Infrared Images","article_published_time":"2020-05-14T22:46:06+00:00","article_modified_time":"2020-05-14T23:12:14+00:00","og_image":[{"width":252,"height":150,"url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/cropped-argo-logo@3x-2-1.png","type":"image\/png"}],"author":"jinghaos","twitter_card":"summary_large_image","twitter_misc":{"Written by":"jinghaos","Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/#article","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/"},"author":{"name":"jinghaos","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/#\/schema\/person\/c16366fd88b347a46937db0758c87811"},"headline":"Project Overview","datePublished":"2020-05-14T22:46:06+00:00","dateModified":"2020-05-14T23:12:14+00:00","mainEntityOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/"},"wordCount":127,"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/cropped-argo-logo@3x-2-1.png","articleSection":["Project Description"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/","name":"Project Overview - Object Detection in Infrared Images","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/cropped-argo-logo@3x-2-1.png","datePublished":"2020-05-14T22:46:06+00:00","dateModified":"2020-05-14T23:12:14+00:00","author":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/#\/schema\/person\/c16366fd88b347a46937db0758c87811"},"breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/cropped-argo-logo@3x-2-1.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-content\/uploads\/sites\/33\/2020\/05\/cropped-argo-logo@3x-2-1.png","width":252,"height":150},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/2020\/05\/14\/project-overview\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/"},{"@type":"ListItem","position":2,"name":"Project Overview"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/","name":"Object Detection in Infrared Images","description":"Students: Yi-Ting Chen, Jinghao Shi | Advisor: Deva Ramanan, Christoph Mertz, Shu Kong | Sponsor: Argo AI","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/#\/schema\/person\/c16366fd88b347a46937db0758c87811","name":"jinghaos","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/2cdee69321ee807d347167709a2d86038ded99350324f9b5fd560b64b1462e54?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/2cdee69321ee807d347167709a2d86038ded99350324f9b5fd560b64b1462e54?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/2cdee69321ee807d347167709a2d86038ded99350324f9b5fd560b64b1462e54?s=96&d=mm&r=g","caption":"jinghaos"},"url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/author\/jinghaos\/"}]}},"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/posts\/180","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/users\/75"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/comments?post=180"}],"version-history":[{"count":2,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/posts\/180\/revisions"}],"predecessor-version":[{"id":183,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/posts\/180\/revisions\/183"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/media?parent=180"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/categories?post=180"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamc\/wp-json\/wp\/v2\/tags?post=180"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}