{"id":74,"date":"2023-12-08T20:01:05","date_gmt":"2023-12-08T20:01:05","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/?page_id=74"},"modified":"2023-12-09T18:48:15","modified_gmt":"2023-12-09T18:48:15","slug":"hello","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/","title":{"rendered":"Project Description"},"content":{"rendered":"\n<p><\/p>\n\n\n\n<p><strong>Hook<\/strong>: The broad scope of my MSCV project is &#8220;Driving in Bad Weather&#8221;. That&#8217;s quite a board research topic. During the MSCV program, I am focusing on develop robust scene understanding algorithms that aids safe autonomous driving in bad weather.<\/p>\n\n\n\n<p><strong>Motivation<\/strong>: In autonomous driving, training on clear weather images is straightforward, as we have an abundance of them with high-quality ground truth annotations (e.g., the Cityscapes dataset), allowing for supervised model training. However, training on bad weather images is challenging due to the time-consuming and labor-intensive process required to annotate these images with high-quality annotations. Therefore, in this project, we focus on the setting of unsupervised domain adaptation, where we utilize labeled clear weather images and unlabeled bad weather images.<\/p>\n\n\n\n<p><strong>Method 1<\/strong>:  The first approach employs an unpaired image-to-image translation framework to convert clear weather images into bad weather images. As the background remains the same, we can transfer the ground truth labels from the clear weather images to the generated bad weather images. Subsequently, we fine-tune the model using these generated images. If the simulated bad weather images are realistic enough, the fine-tuned model should generalize well to actual bad weather scenes. This work is included in the <strong>Spring 2023<\/strong> section.<\/p>\n\n\n\n<p><strong>Method 2<\/strong>: The second approach utilizes a domain adaptation framework. We initially pretrain it on sourced labeled clear weather images in a supervised manner, then adapt it to target unlabeled bad weather images in an unsupervised manner. The supervised stage, with ground truth labels, is straightforward to train. The unsupervised stage employs a self-training (or self-distillation) strategy, where the student model generates its predictions, and the teacher model, which is the exponential moving average of the student, provides &#8216;pseudo-labels&#8217;. This work is included in the <strong>Fall 2023<\/strong> section.<\/p>\n\n\n\n<p><strong>Spring 2023<\/strong>: <a href=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/spring-2023\/\">TPSeNCE: Towards Artifact-Free Realistic Rain Generation for Deraining and Object Detection in Rain<\/a><\/p>\n\n\n\n<p><strong>Fall 2023<\/strong>: <a href=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/fall-2023\/\">Instance-Level Image Warping for Domain Adaptation<\/a><\/p>\n\n\n\n<p><strong>Team<\/strong>: <a href=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/team\/\">Here<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Hook: The broad scope of my MSCV project is &#8220;Driving in Bad Weather&#8221;. That&#8217;s quite a board research topic. During the MSCV program, I am focusing on develop robust scene understanding algorithms that aids safe autonomous driving in bad weather. Motivation: In autonomous driving, training on clear weather images is straightforward, as we have an &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Project Description&#8221;<\/span><\/a><\/p>\n","protected":false},"author":187,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-74","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Project Description - Driving in bad weather<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Project Description - Driving in bad weather\" \/>\n<meta property=\"og:description\" content=\"Hook: The broad scope of my MSCV project is &#8220;Driving in Bad Weather&#8221;. That&#8217;s quite a board research topic. During the MSCV program, I am focusing on develop robust scene understanding algorithms that aids safe autonomous driving in bad weather. Motivation: In autonomous driving, training on clear weather images is straightforward, as we have an &hellip; Continue reading &quot;Project Description&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/\" \/>\n<meta property=\"og:site_name\" content=\"Driving in bad weather\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-09T18:48:15+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/hello\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/hello\\\/\",\"name\":\"Project Description - Driving in bad weather\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/#website\"},\"datePublished\":\"2023-12-08T20:01:05+00:00\",\"dateModified\":\"2023-12-09T18:48:15+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/hello\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/hello\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/hello\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Project Description\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/\",\"name\":\"Driving in bad weather\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team20\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Project Description - Driving in bad weather","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/","og_locale":"en_US","og_type":"article","og_title":"Project Description - Driving in bad weather","og_description":"Hook: The broad scope of my MSCV project is &#8220;Driving in Bad Weather&#8221;. That&#8217;s quite a board research topic. During the MSCV program, I am focusing on develop robust scene understanding algorithms that aids safe autonomous driving in bad weather. Motivation: In autonomous driving, training on clear weather images is straightforward, as we have an &hellip; Continue reading \"Project Description\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/","og_site_name":"Driving in bad weather","article_modified_time":"2023-12-09T18:48:15+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/","name":"Project Description - Driving in bad weather","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/#website"},"datePublished":"2023-12-08T20:01:05+00:00","dateModified":"2023-12-09T18:48:15+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/hello\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/"},{"@type":"ListItem","position":2,"name":"Project Description"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/","name":"Driving in bad weather","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/wp-json\/wp\/v2\/pages\/74","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/wp-json\/wp\/v2\/users\/187"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/wp-json\/wp\/v2\/comments?post=74"}],"version-history":[{"count":7,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/wp-json\/wp\/v2\/pages\/74\/revisions"}],"predecessor-version":[{"id":148,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/wp-json\/wp\/v2\/pages\/74\/revisions\/148"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team20\/wp-json\/wp\/v2\/media?parent=74"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}