{"id":142,"date":"2024-05-11T19:24:46","date_gmt":"2024-05-11T19:24:46","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/?page_id=142"},"modified":"2024-05-11T21:11:01","modified_gmt":"2024-05-11T21:11:01","slug":"detection-experiment","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/","title":{"rendered":"Detection Experiment"},"content":{"rendered":"\n

Dataset<\/strong><\/p>\n\n\n\n

First, we collected some images and videos that were downloaded from public repositories or captured by our lab.<\/p>\n\n\n\n

The BDD100K dataset is a large and diverse driving video dataset, designed for the development and evaluation of autonomous driving and computer vision systems. It features over 100,000 videos captured in a wide range of weather conditions, times of day, and urban and suburban environments, making it a valuable resource for training and testing robust machine learning models.<\/p>\n\n\n\n

The DENSE dataset is a specialized collection designed for enhancing automotive perception systems, particularly in adverse weather conditions. It includes a rich variety of sensor data\u2014such as camera, radar, and lidar\u2014collected under various challenging scenarios like fog, rain, and snow, making it ideal for developing and testing algorithms aimed at improving visibility and reliability in poor weather.<\/p>\n\n\n\n

And we have some driving videos that were collected with an iphone or camera under different weather conditions and times of day.<\/p>\n\n\n\n

<\/p>\n\n\n\n

Here are the quantitative results. The experiment using foggy images generated from the BDD 100K dataset to finetune has the best mAP, which means using foggy images to finetune the Faster R-CNN detector can improve the object detection accuracy.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Here are some qualitative results. On the left is the ground truth, the middle is finetuned on clear images, and the right is finetuned on generated foggy images. We can see that after finetuning on generated foggy images, the detector can identify more objects and detect more accurately, while just finetuning on clear images would make some fake detections.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Next, we applied our fine-tuned Faster R-CNN detector to infer trajectories in unlabeled driving videos under foggy conditions.<\/p>\n\n\n\n

Since the objects in the video are obscured by fog, it greatly increases the difficulty of detection, and the detector will produce some false detections, which are false positives. We minimize the False Positives by filtering out the trajectories whose lengths are shorter than 20 frames, enhancing the accuracy of our detection.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

We also visualize the trajectory in the video. In this graph, each line is a trajectory of a vehicle, and around frame 500, it becomes evident that our fine-tuned detection model enhances the length of trajectories.  <\/p>\n\n\n\n

To further extend the tracking duration, we employ the bounding boxes from the current frame as region proposals to facilitate backward tracking. This is achieved through the ‘tracking by detection’ method, which is compatible with any two-stage detector.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n","protected":false},"excerpt":{"rendered":"

Dataset First, we collected some images and videos that were downloaded from public repositories or captured by our lab. The BDD100K dataset is a large and diverse driving video dataset, designed for the development and evaluation of autonomous driving and computer vision systems. It features over 100,000 videos captured in a wide range of weather … <\/p>\n

Continue reading “Detection Experiment”<\/span><\/a><\/p>\n","protected":false},"author":208,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-142","page","type-page","status-publish","hentry"],"yoast_head":"\nDetection Experiment - Driving in Bad Weather<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Detection Experiment - Driving in Bad Weather\" \/>\n<meta property=\"og:description\" content=\"Dataset First, we collected some images and videos that were downloaded from public repositories or captured by our lab. The BDD100K dataset is a large and diverse driving video dataset, designed for the development and evaluation of autonomous driving and computer vision systems. It features over 100,000 videos captured in a wide range of weather … Continue reading "Detection Experiment"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/\" \/>\n<meta property=\"og:site_name\" content=\"Driving in Bad Weather\" \/>\n<meta property=\"article:modified_time\" content=\"2024-05-11T21:11:01+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-content\/uploads\/sites\/107\/2024\/05\/finetune_table-1-1024x561.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/detection-experiment\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/detection-experiment\\\/\",\"name\":\"Detection Experiment - Driving in Bad Weather\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/detection-experiment\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/detection-experiment\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/wp-content\\\/uploads\\\/sites\\\/107\\\/2024\\\/05\\\/finetune_table-1-1024x561.png\",\"datePublished\":\"2024-05-11T19:24:46+00:00\",\"dateModified\":\"2024-05-11T21:11:01+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/detection-experiment\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/detection-experiment\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/detection-experiment\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/wp-content\\\/uploads\\\/sites\\\/107\\\/2024\\\/05\\\/finetune_table-1.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/wp-content\\\/uploads\\\/sites\\\/107\\\/2024\\\/05\\\/finetune_table-1.png\",\"width\":1823,\"height\":999},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/detection-experiment\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Detection Experiment\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/\",\"name\":\"Driving in Bad Weather\",\"description\":\"Students: Zi Wang, Peipei Zhong | Advisor: Srinivasa Narasimhan\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team9\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Detection Experiment - Driving in Bad Weather","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/","og_locale":"en_US","og_type":"article","og_title":"Detection Experiment - Driving in Bad Weather","og_description":"Dataset First, we collected some images and videos that were downloaded from public repositories or captured by our lab. The BDD100K dataset is a large and diverse driving video dataset, designed for the development and evaluation of autonomous driving and computer vision systems. It features over 100,000 videos captured in a wide range of weather … Continue reading \"Detection Experiment\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/","og_site_name":"Driving in Bad Weather","article_modified_time":"2024-05-11T21:11:01+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-content\/uploads\/sites\/107\/2024\/05\/finetune_table-1-1024x561.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/","name":"Detection Experiment - Driving in Bad Weather","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-content\/uploads\/sites\/107\/2024\/05\/finetune_table-1-1024x561.png","datePublished":"2024-05-11T19:24:46+00:00","dateModified":"2024-05-11T21:11:01+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-content\/uploads\/sites\/107\/2024\/05\/finetune_table-1.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-content\/uploads\/sites\/107\/2024\/05\/finetune_table-1.png","width":1823,"height":999},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/detection-experiment\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/"},{"@type":"ListItem","position":2,"name":"Detection Experiment"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/","name":"Driving in Bad Weather","description":"Students: Zi Wang, Peipei Zhong | Advisor: Srinivasa Narasimhan","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-json\/wp\/v2\/pages\/142","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-json\/wp\/v2\/users\/208"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-json\/wp\/v2\/comments?post=142"}],"version-history":[{"count":4,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-json\/wp\/v2\/pages\/142\/revisions"}],"predecessor-version":[{"id":173,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-json\/wp\/v2\/pages\/142\/revisions\/173"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team9\/wp-json\/wp\/v2\/media?parent=142"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}