{"id":87,"date":"2022-12-20T15:30:37","date_gmt":"2022-12-20T15:30:37","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/?page_id=87"},"modified":"2022-12-20T18:15:38","modified_gmt":"2022-12-20T18:15:38","slug":"method-2","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/","title":{"rendered":"Method"},"content":{"rendered":"\n

Unsupervised domain adaptation<\/strong><\/h2>\n\n\n\n

The conventional domain transfer technology is unsupervised domain adaptation (UDA). In this project, we employ DANN[1]<\/sup> as the baseline UDA method following its default configurations. As shown in the figure, a discriminator is utilized for domain classification and we apply Gradient Reverse Layer (GRL) for adversarial learning. Combined with traditional cross-entropy loss, the model can optimize image classification and domain alignment simultaneously.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Active learning<\/strong><\/h2>\n\n\n\n

Since purely unsupervised learning cannot achieve satisfying performance, we want to introduce active learning as a complement. Within each active learning circle, we aim at selecting the most helpful samples in the unlabeled pool based on the current trained model with a limited budget. And the oracle will label the samples and add them to the training. In this way, the performance of the model boosts gradually until saturation.<\/p>\n\n\n\n

Active domain adaptation<\/strong><\/h2>\n\n\n\n

Our final training pipeline is composed of both unsupervised domain adaptation and active learning stages, as shown below. During unsupervised domain adaptation, we train a model using DANN on all available data samples (labeled source, unlabeled target, and labeled target). After training, we use the trained model to actively select samples from the unlabeled target pool for labeling. This will continue stage by stage until the labeling budget is exhausted.<\/p>\n\n\n\n

\"\"
Active domain adaptation pipeline<\/figcaption><\/figure>\n\n\n\n

Multi-task Geometric contribution<\/h3>\n\n\n\n

We model domain adaptation as a multi-task learning process, which consists of image classification and domain alignment. As a result, the contribution of labeling a sample is the sum of its contribution towards both classification and domain alignment directions.<\/p>\n\n\n\n

The directions of classification and domain alignment are approximated as those of gradients w.r.t. the encoded feature g_cls and g_da, while the magnitude is the projected length of the classification gradient on corresponding directions c_cls and c_da.<\/p>\n\n\n\n

The final proposed score is the sum of c_cls and c_da.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

[1] Ganin, Yaroslav, and Victor Lempitsky. “Unsupervised domain adaptation by backpropagation.” International conference on machine learning<\/em>. PMLR, 2015.<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Unsupervised domain adaptation The conventional domain transfer technology is unsupervised domain adaptation (UDA). In this project, we employ DANN[1] as the baseline UDA method following its default configurations. As shown in the figure, a discriminator is utilized for domain classification and we apply Gradient Reverse Layer (GRL) for adversarial learning. Combined with traditional cross-entropy loss, … <\/p>\n

Continue reading “Method”<\/span><\/a><\/p>\n","protected":false},"author":139,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-87","page","type-page","status-publish","hentry"],"yoast_head":"\nMethod - Automatic bias removal from datasets<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Method - Automatic bias removal from datasets\" \/>\n<meta property=\"og:description\" content=\"Unsupervised domain adaptation The conventional domain transfer technology is unsupervised domain adaptation (UDA). In this project, we employ DANN[1] as the baseline UDA method following its default configurations. As shown in the figure, a discriminator is utilized for domain classification and we apply Gradient Reverse Layer (GRL) for adversarial learning. Combined with traditional cross-entropy loss, … Continue reading "Method"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/\" \/>\n<meta property=\"og:site_name\" content=\"Automatic bias removal from datasets\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-20T18:15:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-content\/uploads\/sites\/59\/2022\/12\/image-1024x426.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/method-2\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/method-2\\\/\",\"name\":\"Method - Automatic bias removal from datasets\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/method-2\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/method-2\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/wp-content\\\/uploads\\\/sites\\\/59\\\/2022\\\/12\\\/image-1024x426.png\",\"datePublished\":\"2022-12-20T15:30:37+00:00\",\"dateModified\":\"2022-12-20T18:15:38+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/method-2\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/method-2\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/method-2\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/wp-content\\\/uploads\\\/sites\\\/59\\\/2022\\\/12\\\/image.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/wp-content\\\/uploads\\\/sites\\\/59\\\/2022\\\/12\\\/image.png\",\"width\":1208,\"height\":502},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/method-2\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Method\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/\",\"name\":\"Automatic bias removal from datasets\",\"description\":\"Students: Lin ZHANG, Linghan Xu | Advisor: Fernando De la Torre\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2022team4\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Method - Automatic bias removal from datasets","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/","og_locale":"en_US","og_type":"article","og_title":"Method - Automatic bias removal from datasets","og_description":"Unsupervised domain adaptation The conventional domain transfer technology is unsupervised domain adaptation (UDA). In this project, we employ DANN[1] as the baseline UDA method following its default configurations. As shown in the figure, a discriminator is utilized for domain classification and we apply Gradient Reverse Layer (GRL) for adversarial learning. Combined with traditional cross-entropy loss, … Continue reading \"Method\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/","og_site_name":"Automatic bias removal from datasets","article_modified_time":"2022-12-20T18:15:38+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-content\/uploads\/sites\/59\/2022\/12\/image-1024x426.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/","name":"Method - Automatic bias removal from datasets","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-content\/uploads\/sites\/59\/2022\/12\/image-1024x426.png","datePublished":"2022-12-20T15:30:37+00:00","dateModified":"2022-12-20T18:15:38+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-content\/uploads\/sites\/59\/2022\/12\/image.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-content\/uploads\/sites\/59\/2022\/12\/image.png","width":1208,"height":502},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/method-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/"},{"@type":"ListItem","position":2,"name":"Method"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/","name":"Automatic bias removal from datasets","description":"Students: Lin ZHANG, Linghan Xu | Advisor: Fernando De la Torre","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-json\/wp\/v2\/pages\/87","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-json\/wp\/v2\/users\/139"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-json\/wp\/v2\/comments?post=87"}],"version-history":[{"count":5,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-json\/wp\/v2\/pages\/87\/revisions"}],"predecessor-version":[{"id":115,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-json\/wp\/v2\/pages\/87\/revisions\/115"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2022team4\/wp-json\/wp\/v2\/media?parent=87"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}