{"id":63,"date":"2026-05-06T12:05:41","date_gmt":"2026-05-06T12:05:41","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/?page_id=63"},"modified":"2026-05-06T13:43:07","modified_gmt":"2026-05-06T13:43:07","slug":"method","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/","title":{"rendered":"Method"},"content":{"rendered":"<section>\n  <h2>Cooperative Foundation Models for Object Detection Active Learning<\/h2>\n\n  <nav>\n    <a href=\"\/2026teamf11\/project2\/\">Introduction<\/a> |\n    <a href=\"\/2026teamf11\/project2\/related-work\/\">Related Work<\/a> |\n    <strong>Method<\/strong> |\n    <a href=\"\/2026teamf11\/project2\/experiments\/\">Experiments<\/a> |\n    <a href=\"\/2026teamf11\/project2\/resources\/\">Resources<\/a> |\n    <a href=\"\/2026teamf11\/project2\/team\/\">Team<\/a>\n  <\/nav>\n\n  <hr>\n\n  <section>\n    <h2>Method<\/h2>\n\n    <h3>Overview<\/h3>\n\n    <p>\n      We propose <strong>CoMODAL<\/strong>, an active learning framework for object detection that uses\n      multiple foundation models cooperatively. Instead of relying on a single model, CoMODAL assigns\n      different foundation models to different stages of the pipeline, including negative image mining,\n      query sampling, and accelerated annotation.\n    <\/p>\n\n    <p>\n      Given an unlabeled image set and a target object class, CoMODAL first identifies reliable negative\n      images, then selects informative query samples from the remaining unlabeled pool, and finally\n      asks the human annotator to verify candidate bounding boxes generated by foundation models.\n    <\/p>\n\n  <\/section>\n\n\n<\/section>\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"380\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-1024x380.jpg\" alt=\"\" class=\"wp-image-147\" style=\"width:800px\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-1024x380.jpg 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-300x111.jpg 300w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-768x285.jpg 768w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-1536x570.jpg 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-2048x761.jpg 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n<section>\n<section>\n\n    <h3>Negative Image Mining<\/h3>\n\n    <p>\n      CoMODAL begins by finding images that confidently do not contain the target class. A committee\n      of vision-language models checks whether each image contains the object of interest. Only images\n      that all committee members agree are negative are added to the negative set.\n    <\/p>\n\n    <p>\n      This step reduces unnecessary annotation effort and provides useful negative supervision for\n      detector training. The design favors precision: uncertain cases are kept in the unlabeled pool\n      rather than being mistakenly removed.\n    <\/p>\n  <\/section>\n<\/section>\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"615\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/negative-1024x615.jpg\" alt=\"\" class=\"wp-image-148\" style=\"width:400px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/negative-1024x615.jpg 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/negative-300x180.jpg 300w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/negative-768x462.jpg 768w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/negative.jpg 1248w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n<section>\n<section>\n    <h3>Query Sampling<\/h3>\n\n    <p>\n      After negative images are removed, CoMODAL selects query images from the remaining unlabeled\n      pool. The query sampler combines two complementary signals: uncertain predictions and likely\n      high-confidence false positives.\n    <\/p>\n\n    <p>\n      For uncertain predictions, CoMODAL estimates a high-uncertainty confidence interval from the\n      detector&#8217;s score distribution and then applies diversity-based sampling using patch embeddings.\n      This helps select samples that are both uncertain and visually diverse.\n    <\/p>\n\n    <p>\n      For high-confidence false positives, CoMODAL searches for confident predictions whose patch\n      embeddings are dissimilar from previously annotated objects. These samples are important because\n      confident false positives can strongly hurt detection performance.\n    <\/p>\n\n  <\/section>\n  <\/section>\n\n\n<figure class=\"wp-block-image aligncenter size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"382\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/querysampling-1024x382.jpg\" alt=\"\" class=\"wp-image-149\" style=\"width:800px\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/querysampling-1024x382.jpg 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/querysampling-300x112.jpg 300w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/querysampling-768x286.jpg 768w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/querysampling-1536x573.jpg 1536w, https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/querysampling-2048x764.jpg 2048w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n<section>\n<section>\n\n    <h3>Targeting High-Confidence False Positives<\/h3>\n\n    <p>\n      A detector can sometimes make confident but incorrect predictions. These errors are especially\n      harmful because they appear early in the ranked prediction list and can significantly reduce\n      Average Precision.\n    <\/p>\n\n    <p>\n      CoMODAL explicitly searches for such cases by comparing high-confidence prediction embeddings\n      with embeddings from previously annotated objects. Predictions that are confident but far from\n      known positives are treated as likely false positives and prioritized for annotation.\n    <\/p>\n\n    <h3>Accelerated Query Annotation<\/h3>\n\n    <p>\n      Once query images are selected, CoMODAL uses another committee of foundation models to\n      generate candidate bounding boxes. The human annotator does not need to draw boxes from\n      scratch; instead, they only approve or reject each proposed box.\n    <\/p>\n\n    <p>\n      This turns object detection annotation into a binary verification task. Accepted boxes are added\n      to the labeled training set, and the detector is retrained for the next active learning iteration.\n    <\/p>\n\n    <h3>Training Loop<\/h3>\n\n    <p>\n      At each active learning iteration, the detector is trained using the mined negative images and all\n      approved annotations collected so far. The updated detector is then used to produce new predictions\n      for the next round of query sampling.\n    <\/p>\n\n    <p>\n      Through this loop, CoMODAL aims to improve detector performance while reducing both the\n      number of annotated images and the effort required for each annotation.\n    <\/p>\n  <\/section>\n<\/section>\n\n\n<div style=\"height:100px\" aria-hidden=\"true\" class=\"wp-block-spacer\"><\/div>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Cooperative Foundation Models for Object Detection Active Learning Introduction | Related Work | Method | Experiments | Resources | Team Method Overview We propose CoMODAL, an active learning framework for object detection that uses multiple foundation models cooperatively. Instead of relying on a single model, CoMODAL assigns different foundation models to different stages of the [&hellip;]<\/p>\n","protected":false},"author":288,"featured_media":0,"parent":34,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-63","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Method - Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Method - Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning\" \/>\n<meta property=\"og:description\" content=\"Cooperative Foundation Models for Object Detection Active Learning Introduction | Related Work | Method | Experiments | Resources | Team Method Overview We propose CoMODAL, an active learning framework for object detection that uses multiple foundation models cooperatively. Instead of relying on a single model, CoMODAL assigns different foundation models to different stages of the [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/\" \/>\n<meta property=\"og:site_name\" content=\"Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning\" \/>\n<meta property=\"article:modified_time\" content=\"2026-05-06T13:43:07+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-scaled.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2560\" \/>\n\t<meta property=\"og:image:height\" content=\"951\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/method\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/method\\\/\",\"name\":\"Method - Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/method\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/method\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/wp-content\\\/uploads\\\/sites\\\/153\\\/2026\\\/05\\\/pipeline-1024x380.jpg\",\"datePublished\":\"2026-05-06T12:05:41+00:00\",\"dateModified\":\"2026-05-06T13:43:07+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/method\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/method\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/method\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/wp-content\\\/uploads\\\/sites\\\/153\\\/2026\\\/05\\\/pipeline-scaled.jpg\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/wp-content\\\/uploads\\\/sites\\\/153\\\/2026\\\/05\\\/pipeline-scaled.jpg\",\"width\":2560,\"height\":951},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/method\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Project 2\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/project2\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Method\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/\",\"name\":\"Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf11\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Method - Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/","og_locale":"en_US","og_type":"article","og_title":"Method - Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning","og_description":"Cooperative Foundation Models for Object Detection Active Learning Introduction | Related Work | Method | Experiments | Resources | Team Method Overview We propose CoMODAL, an active learning framework for object detection that uses multiple foundation models cooperatively. Instead of relying on a single model, CoMODAL assigns different foundation models to different stages of the [&hellip;]","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/","og_site_name":"Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning","article_modified_time":"2026-05-06T13:43:07+00:00","og_image":[{"width":2560,"height":951,"url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-scaled.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/","name":"Method - Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-1024x380.jpg","datePublished":"2026-05-06T12:05:41+00:00","dateModified":"2026-05-06T13:43:07+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-scaled.jpg","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-content\/uploads\/sites\/153\/2026\/05\/pipeline-scaled.jpg","width":2560,"height":951},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/method\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/"},{"@type":"ListItem","position":2,"name":"Project 2","item":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/project2\/"},{"@type":"ListItem","position":3,"name":"Method"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/","name":"Disentangled Gaussian Transformers for Animatable Humans | Cooperative Foundation Models For Object Detection Active Learning","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/pages\/63","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/users\/288"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/comments?post=63"}],"version-history":[{"count":7,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/pages\/63\/revisions"}],"predecessor-version":[{"id":151,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/pages\/63\/revisions\/151"}],"up":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/pages\/34"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf11\/wp-json\/wp\/v2\/media?parent=63"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}