{"id":9,"date":"2025-05-06T17:13:35","date_gmt":"2025-05-06T17:13:35","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/?page_id=9"},"modified":"2025-12-13T01:50:31","modified_gmt":"2025-12-13T01:50:31","slug":"results","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/","title":{"rendered":"Experiments"},"content":{"rendered":"\n<h1 class=\"wp-block-heading\">Models Studied<\/h1>\n\n\n\n<p>To ensure broad and representative coverage of modern monocular depth estimation approaches, our evaluation pipeline incorporates several high-performing models spanning different training regimes and supervision strategies. We include <strong>MiDaS<\/strong> [22], a widely adopted method trained across heterogeneous datasets; among its available configurations, we select the highest-capacity variant to maximize performance. We also evaluate <strong>ZoeDepth<\/strong> [2], which explicitly bridges relative and metric depth prediction, using a model refined on the NYU [26] indoor dataset and the KITTI [8] driving benchmark.<\/p>\n\n\n\n<p>In addition, we consider two large-scale models from the <strong>DepthAnything<\/strong> family. <strong>DepthAnything V1<\/strong> [30] leverages large collections of unlabeled images to improve robustness, while <strong>DepthAnything V2<\/strong> [31] follows a two-stage training strategy\u2014pretraining on 500K synthetic images followed by large-scale adaptation on 62 million real-world samples\u2014yielding strong generalization across domains.<\/p>\n\n\n\n<p>Our system is intentionally designed with modularity in mind: new depth estimation methods can be integrated through a common interface with minimal effort, enabling systematic comparison across architectures, data sources, and training objectives.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Other Experiements<\/h2>\n\n\n\n<h2 class=\"wp-block-heading\">Random Sampling<\/h2>\n\n\n\n<p>Our preliminary results will cover some of the results from random sampling on both the 3D-FRONT dataset as well as our own. The \ud835\udeff\u2081 and AbsRel metrics are evaluated for Depth Anything v2 across different poses, with the graph displaying the mean and standard deviation at each pose under randomly sampled rotations. Notably, the \ud835\udeff\u2081 score drops by approximately 25% relative to its average value, while the AbsRel score experiences a similar decline of about 29%, indicating a significant degradation in depth estimation performance with rotational variation.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"956\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-content\/uploads\/sites\/125\/2025\/05\/Screenshot-2025-05-06-at-2.09.30\u202fPM-1024x956.png\" alt=\"\" class=\"wp-image-51\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-content\/uploads\/sites\/125\/2025\/05\/Screenshot-2025-05-06-at-2.09.30\u202fPM-1024x956.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-content\/uploads\/sites\/125\/2025\/05\/Screenshot-2025-05-06-at-2.09.30\u202fPM-300x280.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-content\/uploads\/sites\/125\/2025\/05\/Screenshot-2025-05-06-at-2.09.30\u202fPM-768x717.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-content\/uploads\/sites\/125\/2025\/05\/Screenshot-2025-05-06-at-2.09.30\u202fPM.png 1228w\" sizes=\"auto, (max-width: 767px) 89vw, (max-width: 1000px) 54vw, (max-width: 1071px) 543px, 580px\" \/><\/figure>\n\n\n\n<h2 class=\"wp-block-heading\">Ablation on Camera Parameterization<\/h2>\n\n\n\n<p>In addition to the camera parameterization adopted in our main methodology, we conduct an ablation study to analyze the impact of different rotation representations on optimization stability and model performance. Specifically, we compare our chosen parameterization against alternatives based on <strong>quaternions<\/strong> and <strong>Lie algebra <\/strong> representations.<\/p>\n\n\n\n<p>These parameterizations differ in their geometric properties and optimization behavior. Quaternions provide a compact and continuous representation of 3D rotations but require explicit normalization to maintain unit length during optimization, which can introduce additional constraints. Lie algebra representations, while minimal and well-suited for incremental updates, may exhibit local linearization effects that influence convergence when large rotations are present. By contrast, our selected parameterization offers a smoother optimization landscape for the update process used in our framework.<\/p>\n\n\n\n<p>Through this ablation, we systematically evaluate convergence behavior, numerical stability, and final task performance across these representations, allowing us to isolate the effect of camera parameterization from other modeling choices. This analysis provides insight into how rotation representation influences both optimization dynamics and downstream depth model failure discovery.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Models Studied To ensure broad and representative coverage of modern monocular depth estimation approaches, our evaluation pipeline incorporates several high-performing models spanning different training regimes and supervision strategies. We include MiDaS [22], a widely adopted method trained across heterogeneous datasets; among its available configurations, we select the highest-capacity variant to maximize performance. We also evaluate &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Experiments&#8221;<\/span><\/a><\/p>\n","protected":false},"author":240,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-9","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Experiments - Breaking Depth Estimation Models with Semantic Adversarial Attacks<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Experiments - Breaking Depth Estimation Models with Semantic Adversarial Attacks\" \/>\n<meta property=\"og:description\" content=\"Models Studied To ensure broad and representative coverage of modern monocular depth estimation approaches, our evaluation pipeline incorporates several high-performing models spanning different training regimes and supervision strategies. We include MiDaS [22], a widely adopted method trained across heterogeneous datasets; among its available configurations, we select the highest-capacity variant to maximize performance. We also evaluate &hellip; Continue reading &quot;Experiments&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/\" \/>\n<meta property=\"og:site_name\" content=\"Breaking Depth Estimation Models with Semantic Adversarial Attacks\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-13T01:50:31+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/results\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/results\\\/\",\"name\":\"Experiments - Breaking Depth Estimation Models with Semantic Adversarial Attacks\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/#website\"},\"datePublished\":\"2025-05-06T17:13:35+00:00\",\"dateModified\":\"2025-12-13T01:50:31+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/results\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/results\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/results\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Experiments\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/\",\"name\":\"Breaking Depth Estimation Models with Semantic Adversarial Attacks\",\"description\":\"Adithya Narayan, Utkarsh Ohja, Justin Theiss, Aayush Prakash, Fernando De la Torre\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team12-2\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Experiments - Breaking Depth Estimation Models with Semantic Adversarial Attacks","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/","og_locale":"en_US","og_type":"article","og_title":"Experiments - Breaking Depth Estimation Models with Semantic Adversarial Attacks","og_description":"Models Studied To ensure broad and representative coverage of modern monocular depth estimation approaches, our evaluation pipeline incorporates several high-performing models spanning different training regimes and supervision strategies. We include MiDaS [22], a widely adopted method trained across heterogeneous datasets; among its available configurations, we select the highest-capacity variant to maximize performance. We also evaluate &hellip; Continue reading \"Experiments\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/","og_site_name":"Breaking Depth Estimation Models with Semantic Adversarial Attacks","article_modified_time":"2025-12-13T01:50:31+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/","name":"Experiments - Breaking Depth Estimation Models with Semantic Adversarial Attacks","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/#website"},"datePublished":"2025-05-06T17:13:35+00:00","dateModified":"2025-12-13T01:50:31+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/results\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/"},{"@type":"ListItem","position":2,"name":"Experiments"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/","name":"Breaking Depth Estimation Models with Semantic Adversarial Attacks","description":"Adithya Narayan, Utkarsh Ohja, Justin Theiss, Aayush Prakash, Fernando De la Torre","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-json\/wp\/v2\/pages\/9","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-json\/wp\/v2\/users\/240"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-json\/wp\/v2\/comments?post=9"}],"version-history":[{"count":9,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-json\/wp\/v2\/pages\/9\/revisions"}],"predecessor-version":[{"id":125,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-json\/wp\/v2\/pages\/9\/revisions\/125"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team12-2\/wp-json\/wp\/v2\/media?parent=9"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}