{"id":27,"date":"2026-05-06T17:06:57","date_gmt":"2026-05-06T17:06:57","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/?page_id=27"},"modified":"2026-05-07T01:59:54","modified_gmt":"2026-05-07T01:59:54","slug":"results","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/","title":{"rendered":"Results"},"content":{"rendered":"\n

Relative Depth Model Validation<\/strong><\/h2>\n\n\n\n

To validate model performance on real-world aerial datasets, we conducted inference using off-the-shelf depth models on captured drone flight data. An analysis of the ground truth distribution and signed relative error residuals was performed to characterize model bias. The results indicate an overall under-prediction bias in relative depth models; however, the concentration of error near the mean suggests that the predictions are structurally sound<\/em>. This finding justifies the use of a linear scale-shift correction to align the model outputs with metric ground truth.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

Metric Depth Model Analysis<\/strong><\/h2>\n\n\n\n

Given these results, we need to ensure metric depth models do not perform adequately well, relative to the performance hit they provide running over commercial hardware (e.g., NVIDIA Jetson Orin). A common problem that hinders depth models video vs individual frames, is temporal consistency. As such, we evaluated the Depth-Anything-V2[1]<\/strong> (metric, large variant) and VideoDepth-Anything[2] <\/strong>(metric, ViT-large variant).<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\n

Depth Method Comparison vs. LiDAR Reference.<\/strong> Video-Depth-Anything outperforms Single-Frame Metric depth across all geometric metrics \u2014 28% lower Chamfer Distance, 29% lower forward error, and 2.2\u00d7 more points within 5 cm \u2014 yet neither model achieves sufficient accuracy to supplant a LiDAR-guided pipeline under edge hardware constraints.<\/p>\n<\/blockquote>\n\n\n\n

As seen, the results, aren\u2019t nearly good enough to replace lidar + relative depth models, especially considering the additional memory footprint and inference time required at runtime.<\/p>\n\n\n\n

\n\n\n\n

References<\/h2>\n\n\n\n

[1] <\/strong>L. Yang et al., “Depth Anything V2,” arXiv:2406.09414, 2024
[2] <\/strong>S. Chen et al., “Video Depth Anything: Consistent Depth Estimation
for Super-Long Videos,” arXiv:2501.12375, 2025.<\/p>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Relative Depth Model Validation To validate model performance on real-world aerial datasets, we conducted inference using off-the-shelf depth models on captured drone flight data. An analysis of the ground truth distribution and signed relative error residuals was performed to characterize model bias. The results indicate an overall under-prediction bias in relative depth models; however, the … <\/p>\n

Continue reading “Results”<\/span><\/a><\/p>\n","protected":false},"author":290,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-27","page","type-page","status-publish","hentry"],"yoast_head":"\nResults - Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Results - Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations\" \/>\n<meta property=\"og:description\" content=\"Relative Depth Model Validation To validate model performance on real-world aerial datasets, we conducted inference using off-the-shelf depth models on captured drone flight data. An analysis of the ground truth distribution and signed relative error residuals was performed to characterize model bias. The results indicate an overall under-prediction bias in relative depth models; however, the … Continue reading "Results"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/\" \/>\n<meta property=\"og:site_name\" content=\"Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations\" \/>\n<meta property=\"article:modified_time\" content=\"2026-05-07T01:59:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-content\/uploads\/sites\/154\/2026\/05\/image.png\" \/>\n\t<meta property=\"og:image:width\" content=\"2048\" \/>\n\t<meta property=\"og:image:height\" content=\"846\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/results\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/results\\\/\",\"name\":\"Results - Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/results\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/results\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/wp-content\\\/uploads\\\/sites\\\/154\\\/2026\\\/05\\\/image-1024x423.png\",\"datePublished\":\"2026-05-06T17:06:57+00:00\",\"dateModified\":\"2026-05-07T01:59:54+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/results\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/results\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/results\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/wp-content\\\/uploads\\\/sites\\\/154\\\/2026\\\/05\\\/image.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/wp-content\\\/uploads\\\/sites\\\/154\\\/2026\\\/05\\\/image.png\",\"width\":2048,\"height\":846},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/results\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Results\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/\",\"name\":\"Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations\",\"description\":\"Students: Aditya Tummala, Yu-An Su | Advisor: Aswin Sankaranarayanan | Sponsor: Near Earth Autonomy\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf12\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Results - Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/","og_locale":"en_US","og_type":"article","og_title":"Results - Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations","og_description":"Relative Depth Model Validation To validate model performance on real-world aerial datasets, we conducted inference using off-the-shelf depth models on captured drone flight data. An analysis of the ground truth distribution and signed relative error residuals was performed to characterize model bias. The results indicate an overall under-prediction bias in relative depth models; however, the … Continue reading \"Results\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/","og_site_name":"Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations","article_modified_time":"2026-05-07T01:59:54+00:00","og_image":[{"width":2048,"height":846,"url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-content\/uploads\/sites\/154\/2026\/05\/image.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/","name":"Results - Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-content\/uploads\/sites\/154\/2026\/05\/image-1024x423.png","datePublished":"2026-05-06T17:06:57+00:00","dateModified":"2026-05-07T01:59:54+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-content\/uploads\/sites\/154\/2026\/05\/image.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-content\/uploads\/sites\/154\/2026\/05\/image.png","width":2048,"height":846},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/results\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/"},{"@type":"ListItem","position":2,"name":"Results"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/","name":"Monocular Vision for Obstacle Detection in Autonomous Aircraft Operations","description":"Students: Aditya Tummala, Yu-An Su | Advisor: Aswin Sankaranarayanan | Sponsor: Near Earth Autonomy","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-json\/wp\/v2\/pages\/27","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-json\/wp\/v2\/users\/290"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-json\/wp\/v2\/comments?post=27"}],"version-history":[{"count":12,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-json\/wp\/v2\/pages\/27\/revisions"}],"predecessor-version":[{"id":166,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-json\/wp\/v2\/pages\/27\/revisions\/166"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf12\/wp-json\/wp\/v2\/media?parent=27"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}