{"id":9,"date":"2025-05-06T20:35:12","date_gmt":"2025-05-06T20:35:12","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/?page_id=9"},"modified":"2025-12-10T23:08:42","modified_gmt":"2025-12-10T23:08:42","slug":"introduction","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/","title":{"rendered":"Introduction"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\" style=\"font-size:28px\">Motivation<\/h2>\n\n\n\n<p>Endoscopic videos are critical tools in minimally invasive medical procedures, enabling physicians to visualize internal organs in real time. However, these videos often suffer from visual artifacts, such as specular highlights, blur, bubbles, and instrument shadows, that can obscure critical anatomical features. Such artifacts not only hinder clinical interpretation but also pose challenges for downstream tasks such as computer-aided diagnosis, robotic navigation, and automated video analysis.<\/p>\n\n\n\n<p>These distortions can significantly affect the accuracy of diagnosis, training, and surgical planning, especially in high-stakes environments like bronchoscopy and urology. For instance, J&amp;J\u2019s MONARCH\u2122 platforms rely heavily on high-quality visual data to enable precise robotic navigation and support various computer vision pipelines.<\/p>\n\n\n\n<p>To address this, our project focuses on enhancing endoscopic video quality using <strong>generative AI techniques<\/strong>. We explore state-of-the-art models for artifact detection, segmentation, and removal, aiming to restore image fidelity while preserving anatomical integrity. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\" style=\"font-size:28px\">Technical Challenges<\/h2>\n\n\n\n<p>Improving video quality in real-time and at high resolution introduces several challenges:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Artifact diversity<\/strong> \u2013 Variability in lighting, anatomy, and motion causes artifacts to appear differently across cases.<\/li>\n\n\n\n<li><strong>Lack of clean ground truth<\/strong> \u2013 Collecting paired clean\/corrupted endoscopic data is difficult.<\/li>\n\n\n\n<li><strong>Balancing clarity with fidelity<\/strong> \u2013 Removing artifacts without damaging anatomical integrity is non-trivial.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" style=\"font-size:28px\">Artifact Types<\/h2>\n\n\n\n<p>Our dataset and model target the following common artifact types:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Specular highlights<\/strong> \u2013 Bright light reflections that mask surface detail<\/li>\n\n\n\n<li><strong>Blur<\/strong> \u2013 Due to motion or focus errors during camera manipulation<\/li>\n\n\n\n<li><strong>Fragments<\/strong> \u2013 Tissue debris or tools partially occluding the view<\/li>\n\n\n\n<li><strong>Under-exposure<\/strong> \u2013 Dark regions that obscure anatomy<\/li>\n\n\n\n<li><strong>Bubbles<\/strong> \u2013 Introduced during fluid irrigation in endoscopy<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\" style=\"font-size:28px\">Project Goals<\/h2>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Develop a high-fidelity model for artifact removal in endoscopic images.<\/li>\n\n\n\n<li>Achieve real-time processing performance for clinical applicability.<\/li>\n\n\n\n<li>Reconstruct artifact-free frames into smooth, temporally consistent video.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Motivation Endoscopic videos are critical tools in minimally invasive medical procedures, enabling physicians to visualize internal organs in real time. However, these videos often suffer from visual artifacts, such as specular highlights, blur, bubbles, and instrument shadows, that can obscure critical anatomical features. Such artifacts not only hinder clinical interpretation but also pose challenges for &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Introduction&#8221;<\/span><\/a><\/p>\n","protected":false},"author":227,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-9","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Introduction - Photometric Image Enhancement For Robotic Endoscopy<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Introduction - Photometric Image Enhancement For Robotic Endoscopy\" \/>\n<meta property=\"og:description\" content=\"Motivation Endoscopic videos are critical tools in minimally invasive medical procedures, enabling physicians to visualize internal organs in real time. However, these videos often suffer from visual artifacts, such as specular highlights, blur, bubbles, and instrument shadows, that can obscure critical anatomical features. Such artifacts not only hinder clinical interpretation but also pose challenges for &hellip; Continue reading &quot;Introduction&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/\" \/>\n<meta property=\"og:site_name\" content=\"Photometric Image Enhancement For Robotic Endoscopy\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-10T23:08:42+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/\",\"name\":\"Introduction - Photometric Image Enhancement For Robotic Endoscopy\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/#website\"},\"datePublished\":\"2025-05-06T20:35:12+00:00\",\"dateModified\":\"2025-12-10T23:08:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introduction\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/\",\"name\":\"Photometric Image Enhancement For Robotic Endoscopy\",\"description\":\"MSCV Capstone Project | Students: Yuze Jiang, Brian Park | Advisors:  Prof. Ioannis Gkioulekas (CMU), Saif Sayed (JnJ), Morgan Ringel (JnJ), Mali Shen (JnJ), Hedyeh Rafii-Tari (JnJ),\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team3\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Introduction - Photometric Image Enhancement For Robotic Endoscopy","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/","og_locale":"en_US","og_type":"article","og_title":"Introduction - Photometric Image Enhancement For Robotic Endoscopy","og_description":"Motivation Endoscopic videos are critical tools in minimally invasive medical procedures, enabling physicians to visualize internal organs in real time. However, these videos often suffer from visual artifacts, such as specular highlights, blur, bubbles, and instrument shadows, that can obscure critical anatomical features. Such artifacts not only hinder clinical interpretation but also pose challenges for &hellip; Continue reading \"Introduction\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/","og_site_name":"Photometric Image Enhancement For Robotic Endoscopy","article_modified_time":"2025-12-10T23:08:42+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/","name":"Introduction - Photometric Image Enhancement For Robotic Endoscopy","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/#website"},"datePublished":"2025-05-06T20:35:12+00:00","dateModified":"2025-12-10T23:08:42+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/"},{"@type":"ListItem","position":2,"name":"Introduction"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/","name":"Photometric Image Enhancement For Robotic Endoscopy","description":"MSCV Capstone Project | Students: Yuze Jiang, Brian Park | Advisors:  Prof. Ioannis Gkioulekas (CMU), Saif Sayed (JnJ), Morgan Ringel (JnJ), Mali Shen (JnJ), Hedyeh Rafii-Tari (JnJ),","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/wp-json\/wp\/v2\/pages\/9","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/wp-json\/wp\/v2\/users\/227"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/wp-json\/wp\/v2\/comments?post=9"}],"version-history":[{"count":27,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/wp-json\/wp\/v2\/pages\/9\/revisions"}],"predecessor-version":[{"id":160,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/wp-json\/wp\/v2\/pages\/9\/revisions\/160"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team3\/wp-json\/wp\/v2\/media?parent=9"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}