{"id":123,"date":"2023-05-09T04:07:46","date_gmt":"2023-05-09T09:07:46","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/?page_id=123"},"modified":"2023-05-09T04:09:13","modified_gmt":"2023-05-09T09:09:13","slug":"results","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/","title":{"rendered":"Results"},"content":{"rendered":"\n

Data Capture Setup<\/h2>\n\n\n\n

The camera we are using comes with an orthographic lens and has a very small field-of-view, and has a very narrow depth of focus. It images a very small section of the scene and has a very narrow depth-of-field. Thus, only a thin slice of the scene will appear in-focus in the captured image. We mount the camera onto a robot arm that moves the camera along the optical axis away from the scene slowly. The camera records a video during the process. In our setup, the camera moves 0.2 inches in 60 seconds, and captures video at 5 fps, resulting in a total of 300 frames for each scene.<\/p>\n\n\n\n

\"\"
Capture setup<\/figcaption><\/figure>\n\n\n\n

We captured two fabric materials under our imaging system. Below we show a sample image from each focal stack<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Fabric materials are particularly challenging and interesting under microscopic scale, due to the occlusion, specular reflection, and complicated geometry.<\/p>\n\n\n\n

Qualitative and Quantitative Results<\/h2>\n\n\n\n

Due to the limitations of our hardware, we cannot obtain accurate measurements of ground truth depth in our captured datasets of microscopic-level scenes. Consequently, we are unable to conduct a quantitative analysis of the depth map’s accuracy. To address this, we rely on a synthetic refocusing task to evaluate the effectiveness of our method. By generating images with unknown focus settings that were not used during network training, we can assess the performance of our method.<\/p>\n\n\n\n

\"\"
Left: depth map estimation. Middle: All-in-focus scene reconstruction. Right: Synthetically refocused image, top-left shows PSNR metric<\/figcaption><\/figure>\n\n\n\n

Dense Focal Stack<\/h2>\n\n\n\n

We also explore whether the method needs a densely-sampled focal stack. Our original dataset, after preprocessing, contains 36 images from foreground focus to background focus. We examine the model performance when we subsample the dataset. The result is shown below. We see that the method requires a relatively dense focal stack for good performance. One possible reason is that our model only explores per-image feature, but does not model relation across images. In general, the focal stack should contain at least one sharp image of each textured structure in the scene.<\/p>\n\n\n\n

\"\"
Ablation with number of images in focal stack<\/figcaption><\/figure>\n\n\n\n

<\/p>\n","protected":false},"excerpt":{"rendered":"

Data Capture Setup The camera we are using comes with an orthographic lens and has a very small field-of-view, and has a very narrow depth of focus. It images a very small section of the scene and has a very narrow depth-of-field. Thus, only a thin slice of the scene will appear in-focus in the … <\/p>\n

Continue reading “Results”<\/span><\/a><\/p>\n","protected":false},"author":151,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-123","page","type-page","status-publish","hentry"],"yoast_head":"\nResults - Neural Radiance Imaging<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Results - Neural Radiance Imaging\" \/>\n<meta property=\"og:description\" content=\"Data Capture Setup The camera we are using comes with an orthographic lens and has a very small field-of-view, and has a very narrow depth of focus. It images a very small section of the scene and has a very narrow depth-of-field. Thus, only a thin slice of the scene will appear in-focus in the … Continue reading "Results"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/\" \/>\n<meta property=\"og:site_name\" content=\"Neural Radiance Imaging\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-09T09:09:13+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-content\/uploads\/sites\/75\/2023\/05\/iShot_2023-05-09_16.42.55.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/results\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/results\\\/\",\"name\":\"Results - Neural Radiance Imaging\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/results\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/results\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/wp-content\\\/uploads\\\/sites\\\/75\\\/2023\\\/05\\\/iShot_2023-05-09_16.42.55.png\",\"datePublished\":\"2023-05-09T09:07:46+00:00\",\"dateModified\":\"2023-05-09T09:09:13+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/results\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/results\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/results\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/wp-content\\\/uploads\\\/sites\\\/75\\\/2023\\\/05\\\/iShot_2023-05-09_16.42.55.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/wp-content\\\/uploads\\\/sites\\\/75\\\/2023\\\/05\\\/iShot_2023-05-09_16.42.55.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/results\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Results\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/\",\"name\":\"Neural Radiance Imaging\",\"description\":\"Monocular Depth Estimation with Focal Stack\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2023team4\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Results - Neural Radiance Imaging","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/","og_locale":"en_US","og_type":"article","og_title":"Results - Neural Radiance Imaging","og_description":"Data Capture Setup The camera we are using comes with an orthographic lens and has a very small field-of-view, and has a very narrow depth of focus. It images a very small section of the scene and has a very narrow depth-of-field. Thus, only a thin slice of the scene will appear in-focus in the … Continue reading \"Results\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/","og_site_name":"Neural Radiance Imaging","article_modified_time":"2023-05-09T09:09:13+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-content\/uploads\/sites\/75\/2023\/05\/iShot_2023-05-09_16.42.55.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/","name":"Results - Neural Radiance Imaging","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-content\/uploads\/sites\/75\/2023\/05\/iShot_2023-05-09_16.42.55.png","datePublished":"2023-05-09T09:07:46+00:00","dateModified":"2023-05-09T09:09:13+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-content\/uploads\/sites\/75\/2023\/05\/iShot_2023-05-09_16.42.55.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-content\/uploads\/sites\/75\/2023\/05\/iShot_2023-05-09_16.42.55.png"},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/results\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/"},{"@type":"ListItem","position":2,"name":"Results"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/","name":"Neural Radiance Imaging","description":"Monocular Depth Estimation with Focal Stack","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-json\/wp\/v2\/pages\/123","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-json\/wp\/v2\/users\/151"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-json\/wp\/v2\/comments?post=123"}],"version-history":[{"count":2,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-json\/wp\/v2\/pages\/123\/revisions"}],"predecessor-version":[{"id":128,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-json\/wp\/v2\/pages\/123\/revisions\/128"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2023team4\/wp-json\/wp\/v2\/media?parent=123"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}