{"id":19,"date":"2024-05-12T20:16:21","date_gmt":"2024-05-12T20:16:21","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/?page_id=19"},"modified":"2024-12-15T00:49:51","modified_gmt":"2024-12-15T00:49:51","slug":"introduction","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/","title":{"rendered":"Overview"},"content":{"rendered":"\n

Motivation<\/h2>\n\n\n\n

Despite its necessity, online communication is hindered by various limitations. Traditional platforms like Zoom lack engagement and non-verbal cues, while existing virtual meeting solutions lack realism. Our project aims to make progress towards VR telepresence by allowing photorealistic real-time rendering of indoor environments, ensuring an immersive and lifelike experience for users<\/p>\n\n\n\n

\n
\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n<\/div>\n\n\n\n

Figure 1: Exising virtual telepresence solutions- Meta Codec Avatars (left) and Meta Horizon Workrooms (right)<\/p>\n\n\n\n

Problem Statement<\/h2>\n\n\n\n

Given a set of images of an indoor environment <\/strong>such as an office area or a meeting room, our goal is to generate a high fidelity reconstruction<\/strong> of the environment which allows for real-time photorealistic rendering  <\/strong>and display on a virtual reality headset.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Figure 2: A VR telepresence solution that facilitates seamless interaction between in-person and remote participants <\/p>\n\n\n\n

Project Scope<\/h2>\n\n\n\n

In this capstone project, we aimed to reconstruct photorealistic office environments using Gaussian Splatting as our 3D representation. Our focus was on enhancing scene quality in challenging indoor areas, particularly textureless regions.<\/p>\n","protected":false},"excerpt":{"rendered":"

Motivation Despite its necessity, online communication is hindered by various limitations. Traditional platforms like Zoom lack engagement and non-verbal cues, while existing virtual meeting solutions lack realism. Our project aims to make progress towards VR telepresence by allowing photorealistic real-time rendering of indoor environments, ensuring an immersive and lifelike experience for users Figure 1: Exising … <\/p>\n

Continue reading “Overview”<\/span><\/a><\/p>\n","protected":false},"author":194,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-19","page","type-page","status-publish","hentry"],"yoast_head":"\nOverview - Generating Real-time Egocentric Viewpoint Scenes<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Overview - Generating Real-time Egocentric Viewpoint Scenes\" \/>\n<meta property=\"og:description\" content=\"Motivation Despite its necessity, online communication is hindered by various limitations. Traditional platforms like Zoom lack engagement and non-verbal cues, while existing virtual meeting solutions lack realism. Our project aims to make progress towards VR telepresence by allowing photorealistic real-time rendering of indoor environments, ensuring an immersive and lifelike experience for users Figure 1: Exising … Continue reading "Overview"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/\" \/>\n<meta property=\"og:site_name\" content=\"Generating Real-time Egocentric Viewpoint Scenes\" \/>\n<meta property=\"article:modified_time\" content=\"2024-12-15T00:49:51+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/media.licdn.com\/dms\/image\/D5612AQHVctGDlaBRKg\/article-cover_image-shrink_600_2000\/0\/1696281089669?e=2147483647&v=beta&t=E27Udsxnz04GEk4VnMd1e2_HVeNNZnavOxx0IfcJhBA\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/\",\"name\":\"Overview - Generating Real-time Egocentric Viewpoint Scenes\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/media.licdn.com\\\/dms\\\/image\\\/D5612AQHVctGDlaBRKg\\\/article-cover_image-shrink_600_2000\\\/0\\\/1696281089669?e=2147483647&v=beta&t=E27Udsxnz04GEk4VnMd1e2_HVeNNZnavOxx0IfcJhBA\",\"datePublished\":\"2024-05-12T20:16:21+00:00\",\"dateModified\":\"2024-12-15T00:49:51+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#primaryimage\",\"url\":\"https:\\\/\\\/media.licdn.com\\\/dms\\\/image\\\/D5612AQHVctGDlaBRKg\\\/article-cover_image-shrink_600_2000\\\/0\\\/1696281089669?e=2147483647&v=beta&t=E27Udsxnz04GEk4VnMd1e2_HVeNNZnavOxx0IfcJhBA\",\"contentUrl\":\"https:\\\/\\\/media.licdn.com\\\/dms\\\/image\\\/D5612AQHVctGDlaBRKg\\\/article-cover_image-shrink_600_2000\\\/0\\\/1696281089669?e=2147483647&v=beta&t=E27Udsxnz04GEk4VnMd1e2_HVeNNZnavOxx0IfcJhBA\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Overview\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/\",\"name\":\"Generating Real-time Egocentric Viewpoint Scenes\",\"description\":\"Avik Kuthiala & Sahil Jain | Advisors: Laszlo A. Jeni, Koichiro Niiruma & Aakar Gupta\",\"publisher\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#organization\",\"name\":\"Generating Real-time Egocentric Viewpoint Scenes\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/wp-content\\\/uploads\\\/sites\\\/100\\\/2024\\\/05\\\/cropped-cropped-logo.jpeg\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/wp-content\\\/uploads\\\/sites\\\/100\\\/2024\\\/05\\\/cropped-cropped-logo.jpeg\",\"width\":327,\"height\":250,\"caption\":\"Generating Real-time Egocentric Viewpoint Scenes\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2024team2\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Overview - Generating Real-time Egocentric Viewpoint Scenes","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/","og_locale":"en_US","og_type":"article","og_title":"Overview - Generating Real-time Egocentric Viewpoint Scenes","og_description":"Motivation Despite its necessity, online communication is hindered by various limitations. Traditional platforms like Zoom lack engagement and non-verbal cues, while existing virtual meeting solutions lack realism. Our project aims to make progress towards VR telepresence by allowing photorealistic real-time rendering of indoor environments, ensuring an immersive and lifelike experience for users Figure 1: Exising … Continue reading \"Overview\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/","og_site_name":"Generating Real-time Egocentric Viewpoint Scenes","article_modified_time":"2024-12-15T00:49:51+00:00","og_image":[{"url":"https:\/\/media.licdn.com\/dms\/image\/D5612AQHVctGDlaBRKg\/article-cover_image-shrink_600_2000\/0\/1696281089669?e=2147483647&v=beta&t=E27Udsxnz04GEk4VnMd1e2_HVeNNZnavOxx0IfcJhBA","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/","name":"Overview - Generating Real-time Egocentric Viewpoint Scenes","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#primaryimage"},"thumbnailUrl":"https:\/\/media.licdn.com\/dms\/image\/D5612AQHVctGDlaBRKg\/article-cover_image-shrink_600_2000\/0\/1696281089669?e=2147483647&v=beta&t=E27Udsxnz04GEk4VnMd1e2_HVeNNZnavOxx0IfcJhBA","datePublished":"2024-05-12T20:16:21+00:00","dateModified":"2024-12-15T00:49:51+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#primaryimage","url":"https:\/\/media.licdn.com\/dms\/image\/D5612AQHVctGDlaBRKg\/article-cover_image-shrink_600_2000\/0\/1696281089669?e=2147483647&v=beta&t=E27Udsxnz04GEk4VnMd1e2_HVeNNZnavOxx0IfcJhBA","contentUrl":"https:\/\/media.licdn.com\/dms\/image\/D5612AQHVctGDlaBRKg\/article-cover_image-shrink_600_2000\/0\/1696281089669?e=2147483647&v=beta&t=E27Udsxnz04GEk4VnMd1e2_HVeNNZnavOxx0IfcJhBA"},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/"},{"@type":"ListItem","position":2,"name":"Overview"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/","name":"Generating Real-time Egocentric Viewpoint Scenes","description":"Avik Kuthiala & Sahil Jain | Advisors: Laszlo A. Jeni, Koichiro Niiruma & Aakar Gupta","publisher":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#organization","name":"Generating Real-time Egocentric Viewpoint Scenes","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#\/schema\/logo\/image\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-content\/uploads\/sites\/100\/2024\/05\/cropped-cropped-logo.jpeg","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-content\/uploads\/sites\/100\/2024\/05\/cropped-cropped-logo.jpeg","width":327,"height":250,"caption":"Generating Real-time Egocentric Viewpoint Scenes"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-json\/wp\/v2\/pages\/19","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-json\/wp\/v2\/users\/194"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-json\/wp\/v2\/comments?post=19"}],"version-history":[{"count":8,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-json\/wp\/v2\/pages\/19\/revisions"}],"predecessor-version":[{"id":151,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-json\/wp\/v2\/pages\/19\/revisions\/151"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2024team2\/wp-json\/wp\/v2\/media?parent=19"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}