{"id":16,"date":"2026-05-07T01:29:58","date_gmt":"2026-05-07T01:29:58","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/?page_id=16"},"modified":"2026-05-07T17:28:45","modified_gmt":"2026-05-07T17:28:45","slug":"related-work","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/","title":{"rendered":"Related Work"},"content":{"rendered":"\n

GIC: Gaussian-Informed Continuum<\/h2>\n\n\n\n

Paper Link<\/a><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

GIC is most relevant to the clay modeling side of our project. It reconstructs deformable objects from multiview RGB video and converts dynamic 3D Gaussians into a continuum representation for physics-based simulation. This is useful for our project because clay needs more than surface reconstruction: we want geometry that is physically meaningful over time. GIC is especially relevant because it estimates physical parameters through an MPM-based simulation loop and supports flexible, non-rigid object behavior. Its main limitation for us is that it does not jointly model humans, hands, or hand\u2013object contact.<\/p>\n\n\n\n

Contact4D<\/h2>\n\n\n\n

Paper Link<\/a><\/p>\n\n\n\n

Contact4D is most relevant to the human and hand capture side of the project. It focuses on multiview capture, producing 3D joint positions that are consistent across views and fitting a parametric human model. For our project, this provides a strong baseline for recovering body and hand motion in a multiview studio. Its useful technical pieces include confidence-weighted triangulation, RANSAC, visibility-aware post-processing, and refinement using priors. The main limitation is that it focuses on fingertip contact and was tested in a furniture assembly domain, so it does not directly solve deformable clay reconstruction.<\/p>\n\n\n\n

Dytact<\/h2>\n\n\n\n

Paper Link<\/a><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

DyTact is most relevant to contact-aware hand\u2013object reconstruction. Given multiview RGB videos, it reconstructs both the hand and object while estimating contact without requiring contact hardware. This is important for our project because hand\u2013clay contact is the bridge between human motion and clay deformation. DyTact gives us inspiration for how to reason about contact from vision and how to focus reconstruction around regions where the hand interacts with the object. Its limitation is that it assumes rigid objects, requires a specific indoor multiview setup, and has not been open-sourced yet.<\/p>\n","protected":false},"excerpt":{"rendered":"

GIC: Gaussian-Informed Continuum Paper Link GIC is most relevant to the clay modeling side of our project. It reconstructs deformable objects from multiview RGB video and converts dynamic 3D Gaussians into a continuum representation for physics-based simulation. This is useful for our project because clay needs more than surface reconstruction: we want geometry that is … <\/p>\n

Continue reading “Related Work”<\/span><\/a><\/p>\n","protected":false},"author":307,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-16","page","type-page","status-publish","hentry"],"yoast_head":"\nRelated Work - Joint 4D Human and Deformable Object Capture Studio<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Related Work - Joint 4D Human and Deformable Object Capture Studio\" \/>\n<meta property=\"og:description\" content=\"GIC: Gaussian-Informed Continuum Paper Link GIC is most relevant to the clay modeling side of our project. It reconstructs deformable objects from multiview RGB video and converts dynamic 3D Gaussians into a continuum representation for physics-based simulation. This is useful for our project because clay needs more than surface reconstruction: we want geometry that is … Continue reading "Related Work"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/\" \/>\n<meta property=\"og:site_name\" content=\"Joint 4D Human and Deformable Object Capture Studio\" \/>\n<meta property=\"article:modified_time\" content=\"2026-05-07T17:28:45+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-content\/uploads\/sites\/161\/2026\/05\/gic.png\" \/>\n\t<meta property=\"og:image:width\" content=\"1194\" \/>\n\t<meta property=\"og:image:height\" content=\"710\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/related-work\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/related-work\\\/\",\"name\":\"Related Work - Joint 4D Human and Deformable Object Capture Studio\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/related-work\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/related-work\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/wp-content\\\/uploads\\\/sites\\\/161\\\/2026\\\/05\\\/gic-1024x609.png\",\"datePublished\":\"2026-05-07T01:29:58+00:00\",\"dateModified\":\"2026-05-07T17:28:45+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/related-work\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/related-work\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/related-work\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/wp-content\\\/uploads\\\/sites\\\/161\\\/2026\\\/05\\\/gic.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/wp-content\\\/uploads\\\/sites\\\/161\\\/2026\\\/05\\\/gic.png\",\"width\":1194,\"height\":710},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/related-work\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Related Work\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/\",\"name\":\"Joint 4D Human and Deformable Object Capture Studio\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2026teamf19\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Related Work - Joint 4D Human and Deformable Object Capture Studio","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/","og_locale":"en_US","og_type":"article","og_title":"Related Work - Joint 4D Human and Deformable Object Capture Studio","og_description":"GIC: Gaussian-Informed Continuum Paper Link GIC is most relevant to the clay modeling side of our project. It reconstructs deformable objects from multiview RGB video and converts dynamic 3D Gaussians into a continuum representation for physics-based simulation. This is useful for our project because clay needs more than surface reconstruction: we want geometry that is … Continue reading \"Related Work\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/","og_site_name":"Joint 4D Human and Deformable Object Capture Studio","article_modified_time":"2026-05-07T17:28:45+00:00","og_image":[{"width":1194,"height":710,"url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-content\/uploads\/sites\/161\/2026\/05\/gic.png","type":"image\/png"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/","name":"Related Work - Joint 4D Human and Deformable Object Capture Studio","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-content\/uploads\/sites\/161\/2026\/05\/gic-1024x609.png","datePublished":"2026-05-07T01:29:58+00:00","dateModified":"2026-05-07T17:28:45+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-content\/uploads\/sites\/161\/2026\/05\/gic.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-content\/uploads\/sites\/161\/2026\/05\/gic.png","width":1194,"height":710},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/related-work\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/"},{"@type":"ListItem","position":2,"name":"Related Work"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/","name":"Joint 4D Human and Deformable Object Capture Studio","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-json\/wp\/v2\/pages\/16","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-json\/wp\/v2\/users\/307"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-json\/wp\/v2\/comments?post=16"}],"version-history":[{"count":2,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-json\/wp\/v2\/pages\/16\/revisions"}],"predecessor-version":[{"id":58,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-json\/wp\/v2\/pages\/16\/revisions\/58"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2026teamf19\/wp-json\/wp\/v2\/media?parent=16"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}