{"id":14,"date":"2025-05-09T20:18:37","date_gmt":"2025-05-09T20:18:37","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/?page_id=14"},"modified":"2025-12-12T21:46:34","modified_gmt":"2025-12-12T21:46:34","slug":"intro","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/","title":{"rendered":"Introduction"},"content":{"rendered":"\n<p>Building on recent advances in motion representation learning, we study hand\u2013object interaction (HOI) motion generation through continuous latent modeling. We demonstrate that continuous motion latents yield smoother and more faithful reconstructions than discrete VQ-based representations for both hand and object trajectories. To this end, we propose a cascaded autoencoder that jointly encodes object motion and articulated hand dynamics into structured latent spaces. Leveraging these representations, we introduce the first latent diffusion framework for HOI motion generation and completion under multimodal conditioning, enabling flexible synthesis and partial motion inference across diverse interaction scenarios.<\/p>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Building on recent advances in motion representation learning, we study hand\u2013object interaction (HOI) motion generation through continuous latent modeling. We demonstrate that continuous motion latents yield smoother and more faithful reconstructions than discrete VQ-based representations for both hand and object trajectories. To this end, we propose a cascaded autoencoder that jointly encodes object motion and &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Introduction&#8221;<\/span><\/a><\/p>\n","protected":false},"author":237,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":"[]"},"class_list":["post-14","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Introduction - Text-Driven Motion Generation for Hand-Object Interaction<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Introduction - Text-Driven Motion Generation for Hand-Object Interaction\" \/>\n<meta property=\"og:description\" content=\"Building on recent advances in motion representation learning, we study hand\u2013object interaction (HOI) motion generation through continuous latent modeling. We demonstrate that continuous motion latents yield smoother and more faithful reconstructions than discrete VQ-based representations for both hand and object trajectories. To this end, we propose a cascaded autoencoder that jointly encodes object motion and &hellip; Continue reading &quot;Introduction&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/\" \/>\n<meta property=\"og:site_name\" content=\"Text-Driven Motion Generation for Hand-Object Interaction\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-12T21:46:34+00:00\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/intro\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/intro\\\/\",\"name\":\"Introduction - Text-Driven Motion Generation for Hand-Object Interaction\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/#website\"},\"datePublished\":\"2025-05-09T20:18:37+00:00\",\"dateModified\":\"2025-12-12T21:46:34+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/intro\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/intro\\\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/intro\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Introduction\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/\",\"name\":\"Text-Driven Motion Generation for Hand-Object Interaction\",\"description\":\"CMU MSCV Capstone Project | Ethan Lai | Advisors: L\u00e1szl\u00f3 A. Jeni and Ananya Bal\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2025team10\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Introduction - Text-Driven Motion Generation for Hand-Object Interaction","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/","og_locale":"en_US","og_type":"article","og_title":"Introduction - Text-Driven Motion Generation for Hand-Object Interaction","og_description":"Building on recent advances in motion representation learning, we study hand\u2013object interaction (HOI) motion generation through continuous latent modeling. We demonstrate that continuous motion latents yield smoother and more faithful reconstructions than discrete VQ-based representations for both hand and object trajectories. To this end, we propose a cascaded autoencoder that jointly encodes object motion and &hellip; Continue reading \"Introduction\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/","og_site_name":"Text-Driven Motion Generation for Hand-Object Interaction","article_modified_time":"2025-12-12T21:46:34+00:00","twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/","name":"Introduction - Text-Driven Motion Generation for Hand-Object Interaction","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/#website"},"datePublished":"2025-05-09T20:18:37+00:00","dateModified":"2025-12-12T21:46:34+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/intro\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/"},{"@type":"ListItem","position":2,"name":"Introduction"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/","name":"Text-Driven Motion Generation for Hand-Object Interaction","description":"CMU MSCV Capstone Project | Ethan Lai | Advisors: L\u00e1szl\u00f3 A. Jeni and Ananya Bal","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/wp-json\/wp\/v2\/pages\/14","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/wp-json\/wp\/v2\/users\/237"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/wp-json\/wp\/v2\/comments?post=14"}],"version-history":[{"count":7,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/wp-json\/wp\/v2\/pages\/14\/revisions"}],"predecessor-version":[{"id":66,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/wp-json\/wp\/v2\/pages\/14\/revisions\/66"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2025team10\/wp-json\/wp\/v2\/media?parent=14"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}