{"id":472,"date":"2023-12-18T23:55:06","date_gmt":"2023-12-18T23:55:06","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/?page_id=472"},"modified":"2023-12-19T05:12:06","modified_gmt":"2023-12-19T05:12:06","slug":"experiments-of-human-object-interaction-fall-2023","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/","title":{"rendered":"Experiments of Human-Object Interaction (Fall 2023)"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\"><strong>Dataset<\/strong><\/h3>\n\n\n\n<p><strong>GRAB<\/strong><\/p>\n\n\n\n<p><img decoding=\"async\" width=\"530px;\" height=\"180px;\" src=\"https:\/\/lh7-us.googleusercontent.com\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048\"><\/p>\n\n\n\n<div class=\"wp-block-columns is-layout-flex wp-container-core-columns-is-layout-9d6595d7 wp-block-columns-is-layout-flex\">\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<p><img decoding=\"async\" width=\"745px;\" height=\"509px;\" src=\"https:\/\/lh7-us.googleusercontent.com\/_FPVoylJpQjU_V_VapFia8KXsdJUcUxrEi5gxDu1bcQvJEHZ2YhN2i8-JegoPOABogN79bjVXlLWKoXZES_reckyve3M73wjaTgGScErybNHpx69inx33lMQacpYuHS1ZFlYO2YGXiCmlxp2p22rbkCqVw=s2048\"><\/p>\n<\/div>\n\n\n\n<div class=\"wp-block-column is-layout-flow wp-block-column-is-layout-flow\">\n<ul class=\"wp-block-list\">\n<li>We utilize the <strong>GRAB<\/strong> dataset, featuring whole-body grasping sequences from 10 subjects interacting with 51 objects through 29 actions.<\/li>\n\n\n\n<li>Our method is evaluated in both seen action and novel action settings.<\/li>\n<\/ul>\n<\/div>\n<\/div>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Quantitative Result<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"327\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-18-1024x327.png\" alt=\"\" class=\"wp-image-509\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-18-1024x327.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-18-300x96.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-18-768x246.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-18-1536x491.png 1536w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-18.png 1695w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>FID<\/strong>: FID evaluates the naturalness of generated motions using the Fr\u00e9chet Inception Distance<\/li>\n\n\n\n<li><strong>Diversity<\/strong>: Diversity measures the variance of the generated motions across all action categories<\/li>\n\n\n\n<li><strong>Multi-Modality<\/strong>: Multi-modality measures how much the generated motions diversify within each action type<\/li>\n<\/ul>\n\n\n\n<h3 class=\"wp-block-heading\"><strong>Qualitative Result<\/strong><\/h3>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"743\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-19-1024x743.png\" alt=\"\" class=\"wp-image-510\" style=\"width:493px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-19-1024x743.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-19-300x218.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-19-768x557.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-19.png 1180w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p><strong>Qualitative Result for Contactnet of Hand-Object Contactness Module<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-image size-large is-resized\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"516\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-20-1024x516.png\" alt=\"\" class=\"wp-image-511\" style=\"width:581px;height:auto\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-20-1024x516.png 1024w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-20-300x151.png 300w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-20-768x387.png 768w, https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-content\/uploads\/sites\/88\/2023\/12\/image-20.png 1464w\" sizes=\"auto, (max-width: 706px) 89vw, (max-width: 767px) 82vw, 740px\" \/><\/figure>\n\n\n\n<p>* Some modules of this work are not fully finished, so their results are not shown here. We are targeting to finish and publish this work, and the remaining results are expected to be shown in the paper.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Dataset GRAB Quantitative Result Qualitative Result Qualitative Result for Contactnet of Hand-Object Contactness Module * Some modules of this work are not fully finished, so their results are not shown here. We are targeting to finish and publish this work, and the remaining results are expected to be shown in the paper.<\/p>\n","protected":false},"author":173,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-472","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v27.4 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Experiments of Human-Object Interaction (Fall 2023) - Human Motion Synthesis<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Experiments of Human-Object Interaction (Fall 2023) - Human Motion Synthesis\" \/>\n<meta property=\"og:description\" content=\"Dataset GRAB Quantitative Result Qualitative Result Qualitative Result for Contactnet of Hand-Object Contactness Module * Some modules of this work are not fully finished, so their results are not shown here. We are targeting to finish and publish this work, and the remaining results are expected to be shown in the paper.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/\" \/>\n<meta property=\"og:site_name\" content=\"Human Motion Synthesis\" \/>\n<meta property=\"article:modified_time\" content=\"2023-12-19T05:12:06+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/lh7-us.googleusercontent.com\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/experiments-of-human-object-interaction-fall-2023\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/experiments-of-human-object-interaction-fall-2023\\\/\",\"name\":\"Experiments of Human-Object Interaction (Fall 2023) - Human Motion Synthesis\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/experiments-of-human-object-interaction-fall-2023\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/experiments-of-human-object-interaction-fall-2023\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/lh7-us.googleusercontent.com\\\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048\",\"datePublished\":\"2023-12-18T23:55:06+00:00\",\"dateModified\":\"2023-12-19T05:12:06+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/experiments-of-human-object-interaction-fall-2023\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/experiments-of-human-object-interaction-fall-2023\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/experiments-of-human-object-interaction-fall-2023\\\/#primaryimage\",\"url\":\"https:\\\/\\\/lh7-us.googleusercontent.com\\\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048\",\"contentUrl\":\"https:\\\/\\\/lh7-us.googleusercontent.com\\\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/experiments-of-human-object-interaction-fall-2023\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Experiments of Human-Object Interaction (Fall 2023)\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/\",\"name\":\"Human Motion Synthesis\",\"description\":\"Chih-Chun Yang, Tianhui Cai | Advisor: Fernando De la Torre\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team11\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Experiments of Human-Object Interaction (Fall 2023) - Human Motion Synthesis","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/","og_locale":"en_US","og_type":"article","og_title":"Experiments of Human-Object Interaction (Fall 2023) - Human Motion Synthesis","og_description":"Dataset GRAB Quantitative Result Qualitative Result Qualitative Result for Contactnet of Hand-Object Contactness Module * Some modules of this work are not fully finished, so their results are not shown here. We are targeting to finish and publish this work, and the remaining results are expected to be shown in the paper.","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/","og_site_name":"Human Motion Synthesis","article_modified_time":"2023-12-19T05:12:06+00:00","og_image":[{"url":"https:\/\/lh7-us.googleusercontent.com\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/","name":"Experiments of Human-Object Interaction (Fall 2023) - Human Motion Synthesis","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/#primaryimage"},"thumbnailUrl":"https:\/\/lh7-us.googleusercontent.com\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048","datePublished":"2023-12-18T23:55:06+00:00","dateModified":"2023-12-19T05:12:06+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/#primaryimage","url":"https:\/\/lh7-us.googleusercontent.com\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048","contentUrl":"https:\/\/lh7-us.googleusercontent.com\/zYgDb1MedW3Fzpp628N3eO2Hxi7HMcpHEka_41awliRDOy44K-kshA6MdinHYLZZLW4A4t1A9SGdPhLp7n4OYx4uwgCzf4Z-bEksEC21Yxaa70BOinjEMpBMT7xmqaTH0RRP1-lzSGTikwbIsrHjZdzSTg=s2048"},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/experiments-of-human-object-interaction-fall-2023\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/"},{"@type":"ListItem","position":2,"name":"Experiments of Human-Object Interaction (Fall 2023)"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/","name":"Human Motion Synthesis","description":"Chih-Chun Yang, Tianhui Cai | Advisor: Fernando De la Torre","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-json\/wp\/v2\/pages\/472","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-json\/wp\/v2\/users\/173"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-json\/wp\/v2\/comments?post=472"}],"version-history":[{"count":6,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-json\/wp\/v2\/pages\/472\/revisions"}],"predecessor-version":[{"id":542,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-json\/wp\/v2\/pages\/472\/revisions\/542"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team11\/wp-json\/wp\/v2\/media?parent=472"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}