{"id":42,"date":"2023-05-09T03:20:01","date_gmt":"2023-05-09T03:20:01","guid":{"rendered":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/?page_id=42"},"modified":"2023-05-09T22:14:42","modified_gmt":"2023-05-09T22:14:42","slug":"team","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/","title":{"rendered":"Team"},"content":{"rendered":"\n<h1 class=\"wp-block-heading\"><mark class=\"has-inline-color has-vivid-cyan-blue-color\">Student<\/mark><\/h1>\n\n\n\n<h2 class=\"wp-block-heading\">Aniruddha Mahapatra<\/h2>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\" style=\"grid-template-columns:37% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"238\" height=\"240\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1.png\" alt=\"\" class=\"wp-image-100 size-full\" srcset=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1.png 238w, https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1-150x150.png 150w, https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1-100x100.png 100w\" sizes=\"auto, (max-width: 238px) 100vw, 238px\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>Aniruddha is a first-year Masters in Computer Vision (MSCV) student at Carnegie Mellon University My research interest includes computer vision and deep learning, specifically, image and video synthesis and editing using generative models. <\/p>\n\n\n\n<p>He graduated from the Indian Institute of Technology, Roorkee (IITR) in 2020. After that, he joined Adobe Research India as Research Associate. where he worked in Image Extrapolation (ICCV 21), Single Image Animation (CVPR 22 and Adobe Photoshop Elements 2023), Scene Graph Expansion (WACV 2023), and Language Model Pretraining (EMNLP 22)<\/p>\n<\/div><\/div>\n\n\n\n<h1 class=\"wp-block-heading\"><mark class=\"has-inline-color has-vivid-cyan-blue-color\">Advisors<\/mark><\/h1>\n\n\n\n<h2 class=\"wp-block-heading\">Jun-Yan Zhu<\/h2>\n\n\n\n<div class=\"wp-block-media-text alignwide has-media-on-the-right is-stacked-on-mobile\" style=\"grid-template-columns:auto 41%\"><div class=\"wp-block-media-text__content\">\n<p>Jun-Yan is an Assistant Professor at The Robotics Institute in the School of Computer Science of Carnegie Mellon University. I also hold affiliated faculty appointments in the Computer Science Department and Machine Learning Department. His areas of interest are computer vision, computer graphics, machine learning, and computational photography.<\/p>\n\n\n\n<p>Prior to joining CMU, he was a Research Scientist at Adobe Research. He did a postdoc at MIT CSAIL, working with William T. Freeman, Josh Tenenbaum, and Antonio Torralba. He obtained his Ph.D. from UC Berkeley, under the supervision of Alexei A. Efros. He received my B.E. from Tsinghua University, working with Zhuowen Tu, Shi-Min Hu, and Eric Chang.<\/p>\n<\/div><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"234\" height=\"240\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1-2.png\" alt=\"\" class=\"wp-image-102 size-full\" \/><\/figure><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Aliaksandr Siarohin <\/h2>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\" style=\"grid-template-columns:41% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"126\" height=\"118\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1.jpg\" alt=\"\" class=\"wp-image-103 size-full\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>Aliaksandr is a Research Scientist working at Snap Research in the Creative Vision team. Previously, he was a Ph.D. Student at the University of Trento where he worked under the supervision of Nicu Sebe at the Multimedia and Human Understanding Group (MHUG). His research interests include machine learning for image animation, video generation, generative adversarial networks, and domain adaptation.<\/p>\n\n\n\n<p>His works have been published in top computer vision and machine learning conferences. He also did internships at Snap Inc. and Google.<\/p>\n<\/div><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Hsin-Ying Lee<\/h2>\n\n\n\n<div class=\"wp-block-media-text alignwide has-media-on-the-right is-stacked-on-mobile\" style=\"grid-template-columns:auto 39%\"><div class=\"wp-block-media-text__content\">\n<p>Hsin-Ying is a research scientist in the Creative Vision team at Snap Research. He received his Ph.D. degree in EECS at UC Merced under the advisement of Prof. Ming-Hsuan Yang in 2020. He got his M.S. degree in the Ming Hsieh Department of Electrical Engineering from the University of Southern California in 2016, and his B.S. degree in the Department of Electrical Engineering from National Taiwan University.<\/p>\n\n\n\n<p>His research interests include Computer Vision and Machine Learning, particularly in 2D and 3D generative models and content creation.<\/p>\n<\/div><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"202\" height=\"240\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1-3.png\" alt=\"\" class=\"wp-image-104 size-full\" \/><\/figure><\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Sergey Tulyakov<\/h2>\n\n\n\n<div class=\"wp-block-media-text alignwide is-stacked-on-mobile\" style=\"grid-template-columns:41% auto\"><figure class=\"wp-block-media-text__media\"><img loading=\"lazy\" decoding=\"async\" width=\"236\" height=\"240\" src=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1-4.png\" alt=\"\" class=\"wp-image-105 size-full\" \/><\/figure><div class=\"wp-block-media-text__content\">\n<p>Sergey is a Principal Research Scientist heading the Creative Vision team at Snap Research. His work focuses on creating methods for manipulating the world via computer vision and machine learning. This includes 2D and 3D methods for photorealistic object manipulation and animation, video synthesis, prediction, and retargeting. <\/p>\n\n\n\n<p>His work has been published in 30+ top conference papers, journals, and patents resulting in multiple tech transfers, including Snapchat Pet Tracking and Real-time Neural Lenses (gender swap, baby face, real-time try-on, and many others).<\/p>\n<\/div><\/div>\n\n\n\n<h1 class=\"wp-block-heading\"><mark class=\"has-inline-color has-vivid-cyan-blue-color\">Project Responsibilities<\/mark><\/h1>\n\n\n\n<p>Aniruddha is the only student working on this project from CMU. Jun-Yan is the Advisor from CMU.  Aliaksandr, Hsin-Ying, and Sergey are advisors from Snap Inc.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Student Aniruddha Mahapatra Aniruddha is a first-year Masters in Computer Vision (MSCV) student at Carnegie Mellon University My research interest includes computer vision and deep learning, specifically, image and video synthesis and editing using generative models. He graduated from the Indian Institute of Technology, Roorkee (IITR) in 2020. After that, he joined Adobe Research India &hellip; <\/p>\n<p class=\"link-more\"><a href=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Team&#8221;<\/span><\/a><\/p>\n","protected":false},"author":177,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-42","page","type-page","status-publish","hentry"],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v28.1 - https:\/\/yoast.com\/product\/yoast-seo-wordpress\/ -->\n<title>Team - Adapting Stable Diffusion Models for Video Synthesis<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Team - Adapting Stable Diffusion Models for Video Synthesis\" \/>\n<meta property=\"og:description\" content=\"Student Aniruddha Mahapatra Aniruddha is a first-year Masters in Computer Vision (MSCV) student at Carnegie Mellon University My research interest includes computer vision and deep learning, specifically, image and video synthesis and editing using generative models. He graduated from the Indian Institute of Technology, Roorkee (IITR) in 2020. After that, he joined Adobe Research India &hellip; Continue reading &quot;Team&quot;\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/\" \/>\n<meta property=\"og:site_name\" content=\"Adapting Stable Diffusion Models for Video Synthesis\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-09T22:14:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1.png\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/team\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/team\\\/\",\"name\":\"Team - Adapting Stable Diffusion Models for Video Synthesis\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/team\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/team\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/wp-content\\\/uploads\\\/sites\\\/90\\\/2023\\\/05\\\/Picture1.png\",\"datePublished\":\"2023-05-09T03:20:01+00:00\",\"dateModified\":\"2023-05-09T22:14:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/team\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/team\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/team\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/wp-content\\\/uploads\\\/sites\\\/90\\\/2023\\\/05\\\/Picture1.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/wp-content\\\/uploads\\\/sites\\\/90\\\/2023\\\/05\\\/Picture1.png\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/team\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Team\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/\",\"name\":\"Adapting Stable Diffusion Models for Video Synthesis\",\"description\":\"Students: Aniruddha Mahapatra | Advisors: Jun-Yan Zhu (CMU), Aliaksandr Sairohin (Snap), Hsin-Ying Lee (Snap), Sergey Tulyakov (Snap) | Sponsor: CMU\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/f23team13\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Team - Adapting Stable Diffusion Models for Video Synthesis","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/","og_locale":"en_US","og_type":"article","og_title":"Team - Adapting Stable Diffusion Models for Video Synthesis","og_description":"Student Aniruddha Mahapatra Aniruddha is a first-year Masters in Computer Vision (MSCV) student at Carnegie Mellon University My research interest includes computer vision and deep learning, specifically, image and video synthesis and editing using generative models. He graduated from the Indian Institute of Technology, Roorkee (IITR) in 2020. After that, he joined Adobe Research India &hellip; Continue reading \"Team\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/","og_site_name":"Adapting Stable Diffusion Models for Video Synthesis","article_modified_time":"2023-05-09T22:14:42+00:00","og_image":[{"url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1.png","type":"","width":"","height":""}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/","name":"Team - Adapting Stable Diffusion Models for Video Synthesis","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1.png","datePublished":"2023-05-09T03:20:01+00:00","dateModified":"2023-05-09T22:14:42+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-content\/uploads\/sites\/90\/2023\/05\/Picture1.png"},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/team\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/"},{"@type":"ListItem","position":2,"name":"Team"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/","name":"Adapting Stable Diffusion Models for Video Synthesis","description":"Students: Aniruddha Mahapatra | Advisors: Jun-Yan Zhu (CMU), Aliaksandr Sairohin (Snap), Hsin-Ying Lee (Snap), Sergey Tulyakov (Snap) | Sponsor: CMU","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-json\/wp\/v2\/pages\/42","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-json\/wp\/v2\/users\/177"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-json\/wp\/v2\/comments?post=42"}],"version-history":[{"count":3,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-json\/wp\/v2\/pages\/42\/revisions"}],"predecessor-version":[{"id":118,"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-json\/wp\/v2\/pages\/42\/revisions\/118"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/f23team13\/wp-json\/wp\/v2\/media?parent=42"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}