{"id":2,"date":"2020-05-05T18:59:05","date_gmt":"2020-05-05T18:59:05","guid":{"rendered":"http:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/?page_id=2"},"modified":"2020-12-22T12:36:42","modified_gmt":"2020-12-22T12:36:42","slug":"team","status":"publish","type":"page","link":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/","title":{"rendered":"Team"},"content":{"rendered":"\n
\"\"<\/figure><\/div>\n\n\n\n

Varun Jain<\/strong>
Current MSCV student (<\/strong> varunjai@andrew.cmu.edu<\/em> ) [Personal Webpage]<\/a><\/strong> [LinkedIn]<\/a><\/strong> <\/p>

Graduate student at the Robotics Institute, Carnegie Mellon University. Passionate about applications of Computer Vision in Augmented and Virtual Reality, Robotics, Artificial Intelligence, Machine learning and Cryptocurrencies. <\/p>

He spent his Summer of ’20 at Facebook Reality Labs Pittsburgh working with Shih-En Wei, Dr. Jason Saragih and Prof. Yasir Sheikh on problems related to metric learning for inference time refinement of sub-optimal predicted expression codes that come from limited views.<\/p>

In his spare time, he can be found reading modernist poetry, playing the piano or the guitar or trading alt-coins.<\/p>

Project Responsibilities:
<\/strong>For the Spring ’20 semester, he handled the procedure for UV coordinate map generation. This included generating ground-truth data via differentiable renderers and also designing methods to predict the UV maps during inference.<\/p>

During his time with FRL in the Summer, he was responsible for formulating the mathematical basis of the machine learning methods that were proposed (metric learning and mimicking a target landscape). For the Fall ’20 semester<\/em>, he worked on refining these methods and demonstrating an end-to-end training and inference pipeline that integrates all these ideas.<\/p><\/blockquote>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

Akankshya Kar<\/strong>
Current MSCV student (akankshk@andrew.cmu.edu) [LinkedIn<\/a>]
<\/strong>She will be interning with Nutonomy (Aptiv-Hyundai) for the summer, with Dr Alex Lang. She was working in Samsung Research, Bangalore for 2 years. She is interested in AR-VR and Scene Semantic Segmentation. She did her Bachelor’s in Technology in Computer Science from National Institute of Technology, Karnataka, Surathkal. In her spare time, she enjoys to dance and watch Sitcoms. <\/p>

Project Responsibilities:
<\/strong>She handled adding the Gradient control loss, worked on getting results from baseline network, worked on usage of UV maps and explore architectural design changes for using UV maps.<\/p><\/blockquote>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

Ioannis Gkioulekas<\/strong>
Assistant Professor (igkioule@cs.cmu.edu) [<\/em>LinkedIn<\/a>]<\/em>
He is interested in computational imaging, computer vision, and computer graphics. He is particularly interested in various aspects of material appearance: how humans perceive real world materials, how we can measure the parameters, and how to reason about them in images of the world.<\/p><\/blockquote>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

Shih-En Wei<\/strong>
Research Scientist at FRL (swei@fb.com ) [LinkedIn<\/a>]
He is the mentor from FRL for this project. He has been part of Facebook Reality Labs for nearly 4 years and is Graduate student from Carnegie Mellon university. He was advised by Prof Yaser Sheikh. <\/p><\/blockquote>\n\n\n\n

\"\"<\/figure><\/div>\n\n\n\n

Te-Li Wang
<\/strong>Research Scientist at FRL (teli@fb.com ) [LinkedIn<\/a>]
He is the mentor from FRL for this project. He has been part of Facebook Reality Labs for nearly 2 years and is Graduate student from Carnegie Mellon university. He was advised by Prof Srinivas. <\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"

Varun Jain Current MSCV student ( varunjai@andrew.cmu.edu ) [Personal Webpage] [LinkedIn] Graduate student at the Robotics Institute, Carnegie Mellon University. Passionate about applications of Computer Vision in Augmented and Virtual Reality, Robotics, Artificial Intelligence, Machine learning and Cryptocurrencies. He spent his Summer of ’20 at Facebook Reality Labs Pittsburgh working with Shih-En Wei, Dr. Jason … <\/p>\n

Continue reading “Team”<\/span><\/a><\/p>\n","protected":false},"author":94,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-2","page","type-page","status-publish","hentry"],"yoast_head":"\nTeam - Real-time Photorealistic VR Facial Animation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Team - Real-time Photorealistic VR Facial Animation\" \/>\n<meta property=\"og:description\" content=\"Varun Jain Current MSCV student ( varunjai@andrew.cmu.edu ) [Personal Webpage] [LinkedIn] Graduate student at the Robotics Institute, Carnegie Mellon University. Passionate about applications of Computer Vision in Augmented and Virtual Reality, Robotics, Artificial Intelligence, Machine learning and Cryptocurrencies. He spent his Summer of ’20 at Facebook Reality Labs Pittsburgh working with Shih-En Wei, Dr. Jason … Continue reading "Team"\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/\" \/>\n<meta property=\"og:site_name\" content=\"Real-time Photorealistic VR Facial Animation\" \/>\n<meta property=\"article:modified_time\" content=\"2020-12-22T12:36:42+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-content\/uploads\/sites\/43\/2020\/05\/gkioulekas_ioannis.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"1800\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/team\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/team\\\/\",\"name\":\"Team - Real-time Photorealistic VR Facial Animation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/team\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/team\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/wp-content\\\/uploads\\\/sites\\\/43\\\/2020\\\/05\\\/IMG_20200124_185259.jpg\",\"datePublished\":\"2020-05-05T18:59:05+00:00\",\"dateModified\":\"2020-12-22T12:36:42+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/team\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/team\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/team\\\/#primaryimage\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/wp-content\\\/uploads\\\/sites\\\/43\\\/2020\\\/05\\\/gkioulekas_ioannis.jpg\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/wp-content\\\/uploads\\\/sites\\\/43\\\/2020\\\/05\\\/gkioulekas_ioannis.jpg\",\"width\":1200,\"height\":1800},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/team\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Team\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/#website\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/\",\"name\":\"Real-time Photorealistic VR Facial Animation\",\"description\":\"Sponsored by Facebook Reality Labs\",\"publisher\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/#organization\",\"name\":\"Real-time Photorealistic VR Facial Animation\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/wp-content\\\/uploads\\\/sites\\\/43\\\/2020\\\/05\\\/cropped-cmu-log.png\",\"contentUrl\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/wp-content\\\/uploads\\\/sites\\\/43\\\/2020\\\/05\\\/cropped-cmu-log.png\",\"width\":250,\"height\":250,\"caption\":\"Real-time Photorealistic VR Facial Animation\"},\"image\":{\"@id\":\"https:\\\/\\\/mscvprojects.ri.cmu.edu\\\/2020teamm\\\/#\\\/schema\\\/logo\\\/image\\\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Team - Real-time Photorealistic VR Facial Animation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/","og_locale":"en_US","og_type":"article","og_title":"Team - Real-time Photorealistic VR Facial Animation","og_description":"Varun Jain Current MSCV student ( varunjai@andrew.cmu.edu ) [Personal Webpage] [LinkedIn] Graduate student at the Robotics Institute, Carnegie Mellon University. Passionate about applications of Computer Vision in Augmented and Virtual Reality, Robotics, Artificial Intelligence, Machine learning and Cryptocurrencies. He spent his Summer of ’20 at Facebook Reality Labs Pittsburgh working with Shih-En Wei, Dr. Jason … Continue reading \"Team\"","og_url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/","og_site_name":"Real-time Photorealistic VR Facial Animation","article_modified_time":"2020-12-22T12:36:42+00:00","og_image":[{"width":1200,"height":1800,"url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-content\/uploads\/sites\/43\/2020\/05\/gkioulekas_ioannis.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/","name":"Team - Real-time Photorealistic VR Facial Animation","isPartOf":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/#website"},"primaryImageOfPage":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/#primaryimage"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/#primaryimage"},"thumbnailUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-content\/uploads\/sites\/43\/2020\/05\/IMG_20200124_185259.jpg","datePublished":"2020-05-05T18:59:05+00:00","dateModified":"2020-12-22T12:36:42+00:00","breadcrumb":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/#primaryimage","url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-content\/uploads\/sites\/43\/2020\/05\/gkioulekas_ioannis.jpg","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-content\/uploads\/sites\/43\/2020\/05\/gkioulekas_ioannis.jpg","width":1200,"height":1800},{"@type":"BreadcrumbList","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/team\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/"},{"@type":"ListItem","position":2,"name":"Team"}]},{"@type":"WebSite","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/#website","url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/","name":"Real-time Photorealistic VR Facial Animation","description":"Sponsored by Facebook Reality Labs","publisher":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/#organization","name":"Real-time Photorealistic VR Facial Animation","url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/#\/schema\/logo\/image\/","url":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-content\/uploads\/sites\/43\/2020\/05\/cropped-cmu-log.png","contentUrl":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-content\/uploads\/sites\/43\/2020\/05\/cropped-cmu-log.png","width":250,"height":250,"caption":"Real-time Photorealistic VR Facial Animation"},"image":{"@id":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-json\/wp\/v2\/pages\/2","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-json\/wp\/v2\/users\/94"}],"replies":[{"embeddable":true,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-json\/wp\/v2\/comments?post=2"}],"version-history":[{"count":20,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-json\/wp\/v2\/pages\/2\/revisions"}],"predecessor-version":[{"id":176,"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-json\/wp\/v2\/pages\/2\/revisions\/176"}],"wp:attachment":[{"href":"https:\/\/mscvprojects.ri.cmu.edu\/2020teamm\/wp-json\/wp\/v2\/media?parent=2"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}