Deepti Upmaka
Deepti is currently a Master’s student in Computer Vision (MSCV) at Robotics Institute (RI) at Carnegie Mellon University (CMU). She graduated from Rutgers University in 2019 with a double major in Computer Engineering and Computer Science. After graduating from undergrad she worked on a Computer Vision platform at Walt Disney Imagineering. Her research interests lie in Computer Vision and Graphics.
Nian-Hsuan Tsai
Nian-Hsuan is currently a Master’s student in Computer Vision (MSCV) at Robotics Institute (RI) at Carnegie Mellon University (CMU). He graduated from National Using Hua University in 2019 with a double major in Electrical Engineering and Computer Science. After graduating from undergrad he worked at the Visual Document Understanding Team at Microsoft. His research interests lie in Computer Vision.
Lazlo Jeni
Laszlo A. Jeni is a Systems Faculty in the Robotics Institute at Carnegie Mellon University, Pittsburgh PA, USA, where he is directing the Computational Behavior Lab. His research interests are in Computer Vision and Computational Behavior Science, specifically in areas of modeling, understanding, and synthesizing human motion and behavior using diverse sensors. He received his MSc degree in Computer Science from Eotvos Lorand University, Hungary, and his Ph.D. in 2012 from the University of Tokyo, Japan. He received best paper awards (eg. at IEEE Conference on Human System Interaction (HSI’2011), Conference on Automatic Face and Gesture Recognition (FG’2015) Best Paper) and outstanding reviewer awards at NeurIPS 2019, CVPR 2017, and IEEE FG 2015, respectively. He has (co)authored over 60 publications in refereed journals and conferences, and he has organized Computer Vision challenges and workshops at ECCV, ICCV, and FG. His research has been supported by grants from the U.S. National Institutes of Health, National Science Foundation, Department of Defense, Facebook, Apple, and Fujitsu among other sponsors.
Koichiro Niinuma
Koichiro Niinuma, PhD, is a research manager at Fujitsu Research of America, Pittsburgh, PA, USA. His research focuses on developing computer vision technologies for human behavior understanding, affective computing, and biometrics. With over 50 patents in the U.S. and internationally, he has developed technologies that have been integrated into various Fujitsu products, including fingerprint authentication and continuous authentication. He received his M.S. degree from Kyoto University and his PhD from the University of Tsukuba.
Responsibilities
Most project responsibilities were shared amongst team members. Deepti and Nian-Husan both contributed to the literature review, problem formulation, and experiments. They worked together to identify key challenges. In Spring ’22, Deepti focused on data preparation for retraining with Bp4D+ and Nian-Husan retrained MoFaNeRF with FACS. In Fall ’22, Deepti and Nian-Husan worked on the data augmentation pipeline which includes identifying neutral frames, mesh alignment and multi-view rendering used in retraining MooFaNeRF with the addition of FACS and Bp4D+.