Motivation
With the development of VR/AR, users want to animate their face in virtual reality
A normally used 3D scanner in industry has several limitations:
- Time costing
- Expensive
![](https://mscvprojects.ri.cmu.edu/2022team15/wp-content/uploads/sites/70/2022/12/20170602102447_15237.jpeg)
Our Goal
Users can capture their 3D face just using their mobile phone!
Our pipeline: RGB-D video from selfie camera —> 3D digital human heads
![](https://mscvprojects.ri.cmu.edu/2022team15/wp-content/uploads/sites/70/2022/12/Screen-Shot-2022-12-09-at-10.34.01-AM-1024x322.png)
Challenges
- We are facing real-world in-the-wild iPhone data
- High variance in video quality
- Unknown camera extrinsics
- How to utilize depth information