Motivation
With the development of VR/AR, users want to animate their face in virtual reality
A normally used 3D scanner in industry has several limitations:
- Time costing
- Expensive
Our Goal
Users can capture their 3D face just using their mobile phone!
Our pipeline: RGB-D video from selfie camera —> 3D digital human heads
Challenges
- We are facing real-world in-the-wild iPhone data
- High variance in video quality
- Unknown camera extrinsics
- How to utilize depth information