Tracking two hand

Project summary

  • Motivation
    • The importance of hand in (virtual) communications.
    • More Technically challenging compared to body or face.
  • Problem
    • Task: Two-hand pose estimation and mesh tracking
    • Data: Sequences of hand images captured from multiple cameras in multiple views
  • Solution
    • Extract feature and detect keypoints in 2D images
    • 2D -> 3D:
      • Use neural network to learn the prior
      • Aggregate multiview 2D features into 3D
    • Structural learning and temporal consistency?

Team

Yihui He: http://yihui-he.github.io/

Rui Yan:

Documents:

Demo:

https://drive.google.com/open?id=1s72aBYBsyeCaBc4_qMysVmYueZ2_kOCe

Slides:

https://docs.google.com/presentation/d/1il_ufJcrc46Nle44Ffs73PLAobKcpAKSlNvGhNI8hoQ/edit?usp=sharing