Openpose is a 2D pose estimation model developed at CMU. It is considered the state-of-the-art approach for real-time 2D human pose estimation. The codebase is open-sourced on GitHub and is very well documented. Openpose is originally written in C++ and Caffe. Its pipeline is as follows:<\/p>\n\n\n\n PARE <\/span><\/strong>[2]<\/p>\n\n\n\n PARE, which is a direct successor of VIBE [3], is an occlusion-robust human pose and shape estimation method. It uses a soft attention mechanism, called the Part Attention REgressor (PARE), which learns to predict body-part-guided attention masks. Most methods rely on global feature representations, making them sensitive to even small occlusions. In contrast, PARE’s part-guided attention mechanism overcomes these issues by exploiting information about the visibility of individual body parts while leveraging information from neighboring body parts to predict occluded parts. Its pipeline is as follows:<\/p>\n\n\n\n ROMP<\/span><\/strong> [4]<\/p>\n\n\n\n ROMP focuses on the regression of multiple 3D people from a single RGB image. Existing approaches predominantly follow a multi-stage pipeline that first detects people in bounding boxes and then independently regresses their 3D body meshes. In contrast, ROMP regresses all meshes in a One-stage fashion for Multiple 3D People (termed ROMP). The approach is conceptually simple, bounding box-free, and able to learn a per-pixel representation in an end-to-end manner. The pipeline is as follows:<\/p>\n\n\n\n BEV<\/span><\/strong> [5]<\/p>\n\n\n\n Given an image with multiple people, BEV’s goal is to directly regress the pose and shape of all the people as well as their relative depth. Inferring the depth of a person in an image, however, is fundamentally ambiguous without knowing their height. This is particularly problematic when the scene contains people of very different sizes, e.g. from infants to adults. First, the authors develop a novel method to infer the poses and depth of multiple people in a single image. While previous work that estimates multiple people does so by reasoning in the image plane, BEV adds an additional imaginary Bird\u2019s-Eye-View representation to explicitly reason about depth. BEV reasons simultaneously about body centers in the image and in-depth and, by combing these, estimates 3D body position. Unlike prior work, BEV is a single-shot method that is end-to-end differentiable. Second, height varies with age, making it impossible to resolve depth without also estimating the age of people in the image. To do so, we exploit a 3D body model space that lets BEV infer shapes from infants to adults. The pipeline is as follows:<\/p>\n\n\n\n![\"\"](\"https:\/\/mscvprojects.ri.cmu.edu\/2022team11\/wp-content\/uploads\/sites\/66\/2022\/04\/openpose-1024x228.png\")
3D Pose Estimation<\/h2>\n\n\n\n
![\"\"](\"https:\/\/mscvprojects.ri.cmu.edu\/2022team11\/wp-content\/uploads\/sites\/66\/2022\/04\/PARE.jpg\")
![\"\"](\"https:\/\/mscvprojects.ri.cmu.edu\/2022team11\/wp-content\/uploads\/sites\/66\/2022\/04\/ROMP.jpg\")
![\"\"](\"https:\/\/mscvprojects.ri.cmu.edu\/2022team11\/wp-content\/uploads\/sites\/66\/2022\/12\/image-15-1024x370.png\")
References<\/h2>\n\n\n\n