Our capstone project involves slightly different methods and experiments for our prototype system in the Spring 2023 Semester and our complete mixed reality vision-based system in the Fall 2023 Semester:
- During the Spring 2023 Semester, we initiated our capstone project and started developing vision-system containing a data-driven classification model deployed within a simple iOS application on an iPad that could predict the current state of the origami paper accurately.
- During the Fall 2023 Semester, we completed our vision-based system so that besides recognizing the current state, it is also capable of autonomously tracking the position of origami paper, and following careful calibration and coordinate transformation, it can project instructional information for the subsequent folding step within a projection website onto the paper.