Tag: Youssef’s Status Report

Current Progress:

• Built the overall hardware for the project (custom frame/holding mechanism for monitors and mirror/ports for the monitor cable plug-ins
• Revised hardware design to have better fitting monitors to deal with issue where monitors would cause mirror to bulge due to rounded back, removed the bezel/casing of the monitors manually (images linked below)
  • https://drive.google.com/file/d/13ZTIaRtRS0eMYPlw3ieAtK4AN9Wl8720/view?usp=sharing
  • https://drive.google.com/file/d/1iO92spZij_xbwOgBAA6TgBWY-pmjWOv4/view?usp=sharing
• Tested hardware integration setup to prepare for MVP demo and made adjustments/tuning

Timeline:

• By the timeline, we should have been finished with the hardware construction by this point, however, because of the multiple unexpected issues we ran into and the dependencies from the hardware on how the software works (mapping system etc.), we chose to spend more time working on the Mirror hardware construction.
• This means that we will have to push the mirror-camera integration and the mirror UI into our buffer time which we allocated for situations like this where we are slightly off-track.

Next Steps:

• We will complete the error rendering for the UI
• Need to make final adjustments to the mapping component
• We will also contact the yoga instructor to gain any constructive criticism before our final demo.

Progress Update:

• Met with yoga instructor
  • Collected yoga reference images for fixed set of poses from 2 different angles (side and frontal view) to ensure all critical elements of pose are captured to be used downstream in the pose correction component
  • Interviewed them to gain better understanding of appropriate error signals to look for as guides for corrective suggestions and also know if the metrics we plan to use in PosePal are comprehensive enough/will result in an effective yoga-learning tool
• Helped with pose correction library implementation
  • Researched more/collected information about the algorithms and metrics we would use to represent poses/detect errors
  • Tested functionality of implemented library to validate results of computed angles on set of examples

Still need to actually order hardware, but given the fact that the hardware we need to buy isn’t particularly niche/hard to acquire and that we are on track with the other tasks/don’t have pressing work that requires hardware within the next couple weeks, we should be able to get the hardware this week and still be on track with our planned schedule.

Relevant Courses Taken:

•  Intro to Machine
• Into to Deep Learning
• Concepts in AI
• Pattern Recognition Theory
• Advanced algorithm course (15-210, 15-451, etc.)
• Physics
• Experience working with CV/rendering from computer vision swe internships

Next Week:

• My goals next week are to finish the pose correction component and map errors internally to corrective suggestions
• We also need to have the hardware ordered by the end of the week

Proposal Work

• Completed requirements and software solution sections of proposal presentation slides
• Prepared for and gave actual presentation for PosePal proposal to the class

Project Work/Progress

• Synched with and organized meeting with yoga instructor for key project-related tasks
  • Will collect selected example pose models from scheduled meeting with instructor
  • Also prepared questions to ask instructor to identify what error signals our pose correction system should look for to best match how in-person classes are run and give the best user experience possible
• Conducted research on different possible approaches we could use for the pose estimation component of PosePal
  • Collected benchmark performance data of candidate models for comparison and to understand how to objectively define the requirements that we can and should meet to satisfy the outlined use case for the project
  • Ran example models on video footage and using real-time camera to make sure that we can run and use them in the project itself
  • Example notebook link: https://colab.research.google.com/drive/13N94cPLcETxEstvvLbQO3jxYsmyNdbN4?usp=sharing
• Code snippet for extracting the model and setting up needed environment to run it:

Next week deliverables include the following:

• Meeting with yoga instructor on Monday and collect the reference yoga pose models
• Implement the pose correction library that will include the geometric computations like computing the Euclidean angle given two x,y,z coordinates for use in pose comparison
• Implement functionality to actually suggest corrections given two points, the reference and user’s, use this information downstream for the correction rendering and suggestions which will be the target task starting in the following week

Schedule Status Check

We have accomplished all the deliverables that we’ve outlined for up until this point on the schedule per the Gantt chart for the first week. Our upcoming tasks for the previous week are all included in the above next week deliverables section, so we expect to still be on track and in line with our original schedule by the end of the week.