Posted on

Team Status Report 4/29

Progress

  • Fine-tuned software with some bug fixes for performance and additional features like displaying reference pose image to help users and updating the audio cues for richer explanations/more accurate feedback
  • Completed final presentation and prepared slides to reflect the final state of our project
  • Collected results from testing with users/automated testing to verify that use case and design requirements have been satisfied

Challenges/Timeline:

  • Preparing to be demo-ready with final tests/workflow practices
  • Understanding logistics like how to prepare for demo with equipment and movement/positioning of the project
  • Need to finish final assignments (report/poster/video) this week

Unit Tests:

  • We tested each of our main sub-systems (Pose Detection and Pose Correction) by tracking the latency for the system from end-to-end
  • In terms of the Pose accuracy testing, we tested the audio cues for 2 of the poses with the Yoga instructor to verify they are being phrased correctly and in the right direction
  • As a result of the feedback provided by the yoga instructor and the survey results, we are planning to modify our audio cues phrasing and relax some of the thresholds on some poses.
  • Other slight software changes include showing a picture of the actual pose and the pose name before each pose is started.

Next Steps

  • Be demo ready and prepared for any live failures/mishaps
  • Finish up final poster/report/video!
Posted on

Youssef Status Report 4/29

Progress Updates:

  • Software system completed and fine-tuned with some additional features like displaying pose reference image and bug fixes for performance
  • Got user testing feedback to verify milestones and requirements have been hit
  • Gave final presentation/prepared ppt
  • Completing final report/poster/and video for demo

Next Steps:

  • Finish up final assignments (report, poster, video)
  • Be ready for final interim demo
Posted on

Youssef Status Report 4/22

Progress Updates:

  • Hardware construction fully completed after unexpected monitor damage/breakage issues
  • Audio cues for yoga workflow integrated
  • Pose Correction system tested with user testing and sync with yoga instructor for product evaluation – overall received great feedback that met/exceeded our original goals outlined in our design and initial planning
  • Despite some unexpected obstacles in the ending few weeks, we were able to recollect ourselves and successfully complete our project with the desired performance/benchmarks being met

Next Steps:

  • Fine tune mirror-mapping to dynamically adjust on user height
  • Make minor revisions to audio cues for improved feedback to users
Posted on

Youssef’s Status Report 4/1

Current Progress:

Timeline:

  • By the timeline, we should have been finished with the hardware construction by this point, however, because of the multiple unexpected issues we ran into and the dependencies from the hardware on how the software works (mapping system etc.), we chose to spend more time working on the Mirror hardware construction.
  • This means that we will have to push the mirror-camera integration and the mirror UI into our buffer time which we allocated for situations like this where we are slightly off-track.

Next Steps:

  • We will complete the error rendering for the UI
  • Need to make final adjustments to the mapping component
  • We will also contact the yoga instructor to gain any constructive criticism before our final demo.
Posted on

Youssef’s Status Report 3/25

Current Progress:

  • Wrote out the pose correction rendering code to dynamically highlight user nodes that need correction
  • Went to Home Depot to obtain the wood pieces and get the corresponding cuts completed, beginning assembly
  • Worked on finalizing mirror coordinate mapping component and testing methodology with example data points prior to full integration testing post-hardware completion

Timeline:

  • Our initially scheduled tasks on the timeline focus on the Mirror UI and the Mirror-Camera calibration components which we are on track to fully complete and test in an integrated environment this week. We are slightly behind on the error rendering component of the UI (need to actually have corrective suggestions not just highlighted errors) and the hardware assembly, but we plan to have that finished this week.

Next Steps:

  • Need to update pose correction rendering to actually give corrective suggestions not just error highlighting/signalling
  • Will complete hardware assembly/integration
  • Test mirror mapping component using completed hardware setup
Posted on

Youssef Status Report 3/11

Completed Tasks

  • Worked with team in completion of pose correction component and testing pose estimation
  • Tested pose correction system with user testing, started to set up work to test the pose correction with labeled ground truth based on feedback from professor advisor meeting
  • Ordered parts for the hardware and tested different alternatives (i.e. acrylic vs film mirror sheet)

Timeline

  • Still largely on track with original schedule outlined in Gantt chart using slack week before spring break for finishing hardware setup
  • On track with software tasks

Next Tasks

  • Complete hardware construction of mirror and addition of camera for live user feed
  • More rigorous, objective testing of pose correction system via ground-truth comparison
  • Work on rendering of pose corrections

Tools to Learn

  • Need to revise and expand knowledge of tkinter and possibly other libraries to enable the rendering of pose corrections in a visually nice, dynamic, and insightful manner
  • May need to learn techniques for wood-working to assemble the mirror frame itself
Posted on

Youssef’s Status Report 2/25

Current Progress:

  • Researched possible monitors to use and ordered them
  • Looked more deeply into 2-way mirror options to purchase, compare pros/cons of film vs acrylic mirror approaches. Ordered film for now as cheap option, have budget to upgrade to acrylic if film is insufficient/doesn’t meet standards when testing it this week
  • Synced with other teammates on pose correction for specific poses, began implementation and split up remaining work by poses

Next Steps:

  • Complete pose correction for poses I am assigned
  • Begin to assemble the mirror hardware with the team
  • Test integrations of the system, validate pose correction works
Posted on

Ankita’s Status Report 2/18

Current Progress:

  • Met with a yoga instructor to take reference pics for each of the 6 specified poses from the TOP and SIDE view
    • Also inquired about how a professional yoga instructor judges whether a pose is held correctly and what metrics she uses.
    • Based on her feedback, we are now emphasizing whether the joints are aligned with each other (“straightness”) of the limb
  • From these pics, created a pose/angle lookup table by quantifying the ideal yoga pose images from the instructor into angles formed from 3 of the 33 possible MediaPipe landmarks using the PoseEstimation function we previously wrote.
  •  Wrote the getAngle2D function that calculates the angle from 3 inputted nodes. This was used above to calculate the angles at notable joint combinations and analyze how the instructor’s pose angles varied with our hypothesized pose angles. This could also help us identify a valid error threshold as angles could vary slightly from person to person.
  • Read and watched tutorials on how to construct a wooden frame that will go around the mirror and LCD screen -> Will finalize the wood dimensions once we decide whether we will use one or two monitors.

In regard to the schedule, we are slightly behind on the hardware construction as we haven’t ordered our materials yet. In regards to the Pose Correction, we have made significant progress and will be most likely finished by the end of the week.

Next Week’s Deliverables:

  • Continue working on the Pose Correction algorithm and research other metrics besides angles and node distances that could be used to further improve our algorithm
  • Order the LCD monitor, 2-way mirror, and wood
  • Participate in a yoga class to gain further insight into what other metrics could be helpful to include

Relevant Courses:

  • 16-385: Computer Vision
  • 16-467: Human-Robot Interaction
  • 15-281: Artificial Intelligence: Representation and Problem Solving
  • 16-384: Robot Kinematics and Dynamics
Posted on

Sruti’s Status Report 2/18

Progress Update:

  • Worked on creating pose correction library:
    • Built functions to calculate node distances
    • Built functions to check for node visibility and thresholding
  • Processed ideal yoga pose images that were taken during the yoga instructor meeting.
    • Identified important nodes that should be used for correction
    • Identified what the node values should be
  • Spent a lot of time fleshing out the software and hardware workflow for the overall system and creating graphics for the design presentation
  • Looked into the physics behind how we will identify where the reflection of the user will show up on the mirror.

Even though we are behind on the hardware acquisition, I feel like we are on track for the schedule and should be able to get things done on track.

Relevant Courses Taken:

  •  Intro to Machine Learning
  • Computer Vision
  • Gadgets, Sensors, and Activity Recognition
  • Interactive Design Studio (HCI class for accessibility and usability design)
  • Physics II

Next Week:

  • Next week I hope to have the pose comparison aspect of the software working
  • I also hope to have the hardware bought and start assembly.
Posted on

Youssef’s Status Report 2/18

Progress Update:

  • Met with yoga instructor
    • Collected yoga reference images for fixed set of poses from 2 different angles (side and frontal view) to ensure all critical elements of pose are captured to be used downstream in the pose correction component
    • Interviewed them to gain better understanding of appropriate error signals to look for as guides for corrective suggestions and also know if the metrics we plan to use in PosePal are comprehensive enough/will result in an effective yoga-learning tool
  • Helped with pose correction library implementation
    • Researched more/collected information about the algorithms and metrics we would use to represent poses/detect errors
    • Tested functionality of implemented library to validate results of computed angles on set of examples

Still need to actually order hardware, but given the fact that the hardware we need to buy isn’t particularly niche/hard to acquire and that we are on track with the other tasks/don’t have pressing work that requires hardware within the next couple weeks, we should be able to get the hardware this week and still be on track with our planned schedule.

Relevant Courses Taken:

  •  Intro to Machine
  • Into to Deep Learning
  • Concepts in AI
  • Pattern Recognition Theory
  • Advanced algorithm course (15-210, 15-451, etc.)
  • Physics
  • Experience working with CV/rendering from computer vision swe internships

Next Week:

  • My goals next week are to finish the pose correction component and map errors internally to corrective suggestions
  • We also need to have the hardware ordered by the end of the week