Tag: Sruti’s Status Report

Progress:

• Updated audio cues
• Created a demo video that shows functionality of the mirror
• Worked on optimization of the software. There was a large amount of lag and wait time between each pose previously. I optimized the code so that the camera frames would be processed faster and each video capture would not start and end between each pose.
• Worked on the final report and presentation.

Overall, I think we are all set and on track for the demo!

Remaining steps:

• We are meeting the yoga instructor this week to get the remaining testing metrics
• Complete final deliverables like report, poster and video

Progress Updates:

• Completed hardware construction and have a fully working smart mirror
• Completed audio cues for all the yoga poses
• Tested a full end to end software system that corrects a yoga pose, waits for 8 seconds for you to hold the pose, then moves on to the next pose with audio and visual feedback.
• Also tested the pose corrections and suggestions and made the expected pose thresholds more relaxed to account for different body types and flexibility limits.
• Tested the system with the yoga instructor and got feedback on 2 of the poses as well as the general usability of the system.

Overall I think the team did have a rough patch the past couple of weeks but we are now in a pretty good place and will be able to comfortably complete our project.

Next Steps:

• Complete the mirror-camera integration
• Improve the quality of the audio cues to be more specific.
• Finish accuracy testing for the remaining poses and conduct some more usability tests
• Finish other final deliverables like the poster and video

Progress:

• Completed most of the mirror to camera integration. We were able to compute the scale factor in the x and y direction to make the mirror reflection be drawn over with error renderings
• We wrote out the code to show error renderings for all of the poses, and not just the one that we were testing on before
• Continued to work on building the mirror as we had damaged the monitors and are working on fixing it.

After the interim demo, we scoped out what else we need to get done and the plan seems very doable in time!

Next Steps:

• We need to complete building the mirror in a robust manner so it will not constantly break
• We need to integrate the second camera

Progress Report

• I worked on completing the hardware construction. I spent time cutting, drilling, gluing and re-designing the hardware based on constraints, errors and things we realized on the fly.
• Got the web cameras for out mirror with I tested and worked on integrating with the hardware and software.
• Realized the camera’s render flipped images, so worked on flipping the poses and processing the flipped poses in real time.
• Initial camera mirror integration has been done, but there is still more work that needs to happen for it to be completed!

I think that while we are behind schedule, we have a plan in place on how to tackle the rest of the project, so we should be able to complete it in time.

Next Steps

• We will complete the camera to mirror integration
• We will then begin testing

Progress:

• Wrote the scaling algorithm and created a plan, as well as did a preliminary proof of concept test, to calibrate the camera-mirror scaling factor.
• Finalized dimensions and hardware design.
• Bought the wood and supplies from home depot and marked their dimensions
• We were supposed to do the wood working and building today but techspark’s woodshop was closed and so have to push that out to early next week.

In regards to the schedule, I think we are a little behind track especially with the hardware building section, but if we get it done in the next couple of days then we will be on track.

Next Steps:

• Work on hardware construction
• Work on completing the mirror-camera integration

Current Progress:

• Helped with testing acrylic two way mirror, which we now decided we want to use.
• Spent significant amounts of time understanding the math and physics behind the mirror-camera integration and presented it to the team. The whole team then  discussed and solidified the approach to solve the problem.
• Wrote the function to calculate the amount by which an object appears smaller as they move away from the mirror, which we will use for understanding which parts of a body is visible on the mirror.

In regards to the schedule, I think we are mostly on track, but it depends on whether the hardware construction is difficult or not.

Next Steps:

• Work on completing the mirror-camera integration
• Work on hardware construction

Current Progress:

• Completed pose comparison algorithm for all poses (6 poses)
• Tested and tuned 5 out of the 6 poses, which are now ready for testing with the yoga instructor
• Received the monitors and two way mirror sheet, which was tested with the whole team
• Ordered the acrylic mirror hardware with the team for testing after spring break.
• We are able to identify which parts of the body is wrong and how it should be corrected

In regards to the schedule, I think we are on track except the one pose that needs to be tested.

Next Steps:

• Finish the Pose Comparison testing
• Get yoga teacher to verify our pose comparison algorithm
• Work on rendering the error as a graphic
• Decide on whether we want to use acrylic mirror or mirror sheet

Current Progress:

• Worked on researching different monitors and ordering the appropriate ones for the project
• Also spent time looking into two way mirrors – both acrylic as well as film mirrors and then ordering them
• Worked on pose comparison algorithms for tree pose and upward Salute. Spent time setting up the pose comparison framework which is standard between all poses and then wrote the specific code for these two poses.

In regards to the schedule, I think we are on track to complete the Pose Detection and Correction before Spring break.

Next Steps:

• Finish the Pose Correction functions for the remaining poses
• It is difficult to test the poses alone, so work on testing the pose comparison
• Assemble the mirror hardware

Progress Update:

• Worked on creating pose correction library:
  • Built functions to calculate node distances
  • Built functions to check for node visibility and thresholding
• Processed ideal yoga pose images that were taken during the yoga instructor meeting.
  • Identified important nodes that should be used for correction
  • Identified what the node values should be
• Spent a lot of time fleshing out the software and hardware workflow for the overall system and creating graphics for the design presentation
• Looked into the physics behind how we will identify where the reflection of the user will show up on the mirror.

Even though we are behind on the hardware acquisition, I feel like we are on track for the schedule and should be able to get things done on track.

Relevant Courses Taken:

•  Intro to Machine Learning
• Computer Vision
• Gadgets, Sensors, and Activity Recognition
• Interactive Design Studio (HCI class for accessibility and usability design)
• Physics II

Next Week:

• Next week I hope to have the pose comparison aspect of the software working
• I also hope to have the hardware bought and start assembly.

Progress Update:

• Tested out Mediapipe’s pose detection algorithm to see the results it would give.
• After the team decided to use mediapipe, worked on creating a real time 2D pose detection algorithm which rendered the pose over the person’s video stream real time as shown below.

• Spent some time understanding all the possible outputs from the media pipe pose detection.
• Created a 3D rendering of the real world poses based on the video camera input as shown below.

• Spent time deciding the different values we want to look at when doing pose correction with the rest of the team and created a clear plan and approach

Based on the progress, I feel like we are on track for the schedule and should be able to get things done on track.

Next Week:

• Next week I hope to have a library of functions that handles pose correction completed.
• I am participating in the yoga instructor meeting and hope to have ideas poses by the end of that meeting.
• I hope to have decided on what hardware we need to buy and made that purchasing order.