Author: jmin1

This week Devon and Christina came over multiple times this week to work on finalizing the mirror! We got the mirror screen calibration pretty much done. With the reflection of the mirror it looks like the user is actually trying on the clothes. I also went to tech spark on Monday and got a small .75 inch hole cut on the side of the mirror. This way we can have the camera embedded into the mirror creating a more seamless look. I went home on Thursday so we moved the mirror from my house to Devon’s house. At home, I filled in the poster and I am waiting on some detailed pictures of the mirror and the poster will be ready for the demo. We still have some work left to do like enhancing the user interface so that they could try on multiple clothes at once. However, we made great progress so far!

This week we worked on preparing our final presentation. I worked on the project management slides as well as taking pictures of our mirror and user interface for the slides. In addition to this, I worked on integrating the UI with the matching algorithm with the script. There are still some issues with the display of the matching. When running the script, the matching tkinter screen doesn’t load. Next week, along with preparing the video and demo, I will be working on getting the tkinter screen to load.

This week, in class we talked about ethics. It was eye opening hearing other classmates discuss the ethics of the smart mirror. Many of the other students brought up many great questions as to how inclusive the mirror is. It gave us a lot to think about as we continue to build the mirror. In addition to this, I worked on creating the user interface for the mirror this week. I used Pkinter to make a simple UI that allows the user to either upload a shirt to try on, or choose from the existing shirts to try on. We are working on connecting the interface with the rest of the mirror.

This week we made some exciting strides as a team. We were able to successfully deploy OpenPose on the Xavier and start running tests. As expected, we had some initial hiccups with the deployment but we sorted through them. Unfortunately, our camera strip broke and we had to order a new one so we will continue testing for our demo when it comes in. Our TV stand was delivered and we built it and attached the monitor. It was a perfect height and we were very happy with the way the stand looks and functions. We also laser cut the mirror but we will be holding off on glueing it to the monitor until we have everything running smoothly. We also began working with the ACGPN model which solves our issues of clothing recognition and image warping. Our updated Gantt chart for the remainder of the class is attached below.

This week we were mainly preparing for the demo. Devon and I assembled the TV stand and place the TV monitor on the stand. We place it vertically so that the tv could show more of the torso. In addition to this, I wrote a script that allowed the camera to take images of the body, then send the pictures directly to openpose to analyze. However, the script that I wrote took over 90 seconds to take picture and analyze in OpenPose. Marios gave us the recommendation to use the GPU version of OpenPose so that it will run faster. I downloaded the GPU version and Openpose did indeed work a lot faster. However, while testing the script, the plastic that connected the camera to the Jetson smoked and burned a little, so the camera is not working anymore. I ordered more of the plastic strips so they are coming on Sunday so we can test before the demo next week. In addition to this, I brought the mirror to Ansys and got the mirror laser cut to fit the screen. We are going to try and glue the mirror to the tv. We left a one inch border around the tv so we could potentially cut a hole for the camera to peak through.

This week we worked on configuring openpose onto the Jetson. We all went over to Judy’s house to work on the mirror in person. We decided on how we want to actually display the mirror, so we ordered a tv mount. We want to glue the mirror onto the screen then put the screen vertically on the tv mount with the keyboard and mouse on the bottom. In addition to this, we got openpose installed onto the Jetson, however we ran into issues when running openpose. After talking to Marios, we realized that the issue was with the display openpose was using but openpose still works. We tested openpose on the sample images as well as on images of shirts and both work! We have also been researching how we want to cut out the background of images of shirts because we just want the shirt and not the person or the background. And lastly we have been working on the matching algorithm and the user interface.

This week, we worked on getting our mirror demo ready. One of the biggest challenges we ran into was downloading openpose onto the Jetson Xavier NX. There wasn’t any documentation on how to do it on the openpose website, but we found a blog that detailed the steps to download. However, after we downloaded it, we would run openpose and we would just see a gray screen. I redownloaded openpose three times on the Jetson and we encountered the same issue each time. After meeting with Marios, we realized that the gray screen meant that the display wasn’t working, but openpose itself was working. Then, I worked on connecting openpose to the arducam, but I am also running into issues because openpose isn’t recognizing the camera. When I run it will say that the camera was detached. I am thinking that a work-around could be to record the body, then download that recording and send it to openpose to analyze. However, this may take a lot more time and we want to keep it to a 3.5 second latency so I may have to do more research on connecting the arducam to openpose.

Last week I worked on writing the design report. We divided up the report according to how we divided the proposal and design presentations. I worked on the project management aspects as well as the user interface of the presentations, so I wrote those sections of the proposal. I wrote the schedule, division of labor, introduction, budget, user interface, and IR frame design trade-off sections. After we each wrote our individual sections, we met together to combine everything and format it all correctly. In addition to this, this week we started to receive the parts for our mirror. We have already received the Jetson Xavier NX, Arducam, and monitor, and we are still waiting on the mirror.

Our parts came in this week so I worked on assembling the mirror. When I opened all of the parts, I realized there were many parts still missing. The Jetson NX needed a MicroSD card. In addition to this, we realized that we needed an HDMI cord and a keyboard and mouse to connect to the Jetson. We were also deciding how we wanted to mount the mirror to the tv, and we ultimately decided to buy a picture frame and use the mirror as the glass of the picture frame to attach to the tv. In addition to this, we had to do some research on how to laser cut the glass.

This week we worked on compiling the design report. We divided up the sections of the report according to the division of the slides. Christina created the block diagrams for the design presentation, so she focused on the Architecture and System Description sections. Devon also focused on these sections in addition to the design trade-off sections. Judy worked on the schedule and project management sections of the presentations, so she focused on those sections in the design report. After dividing up the report, we met again to combine the different sections to ensure that the report had all of the aspects we wanted to include and flowed together well. Then, before submitting, we met one last time to polish and submit the report. In addition to this, we had a minor issue with ordering our parts, but after talking to Quinn about the orders, they were placed and we have already received the Jetson Xavier NX, arducam, and the monitor. We are still waiting on the mirror.