Category: Dhruv’s Status Reports

Accomplishments this week:
This week, I focused on finishing up the entire project. I solidified the backend and fixed a bug causing inaccurate location. Python was truncating the location coordinates so I made sure it did not do that. We also worked on 3D printing and making our product look a lot nicer. We realized we need a much smaller box. In addition, we did more testing with walking around with the product and making sure it tracked correctly. We also worked on poster and getting ready for final demo

Reflection on schedule:
We are on time and have finished our product. Now we are working on final deliverables and demonstration.

Plans for next week:
We will finish deliverables and plan our demonstration!

Accomplishments this week:
This week, I focused on finishing up the entire pipeline of the project. As a group, we were able to finish our product. We got the location based image capturing working and it now automatically routes to our frontend which shows summaries and pictures in a calendar view. We can also change settings on the web app. I worked on the google maps API as well and integrated it. The google maps api allows us to get an actual location from the location coordinates and there is a map view on the web app. I also worked on testing the webapp for all its buttons and making sure everything works.

Reflection on schedule:
We are now on time on the schedule as we have finished our product and testing.

Plans for next week:
The following weeks we will be preparing to demo and finish up our assignments.

New tools/technologies learned and how:
Throughout the process, I learned a lot about hardware as I mainly have a software background. I learned all the basics about the raspberry pi pico and about its constraints. I also learned how unreliable hardware can be and how important testing is. I learned this through a series of youtube videos and blogs. I also learned more about LLMs and MQTT which is very useful!

Accomplishments this week:
This week I focused on connecting the backend pipeline to the to the frontend. This involved a lot of effort in changing the structure of the code to match the frontend. We know have a working calendar view with configurable settings and generated diary entries. Now, whenever a picture is taken, it dynamically gets added to the website. In addition to this, Will and I worked on location. We realized the GPS is not great so we are going back to using the Blue’s Notecard. We also all 3D printed the casing for our parts.

Reflection on schedule:
I need to focus on helping integrate all the parts together and start testing. We are behind the schedule as we should have started testing.

Plans for next week:
Finish entire pipeline and start testing.

Verification Plans:
To verify that my part works as expected. I have built a simulator to simulate location changes using my arrow keys. I am using this to simulate the entire pipeline of picture taking and website updates. So far, it is working correctly. Once, we have the location working, we will verify location by walked certain distances and comparing coordinates with our phone. We will make sure it is within the 100 meter radius. We have already tested camera capture and network connectivity.

Accomplishments this week:
This week I did a lot of work on the software back-end. Specifically, I spent a lot of time coding the location change detection program and got it working. I made a dummy website to show the model of this working. I have a map with a user that can be controlled by arrow keys that shows this program working. When the user becomes stationary, a signal to capture an image is sent and I use a vision model to get details about the image. I store all these details in a string and send these to an LLM (Open AI API) to get the summary.

Reflection on Schedule:
I am ahead of schedule now and have finished a large portion of the early developments of my part for the software back-end

Plans for next week:
Since I have done a lot of the early work on my part, I will be working on the hardware next week. In specific, I will be working on getting the arducam set up with Will.

This week I worked on the raspberry Pi Pico, blue’s notecard, and arducam to learn how to set it up. I learned what all the pins do and how to connect each one together. I also spent a lot of time working on the paper that was due. I spent time researching section 6 and 7. I have also been working on setting up our AWS. I am configuring all the roles and IAM permissions we will need for this project. I have also been working on our location change detect function and will be testing it soon when we get the hardware side working. Overall, I believe I am slightly behind schedule but can catch up soon.

This past week I spent time doing research on the software block diagram of the project. We realized this project is much more complex than we originally thought. The main concern I was researching was how to transfer images from the glasses to the cloud. My original idea was to do it through the blue’s notecard onto notehub which can connect to AWS. However, I found out that blues notecard cannot send large files and instead needs to send images in chunks. We can also send through raspberry pi but after research, I was not able to find out how large of an image we can send. Therefore, we are going to have to do tests to determine what size of image we can send. If we cannot send a large image file, we will try to compress our image down to 8kB as that is the max file size we can send in one chunk through blues notecard. I also practiced my presentation this week as I presented on Monday. We have also received our parts and I have begun brainstorming on how I will start the implementation. I am going to start with the image capture trigger as that is the start of the software pipeline and work from there.