Category: Dhruv’s Status Reports

Accomplishments this week:
This week I focused on connecting the backend pipeline to the to the frontend. This involved a lot of effort in changing the structure of the code to match the frontend. We know have a working calendar view with configurable settings and generated diary entries. Now, whenever a picture is taken, it dynamically gets added to the website. In addition to this, Will and I worked on location. We realized the GPS is not great so we are going back to using the Blue’s Notecard. We also all 3D printed the casing for our parts.

Reflection on schedule:
I need to focus on helping integrate all the parts together and start testing. We are behind the schedule as we should have started testing.

Plans for next week:
Finish entire pipeline and start testing.

Verification Plans:
To verify that my part works as expected. I have built a simulator to simulate location changes using my arrow keys. I am using this to simulate the entire pipeline of picture taking and website updates. So far, it is working correctly. Once, we have the location working, we will verify location by walked certain distances and comparing coordinates with our phone. We will make sure it is within the 100 meter radius. We have already tested camera capture and network connectivity.

Accomplishments this week:
This week I did a lot of work on the software back-end. Specifically, I spent a lot of time coding the location change detection program and got it working. I made a dummy website to show the model of this working. I have a map with a user that can be controlled by arrow keys that shows this program working. When the user becomes stationary, a signal to capture an image is sent and I use a vision model to get details about the image. I store all these details in a string and send these to an LLM (Open AI API) to get the summary.

Reflection on Schedule:
I am ahead of schedule now and have finished a large portion of the early developments of my part for the software back-end

Plans for next week:
Since I have done a lot of the early work on my part, I will be working on the hardware next week. In specific, I will be working on getting the arducam set up with Will.

This week I worked on the raspberry Pi Pico, blue’s notecard, and arducam to learn how to set it up. I learned what all the pins do and how to connect each one together. I also spent a lot of time working on the paper that was due. I spent time researching section 6 and 7. I have also been working on setting up our AWS. I am configuring all the roles and IAM permissions we will need for this project. I have also been working on our location change detect function and will be testing it soon when we get the hardware side working. Overall, I believe I am slightly behind schedule but can catch up soon.

This past week I spent time doing research on the software block diagram of the project. We realized this project is much more complex than we originally thought. The main concern I was researching was how to transfer images from the glasses to the cloud. My original idea was to do it through the blue’s notecard onto notehub which can connect to AWS. However, I found out that blues notecard cannot send large files and instead needs to send images in chunks. We can also send through raspberry pi but after research, I was not able to find out how large of an image we can send. Therefore, we are going to have to do tests to determine what size of image we can send. If we cannot send a large image file, we will try to compress our image down to 8kB as that is the max file size we can send in one chunk through blues notecard. I also practiced my presentation this week as I presented on Monday. We have also received our parts and I have begun brainstorming on how I will start the implementation. I am going to start with the image capture trigger as that is the start of the software pipeline and work from there.