Team Status Report for 4/27/2024

 What are the most significant risks that could jeopardize the success of theproject? How are these risks being managed? What contingency plans are ready?

Currently, the most significant risks that could jeopardize the success of the project would be connecting everyone’s parts together and making sure the communication between the components work properly, smoothly, and on time. In order to manage these risks we have thought of alternatives to mitigate this. One of the contingency plans would be to host all the data from different parts on online and we will just be pulling from it from the iOS app. We are also working together very closely and making sure each small step, change we make towards integration does not break the other parts.

 

 Were any changes made to the existing design of the system (requirements,block diagram, system spec, etc)? Why was this change necessary, what costsdoes the change incur, and how will these costs be mitigated going forward?

We might be hosting our data from different parts (obstacle identification and presence and direction online instead of using bluetooth), as of right now, some funky thing happened and we are not able to connect the raspberry pi to bluetooth for some weird reason. So if we do not get that figured out we might be hosting our data online for the IOS app to pull. This is necessary in order to  have the three parts communicating to each other properly and work well. In terms of costs, the user would have to have access to internet all the time, but at this day and age, everyone has access to the internet! This assumes that the user has access to the internet. In order to mitigate this cost, we will encourage users to be at wifi spots more.
 Provide an updated schedule if changes have occurred.

We have no updates for our current schedule.

EXTRA:
List all unit tests and overall system test carried out for experimentation of the system. List any findings and design changes made from your analysis of test results and other data obtained from the experimentation.

In terms of unit tests carried out:
iOS app:

For the iOS app, we tested the app on 12 users, like mentioned by last week’s status report (from Oi’s). We blindfolded users and asked them to navigate on our app. In terms of changes made, we made messages shorter but that is because users told us that long descriptions/notifications does not give them ample time to react and move safely. So that is what we’ve changed.

I have also tested that the device can remember the latest bluetooth device it was selected to pair with, and it could remember fine.

Sensors:
we’ve done tests to make sure that our sensors can detect the presence of objects and classify each sensor’s direction properly, the objects within 1-3 meters from the users were properly detected. (distance and direction tests of objects’ presence).

Machine learning model:

The ML model was tested for accuracy and latency. The accuracy was tested by running the model on both validation and test datasets. The validation test allowed us to ensure that we weren’t overfitting the model, while the testing dataset allowed us to test the overall accuracy of the model. The latency of the model was measured by running about a 100 test images and the average latency for the model was around 400 ms.

Headset:
We had users test on our headset prototype design, and we’ve found out that users also found too many sensors annoying and agitating. So we’ve decided to change that to 5 sensors instead. We want both practicality and comfort and want to be able to balance it. That was a trade-off we were willing to make.

Overall System:

In terms of the overall system, the tests that we’ve made is that everything can stay connected together and send data and read data from another fine. We still need time to verify this before we let this go. But if not we’ve already made plans like said earlier.

We’ve also measured out the lengths of the wires to the raspberry pi (from the sensors) to make sure that the user will find it comfortable. We want wires to be long enough but not too long that they are dangling everywhere. We also had to account for the possible height differences for our users and make sure that the wires are long enough from the top of one’s head to their hip. for now, we aim for that to be around 65 inches, but will do more testing on that as well.

We’ve also conducted battery testing and found out that we are within the required battery life goal, so that is good!

We are also planning on having the same 12 blindfolded users navigate in a room of obstacles (still and moving) with our app blindfolded once integration works together and gather more feedback.

Oi’s Status Report for 4/27/2024

What did you personally accomplish this week on the project? Give files or

photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I worked on making sure that the iOS app can remember the device that it was previously connected to and read that to the user to make sure. However, it seemed like there were some other connection issues that we did not see in the test, so I have been working on fixing that right now. I also led the team’s meeting and our get together to combine our parts together. I had a meeting with Ryan and Ishan on tweaking our headset a bit so that it will account more for user comfort based on the feedback we’ve gathered from user testing. I also conducted some distance testing between the iOS device (my iPhone) and the raspberry pi to ensure a stable connection between them. Right now, I am a little bit worried about maintaining the connection, but I think I will be able to learn how to make sure it’s lasting for demo day or come up with the solution where Ryan and Ishan will put the data for the text to speech iOS app online and I will just be getting the data from them there, this will be harder, but we are up for that challenge if it need be. I also finalized the tweaks to our headset a bit to allow more accessibility for our users as well.

 Is your progress on schedule or behind? If you are behind, what actions will btaken to catch up to the project schedule?

I believe my project is currently on schedule.

 What deliverables do you hope to complete in the next week?

I hope that our system will integrate well altogether and hopefully there are no bugs. There might be some UI touch-ups, but that’s pretty much it for my end of the iOS app. For next week, I hope to finish our final report, create an informative well-thought-out final video with my teammates, and make sure we are ready for our demo day and show case what we’ve learned to everyone!

Oi’s Status Report for 4/20/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I helped lead the team in preparing for the final presentation that is coming. Additionally, I also worked on our app more in making sure that we can remember devices that were recently connected. I also tested connectivity with another device, a pair of wireless earphones, while waiting for the RPi from my teammate! I had some bugs here and there in the project, but I was able to resolve them! I also put a lot of effort into continuing to test the app from blindfolding users. I blindfolded 12 users this week and asked them for their advice on how to improve the app and worked on the app to make the notification messages more direct and clear. I also was able to get a smooth transitions between the different pages while remembering the user’s data settings in between launches! yay!

I have also been involved in the headset assembly process with my teammates.

 Is your progress on schedule or behind? If you are behind, what actions will btaken to catch up to the project schedule?

I believe my project is currently on schedule.

 What deliverables do you hope to complete in the next week?

For next week, I hope to continue building the app and iterating on the users’ feedback more! Due to the switch from the Jetson to the RPi, I hope that I will be able to send and receive data from my teammates’ components. I also hope to find a way to make the app run in the background of the phone!

As you’ve designed, implemented and debugged your project, what new tools or new knowledge did you find it necessary to learn to be able to accomplish these tasks? What learning strategies did you use to acquire this new knowledge?

For me, I feel like looking at youtube videos and online tutorials helped me quite a lot! I also liked reading documentation online about the tools and libraries I was using! I also think that sometimes reading youtube comments can be pretty helpful to learn here!

We recognize that there are quite a few different methods (i.e. learning strategies) for gaining new knowledge — one doesn’t always need to take a class, or read a textbook to learn something new. Informal methods, such as watching an online video or reading a forum post are quite appropriate learning strategies for the acquisition of new knowledge

Oi’s Status Report for April 6, 2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I worked on learning how to save user’s data to the app so that the user would not have to reconnect to a device via bluetooth every time the app restarts. I figured out how to save data properly and all. I have also incorporated another feature where the user can swipe on their screen (anywhere) and then the program will take them back to reset their settings. Currently, the swipe detection works fine. I spent a while figuring out the ideal swipe distance as well, as we want to differentiate clearly between swipes and taps, as their effects will be different. However, I am currently a little bit stuck on how to navigate to a different page once a swipe has been detected, and I have been playing around with the code for a bit here. 

 Is your progress on schedule or behind? If you are behind, what actions will btaken to catch up to the project schedule?

I believe my project is currently on schedule.

 What deliverables do you hope to complete in the next week?

For next week, I hope to be able to make the smooth transitions between different pages (after a swipe has been detected to go back to the connecting page). I also hope to work on getting data from Ryan and Ishan’s parts once we’ve fixed Jetson issues. We will also be working together to integrate the headset.

ADDITIONAL:

Now that you have some portions of your project built, and entering into the verification and validation phase of your project, provide a comprehensive update on what tests you have run or are planning to run. In particular, how will you analyze the anticipated measured results to verify your contribution to the project meets the engineering design requirements or the use case requirements?

Verification is usually related to your own subsystem and is likely to be discussed in your individual reports.

For my own part, I have looked into incorporating Apple’s accessibility features on the app, as Eshita, our TA, has recommended. However, I’ve decided not to, as that does not integrate well with what we want our app to do. With the accessibility features from Apple, if the user were to tap on the screen (anywhere), they aren’t guaranteed that the message on the screen will be read to them. They need to tap specifically on the text, which the chance of them tapping on that right away is probably low.

I will also be  finding visually impaired people and blindfolding people and having them use the app, and gathering feedbacks and comments from them on how the app can be improved if you can’t see properly. I will be gathering qualitative feedbacks here from them and improving my iOS app based on that.

Once the data can be sent from Ryan and Ishan, I will also be measuring the latency from the time that the data was sent to when it was read to the user to make sure that it is a low number and within our target.

I will also be running the app on my phone and making sure that the app will not die let’s say if the user puts their phone to sleep or turns their display off. The app should still be working in the background for our users. This will ensure that we are being reliable and safety.

I will also be checking that connection error alerts are working for the user once the device gets disconnected or connection fails at any point. We want to notify the user as soon as possible. Again, latency here will be measured.

When conducting the user testing (as described in our presentations), we will also be asking the user on how clear the notification alerts/messages are. I will be gathering qualitative feedback on that and will be improving our app further until more than 75% of the users find it clear.

Oi’s Status Report for 3/30/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I spent a lot of time fixing up the design of the Nav-Assist iOS app and gathering feedback from people regarding on what features to have, particularly with the text-to-speech. I am leaning towards not having the user tap the screen for the app to repeat what’s on it, as it might conflict with the existing screen readers for visually impaired users. The next thing I worked on was learning how to integrate the app with Raspberry Pi in order to receive data from Ishan’s component. I looked into and analyze different ways to send data between the different components via Bluetooth. I also met up with Ryan and Ishan on connecting our parts together in order to prepare for the interim demo.

 Is your progress on schedule or behind? If you are behind, what actions will btaken to catch up to the project schedule?

I believe my project is currently on schedule.

 What deliverables do you hope to complete in the next week?

For next week, I hope to be able to integrate and receive data from Ryan and Ishan’s components. I also hope to expand the UI more, as we get more data coming from the other components. I hope to make the UI smoother for the users.

Team Status Report for 03/23/2024

What are the most significant risks that could jeopardize the success of theproject? How are these risks being managed? What contingency plans are ready?

Currently there are no major risks that could jeopardize the success of the project. As of now the biggest concern and challenge for all of us is how to integrate everything together and ensure that all the systems work smoothly together. In order to manage these risks, we are all trying our best in our own parts and testing it in a way that simulates the connection to the other parts.

 

Were any changes made to the existing design of the system (requirements,block diagram, system spec, etc)? Why was this change necessary, what costsdoes the change incur, and how will these costs be mitigated going forward?

The iOS app now allows the user to tap on the screen, and it will read to the user the message on the screen. This allows the user to hear a repeat of what screen they are at as well as the state of the app, which will promote safety. There are no costs for this change.

No schedule changes have been made as of now.

Oi’s Status Report for 3/23/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I spent a lot of time reading about ethics and discussing about ethics with other teams. I’ve spent a lot of time in coming up with discussions and also contemplating about how to incorporate what I’ve learned from the discussions and research into the project. I’ve been thinking about how to make the design of the iOS app more accessible to users by changing and adding more features into the iOS app. I’ve been able to enable the app to read the screen to the users as well as also allow the user to tap on the screen they’re currently at, and the app will just read out what screen it’s at to the user. I struggled with this a little bit initially, as I had to find a way to do this without using the View Controller and do it directly through the Swift UI. This will be a great help to visually impaired users, as they will learn what stage the screen is  at.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I believe my project is currently on schedule.

What deliverables do you hope to complete in the next week?

For next week, I hope to get the features incorporated on all pages, as well as adding images, but I’m saving it for the last, as that should be done pretty simply. I am also thinking about how to make the transitions between the notifications smoothly for the user. I also hope to finish the user guiding steps.

Oi’s Status Report for 03/16/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I was mostly sick, so I could not come to class and was traveling on Monday, so I missed class. However, I was able to feel better soon and was able to do some work. I worked on the Ethics assignment and read about how technology can be political. While doing the ethics assignment, I’ve came up with different ways I am considering to add to my design as stretch goals, such as speaking in different languages to also reach more users. For the iOS app, I worked on integrating the text to speech feature onto the app, to read message off of the screen to the user. Originally, I was struggling a little bit to do that as it seemed to be that the iOS version had to be downgraded for that to work. However, after a few days of tinkering and considering different modules (I was considering using OpenAI too), I was able to get it working with Av Foundation! Currently, the app can read screens and the different states of the system to the user and also verify the user’s activity, such as when trying to connect to a peripheral bluetooth device.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I think I am a little bit behind, as I got sick and was stuck for a bit with the iOS problem, but for next week, I will try to ramp that up. I will be planning on working for more hours next week to compensate for being sick this week and also travel issues.

What deliverables do you hope to complete in the next week?

I hope to finish setting up all the state screens and get the app to correctly read them to the user and also add images to those screens. I also hope to think about ways to interactively teach the user how to use the app through a tutorial, but I have to decide first what is to do. If not, I plan to start working on integrating the app with the Jetson and try to get basic data from it and learn more about data processing here.

Oi’s Status Report for 3/9/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I personally focused most of this week doing the design document. I helped the team get started as well as created diagrams for the design document.  I also gathered feedback from Eshita via Slack on that to incorporate into our final design paper. I also looked into creating voice over onto screens in iOS and started watching youtube videos on how to integrate that into the system for once I get back from break!

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I believe that my project is on schedule.

What deliverables do you hope to complete in the next week?

I hope to finish learning how to create voice over onto screens into iOS and integrate that onto the screens. I also hope to learn how to create specific voice overs to read over objects discovered.

Team Status Report for 02/24/2024

This week was a productive week for our team. We finished the design presentation proposal together and will look into feedback and incorporate them! Right now, we are trying to order the Jetson and also get parts from our 18500 kit! We are also waiting for access to  ImageNet database, which is out of our control right now. We hope that this turns out smoothly, as if not, we will have to wait longer for the parts to arrive and access to be given in order to test things out. While we wait, we plan on making the most out of our time by working on tasks that we do not have to wait on materials or access for.

 

We have no design or schedule changes right now.