Oi’s Status Report for 4/27/2024

What did you personally accomplish this week on the project? Give files or

photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I worked on making sure that the iOS app can remember the device that it was previously connected to and read that to the user to make sure. However, it seemed like there were some other connection issues that we did not see in the test, so I have been working on fixing that right now. I also led the team’s meeting and our get together to combine our parts together. I had a meeting with Ryan and Ishan on tweaking our headset a bit so that it will account more for user comfort based on the feedback we’ve gathered from user testing. I also conducted some distance testing between the iOS device (my iPhone) and the raspberry pi to ensure a stable connection between them. Right now, I am a little bit worried about maintaining the connection, but I think I will be able to learn how to make sure it’s lasting for demo day or come up with the solution where Ryan and Ishan will put the data for the text to speech iOS app online and I will just be getting the data from them there, this will be harder, but we are up for that challenge if it need be. I also finalized the tweaks to our headset a bit to allow more accessibility for our users as well.

 Is your progress on schedule or behind? If you are behind, what actions will btaken to catch up to the project schedule?

I believe my project is currently on schedule.

 What deliverables do you hope to complete in the next week?

I hope that our system will integrate well altogether and hopefully there are no bugs. There might be some UI touch-ups, but that’s pretty much it for my end of the iOS app. For next week, I hope to finish our final report, create an informative well-thought-out final video with my teammates, and make sure we are ready for our demo day and show case what we’ve learned to everyone!

Oi’s Status Report for 4/20/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I helped lead the team in preparing for the final presentation that is coming. Additionally, I also worked on our app more in making sure that we can remember devices that were recently connected. I also tested connectivity with another device, a pair of wireless earphones, while waiting for the RPi from my teammate! I had some bugs here and there in the project, but I was able to resolve them! I also put a lot of effort into continuing to test the app from blindfolding users. I blindfolded 12 users this week and asked them for their advice on how to improve the app and worked on the app to make the notification messages more direct and clear. I also was able to get a smooth transitions between the different pages while remembering the user’s data settings in between launches! yay!

I have also been involved in the headset assembly process with my teammates.

 Is your progress on schedule or behind? If you are behind, what actions will btaken to catch up to the project schedule?

I believe my project is currently on schedule.

 What deliverables do you hope to complete in the next week?

For next week, I hope to continue building the app and iterating on the users’ feedback more! Due to the switch from the Jetson to the RPi, I hope that I will be able to send and receive data from my teammates’ components. I also hope to find a way to make the app run in the background of the phone!

As you’ve designed, implemented and debugged your project, what new tools or new knowledge did you find it necessary to learn to be able to accomplish these tasks? What learning strategies did you use to acquire this new knowledge?

For me, I feel like looking at youtube videos and online tutorials helped me quite a lot! I also liked reading documentation online about the tools and libraries I was using! I also think that sometimes reading youtube comments can be pretty helpful to learn here!

We recognize that there are quite a few different methods (i.e. learning strategies) for gaining new knowledge — one doesn’t always need to take a class, or read a textbook to learn something new. Informal methods, such as watching an online video or reading a forum post are quite appropriate learning strategies for the acquisition of new knowledge

Oi’s Status Report for April 6, 2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I worked on learning how to save user’s data to the app so that the user would not have to reconnect to a device via bluetooth every time the app restarts. I figured out how to save data properly and all. I have also incorporated another feature where the user can swipe on their screen (anywhere) and then the program will take them back to reset their settings. Currently, the swipe detection works fine. I spent a while figuring out the ideal swipe distance as well, as we want to differentiate clearly between swipes and taps, as their effects will be different. However, I am currently a little bit stuck on how to navigate to a different page once a swipe has been detected, and I have been playing around with the code for a bit here. 

 Is your progress on schedule or behind? If you are behind, what actions will btaken to catch up to the project schedule?

I believe my project is currently on schedule.

 What deliverables do you hope to complete in the next week?

For next week, I hope to be able to make the smooth transitions between different pages (after a swipe has been detected to go back to the connecting page). I also hope to work on getting data from Ryan and Ishan’s parts once we’ve fixed Jetson issues. We will also be working together to integrate the headset.

ADDITIONAL:

Now that you have some portions of your project built, and entering into the verification and validation phase of your project, provide a comprehensive update on what tests you have run or are planning to run. In particular, how will you analyze the anticipated measured results to verify your contribution to the project meets the engineering design requirements or the use case requirements?

Verification is usually related to your own subsystem and is likely to be discussed in your individual reports.

For my own part, I have looked into incorporating Apple’s accessibility features on the app, as Eshita, our TA, has recommended. However, I’ve decided not to, as that does not integrate well with what we want our app to do. With the accessibility features from Apple, if the user were to tap on the screen (anywhere), they aren’t guaranteed that the message on the screen will be read to them. They need to tap specifically on the text, which the chance of them tapping on that right away is probably low.

I will also be  finding visually impaired people and blindfolding people and having them use the app, and gathering feedbacks and comments from them on how the app can be improved if you can’t see properly. I will be gathering qualitative feedbacks here from them and improving my iOS app based on that.

Once the data can be sent from Ryan and Ishan, I will also be measuring the latency from the time that the data was sent to when it was read to the user to make sure that it is a low number and within our target.

I will also be running the app on my phone and making sure that the app will not die let’s say if the user puts their phone to sleep or turns their display off. The app should still be working in the background for our users. This will ensure that we are being reliable and safety.

I will also be checking that connection error alerts are working for the user once the device gets disconnected or connection fails at any point. We want to notify the user as soon as possible. Again, latency here will be measured.

When conducting the user testing (as described in our presentations), we will also be asking the user on how clear the notification alerts/messages are. I will be gathering qualitative feedback on that and will be improving our app further until more than 75% of the users find it clear.

Oi’s Status Report for 3/30/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I spent a lot of time fixing up the design of the Nav-Assist iOS app and gathering feedback from people regarding on what features to have, particularly with the text-to-speech. I am leaning towards not having the user tap the screen for the app to repeat what’s on it, as it might conflict with the existing screen readers for visually impaired users. The next thing I worked on was learning how to integrate the app with Raspberry Pi in order to receive data from Ishan’s component. I looked into and analyze different ways to send data between the different components via Bluetooth. I also met up with Ryan and Ishan on connecting our parts together in order to prepare for the interim demo.

 Is your progress on schedule or behind? If you are behind, what actions will btaken to catch up to the project schedule?

I believe my project is currently on schedule.

 What deliverables do you hope to complete in the next week?

For next week, I hope to be able to integrate and receive data from Ryan and Ishan’s components. I also hope to expand the UI more, as we get more data coming from the other components. I hope to make the UI smoother for the users.

Oi’s Status Report for 3/23/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I spent a lot of time reading about ethics and discussing about ethics with other teams. I’ve spent a lot of time in coming up with discussions and also contemplating about how to incorporate what I’ve learned from the discussions and research into the project. I’ve been thinking about how to make the design of the iOS app more accessible to users by changing and adding more features into the iOS app. I’ve been able to enable the app to read the screen to the users as well as also allow the user to tap on the screen they’re currently at, and the app will just read out what screen it’s at to the user. I struggled with this a little bit initially, as I had to find a way to do this without using the View Controller and do it directly through the Swift UI. This will be a great help to visually impaired users, as they will learn what stage the screen is  at.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I believe my project is currently on schedule.

What deliverables do you hope to complete in the next week?

For next week, I hope to get the features incorporated on all pages, as well as adding images, but I’m saving it for the last, as that should be done pretty simply. I am also thinking about how to make the transitions between the notifications smoothly for the user. I also hope to finish the user guiding steps.

Oi’s Status Report for 03/16/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

For this week, I was mostly sick, so I could not come to class and was traveling on Monday, so I missed class. However, I was able to feel better soon and was able to do some work. I worked on the Ethics assignment and read about how technology can be political. While doing the ethics assignment, I’ve came up with different ways I am considering to add to my design as stretch goals, such as speaking in different languages to also reach more users. For the iOS app, I worked on integrating the text to speech feature onto the app, to read message off of the screen to the user. Originally, I was struggling a little bit to do that as it seemed to be that the iOS version had to be downgraded for that to work. However, after a few days of tinkering and considering different modules (I was considering using OpenAI too), I was able to get it working with Av Foundation! Currently, the app can read screens and the different states of the system to the user and also verify the user’s activity, such as when trying to connect to a peripheral bluetooth device.

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I think I am a little bit behind, as I got sick and was stuck for a bit with the iOS problem, but for next week, I will try to ramp that up. I will be planning on working for more hours next week to compensate for being sick this week and also travel issues.

What deliverables do you hope to complete in the next week?

I hope to finish setting up all the state screens and get the app to correctly read them to the user and also add images to those screens. I also hope to think about ways to interactively teach the user how to use the app through a tutorial, but I have to decide first what is to do. If not, I plan to start working on integrating the app with the Jetson and try to get basic data from it and learn more about data processing here.

Oi’s Status Report for 3/9/2024

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).

I personally focused most of this week doing the design document. I helped the team get started as well as created diagrams for the design document.  I also gathered feedback from Eshita via Slack on that to incorporate into our final design paper. I also looked into creating voice over onto screens in iOS and started watching youtube videos on how to integrate that into the system for once I get back from break!

Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?

I believe that my project is on schedule.

What deliverables do you hope to complete in the next week?

I hope to finish learning how to create voice over onto screens into iOS and integrate that onto the screens. I also hope to learn how to create specific voice overs to read over objects discovered.

Oi’s Status Report for 02/24/2024

During this week, I focused on learning more about the Core Bluetooth of Swift. I learned about how to find peripherals nearby to my central IOS device and also how to connect to them successfully. I also researched and delved into ways to send data from the NVIDIA Jetson to the IOS App, which I will use bluetooth connection and through several Python modules to help! I’ve tested the connectivity with my IOS app from iPhone to connect to my laptop. I can see some information from my laptop on my iPhone. I have also worked on creating layouts and pages to notify the user of different statuses (finding objects, connection lost, etc.)

I believe that my project is on schedule.

For the next week, I plan on making sure that I can create a request to connect notification message to the peripheral and find more ways to send more types of data to my ios app. I will also be working and expanding on the UI/UX features of my IOS app. I also plan on working on the design paper due before spring break!

Oi’s Weekly Status Report for 17/02/2024

For this week, I focused on creating the IOS App and getting the basic initial functions to work. I am focusing on connecting with and identifying peripheral devices via bluetooth. I have also created an interactive UI wireframe on Invision studio for our IOS App!

I believe that my progress is on schedule.

For next week, I hope to improve the design of the IOS App and make the design much more smoother and also improve the UI. I will also delve into how to connect the Jetson to the app and get data from the Jetson.

Oi’s Weekly Status Report for Feb 10th

For this week, I focused on making the presentation slides and practicing and rehearsing for the proposal presentation to my section.

I am currently researching and looking into ways to integrate the Jetson with the IOS App and learning more about XCode for IOS App creation!

I believe that my progress is on schedule.

I hope to understand XCode more and create a basic functioning app if possible for next week.