PCB verification part is a bit off track since we are still waiting for it to be manufactured. I will work on verification as soon as the board arrives after spring break.
Assist Nadia with firmware testing. PCB verificationb
I spent the bulk of the week leading up to spring break working on the design report due on Friday. I was busier than expected during spring break itself, so not much progress happened during that week. I am continuing to verify and test code on the breakout setup to prepare for flashing onto the board. Currently, the biggest concern on my end is making the code as reliable as possible and ensuring that the user control handling is robust.
I remain on schedule. The PCB is probably going to arrive soon, so I will coordinate with Sharon to come up with a test plan since she will also have to verify the PCB initially once it arrives. Until then, I will work more extensively testing on the breakout/breadboard setup to minimize potential issues during PCB testing and system integration.
Our biggest concern at this point is ensuring we can successfully integrate before the interim demo. To mitigate this, we will extensively test our individual parts to minimize the amount of sources of error before attempting to integrate onto our custom hardware in the coming weeks.
No changes to our design at this point.
We remain on schedule.
Our product addresses global needs by providing a simple, accessible solution to interact with IR-controlled devices, offering an affordable and user-friendly option without the need for sophisticated or expensive smart home infrastructure. The processes to clone and transmit signals are simple and easy to learn, and the use of clear gestures makes it ideal for non-technologically savvy users. In this way, our wand can bridge the gap for people who may not be familiar with traditional remote controls or more complex voice-activated systems.
In a cultural sense, our wand is designed to be easily used since it does not inherently rely on languages or symbols specific to any culture. The gestures themselves do not have any specific intonation or meaning since they were chosen chiefly for their optimality with regards to detection instead of any cultural meaning. Further, the wand’s simplicity in design is also intuitive enough for individuals who may not have prior exposure to high-tech gadgets.
Our wand offers a more environmentally friendly approach than typical remotes because it uses a rechargeable battery. Typical remotes for IR controlled devices use disposable batteries which in turn constitute electronic waste. In a global context where environmental sustainability is becoming increasingly important, our product solution contributes to minimizing the carbon footprint associated with the overproduction and disposal of electronic products, offering a cleaner alternative to traditional methods of controlling devices.
These 2 weeks, I compared the CNN, RNN, and LSFM models. While all three models performed well in training, CNN demonstrated the best generalization with minimal overfitting, the fastest training time, and high robustness to noise. In addition to the comparison, I worked on fine-tuning the models to improve their performance and reduce overfitting, focusing on optimizing hyperparameters and refining preprocessing techniques.
During fine-tuning, I encountered difficulties in balancing model performance and overfitting. Additionally, optimizing computational efficiency while maintaining accuracy was challenging.
Next week, I will complete the fine-tuning process and finalize model evaluations. Additionally, I will analyze the impact of fine-tuning adjustments and document findings to guide further improvements.
This week, I got started setting up some physical tests (loopback, basic communication with the peripherals to ensure working) as well as finishing porting over the preliminary code to FreeRTOS. More generally, using an RTOS will make having concurrency between the user-facing tasks (such as status LEDs, mode switching) easier to implement. I also reduced reliance on a debug terminal with serial since the debugger within the Cube IDE provides many graphical interfaces for using gdb. For deliverables, this also involved documenting the overall flow for the design document due on Friday.
I remain on schedule. Next week, we will focus our attention on finishing the design report since it is due this Friday, and I will begin tests to ensure that we retain full functionality when switching to an RTOS based setup. I aim to have this completed by the end of spring break so we can do more integration tests as well as start evaluating the ordered PCB.
Please check the project GitHub for updated details.
PCB verification part is a bit off track since we are still waiting for it to be manufactured. As we wait for the PCB, we will focus more on the firmware side so that we will be able to have a working firmware once we get the customized PCB.
Assist Nadia with firmware testing.
The most significant risk right now is that our model evaluation is behind schedule, which may delay integration with the IR wand system. Since we need to compare CNN, RNN, and LSFM models before finalizing one for deployment, delays in testing could impact our further implementation and optimization.
To mitigate this risk, Olina will prioritize completing model evaluations next week and continue working during spring break weekend to ensure we stay on track.
No changes to our design at this point.
We are behind schedule due to delays in model testing. However, we are working to catch up next week and will use spring break to ensure we meet our project milestones.
This week, I focused on setting up and refining the model evaluation process. I continued working with the CNN, RNN, and LSFM models, preparing them for a detailed comparison in terms of accuracy, speed, and computational efficiency.
To ensure a fair comparison, I refined data preprocessing steps, standardized input formats. I also set up evaluation scripts to measure key performance metrics such as accuracy, precision, recall, and inference time. While initial testing is in progress, I have yet to complete a full analysis.
To get back on track, I plan to complete all model evaluations next week by running full-scale tests and comparing the architectures based on their efficiency and accuracy. Since I am behind schedule, I will continue working during spring break to ensure that I meet the project goals.
Risks and Contingency Plans
The most significant risk right now is if our ordered PCB doesn’t work after being ordered because there may not be sufficient slack to redesign and order another PCB after receiving our V1. As such, we are spending substantial time verifying the PCB design before ordering it. Additionally, there are multiple test points on the boards in case hotfixes are required.
Design Changes
No changes to our design at this point.
Schedule
We remain on schedule.
Part A (Olina Zhang):
Our wand-based gesture detection and infrared control technology benefit public health, safety, and welfare in a variety of ways. Our technology eliminates the need for physical switches, which improves safety. It offers a touch-free interaction technique, which reduces the spread of viruses and impurities on frequently handled objects like light switches and TV remotes.This is ideal for persons with restricted mobility, disabilities, or the elderly, who may struggle with traditional remote-controlled devices. The technology allows people to easily control their surroundings with simple gestures, reducing the risk of falls or accidents caused by reaching for physical controls.
In terms of welfare, our product strives to improve people’s quality of life. We want to create a wand that is small, simple to use, and provides consistent results. Our technology provides convenience to a wide spectrum of consumers. This promotes independent living for people with physical disabilities and enhances comfort and usability in smart homes.
Part B (Nadia Palar):
The wand provides a unique and expressive experience for individuals to interact with their technological devices. The wand also gives individuals a way to interact with devices in a more meaningful way as well as express an interest in magic. One such social context in which this might be particularly of note is in the classroom, where the wand could be used to make lessons and engaging with educational material more interactive and appealing for some students.
Part C (Sharon Lai):
One of the primary economic considerations is the final cost of manufacturing the wand. The components involved—IMUs, IR transmitters, and CNN-powered systems—are becoming increasingly affordable due to advances in sensor technology, machine learning, and miniaturization. Our approach allows us to leverage these innovations to create a cost-effective and economically viable option for individuals looking for a new and more expressive way to interact with their technological devices.
Initial iterations of the device drivers for the IR receiver and external flash memory have been finished. The codebase is less messy, but there are some restructuring changes that will be finished. Since Sharon has began testing some of the initial firmware, I started a new branch to begin integrating FreeRTOS for task management; this will ideally help with some of the contention and aid with overall robustness and handling. This involves additional restructuring of the code so that various blocks can be more cleanly organized into tasks.
For deliverables, I created more polished versions of our block diagrams for the design presentation this week and started work on the design report document.
I remain on schedule. Next week, I will work with Sharon to complete the first hardware order of the semester so we can get the PCB fabricated as well as begin more thorough development testing for our drivers and overall use-case flow.