Category: Kapil’s Status Reports

1. What did you personally accomplish this week on the project?

• I coded the entire Bluetooth Low Energy (BLE) functionality on the Adafruit Feather, ensuring it can communicate effectively as part of the system.
• Mason and I began integrating BLE with the Jetson. We discovered that the Jetson does not natively support Bluetooth, but I resolved this issue by using a USB Bluetooth adapter. After configuring it, I successfully got BLE to work between the Jetson and the Adafruit Feather.
• I obtained straps for the bracelet and 3D printed a prototype of the enclosure design. This prototype will house all the components and provide the structure needed for the final version.

2. Is your progress on schedule or behind?

• My schedule is on track. BLE integration and the 3D printed prototype are significant milestones, and I am progressing as planned toward final assembly and testing.

3. What deliverables do you hope to complete in the next week?

• Integrate all bracelet components inside the 3D printed enclosure. This will involve resoldering the connections to fit the prototype and ensuring everything is securely housed.
• Glue the straps onto the 3D printed enclosure to finalize the wearable structure.

1. What did you personally accomplish this week on the project?

• For the demo,  integrated the bracelet with the NVIDIA Jetson, ensuring that the entire setup functions as intended.
• Inquired at TechSpark to gather more information about the 3D printing process and requirements
  • Base of the bracelet can be printed at TechSpark, however, the flexible straps require external printing.
• Downloaded the new Bluetooth Low Energy libraries onto the Adafruit Feather
  • CircuitPython is not compatible with these libraries and requires an alternative method for pushing code. Exploring best approach to resolve this issue.
• Tested and validated UART communication latency.
  • Measured latency was approximately 30ms, which is significantly below the 150ms requirement
• Worked on the final presentation for the project

2. Is your progress on schedule or behind?

• My progress is on schedule. The successful demo and latency validation ensure that the system is performing as required. I’ve also laid the groundwork for the remaining tasks, including Bluetooth integration and 3D printing.

3. What deliverables do you hope to complete in the next week?

• Implement Bluetooth Low Energy (BLE) integration to replace UART communication, ensuring seamless wireless connectivity.
• Begin printing the 3D enclosure, ensuring it securely houses all components while maintaining usability

1. What did you personally accomplish this week on the project?

• Received the NeoPixel and soldered header pins on.
• Connected the NeoPixel to the Adafruit Feather.
  • Initially, it did not work, but after debugging a physical connection issue, I successfully resolved the problem and got it operational.
• Attempted to connect Adafruit Feather to the WiFi
  • Unfortunately, due to persistent connectivity issues, I was unable to establish a connection. To work around this, I identified a program that allows me to push code to the Feather via a wired cable, enabling continued progress without relying on WiFi connectivity.
• Attended two group meetings focusing on integrating the Jetson.
  • First meeting: encountered issues with securing an SSH connection
  • Second meeting: Successfully established the entire pipeline. The Jetson now communicates with both the iPad display and the embedded bracelet via UART, achieving the intended functionality for the demo.

2. Is your progress on schedule or behind?

• My progress is on schedule. Despite the WiFi connectivity setbacks, I was able to get the NeoPixel working and successfully integrated the Jetson pipeline. The system is now demo-ready with UART communication functioning as intended.

3. What deliverables do you hope to complete in the next week?

• Post-demo, my focus will shift to implementing Bluetooth Low Energy (BLE) to replace UART for wireless communication.
• Conduct timing analysis to ensure the system meets its real-time performance requirements
• Begin finalizing the 3D-printed enclosure and organizing the circuit for a more polished appearance.

4. Tests conducted and planned for verification and validation:

• Verification Tests (Subsystem-level):
  • The embedded bracelet must achieve a latency of 150ms. As outlined in the Design Report, I will be using an oscilloscope for this. I will have two latencies one for UART (wired communication), and one for BLE (wireless)
    • testing BLE latency and comparing it to the UART baseline to ensure that BLE does not compromise system responsiveness
  • For the user testing portion, I have two goals
    • Feedback Recognition Accuracy: At least 90% of participants should correctly identify the type of feedback (haptic or visual) associated with specific emotions within 3 seconds of actuation.
    • Error Rate: The system must maintain an error rate of less than 10% for incorrectly signaling emotions, ensuring reliability.

1. What did you personally accomplish this week on the project?

• This week, I confirmed that the NeoPixel part I ordered last week is on its way. Once it arrives, I plan to finalize and complete the circuit assembly.
• In the meantime, I shifted my focus to integrating the components with the Jetson, which is an essential step for the full system setup. To facilitate this, I participated in a group meeting where we worked on setting up the Jetson and coordinating its communication with other system components.
• During integration, I identified an issue with the Adafruit Feather’s connectivity. While it works smoothly on my local WiFi, it faces challenges when trying to connect to CMU’s network. This is a critical insight that will need addressing to ensure reliable operation in our intended environment.

2. Is your progress on schedule or behind?

• My progress is slightly behind schedule.  I wanted to have finished my circuit and start working on  streamlining the design but am still waiting for the NeoPixel to arrive.

3. What deliverables do you hope to complete in the next week?

• Next week, I hope to have the NeoPixel part in hand and complete the circuit assembly.
• I aim to continue working on and ideally finalize the integration between the Adafruit Feather and the Jetson, addressing the WiFi connectivity issue to ensure seamless communication.
• If the circuit is completed, I will run initial tests to confirm that the system operates as expected and adjust any configurations as necessary.

1. What did you personally accomplish this week on the project?

• Made significant progress by receiving all of the hardware components needed for the project. With the parts now in hand, I started working on integrating them to verify that they function as intended.
• Participated in two team meetings to align our progress and refine the action items with my group members.
• I began developing the Adafruit code to control the individual components, focusing on the setup of communication protocols between the microcontroller and the other hardware elements.

• In parallel, I reviewed some preliminary designs for the 3D printed enclosure. My goal was to identify any structural issues early and ensure that the design can securely house all components while allowing sufficient space for wiring and connections. To facilitate this, I started exploring software that would allow me to edit and customize the enclosure design. This involved downloading and experimenting with CAD tools to see which ones offer the most flexibility for making the necessary design adjustments.

2. Is your progress on schedule or behind?

• My progress is on schedule. Receiving all the components and beginning the coding process was a critical milestone, and I’m pleased to have reached it without any delays.

3. What deliverables do you hope to complete in the next week?

• By next week, I want a working circuit on a breadboard with the different Adafruit components.  This will involve conducting integration tests to confirm that each part works seamlessly with the microcontroller and making adjustments based on the test results.
• I also aim to complete a final version of the 3D printed enclosure design in 3 weeks.

1. What did you personally accomplish this week on the project?

• Last week, I completed my initial circuit design and sent it to three faculty members and one TA for feedback. After receiving extensive feedback, I made several modifications to the design, ensuring that all components had sufficient current draw to operate properly.

• I also created a more visual version of the design to clearly explain how the different components will communicate with each other, making it easier to understand for both the team and external reviewers.
• After finalizing the design, I placed the order for all necessary parts, and the TA approved the order form.
• In addition, we explored the haptic feedback system, considering whether it will correspond to specific emotions (e.g., vibration for happiness vs. sadness) or whether it will reflect the confidence/strength of the detected emotion.

2. Is your progress on schedule or behind?

• My progress is on schedule. The circuit design has been finalized and approved, and the parts have been ordered. I’m currently awaiting their arrival to begin assembly and testing.

3. What deliverables do you hope to complete in the next week?

• Receive the ordered parts and begin initial assembly and testing of the circuit.
• Finalize the decision on how the haptic feedback will function—whether it will correspond to specific emotions or reflect the confidence level of the emotion detected.
• Begin prototyping the 3D printed enclosure for the bracelet, ensuring it fits all the necessary components.

 

1. What did you personally accomplish this week on the project?

• This week, I prepared and presented the design presentation to the team and class, where I detailed the bracelet design and its components.
• Based on feedback from the presentation, I made changes to the bracelet’s haptic feedback system. Initially, we planned for binary (on/off) feedback, but I adjusted the design to include a microcontroller that allows the vibration intensity to ramp up and down, offering more dynamic feedback based on different emotional states.
• I finalized the exact Adafruit Feather model (Assembled Adafruit HUZZAH32 – ESP32 Feather Board – with Stacking Headers)  that we’ll use, ensuring it has the required functionality for our project.
• I sent my final circuit design to the group TA and two faculty members for review before ordering the necessary components.
• After further consideration of the design, I concluded that we do not need to create a PCB for this phase of the project. Instead, we will 3D print an enclosure and solder the components together to demonstrate the project effectively. My design inspiration came from researching other similar projects. The most relevant is the following:
  • https://learn.adafruit.com/ble-vibration-bracelet

2. Is your progress on schedule or behind?

• My progress is on schedule. I have made significant design adjustments based on feedback, finalized the necessary components, and completed the design review process.

3. What deliverables do you hope to complete in the next week?

• I plan to place the order for the components after receiving feedback from the TA and faculty.
• Begin working on the 3D printed enclosure for the bracelet.

1. What did you personally accomplish this week on the project?

• I attended two team meetings and participated in a work session on Monday, as well as a TA + professor meeting on Wednesday, where I received valuable feedback on my progress and design considerations.
• I spent most of the week working on a prototype design for the bracelet components of our system. Initially, I aimed for a simple design connecting components directly to the Jetson Nano, but I encountered challenges that made me realize the need for a microcontroller to avoid compatibility issues.

• https://www.adafruit.com/product/1643
• https://www.adafruit.com/product/2305
• https://www.adafruit.com/product/1201
• I explored several microcontroller options, including the STM32, ESP32, and Adafruit Feather. After discussing with the group TA, I chose the Adafruit Feather due to its seamless integration with the Adafruit components I am using for the bracelet.

• I created two circuit diagrams: one for a wired connection and one for a wireless setup, ensuring both options are viable based on the needs of the project.

• Next steps include finalizing the circuit and placing a purchase order for the components. I also plan to start the PCB design in parallel with these tasks.

2. Is your progress on schedule or behind?

• My progress is on schedule. While there was a slight delay in finalizing the microcontroller decision, I quickly addressed it, and now I’m moving forward with both circuit and PCB design, which are key deliverables for the upcoming weeks.

3. What deliverables do you hope to complete in the next week?

• Finalize the circuit design for the bracelet and place an order for the required components.
• Begin the PCB design process, working through layout and pin configurations for seamless integration with the bracelet’s components.
• Prepare to test both wired and wireless configurations once the parts arrive.

Progress

• This week, I began the preliminary design for the PCB, focusing on the use case requirements and what hardware is best for meeting these requirements. I also narrowed down on how the individuals components of the embedded device will communicate with each other. I also communicated budget requirements with the team to ensure we are choosing the best hardware devices for the application.
• I reviewed design tools like SolidWorks to assess which would best suit our project. I also researched the pin configurations and layout considerations needed for our facial recognition system.
• Additionally, I attended all team meetings and participated in discussions regarding hardware latency and accuracy goals.
• I also supported the team during our proposal presentation by giving input on how hardware and design choices will impact latency and overall performance.

Schedule

• Currently, my progress is on schedule. The PCB design phase will official begin next week according to the Gantt chart but I’m feeling more confident given the initial research I’ve conducted this past week. However, I anticipate that the next phase, involving component orders and integration testing, will need close attention to stay on track.

Upcoming Deliverables

• Finalize the component choices for the PCB.
• Complete the initial PCB layout and design considerations.
• Submit component orders once the design and budget are confirmed.