Team Status Report for 2/7

Work Completed This Week As a Team:

  • Contacted local trade schools regarding access to used or damaged HVAC ducts (no response yet)
  • Researched robot simulators for early testing before physical hardware integration
  • Contacted HVAC technicians about sourcing scrap duct materials
  • Researched purchasing options for sheet metal ducts and fiberglass ductboard and documented sizes/prices
  • Reviewed research papers to identify acoustic features used for corrosion and leak detection
  • Researched publicly available ML datasets for acoustic-based defect classification
  • Reviewed guided-wave and structural health monitoring literature to understand how tap-induced vibrations propagate through ducts
  • Investigated NVIDIA Jetson Orin Nano as an onboard compute option for real-time inference
  • Explored multiple mechanical tapping mechanisms for generating consistent acoustic excitation

Summary

This week our team prepared for the project proposal presentation. We finetuned our use case requirements, settling on a couple large goals: defect detection using acoustic data, localization using image data, and a generalization to different materials. After Rayann presented the proposal on Wednesday, the team focused on our supervising professor’s largest questions: where will the HVAC duct system that we plan to test the robot on come from and where will the data to train the ML model come from. Adithi and Rayann called HVAC technicians inquiring about where damaged HVAC ducts go. These technicians were unresponsive so as a precautionary measure, Rayann looked into buying affordable sheet metal HVAC ducts and fiberglass ductboards on Amazon. She saved the links and documented their sizes and prices and shared them with the rest of the team. In the next week, our team will continue to search for old HVAC duct systems. Our new direction is to call trade schools.

Mahati has already begun by contacting the Pittsburgh Trade School. Rayann also looked into different acoustic features that are used to detect corrosion and air leaks in research papers. She was able to get a comprehensive list of features we can extract from acoustic signatures. Adithi looked into finding a dataset to train the ML model with. She has found a large amount that Rayann will have to search through and find one that matches the minimum requirements: a dataset that includes acoustic data labeled with the defects we are focusing on (corrosion and air leaks) from the duct material we are focusing on (sheet metal and fiberglass ductboard). Rayann worries that if we are not able to find a dataset that fits these requirements, we will have to collect the data ourselves.

For now, Rayann is working on choosing a dataset or concluding that none will fit. No changes have been finalized to our design as of now. If there must be a change regarding where we obtain the dataset, this decision will be made by next week. This would affect our entire schedule, moving building the robot and duct system to the front and training the ML model farther to the back as we would need time to collect data.

Meanwhile, Adithi is working on the hardware design. Specifically, Adithi has already gone through the process of requesting the robotic base from the ECE department and ordering the sensors that will be mounted on the robot. Mahati has been looking into finding a simulator that we can use for testing the robot before we get to the physical phase of testing. She has found a couple of online simulators and shared with the rest of the team. In terms of our current schedule, we have taken care of most of the parts that need purchasing or requesting. However, due to the delays with finding HVAC ducts, we are slightly behind schedule. Although, as a team, we agree to do the research into finding and ordering HVAC ducts along with our tasks for next week.

  •  Risks and Contingency Plans
  • We have found that running our ML model in real time on our Jetson might need setup and debugging time which we have not accounted for. We need to make sure we have a Jetson and a contingency onboard computing option so that we can pivot and need to account for this in our schedule.
  • We also found that there may be limited HVAC duct materials available to us but we have started to overcome this by calling suppliers and checking within CMU so that we can correctly get our own data as well as test our final product. We have looked through cheap options and have talked extensively on how testing will work.
  • We also started the week thinking we may not have enough available public datasets but have since then made sure to review multiple datasets across different HVAC materials and are learning more about guided waves through academic and industrial literature available to us. The worst case is we can collect our own data once the tapping and sensing system is operational. Since this is one of our contingency plans, we will have to build our tapping mechanism quickly.

Design Changes

We do not have any major architectural changes as of yet however the first part of next week will be spent finalizing and finetuning decisions so this may change. We are however considering simplifying our hardware by using a single onboard compute (SBC) rather than multiple controllers. We will check in with our TA and professor about this change as well.

Schedule Update

We are slightly behind schedule as we spent a lot of time thinking about testing, material supplies, datasets, and literature. However, we have completed purchasing and technical planning and plan to catch up on our schedule by Wednesday this following week.

Next week, we aim to finalize hardware architecture, secure HVAC duct materials, begin prototyping the tapping system, and set up the software environment.

Mahati’s Status Report for 2/7

Since I will be working primarily on the software component of the project, I wanted to explore testing approaches beyond static inspection datasets. Ideally, we would like a way to generate signals and simulate sensor feedback so we can observe how the robot responds in near real-time, closer to how it would behave in a real deployment.

To this end, I am investigating whether there are HVAC duct simulation tools that could (1) imitate the duct environment and (2) generate realistic signals or environmental conditions for the robot to interact with. So far, I have identified several duct-specific simulators, including SimScale, TensorHVAC-Pro, and OpenFOAM. Over the next few days, I plan to explore these tools in more detail and evaluate whether they are feasible to run on my laptop, since compatibility and setup overhead can be a limiting factor.

If these simulators do not meet our requirements—particularly for real-time interaction or sensor-level simulation, I will pivot to more general robotics simulation frameworks such as NVIDIA Isaac Sim, Webots, and Gazebo. These tools are not duct-specific but offer better support for robot dynamics, sensors, and closed-loop testing. Since I have limited experience working with simulators outside of ROS, I expect this to be a learning curve over the coming week.

Real-world hardware testing was also a major concern raised during project proposal feedback. I contacted the Pittsburgh Trade School to ask whether they had unused duct components we could use for testing, but I have not yet received a response. I plan to follow up via email and reach out to additional trade schools in the Pittsburgh area over the coming week to see whether sourcing duct parts for physical testing would be possible.

Summary

Things accomplished this week

  1. Identified both duct-specific and general-purpose simulators relevant to the project.
  2. Goals for next week
  3. Install and evaluate selected simulators, focusing on compatibility and real-time sensor simulation capabilities.
  4. Follow up with the Pittsburgh Trade School and contact additional trade schools to explore acquiring unused duct components for testing.

My week’s work can be found here: https://docs.google.com/document/d/1MUVXOmcYyLjaods_Zd165aJV-86cpB4vcz8pvJeTxqY/edit?usp=sharing 

Adithi’s Status Report for 2/7

Accomplishments:
This week, I focused on researching the hardware requirements for our onboard intelligence. I read through multiple papers and machine learning datasets to evaluate which public, free datasets we could use for our model’s initial training. I quickly learned it is hard to find a lot of acoustic datasets for our use case but fortunately I came across academic and industrial research work related to Structural Health Monitoring. We can use guided wave-based structural monitoring datasets to evaluate how taps against sheet metal in HVAC ducts can propagate through wave materials. I was able to identify how frequency bands and wave reflections can indicate leaks or corrosion. In all, I believe I have found 3 or more datasets we can use to train our model. I have shared these with the signal processing expert in our group, Rayann, and it is pending discussion.

On the hardware side, I further analyzed whether the NVIDIA Jetson Orin Nano is the right onboard computing platform for us to run real-time signal processing and ML interference on. Upon further research I was able to look at performance, power requirements, and software support as well as ability.

In addition to the Jetson, I looked into the best tapping mechanism for our design. I found 3 but have narrowed it down to solenoid, and servo-driven approaches as this best fits our use case and how we are planning to build our robot.

I also, along with my teammates, contacted several HVAC repair places and learnt that it is best to contact trade schools, dump sites, and look within CMU itself in the robotics department and the Mechanical Engineering department. I will be doing this early next week as we need some way to source sheet metal and learn more about the defects themselves in general to be able to simulate realistic testing towards the end of our build process to ensure our product works.

Finally, I ordered most of our initial parts for our project and am excited to start building next week!

My work is here: Adithi – Week 4

Schedule:
We are slightly behind schedule because we have been researching technical components and restrictions of the testing of our project. However, because of our research, I think we are putting ourselves in a better position by addressing key problem areas and thinking about how we can mitigate them beforehand. We will be catching up to our schedule by Wednesday latest this following week.

Next Week:
Next week, I will finalize the hardware architecture, component selection, and finish my research on the power distribution and mechanical integration. I will also start building the tapping mechanism if the parts arrive otherwise, I will start finalizing testing and sourcing plans for different materials and begin the software development with Mahati.