Posted on

Matt’s Status Report for 3/22

What did you personally accomplish this week on the project?

This week, I tested the QR scanning code for getting the QR value, determining the box height, and determining the box speed/position on our complete system. Creating physical boxes and attaching various QR codes to them, I then ran them on the conveyor belt on different speed settings with our Brio3000 webcam mounted above. I was able to successfully verify the correctness and accuracy of the code to determine the box value, height, speed, and position.

Is your progress on schedule?

We are running on schedule.

What deliverables do you hope to complete in the next week?

I hope to finish linking our Python and Arduino code, which will enable us to test the QR scanning software and the robotic arm together. Hopefully we can also start testing the entire system next week, since the scanning system can currently acquire all the necessary metrics, and the robotic arm can currently pick up, move, and drop boxes.

Posted on

Raunak’s Status Report for 3/22

What did you personally accomplish this week on the project? 

This week, we made huge progress on combining all of the working parts together. Namely, the robotic arm is now able to pick up objects off of the conveyor belt, which is the MVP for our project (see slack for video). My contribution to this mainly involved writing Arduino code that controls the arm. I wrote a significant portion of the code that controls the third motor (horizontal axis) which allows the robotic arm to move side-to-side (so that it can drop off the box after picking it up). This was the final piece of the code that enabled our arm to pick up and drop off boxes in their bins. I also continued working on some of the extra features I wanted to add from last week (the ML object detection code) in parallel.

Is your progress on schedule or behind?

Our progress is on schedule!

What deliverables do you hope to complete in the next week?

While our robotic arm picks up and drops of boxes correctly, it is quite slow. It takes about 15-20 seconds for the entire process of picking up and dropping the box. We want to increase the speed of this overall process and bring it down to  ~5 seconds for the entire process. This will involve increasing the RPMs of the motor and writing code to handle this. We will also have to test that the arm doesn’t make more mistakes because of the increased speed. Additionally, we want to begin hooking up the camera system to the robotic arm so that we can pick up objects with the QR code detection.

Posted on

Matt’s Status Report for 3/15

What did you personally accomplish this week on the project?

This week, I completed the code for determining the box’s speed and depth (y-coordinate). This involved continuously tracking the QR codes using the webcam and estimating continuous center position movement over time. I tested it using our Brio3000 webcam on actual boxes moving on the treadmill, and it seems to work accurately.

Is your progress on schedule?

We are running on schedule, although we’re less ahead than we were a few weeks ago. With the hardware almost ready to be integrated with the CV / kinematics / control code, our overall progress should pick up again soon.

What deliverables do you hope to complete in the next week?

I plan on completing the Arduino code and the Python/Arduino interfacing code so that we can immediately run our software as soon as the arm is ready. Hopefully we can also start testing our QR / movement code with the arm.

Posted on

Team’s Status Report 3/15/25

This week we worked on out qr tracking algorithm for realtime tracking down the conveyor belt. We also wired the robot arm and got it to pick up packages. Our next steps are finishing the robot arm and getting it to pick up packages off of the conveyor belt.

Posted on

Marcus’s Status Report 3/15

This week I soldered most of the arm wiring, and connected it up to an Arduino controller. I testes the voltage feedback for each component. The 360 angle sensors were more like 180 so I had to account for dead space in the actuator movement. It took many iterations of Arduino to get the angles dialed to have each actuator have an accurate 0 – 180 measurement. I then wired the motors for t1 an t2. I had to get the direction of rotation and limit switches right  through flipping wires. I was able to get t1 and t2 to run specific angle moves with feedback. I then wired the vacuum and got the robot to do a box pick up move.

Next steps are: getting the robot to run multiple sequential moves instead of just 1, and wiring the rest of the robot motors and servo, t0 and the t4 servo. I working to figure out how to post videos on this website.

 

Posted on

Raunak’s Status Report for 3/15

What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. 

This week I helped with integrating the camera system with the treadmill and verifying that QR codes could be scanned. We tested the camera at varying heights and positions on the treadmill and marked the region that we found was the best for positioning (far enough from the head of the treadmill to place boxes and high enough to see the entire width of the treadmill).

IMG_2592.jpeg

Since we have completed a lot of the software already, I decided to work on some extra “nice-to-have” features for our software. Namely, I wanted to add an ML component to the project, so I decided to start working on a system that detects objects on a treadmill. My idea was that instead of QR codes labelling the category of each box, which can be tedious in real life, we could have the algorithm determine the object using CV. This is a reach goal for our project because getting an accurate classifer for a variety of objects and integrating it into the system is a difficult task. Nevertheless, this week I started coding up the classification algorithm using PyTorch and Torchvision.

Is your progress on schedule or behind? If you are behind, what actions will be
taken to catch up to the project schedule?

Our progress is on schedule! We have ordered and received pretty much all of the parts we need and are starting to integrate various components of the project together.

What deliverables do you hope to complete in the next week?

Next week, we want to start testing our software on the robotic arm and Arduino microcontroller. This will be the first major integration test, verifying that the different components of our project work correctly together. That will be the main focus for next week. If I get time outside of that, I want to continue working on my CV piece to see if I can get my algorithm to identify various objects.

 

Posted on

Matt’s Status Report for 3/8

What did you personally accomplish this week on the project?

This week, I completed the QR scanning code and successfully tested it using our Brio3000 webcam. In addition to reading the QR code value, I completed the code for getting the QR’s position and size. I also tested this on real-world QR codes using the Brio3000. This code should allow us to estimate a box’s depth and speed in our robotic arm system.

Is your progress on schedule?

We are definitely running on schedule. The software is ready to be tested with the arm/system.

What deliverables do you hope to complete in the next week?

I plan on testing the QR code on the entire treadmill system. This will involve mounting the webcam above the treadmill and running the QR code scanning, position, and size tests on real boxes that are moving on the treadmill.

Posted on

Teams Status Report for 3/8/25

This week we worked on the design report and planning out the connection of our algorithms. We discussed using pixel differences in the qr to judge the height of the box on the treadmill. We are working to test the camera and the rest of our electrical components. When we get the robot arm to work were are going to feed it live position control calculate from camera data.

Here is about halfway finished soldering and wiring of the robot arm motor control box. 

 

Posted on

Marcus’s status report for 3/8

These weeks I worked on the report and wiring the robot. I was able to wire about half of the robot and do tests on one of motors and angle sensors. I was able to create a preliminary Arduino angle feedback control system for 1 motor. One setback is that the “360” angle sensors were actually 250, and I think the overall cause was esp32 only supporting 3.3v and not 5. This problem might require a switch to arduino. Otherwise everything going smooth, next week I am going to finish wiring the robot arm and do full movement tests. 

Posted on

Raunak’s Status Report for 3/8/25

What did you personally accomplish this week on the project? Give files orphotos that demonstrate your progress. 

This week, we got the computer vision system set up started. Our camera got delivered and we verified that it was able to scan and track QR codes, which is essential to our system working. We also finished testing the kinematic equation solver and verified that it is working completely (via matplotlib simulation). In addition to all of this, I spent a lot of time on the design report, making sure we included a significant amount of detail for each part. I focused on the Abstract, Introduction, Use-Case Requirements and Architecture portions of the report.

Is your progress on schedule or behind? 

I think our progress is actually ahead of schedule. We are closing in on getting the MVP to work soon after the break!

What deliverables do you hope to complete in the next week?

For after the break, we want to start simulating the software on the robotic arm and the camera. For instance, we want to get the kinematic equations to work with the robotic arm and see if it is able to pick up objects. We also want to get the camera working with the CV software and be able to take the scanned QR codes, convert them to numbers and send this information back to the robotic arm so that it knows where to place the box.