Team Status Report – 10/4

The most significant risks that could jeopardize the success of the project is the actuator and rack and pinion mechanism not working properly. In order to successfully actuate the pins, we will need this system to work or we will experience speed delays and inaccuracies. Another risk is the depth map not giving us accurate results. This could lead the wrong pins to be actuated even though they are just following the information from the depth map. The first risk is being managed by ensuring that we have proper design requirements so that the hardware does not run into any issues. The second risk is being managed by doing rigorous testing of the depth camera and ensuring that the heightmap from the camera is accurate. Further testing is currently being done to convert the heightmap to a depthmap. We have contingency plans set up to make sure that our product will still be successful. For the gantry system, we can sacrifice speed for more accurate actuation. For the depth camera, we can always find another camera to work with, ensuring that our options are not limited.

There were no changes made to the existing design of the system since the design presentation. We are pretty confident in our design, including the requirements, block diagram, and system specifications. We may run into issues that may require us to pivot from our current design, but so far we are confident in the design.

This is our schedule from the design presentation, and we are still on time with our work with no changes necessary.

A picture of visible progress this week:

Tedd’s Status Report – 10/4

This week, I started working on getting the Intel Realsense camera to work. While we were anticipating on using the Oak-D cameras, we realized that other teams have checked out the cameras already, leaving us with the Realsense camera. There is nothing wrong with the Realsense camera, but we found out that it wasn’t fully compatible with Macs. However, I have an Intel NUC that runs on Ubuntu 24.04, so there is no huge issue. After downloading the necessary libraries, I was able to run the realsense application and turn on the camera. The image below displays a heightmap of me sitting on a chair holding a guitar:

The next step after this is to actually get a good depthmap for different shapes and see if I can convert them into actual measurements.

Tedd’s Status Report – 9/27

This week, we made sure to get the design presentation down. We broke down the design presentation into different parts, and for the presentation, I took the use-case requirements and the testing and verification portion. We also took feedback from other groups from our proposal presentation, and realized that we need to add more numbers and be more thorough in our explanation. This week I also looked into the Intel Realsense, but realized that it is not fully compatible with Macs. So I will be waiting for the Oak-d Pro to be lent to us as it is fully compatible with Macs.

Safiya’s Status Report 9/27

This week I spent a lot of time on Onshape CADing and redesigning. The original CAD that I started earlier in the week derailed a bit, as we got to discussing some design changes, specifically centered around increasing the resolution of the PinScreen. As it scaled up, the frame and gantry and carriage all had to scale up as well. We then decided on Monday to make a custom PinScreen instead of buying a COT one, and thus that led to needing to design and CAD the PinScreen. I am not totally done with a lot of the details (haven’t started the reset mechanism). But this is the progress so far on the cad :
  

Deliverables for next week would be a complete Bill of Materials, Purchasing done, and a more fleshed out CAD that is ready(ish) for assembly. This includes the design and CAD of the carriage 3D print, which is the most complicated, the motors and belts on the frame, and the pinScreen reset mechanism.

We are pretty good on schedule so far.

Team Status Report 9/27

After further designing our project, we identified several risks. A big concern is actuator reliability. The RC servos may stall, strip gears, or fail to deliver our desired accuracy under load. To mitigate this we will do early bench testing of the servos with the rack and pinion to see if they can deliver the desired results. Another concern is gantry misalignment.
A significant change we made to our design is scaling up our design from 16 x 16 pins to 32 x 32 pins. This change was necessary due to concerns of low resolution. Though you can see Abraham Lincoln with 16 x 16 pins (image below). We originally decide to only have 16 x 16 pins to comfortably afford 16 actuators, but with a more detailed bill of materials we concluded we could afford 32 actuators.


Part A:

The primary purpose of our solution is for entertainment that brings a familiar pin toy concept into a dynamic, automatic form. From a health and well-being standpoint, it offers a playful, low-stress form of interaction. Unlike more physically demanding entertainment technologies, the system is hands-free and does not require repetitive strain, making it safe and comfortable for users of all ages.

Safety is carefully addressed in both mechanical and electronic design. The pins are covered by an acrylic pane to prevent accidental pinching or injury. Furthermore the reset button acts moves the device into a safe state where pins are reset. Protective housing and controlled motion paths further reduce hazards, ensuring that the entertainment experience remains safe and reliable.

Part B:

Our product solution is designed to foster social connection and shared experiences through entertainment. By transforming the classic pin-art toy into an interactive, automated and affordable display, it creates a platform where groups of people can gather, observe, and engage with the visual output together. This collective interaction encourages conversation, collaboration, and bonding. The system therefore becomes more than just a device. It becomes a medium for social engagement.

Culturally and economically, the product is designed to be versatile and accessible. Its modular, scalable design allows it to be deployed in diverse settings, from well-funded institutions to smaller community organizations, ensuring broader access regardless of resources. By supporting creative expression across different cultural contexts, the system respects and enhances how communities organize around shared interests such as art, technology, or education. In this way, the device not only entertains but also reinforces social ties, offering a playful and inclusive means for people to connect across age groups, cultural backgrounds, and social organizations.

Part C:

A big focus of our project was creating a 2D to 3D display while being affordable. As any projects that were done before that had actuating pins were extremely expensive and thus making it out of reach for casual applications and environments, such as schools and homes. To accomplish our goal of a live pinScreen, we had to create a mechanism that would push each row of pins, which is mechanically more difficult, but in the long term it is cheaper and more accessible.

Additionally our design controls cost by using a shared actuator head instead of one motor per pin, so resolution scales mostly with low-cost passive parts rather than expensive motors, drivers, and power. Major cost drivers are the frame/linear hardware,  a small set of servos, and the depth-camera/Pi. Operating costs are low , and the architecture lets us scale up affordably by adding pinScreen tiles without redesigning the actuation/control stack.

A was written by Crystal, B was written by Tedd and C was written by Safiya.

Crystal’s Status Report for 9/27

This week I continued designing the actuator subsystem of the project. We decided to use a RC servos to power rack and pinions that will actually push the pins. However, each servo would need their own continuous PWM signal and using 32 independent channels directly on one STM is impractical. This means we need an external PWM driver IC.

We are still on schedule. We hope to order parts by the end of next week.

Crystal’s Status Report – 9/20

So far, I’ve worked on shaping the project by carefully identifying the right components and mechanisms to make it feasible. I started by analyzing the cost and scalability issues of giving each pin its own actuator, realizing that this would exceed our $600 budget, so I explored alternatives like row-based actuation and column scanning. This week I listed different position based actuator parts we could use and narrowed it down to a few. On the electronics side, I mapped out how to divide responsibilities between a Raspberry Pi (for real-time depth capture and heightmap processing) and an STM32 (for deterministic actuator control), since the Pi can’t handle precise timing and the STM32 can’t handle heavy vision workloads. I also investigated specific ways to test latency, weighing options like software timestamps versus high-speed video, to ensure I can measure each subsystem’s delay as well as the full end-to-end pipeline.

Tedd’s Status Report – 9/20

This week, I looked at the various computer vision libraries that were compatible with our project. I am not sure which depth camera we will be using, so I am assuming that we will be using the Intel Realsense camera. Right now, we are tasked to work on the design of our product, which means that we will need to look over all our design choices for the gantry and the actuators. I looked into which computer vision libraries may be useful for our project, which will include the height map as well. Right now I think we are right on schedule.

Team Status Report 9/20

The most significant risks that could jeopardize the success of the project might be the complexity of the design. Mechanically and Electronically it’s a little complex and out of our comfort zone, the most difficult part that could risk the feasibility is most likely the integration and getting software + firmware + hardware all working cohesively. To manage these risks, we are doing our best to separate each category of the design into different areas of responsibility so that each person will be accountable and an “expert” at their tasks. This will help us when debugging when it comes to the integration stage. Our contingency plan would be scaling down, we are prepared for the firmware and software part to be complicated so we are prepared to drop the “updating” nature of LivePin, and start with pre fed images to replicate on the board, without the human aspect and the “live” feature.

Yes, through concept sketching we found that some sort of clamping mechanism was necessary for the pinboard to stay upright, and we also found the need of limit switches in our design to mitigate the risk of the gantry from damaging itself, and also for the carriage to be able to “home” itself. This change was very necessary, in order for us to have a way to initially find where the carriage is in terms of its cartesian coordinates. This incurs the cost of a couple limit switches which are relatively cheap (less than 15 bucks total).

Safiya’s Status Report for 9/20

  1. This week I created concept sketches for the LivePin Prototype and did a lot of research on all the components that it would take to come up with a comprehensive design. I looked into some actuator options and think the place to start would be a 3d printed rack and pinion. I also started sketching out the carriage design and the gantry system, which brought up a lot of design questions, which is good so we can answer them before moving forward. I included that concept sketch doc here.
  2. My progress is on schedule, as we planned for me to do the concept sketch this week and then finish CAD by next week.
  3. I hope to complete the CAD of the prototype in time for the design presentation and complete the design presentation.This one is not the final, it won’t let me upload because its too big
    Note Sep 18, 2025