Team Status Report for 2/14/26

 

Our project has received a change in use case upon further discussion with faculty and evaluation of parts within our budget. We are switching to delivery from last-mile delivery to delivery of small objects within a building. This removes the need to read and identify signs, and reduces the number of potential obstacles. In addition, the more consistent lighting and surfaces will help our camera and odometry system to function better. 

Last week, we brought up the depth-sensing cameras. We were notified that they were mistakenly marked as available on the inventory sheet, so we will not be going farther down that route and will instead be continuing with bounding boxes.

Risk 1:  With the RTL pipeline this week a risk that can happen is that right after the last chunk is said to be done on a convolutional layer the next chunk can get processed. This could lead to the Multipliers and adder tree not being done and starting another layer messing up the actual accumulated value.

Risk 2: Proper balance of vehicle with multiple batteries: We identified the need for multiple batteries for the KR260, motor systems and arduino. With limited space on the vehicle chassis, we need to align them so that we do not have an unbalanced vehicle that, while functional, will make accurate movement and turning more difficult to implement.

 

Part A: Written by Paul

When considering public health and safety in our use case and design, our primary focus is not to be a hazard to people who go through hallways. This is emphasized in two of our primary design requirements of being able to identify and change navigation when a person is within 2 meters under 50ms and to be able to stop within 0.5m. The robot needs to react to and navigate around people quickly enough that the person will not have to alter their path. This is especially important for those with movement impairments or sensory disabilities. For those without them, a robot getting in the way just means stepping out of the way or slightly changing tour path, an inconvenience that rarely would cause a real safety hazard. However, for those with impairments, quickly changing paths or stopping is a much taller order that can risk their safety, and for those with sensory impairments, they may only detect the vehicle as it is crashing into them.  

 

Aside from our design goals, our focus on public health and safety is exemplified in our curation of training data. We are placing special focus on using data that includes those who are holding objects that obscure parts of them and who are in wheelchairs. Focusing on those with impairments and disabilities also helps those who do not have them, as they can temporarily have them. Consider a maintenance worker who is holding a large box in front of them. They are partially vision impaired at that time, and should not have to worry about a small robotic car that is out of their field of vision.

 

Part B: Written by Sean

Our autonomous indoor delivery robot is designed with careful consideration of social factors, particularly its operation in shared indoor pedestrian spaces where diverse social groups are present. By prioritizing people detection and obstacle avoidance, our system respects the fundamental social principle that indoor corridors, lobbies, and pathways are primarily human spaces. Users including children, elderly individuals, people with disabilities, and those carrying packages or using mobility aids should feel safe and comfortable around our product. Our focus is on maintaining appropriate distance from pedestrians and stopping when people are detected which is critical for settings like university campuses, hospitals, office buildings, and residential complexes. Predictable behavior addresses social concerns about robots operating in confined spaces where surprise encounters could cause discomfort particularly among vulnerable populations like elderly residents or young children. Our design acknowledges the importance of prioritizing human presence over delivery efficiency. Our solution aims to gain community acceptance by operating as a considerate “neighbor” rather than prioritizing speed. 

 

Part C:  Written by Justin

When considering economic factors, our product is designed to be a practical and efficient solution for real time video processing on low power hardware. The KR260 based computer vision system delivers fast inference while consuming significantly less power than a traditional GPU and providing far more capability than a typical microcontroller. This balance between performance and energy efficiency reduces operational costs through lower power consumption, longer battery life, and reduced cooling requirements. For delivery robots that must react quickly to obstacles, this efficiency translates directly into both safety improvements and long term cost savings.

From a production and distribution standpoint, the system relies primarily on commercially available, off the shelf components rather than custom manufactured hardware. This reduces upfront development costs, minimizes supply chain risk, and allows for easier scaling. The main bottleneck would likely be shipping and lead times rather than specialized fabrication. Because the design is modular, components can be replaced individually, lowering maintenance costs and extending product lifespan.

Sean Johnson Status Report for 2/14/26

What I personally accomplished this week:

This week I focused on refining our position tracking approach with the PAA5160E1 optical sensor. I discovered that the sensor uses I2C communication, not SPI as initially thought. This simplifies our integration, the sensor will connect to the Arduino rather than directly to the FPGA, since it has an onboard STM32 microcontroller that outputs processed position data over I2C. I reviewed the SparkFun documentation and Arduino library for the PAA5160E1 to understand the integration workflow. The sensor provides X/Y displacement values that we can accumulate into absolute position. I studied how to read position data via I2C on Arduino and forward it to the KR260 over serial communication for use in navigation decisions.

I also researched how to calibrate the sensor and handle edge cases like sensor drift and surface compatibility. The sensor requires mounting 10-27mm above the tracking surface and works best on hard floors, which matches our indoor demo environment.

I continued learning ROS2, focusing on how position data flows through navigation nodes and how to structure communication between the Arduino, handling sensors/motors, and KR260.

I coordinated with Paul on mounting requirements for the optical sensor on our chassis design.

Progress relative to schedule:

On schedule. This week’s work on optical sensor integration planning aligns with Gantt chart task 3.1 (optical sensor) and 3.4 (position tracking).

Deliverables for next week:

  • Complete integration plan for PAA5160E1. Arduino I2C interface and serial communication to KR260
  • Begin testing basic I2C communication with Arduino if sensor arrives
  • Define data format for position updates sent from Arduino to KR260
  • Continue ROS2 learning focused on position/odometry message types

Team Status Report for 2/7/26

Our project has received a significant shakeup over the last week. Last Sunday, we put a significant amount of additional work into our proposal presentation compared to when we had finished before we wrote the last report. This resulted in a shakeup of both our schedule and roles for the 3 of us. We consider the proposal presentation to be of great value, as it forced us to think a lot more about what we are doing. Our new schedule for the individual portions of the project is in the project proposal gantt chart.

In addition, the inventory being shared on Wednesday changed some of our part and depth-sensing plans. Two depth-sensing cameras are available, which may reduce our need for additional distance sensing hardware.

Risk 1: Hardware component availability and integration
We’re currently evaluating robotics chassis options to ensure adequate payload capacity, 2-3kg and platform size for the KR260. We are mitigating this by researching multiple vendors and chassis types.

Risk 2: Model training timeline and FPGA resource constraints
Training YOLOv3-tiny and fitting quantized weights on FPGA could take longer than anticipated. Mitigate this risk by starting model training this week ahead of schedule. The back up plan is to use pretrained weights if custom training fails. fall back to Vitis AI if custom RTL integration proves too difficult.

Risk 3: CPU processing constraints

We are requiring the CPU on the KR260 to convert frames into 1D arrays, handle robotics control logic, and perform postprocessing of frames while evaluating depth. We will mitigate this risk by starting with simply bounding boxes for our distance measurements. If we have the processing overhead, we would then use a depth camera system for more accurate distance measurements. In the absolute worst case, we would need to offload some of the CPU responsibilities to a separate board, which would introduce difficulties in making the two boards coordinate.

No photos yet as we’re in the planning phase, but hardware selection will be finalized by next week.

 

Sean’s Status Report for 2/7/26

What I personally accomplished this week:

This week I focused on hardware selection for our robot platform. I researched and evaluated multiple robotics chassis options including the Hiwonder MiniAuto kit, 4WD platforms, and tank chassis systems. I determined we need a platform with at least 250mm x 200mm dimensions and 2-3kg payload capacity to support the KR260, sensors, camera, battery, and Arduino.

I also began researching the PAA5160 optical flow sensor for position tracking, reviewing its datasheet and SPI communication protocol. Researching integration requirements and how to convert sensor data into position information.

Additionally, I started learning ROS2 fundamentals which we’ll use to integrate our vision, positioning, and motor control systems. I coordinated with Paul on physical design considerations.

Progress relative to schedule:

On schedule. Week 1’s proposal work is complete, and this week’s hardware research aligns with our Gantt chart tasks for Week 2.

Deliverables for next week:

  • Finalize robotics chassis selection with team
  • Contribute to CAD layout planning for component placement
  • Develop position tracking integration plan, encoder based or optical sensor
  • Continue ROS2 learning focused on navigation and motor control

Sean’s Status Report for 1/31

What I personally accomplished this week:
     I spent time establishing the foundation of our project both technically and organizationally. I set up the team project website, including the homepage introduction and structure for status reports. I worked with my team on developing our project proposal slides, helping refine the project scope, use case, and final demo concept based on feedback from Professor Hyong. Narrowing the use case toward an autonomous sidewalk delivery vehicle and clarifying how our system will detect and react to signs, obstacles, and pedestrians in a demo environment. I also helped specify demo details, including the environment setup and expected vehicle behaviors. I also did background research on FPGA based computer vision systems.

Progress relative to schedule:
     Our progress is on schedule even with the change in scope. The planning, scoping, and background research focused on this week were necessary for upcoming design decisions. 

Deliverables for the next week:
     I plan to help finalize a detailed list of required hardware components and contribute to refining the system block diagram. I will also assist in defining use case requirements and measurable performance targets to guide our design choices going forward. Additionally, I will continue supporting the team in preparing for upcoming presentations and design reviews.