For the early half of this week, I have worked on the proposal representation and I was assigned to use case & use case requirements. I went through previous communications with the staff team, as well as our proposal planning doc and abstract doc to further clarify our project scope. I first wrote down all use case requirements associated with each technical component in a planning document and created slides from there. The detailed requirements are used as speaker’s notes for our actual presentation. Over the weekend, I met with my team to polish slides and rehearse our proposal presentation.
After the presentation, I have discussed with our team and TA about whether the goal is to identify single or multiple objects at once. I spent two hours on Tuesday night watching tutorials of YOLO, ResNet, etc. and reading documentation about pre-trained CV models that our team will potentially use (references attached at the end).
After Wednesday’s class, we have decided to also start researching hardware to confirm parts that we need to order. I have looked into data transfer between Jetson and Arduino and the messaging read (Serial) mechanism of Arduino. I have also watched setup guides of Jetson, as well as connecting an Rpi camera with Jetson. At this point as I am writing on Friday, I have already ordered Jetson from the class inventory and we will request cameras soon. We are most likely getting an Rpi camera that is known to be compatible with Jetson.
Tomorrow (Saturday, 2/10) I am planning to spend 2 more hours looking into the pre-trained model and hopefully run it on datasets that we have already found.
Here is a list of guidances I believe we will use after the hardware parts arrive:
Jetson Nano (with camera): https://automaticaddison.com/how-to-set-up-a-camera-for-nvidia-jetson-nano/#:~:text=Connect%20the%20Camera%20to%20the%20Jetson%20Nano,-Make%20sure%20the&text=Grab%20the%20camera.,away%20from%20the%20heat%20sink.
Arduino (data transfer):
(Multiple) Object Detection CV documentation:
https://medium.com/analytics-vidhya/object-detection-with-opencv-step-by-step-6c49a9cc1ff0