{"id":273,"date":"2024-04-27T04:26:22","date_gmt":"2024-04-27T04:26:22","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/?p=273"},"modified":"2024-04-29T22:45:08","modified_gmt":"2024-04-29T22:45:08","slug":"sandras-status-report-4-27-2024","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/2024\/04\/27\/sandras-status-report-4-27-2024\/","title":{"rendered":"Sandra\u2019s Status Report 4\/27\/2024"},"content":{"rendered":"<p><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">This<\/span> <span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">week, I worked on setting up an IDE environment on the Jetson Nano for Llama 2 and Node.js. Unfortunately, in the process I found the Jetson used an aarch64 (ARM) instead of a x86_64 (Intel) CPU architecture. As a result, the necessary local\u00a0 conda environment to enable Llama 2 wasn&#8217;t a feasible option. In the initial debugging phase, multiple developers who&#8217;d run into the same issue recommended I follow <a href=\"https:\/\/medium.com\/@seehleung\/how-to-setup-a-jetson-nano-for-ai-projects-in-2021-f8d0ac557966\">this article<\/a>\u00a0as a workaround for a conda-like environment (Archiconda). However, upon trial the Jetson experienced multiple dependency issues that didn&#8217;t have simple resolutions after attempting the first 3-4 viable suggestions (like running<em> sudo apt update\/upgrade<\/em> or <em>sudo apt-get autoremove<\/em> to update\/reinstall available libraries). Due to time constraints, I thought it best to follow the previously stated backup plan, working with OpenAI&#8217;s API. This would allow me to fine tune the GPT LLM simply without needing to rely on device\/OS specific variability within environment and setup.\u00a0<\/span><\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"wp-image-298  alignleft\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-content\/uploads\/sites\/308\/2024\/04\/llm-1-300x125.png\" alt=\"\" width=\"358\" height=\"149\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-content\/uploads\/sites\/308\/2024\/04\/llm-1-300x125.png 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-content\/uploads\/sites\/308\/2024\/04\/llm-1-768x321.png 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-content\/uploads\/sites\/308\/2024\/04\/llm-1.png 776w\" sizes=\"(max-width: 358px) 100vw, 358px\" \/>here, you can see a few syntactically ASL sentences correctly translated to natural language English sentences.<\/p>\n<p><img decoding=\"async\" loading=\"lazy\" class=\"size-medium wp-image-294 alignleft\" src=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-content\/uploads\/sites\/308\/2024\/04\/IMG_1935-300x225.jpg\" alt=\"\" width=\"300\" height=\"225\" srcset=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-content\/uploads\/sites\/308\/2024\/04\/IMG_1935-300x225.jpg 300w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-content\/uploads\/sites\/308\/2024\/04\/IMG_1935-768x576.jpg 768w, http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-content\/uploads\/sites\/308\/2024\/04\/IMG_1935-1024x768.jpg 1024w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/>\u00a0I was able to successfully install Node on the Jetson and create a simple local web server that displayed webcam input on a browser using the livecam library. As seen to the left, the monitor displays a live stream of the webcam connected to the Jetson. I have limited experience with front end development but will shortly be adding text and interactive features to the display.<\/p>\n<p><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">In the final stretch of our schedule, my <\/span><span class=\"textLayer--absolute\" dir=\"ltr\" role=\"presentation\">progress is<\/span>\u00a0slightly behind where I&#8217;d like it to be due to the extensive time spent on debugging and testing multiple avenues for setting up an adequate LLM without needing to pay out of pocket.<\/p>\n<p>By next week, the whole project will need to be fully integrated from end to end on the Jetson and stress tested. For me, that will mean setting up the proper connection with OpenAI on the Jetson and aiding in any integration issues or debugging.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This week, I worked on setting up an IDE environment on the Jetson Nano for Llama 2 and Node.js. Unfortunately, in the process I found the Jetson used an aarch64 (ARM) instead of a x86_64 (Intel) CPU architecture. As a result, the necessary local\u00a0 conda environment to enable Llama 2 wasn&#8217;t a feasible option. In &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/2024\/04\/27\/sandras-status-report-4-27-2024\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Sandra\u2019s Status Report 4\/27\/2024&#8221;<\/span><\/a><\/p>\n","protected":false},"author":889,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[6,7],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/posts\/273"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/users\/889"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/comments?post=273"}],"version-history":[{"count":4,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/posts\/273\/revisions"}],"predecessor-version":[{"id":299,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/posts\/273\/revisions\/299"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/media?parent=273"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/categories?post=273"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s24-teame6\/wp-json\/wp\/v2\/tags?post=273"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}