- What did you personally accomplish this week on the project? Give files or
photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).
This week I consolidated resources for building a GPT from scratch. These include:
- This video by Andrej Karpathy: https://www.youtube.com/watchv=kCc8FmEb1nY&ab_channel=AndrejKarpathy
- This article with code and theory: https://habr.com/en/company/ods/blog/708672/
- This Jupyter notebook implements a similar workflow as a reference, I will follow a similar process for experimentation and prototyping: https://github.com/Natooz/MidiTok/blob/main/colab-notebooks/Full_Example_HuggingFace_GPT2_Transformer.ipynb
- Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?
I feel that this week I am a little behind schedule due to midterms and other work that was brought forward. This next week will be relatively light and I intend to put more time into the project implementing an end-to-end workflow.
- What deliverables do you hope to complete in the next week?
The main deliverable I want to achieve next week is having an end-to-end workflow ready using a pre-built GPT