{"id":256,"date":"2025-04-13T01:19:11","date_gmt":"2025-04-13T01:19:11","guid":{"rendered":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/?p=256"},"modified":"2025-04-13T01:19:11","modified_gmt":"2025-04-13T01:19:11","slug":"nicoles-status-report-for-4-12","status":"publish","type":"post","link":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/2025\/04\/13\/nicoles-status-report-for-4-12\/","title":{"rendered":"Nicole&#8217;s Status Report for 4\/12"},"content":{"rendered":"<p><span style=\"font-weight: 400\">What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours).<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">This week I fabricated and tested all the internal circuitry for the new 8 blocks.<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">I soldered all battery holders to adapters, soldered headers onto all picos and muxes, cut charging ports into battery holders, and tested all picos, waveshare LCDs, batteries, battery holders, and adapters for functionality.<\/span><\/li>\n<\/ul>\n<\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">I changed the web app to handle 4 rows by using the full NYT Connections dataset and using their startup word placements instead of a random shuffle. I also implemented the \u201cone word away\u201d feature.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">I helped to fabricate the test bed for 16 blocks. I laser cut cardboard platforms for the male pogo pins, cut all the wires needed, and helped to tape everything onto a text board.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Additionally, I soldered wires for the buttons and row LCD displays, and did a little soldering to help with the transfer of using a breadboard to using a soldered perf board for the grid circuitry.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">I went through the NYT connections database and picked 2 puzzles of similar difficulty that contained words involving knowledge of American cultural references and double meanings to use for our user testing.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">Is your progress on schedule or behind? If you are behind, what actions will be taken to catch up to the project schedule?<\/span><\/p>\n<ul>\n<li><span style=\"font-weight: 400\">My progress is a little behind schedule because we were having some issues with the 16-block grid working consistently, so I did not get as much testing as I would have liked. To remedy this, I will write scripts to perform my latency testing so that once the grid is ready, I can just run my scripts and get the testing done as fast as possible.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">What deliverables do you hope to complete in the next week?<\/span><\/p>\n<ul>\n<li><span style=\"font-weight: 400\">Next week I hope to complete my verification tests and gather user testing data.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">If I have time, I will also try to improve the text cleaning for the dictionary api and potentially look into using gemini api for words or phrases that don\u2019t show up in the dictionary api.\u00a0<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">Now that you have some portions of your project built, and entering into the verification and validation phase of your project, provide a comprehensive update on what tests you have run or are planning to run. In particular,<\/span> <span style=\"font-weight: 400\">how will you analyze the anticipated measured results to verify your contribution to the project meets the engineering design requirements or the use case requirements?<\/span> <span style=\"font-weight: 400\">Verification is usually related to your own subsystem and is likely to be discussed in your individual reports. Validation is usually related to your overall project and is likely to be discussed in your team reports.<\/span><\/p>\n<p><span style=\"font-weight: 400\">Tests that I have run:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Game logic accuracy<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Input: Sets of submitted words<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Output: 100% correct answer checking<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">I played 10 games. For 5 games, I tested 2 combinations of correct submissions and 4 combinations of wrong submissions. I made sure that 4 wrong submissions resulted in a game loss. For the next 5 games, I tested 2 combinations of wrong submissions and 4 combinations of correct submissions. I made sure that the 4 correct submissions resulted in a game loss. For all games, I made sure that the correct submissions were registered as correct and the wrong submissions were registered as incorrect. I also verified that the mistake count was decremented and reset properly, and that submitting the same category multiple times would not result in a premature game win. For each of the 10 games, I made sure that at least 1 wrong submission was a \u201cone away\u201d submission, and checked that the \u201cone away\u201d message was displayed properly.<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">From these tests, I was able to verify that the game logic was 100% accurate, which is imperative as incorrect game logic will result in the user not being able to finish the game properly since each successive submission depends on what words have been \u201celiminated\u201d by previous submissions.<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><span style=\"font-weight: 400\">Tests I am planning to run:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Hints Retrieval Latency<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Input: Load 20 puzzles<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Output:3.2s latency\/puzzle<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">I plan to write a script that will run on the RPi to test latency of hint retrieval. The script will load 20 puzzles. For each puzzle, I will time how long it takes to retrieve\/generate the puzzle, retrieve hints via calls to the dictionary API, and parse and store these responses into the game controller data structures. This will give us an idea of how long it takes to gather hints for all of the words in a puzzle, and make sure that it is not too long so that we can meet our latency goals and maintain user attention.<\/span><\/li>\n<\/ul>\n<\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Hints Retrieval Quality<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Input: all words in the NYT Connections Archive dataset<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Output:\u00a0<\/span>\n<ul>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">95% retrieval rate of definitions<\/span><\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">no more than 1 word\u2019s hints unretrieved for each puzzle<\/span><\/li>\n<\/ul>\n<\/li>\n<li style=\"font-weight: 400\"><span style=\"font-weight: 400\">Aside from the latency, I also want to test the quality of the hint retrieval itself. I will write a script to loop through every word in the dataset and record the number of times where no definitions or context\/examples were found for a word. I want to make sure that definitions\/examples are retrieved at least 95% of the time. Additionally, for each puzzle, I want to make sure that no more than 1 word in that puzzle does not have hints available. If I do not meet this goal, I will consider options like generative LLM APIs such as Gemini to provide hints for missing words. It is important that the virtual companion is able to retrieve hints reliably since otherwise it will be completely useless to the user as a feature.<\/span><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>What did you personally accomplish this week on the project? Give files or photos that demonstrate your progress. Prove to the reader that you put sufficient effort into the project over the course of the week (12+ hours). This week I fabricated and tested all the internal circuitry for the new 8 blocks. I soldered &hellip; <\/p>\n<p class=\"link-more\"><a href=\"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/2025\/04\/13\/nicoles-status-report-for-4-12\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Nicole&#8217;s Status Report for 4\/12&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1091,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[6],"tags":[],"_links":{"self":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/posts\/256"}],"collection":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/users\/1091"}],"replies":[{"embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/comments?post=256"}],"version-history":[{"count":2,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/posts\/256\/revisions"}],"predecessor-version":[{"id":258,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/posts\/256\/revisions\/258"}],"wp:attachment":[{"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/media?parent=256"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/categories?post=256"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/course.ece.cmu.edu\/~ece500\/projects\/s25-teamb4\/wp-json\/wp\/v2\/tags?post=256"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}