Zeynep’s Status Report for 12/9

This week, I spent most of my time debugging the Arduino code to successfully be able to emboss braille up to specs, adding other hardware components to the device, and also spent a significant amount of time finalizing the full pipeline with Joshna. My primary accomplishments for this week include setting up the code to control the LDR and LED, finalizing the code for the solenoid and motor control to enable embossing, creating the rigid surface for the solenoids to emboss against, setting up a speaker to provide cues to the user, securing the tension of the solenoids, and working with Joshna to finalize the full pipeline.

In addition to work on the hardware components, I created both the poster for the final demo and the slide deck for the final presentation, and practiced for my presentation.

To set up the code to control the LDR, I worked with Becky to determine a threshold for which the photoresistor was sensitive to light. Then I used that threshold and calculated the specific distance the roller should move to place the paper in the proper location.

For the solenoid and motor code, I spent a considerable amount of time testing different distances between the solenoids and the two motors to create the optimal braille output. This took some more time than expected because there were issues with power supplies and motor drivers.

I also worked to finalized some of the variables for the tension of the system. I contributed to creating the rigid surface and securing the embossing styluses attached to the solenoids. I also incorporated a speaker to provide cues to the user.

Finally, I worked with Joshna on Saturday to test the full pipeline with integration, ensuring the RPi was properly sending signals to the Arduino to emboss the paper.

 

Team Status Report for 12/09

Weekly Status Report Question (Team):

ABET #6 discusses develop and conduct appropriate experimentation, analyze and interpret data, and use engineering judgment to draw conclusions 
List all unit tests and overall system test carried out for experimentation of the system. List any findings and design changes made from your analysis of test results and other data obtained from the experimentation.

Back-end Tests

  • Uncontracted and contracted braille function test: Trying 100 randomly generated strings and comparing it with the output of Braille Blaster app (state of the art translation software)
    • Result: 100% accuracy
  • Testing to see how many responses were in database according to https://progressivegrocer.com/100-iconic-brands-changed-grocery
    • Result: 97% hit rate, 100% relevancy
  • Timing test to create the database:  converting it from a csv to the database multiple times and averaging that time as well
    • Result: 36.7 s
  • Timing database lookup time
    • Result: .132 second
  • Timing how long it took to query for each above test
    • Result 5.32 s
  • Solenoid instruction testing:  creating a sample input with unique numbers instead of just 0s and 1s and compared it to the expected output.
  • Based on the results of these tests, we determined that the database was the faster option for our product. In addition, we determined that our webscraping algorithm was satisfactory.

Front-end Tests

  • User testing: ran user testing session with 4 users to test user satisfaction with front-end interface and embosser device on a satisfaction scale from one to ten
    • Questions asked?
      • How easy was it for you to navigate the web-app?
      • Based on your experience, how likely are you to continue using this web app for your needs?
      • Did you receive sufficient and timely feedback when you entered a product name or typed notes?
      • How satisfied are you with the overall usability and functionality of the web app?
      • How efficient was the search functionality in retrieving relevant instructions or information based on the product name you entered?
      • Based on your experience, how likely are you to continue using this web app for your needs?
      • How well did the web app handle errors, such as incorrect product names or failed searches?
      • How effective were the accessibility features (such as screen reader compatibility) in making the web app usable for you?
      • How clear and understandable were the instructions provided by the web app?
      • How easy was it for you to use the embossing device?
      • How effective were the tactile cues on the box (including surface textures and braille instructions)?
      • How would you rate the paper registration experience?
      • How would you rate the portability of the device (weight, size, etc.)?
    • Results: 4.55/5 user satisfaction
    • User feedback: different button names, placement of buttons

Hardware Tests

  • Tested quality of embossed braille (size and location) by inputing random combinations of solenoids into arduino code
    • Design changes: downsized from 4 to 2 solenoids to gain more control over the tensioning of the paper and distances between the solenoids. Changed various spacing settings within the arduino code
    • Design changes: change in stepper motor driver to achieve better precision with the stepper motor
  • Photo-resistor testing: Varied values given to the photo resistor to test light sensitivity for paper registration.
    • Design changes: swapped from a 10k to a 4.7 k resistor to get more dynamic range on the ldr when we closed the top of the embosser, added an LED to pair with the ldr because when the lid is closed there is virtually no light in the embosser

Integration Tests

  • Tested communication between the RPi and Arduino using LEDs to represent solenoids: sent 30+ sample inputs to the RPi from the web-app and tested for accuracy in solenoid representation. Test results influenced how serial communication was set up in the Arduino code.
  • Tested full pipeline on various notes input combinations such as “abcd”, “llll”, “dfdfdf” that have distinct braille shapes to test quality of output.

Zeynep Status Report 12/02

This week, I focused on testing the solenoid and stepper motors of the physical embosser, doing user testing, and refining the web-app. I refined the web-app a bit more to ensure that everything was as clear as possible before user testing, but I spent a majority of my week focusing on debugging the Arduino code and testing the braille outputs of the solenoids and stepper motors combined. I have attached a video that shows an example of the work I have been doing with the solenoids and stepper motors. I have also helped with the assembly of the embosser. We also had a user testing session on Friday where we had users test the web app and tactile experience with the embosser.

Team Status Report for 12/02

As a team, we focused on user testing, testing the accuracy and speed of our web app, and assembly of the embosser device. This includes debugging the stepper motor and arduino circuit, assembling the electrical and mechanical components of the board. We have also had a user testing session to test the quality of the braille, the embosser device, and the web app. Looking to next week, we are focusing on completing assembly of the device and working on our final presentations

Other notable team events include:

  • PCB’s arriving and not working
  • A4988 motor controller issues making it hard to control direction. switched to l298n and had no problem with stepper motor control
  • Got necessary step measurements for printing braille
  • Got feedback on both our physical device and software at the Library of Accesible Media for Pennsylvanian’s blind user focus group.
  • Ran database tests

Zeynep’s Status Report for 11/18

This week I worked on refining the web-app and hosting it on a domain, debugging the web-app to solenoid pipeline, and starting the arduino code for the stepper motors.

Joshna and I visited the LAMP Library on Tuesday to get some user feedback for the webapp. Overall, the participants were happy with the design/layout of the web-app and were able to navigate it with ease. They suggested some small tweaks which I am currently implementing. I also worked with Joshna to debug some issues in the web-app to solenoid pipeline when communicating with the arduino using the RPi. We had some issues with how the signals were being sent to the arduino and we worked to debug that. We now have a fully working webapp to solenoid pipeline. Our next step is include the stepper motors into this pipeline. I have begun writing the arduino code for the stepper motors. My goal is to have this complete before Thanksgiving to give to Becky to work with for the electromechanical system.

Team Status Report for 11/18

Explain how you have grown as a team, and detail some of the strategies you have used to establish goals and plan tasks so far this semester.

Throughout the semester, we have greatly improved our communication and collaboration as a team. At the beginning of the semester, we had difficulty agreeing on a project idea and communicating our thoughts. We were making slow progress and had difficulty moving forward on some aspects of our project early on. Over the course of the semester, we have greatly improved in our ability communicate our ideas and work together. Some strategies we employ as a team to ensure strong communication and collaboration between team members include frequent checkins, updates every day about progress and encouraging team member progress, and collaborating on problems across sub-systems. For example, everybody is involved in discussions about the optimal way to design the front end and discussions about design choices on the electromechanical embosser. We have weekly meetings every Friday to discuss weekly progress and goals for the next week. These meetings allow team members to understand what other team members have been working and help us understand what needs to be done for the next week. We also establish goals and plan tasks by considering what has been accomplished in a week and gauging what gaps still need to be filled, which in part is also guided by our Gantt chart. At this point in the semester, our goals are also guided by testing we have coming up. For example, we had a goal to have the front-end completed by this Tuesday for a demo. We have another goal of having the entire electromechanical embosser pipeline complete for an upcoming demo after Thanksgiving.

Some weekly progress updates from our team: Joshna and Zeynep went to the LAMP Library on Tuesday to perform some user testing on the UI, and Zeynep is currently working on integrating some of the feedback. Overall, the users were happy with our interface and were able to navigate it with ease. We have also been working on completing the mechanics of the device, which includes laser printing the box, establishing the tension system, and integrating the hardware and software. As of right now we have established the web-app to solenoid pipeline and are currently working on integrating the stepper motors.  In the upcoming weeks, our primary focus will be integrating all of the sub-systems and testing our embosser.

Zeynep’s Status Report for 11/11

ABET #6 says … An ability to develop and conduct appropriate experimentation, analyze and interpret data, and use engineering judgment to draw conclusions

Now that you are entering into the verification and validation phase of your project, provide a comprehensive update on what tests you have run or are planning to run.  In particular, how will you analyze the anticipated measured results to verify your contribution to the project meets the engineering design requirements or the use case requirements? 

My individual components included designing the embosser system with solenoids and creating the web-app. The use-case requirements that my components cover include fast delivery of braille, accuracy of embossing, and providing an accessible interface. Our speed requirement was driven by the time it takes a user to manually emboss braille using a braille writing slate. Based on user interviews prior to starting our project, we determined that it takes 15 minutes to write a full page of braille on a braille writing slate and we required the braille printing process of our device to take at most 10 minutes. To design for this, we required our solenoids actuated at < .5s. We also required 100% readability of the braille. This will be realized through providing proper force from the solenoids to emboss, ensuring proper spacing between the solenoids, and that our embossed braille is to specifications. As for our UI, we required our web-app to be able to interface with existing accessibility features on phones and that it takes no more than 1 second to display results. We required our user to be able to acquaint themselves with the web-app and device < 10 minutes through an easy to use interface with feedback to the user. 

Testing for speed: We communicate with the solenoids by sending a digital high to an individual solenoid, delaying by x seconds, and then sending a digital low. I have been testing for the threshold of delay by gradually decreasing the amount of delay i can have without damaging the circuit. Once we establish the tension system, I will repeat this process of gradually decreasing the amount of delay we can have between the digital high and low that will still allow the solenoids to emboss. I also plan to test 10-20 inputs such as notes or products to see if the embosser is able to print these at the proper speed.

Testing for force/embossing capability: The force provided by the solenoids dictates our embossing capabilities. Our solenoids can be powered with up to 12 V. I aim to use as little power as possible. Once we have the tension system in place, I will test the solenoid’s ability to emboss paper in voltage increments of .5 V up to 12 V starting at 4 V. I also plan to test 10-20 inputs such as notes or products to see if the embosser is able to print these.

Testing Solenoid Control Circuit: We have just sent out our PCBs, but I have tested the solenoid’s control circuit by making it on a breadboarding and using the serial monitor in arduino. I mapped every combination of the four solenoids to a set of values in a truth table and have tested the circuits ability to withstand embossing in different combinations starting at 10 seconds and worked up to 10 minutes, which is our maximum embossing time. This is representative of how we will be communicating with the arduino using the RPi.

Testing for specifications: Once we have our electromechanical embosser system in place, I will measure the distances between braille characters to make sure they are to specification. We will also have user testing to ensure that the braille is readable. I also have printed braille from a state-of the art printer. I will compare our braille with this braille output to see if the size is similar. I also plan to test 10-20 inputs such as notes or products to see if the embosser is able to print these to specification.

User Testing: I have been testing the web-app using the text-to-speech capability on my phone. This is to ensure the button spacing is enough for the text-to-speech to discriminate based on touch. I also want to ensure that the text-to-speech isn’t overwhelmed by the amount of text I am displaying on the screen and is able to communicate the information clearly. This coming week, we are going to be having a user testing session at LAMP Pittsburgh with blind and partially blind users. This test will be a great way to gauge the usability of our app and will inform any adjustments I may need to make towards our final demo.

Weekly Accomplishments: 

This week, I focused on finalizing the web-app to ensure that it was easy to use for completely blind users and clear for partially blind users. This process included ensuring proper spacing between all of the buttons, testing our web-app’s features using text-to-speech to assess  the clarity of our buttons, ensuring large text, and limiting the amount of text on a page while making sure our users understand the flow of our site. I have also publicly hosted our web-app so it is more accessible to users (it is not ideal for a blind user to have to type the name of the local host). After talking to Joshna about how the braille cells will be mapped to the solenoids to emboss, I realized we needed to make slight modifications to our solenoid encasings and x/y gantry cart to ensure proper spacing between each embosser head (4 braille cells apart in x and y direction). I modified these parts in CAD and sent them to be 3D printed again.

In the coming weeks, I will be working with Joshna on integrating the software and hardware through the RPi and arduino, and working with Becky to assemble the electromechanical embosser. I am also working on establishing unique user sessions to ensure privacy of the user’s data.

 

Team Status Report for 11/11

This week we focused on making sure our demo ran smoothly and began preparing for our user testing session next week. For the demo, we displayed a completed web-app integrated with the back-end and a working solenoid system with serial communication, which is how we will be communicating between hardware and software once we have integrated our system.

We are currently working on improving the front-end to ensure it is easy to use for completely blind users and clear for partially blind users. This process includes ensuring proper spacing between all of our buttons, testing our web-app’s features using text-to-speech to assess  the clarity of our buttons, ensuring large text, and limiting the amount of text on a page while making sure our users understand the flow of our site. We currently have it running on a phone using a local-host and are looking into hosting it publicly for our demo.

We successfully integrated our front-end and back-end components, and we are currently in the process of integrating our software with our hardware. We have completed writing the American English text to braille algorithms and have converted our braille representation in software to signals that can be sent to the solenoids to emboss onto paper.  We made slight modifications to the size of our solenoid encasing on our electromechanical embosser. This modification was to make the spacing between each solenoid 4 braille characters, which is a cleaner way to represent the braille in software. We also sent out our updated PCB to include our RPI->arduino modification. We are currently working on establishing communication between the RPI and the arduino and assembling the electromechanical embosser system.

 

Zeynep’s Status Report for 11/4

This week, I focused on finishing the web-app and integrating it with the back-end, fabricating solenoid enclosures, and testing the solenoid control circuit for demo. Since last week, I added the ability to display the product information on the web-app based on information return from the back-end. I also had a few bugs with my buttons and page refreshes  that I fixed. I received my first fabricated enclosure for the solenoids, but it had a few issues so I adjusted my enclosure design and sent it out to be printed again. Because we switched from controlling the hardware with a RPi to controlling with an arduino via uart, I had did testing on the solenoid control circuit with an arduino and sent it signals over the serial monitor. Each solenoid command will correspond to an embossed braille character. I am currently testing the speed we can run the solenoids at.

Team Status Report for 11/4

This week, we primarily focused on preparing for our interim demo. Because focused on breadboarding the electrical subsystem for the stepper motor, Becky adjusted the design of the loading system, and had parts fabricated. We have decided to separate the software side from the hardware side, so the RPi handles the software and communicates with the arduino via uart, which handles the hardware. Zeynep focused on completing the front-end for the demo and assembling the solenoid circuit for demo and establishing the serial communication to send signals to the solenoids. She also fabricated the enclosures for the solenoids. Zeynep and Joshna are also working together to integrate front-end and back-end. Joshna worked on the database, integrating the front-end and back-end, and writing the translation function to translate from American English to braille to prepare for the demo. Some issues we ran into as a team is adjusting our design to now incorporate and arduino and RPi, and we received the incorrect linear rails for the gantry system.