• *Prototype photos.*Digital photos of the pieces of your prototype. Show the prototype in interesting states; don't just show a blank window. Although you will iterate your paper prototype during this assignment, the photos only need to show one iteration.
  • *Briefing.*The briefing you gave to users.
  • *Scenario Tasks.*The tasks you gave to users, as you wrote them on the cards.
  • Observations.*Usability problems you discovered from the testing. Describe critical incidents encountered by the users, but *don't record users' names. Record these as a series of high-level takeaways, focusing on the usability problems you saw, rather than what each participant did. For instance, you might describe how you had some learnability issues with your prototype, as evidenced by users B and C clicking all of the menus to try to find option X.
  • *Prototype iteration.*You did two rounds of paper prototyping. Describe how your prototype changed between those two rounds.

Iteration 1:

Prototype Photos 

 

When the user logs in, the screen will direct the user to add new medication.

 It will then ask what type of medication it is.

 

The system will ask the user to fill out detailed information of this medication.

 

This is the page where all the medications will be shown. 

 

The user can click on add pills to edit the drugs.

When user deletes any drug, a screen will pop up to reconfirm it. 


When user click on the drug button on the home screen for drug that has been taken, a screen will pop up to reconfirm it.

Missed drug will be on the very top of the screen.

When the user clicks on the missed drug, a screen will pop up as the following.

When the user clicks on Ask Doctors, a list of doctors will appear.

On the doctor's screen, the doctor will be able to see a list of drug that the user is taking. When the drug button is clicked, it will show a calendar displaying dates when the user misses the drug.

The doctor can also add medication for the user and it will be updated to the user's app.

This is a chatbox for the doctor to communicate with the user. The most recent message will pop up for the doctor.

Briefing

Patient:

  • You are a patient taking several drugs at different times of the day but sometimes you forget about them.. You want to keep track and be reminded to take them correctly by using this mobile app.

Doctor:

  • You want to hear immediate feedback from your patients about their medications. The doctor version of Take Your Pills allow you to communicate with your patients and check their medications records.

Scenario Tasks

Patient:

  • You want to add Drug A to your medications. You take 2 pills of Drug A everyday at 2PM and 6PM.
  • You want to add Drug B to your medications. You take 1 pill of Drug B every 5 hours starting from now.
  • You realized that you actually made a mistake about Drug A. You want to remove it from all your medications.
  • You are having a headache for no reason. You are not sure if this is related to any medicine that you are taking. You want to contact your doctor.

Doctor:

  • Check if there is any new notes from your patients.
  • It seems that your patient Eric is having a headache. You want to check his medication history especially that of Drug C for this week.
  • You think Eric is having his headache because he missed Drug C. You want to tell him about it.
  • You want Eric to start taking Drug E.

User Observations and Feedback

Below are our observations from each user.  We also asked each user for feedback after they have completed all the tasks.

User 1
Observations:

  • Patient
    • did not notice the 24-hr time selector
    • clicked on DrugA to edit (mis-functionality: clicking on DrugA button prompts users whether they have taken the drug at an earlier time, missed the drug, or will be taking the drug now)

Feedback:

  • what about users who do not want to interact every few hours with app (busy lifestyle and just wants to deal with app like once a day)

User 2
Observations:

  • Patient
    • did not notice the 24-hr time selector; realized and then selected correct time
    • clicked on DrugA to edit (mis-functionality: clicking on DrugA button prompts users whether they have taken the drug at an earlier time, missed the drug, or will be taking the drug now)

Feedback:

  • how to get chat message from doctor after moving to a different page, any notifications?
  • if patient sees multiple doctors, is there privacy/sand-boxing among doctors and drug info?
  • Took it/missed it/take it now - confusing wording between "took it" and "take it now" (what's the difference between just took it and taking it now?)

User 3
Observations:

  • Patient
    • did not notice the 24-hr time selector; realized and then selected correct time
    • clicked on DrugA to edit (mis-functionality: clicking on DrugA button prompts users whether they have taken the drug at an earlier time, missed the drug, or will be taking the drug now)
    • confused about how to go back to main page ("Today" not clear)
    • how to undo mistakes (ie clicked on "Took it" but wanted to change answer)

Feedback:

  • interface looks like a chart
  • edit drug page confusing
  • don't know how to undo mistakes and escape from pages or dialog boxes
  • would not chat with doctor (would prefer email or something less informal)
  • less screens

User 4
Observations:

  • Patient
    • did not notice the 24-hr time selector; realized and then selected correct time
    • clicked on DrugA to edit (mis-functionality: clicking on DrugA button prompts users whether they have taken the drug at an earlier time, missed the drug, or will be taking the drug now)
    • accidentally clicked on "Took it" instead of "Take it now" and did not know how to undo

Feedback:

  • "My Pills" page has too much stuff; app has too many pages
  • Took it/missed it/take it now - confusing wording between "took it" and "take it now" (what's the difference between just took it and taking it now?)
  • Was not sure what kind of input was pill dosage (text field)

User 5
Observations:

  • Patient
    • clicked on "Add Pill" on page description instead of actual tab at the top
    • did not notice the 24-hr time selector; realized and then selected correct time
    • did not know end date/start date were optional
    • Cycle length dropdown vs clock widget confusion (we used the same one)
    • tried swiping on DrugA button to edit (mis-functionality: clicking on DrugA button prompts users whether they have taken the drug at an earlier time, missed the drug, or will be taking the drug now)
    • did not know how to navigate away from "Chat" page
  • Doctor
    • clicked on patient name in chat
    • confused where to add drug
    • drop down options confusing

Feedback:

  • "My Pills" page was confusing; what was difference from "Today" page (both were a list of your drugs)
  • hard to get to specific "Patient's Page" without having search for patient each time
  • can look for specific date in calendar? can add doctor's notes to calendar?

User 6
Observations:

  • Patient
    • did not notice the 24-hr time selector
    • Cycle length dropdown vs clock widget confusion (we used the same one)
    • did not know to click outside the dialog box to escape
    • clicked on DrugA to edit (mis-functionality: clicking on DrugA button prompts users whether they have taken the drug at an earlier time, missed the drug, or will be taking the drug now)
    • "Today" vs "My Pills" tabs were confusing
  • Doctor
    • tried to get to "Patient's Page" by clicking on Patient's picture
    • tried to get to "Patient's Page" by clicking on Patient's name in the left column list
    • red-marked dates in calendar - don't know if that means Patient should take drugs on those days or Patient missed drugs on those days
    • clicked on DrugC button to edit (mis-functionality: clicking on DrugC button marks in red the dates of the calendar that Patient missed drugs)
    • does not know how to go back or escape pages

Feedback:

  • what to do if "miss" many drugs (ie did not use app to log several drug-taking events, for example on a weekend trip without wifi or batteries)
  • how to clear all
  • are there alarm settings
  • what about users who do not want to interact every few hours with app
  • suggests if press drug button, it selects, and edit/delete buttons show up for selected drug

Iteration 2:

Prototype Iteration

We made changes to our prototype after our first round of testing, mostly to simplify the user interface and clear confusions users have.  Here is a list of our changes:

Patient

  • "Today", "My Pills" "Add Pills" were condensed into one main page. User can now both edit the drugs (including add and delete) and record actions with the drugs (take it, missed it) on the same page.
  • Removed "current date and time" from the time bar since it is obvious. Time is now in the bar that has "contact doctor" and "sign out".
  • Clicking on the medicine now leads the user to the info page of the medicine, where user can edit and delete that medicine.
  • Recording actions with medicine is now handled with a pop up box when user clicks the check box on the left of the medicine.
  • Changed the "add drug" page. Now all three types of drugs are handled by one dynamic page that changes when selecting different options. 
  • Add AM/PM to drug time "widget".
  • In "repeat every several hours" option, now "minutes" only has "00" and "30".
  • Clicking the "pencil" icon on main page now leads to "edit drugs" page.

Doctor

No change

Prototype Photos

 "Today", "My Pills" "Add Pills" were condensed into one main page. User can now both edit the drugs (including add and delete) and record actions with the drugs (take it, missed it) on the same page.

 Removed "current date and time" from the time bar since it is obvious. Time is now in the bar that has "contact doctor" and "sign out".

Clicking on the medicine now leads the user to the info page of the medicine, where user can edit and delete that medicine.

Changed the "add drug" page. Now all three types of drugs are handled by one dynamic page that changes when selecting different options

.

Add AM/PM to drug time "widget".
In "repeat every several hours" option, now "minutes" only has "00" and "30".

Clicking the "pencil" icon on main page now leads to "edit drugs" page.

Briefing

Patient:

  • You are a patient taking several drugs at different times of the day but sometimes you forget about them.. You want to keep track and be reminded to take them correctly by using this mobile app.

Doctor:

  • You want to hear immediate feedback from your patients about their medications. The doctor version of Take Your Pills allow you to communicate with your patients and check their medications records.

Scenario Tasks

Patient:

  • You want to add Drug A to your medications. You take 2 pills of Drug A everyday at 2PM and 6PM.
  • You want to add Drug B to your medications. You take 1 pill of Drug B every 5 hours starting from now.
  • You realized that you actually made a mistake about Drug A. You want to remove it from all your medications.
  • You are having a headache for no reason. You are not sure if this is related to any medicine that you are taking. You want to contact your doctor.

Doctor:

  • Check if there is any new notes from your patients.
  • It seems that your patient Eric is having a headache. You want to check his medication history especially that of Drug C for this week.
  • You think Eric is having his headache because he missed Drug C. You want to tell him about it.
  • You want Eric to start taking Drug E.

User Observations and Feedback

Below are our observations from each user.  We also asked each user for feedback after they have completed all the tasks.

User 1

Observations:

  • Patient
    • Was confused about the "Today" button.
    • when asked to add drug that is not time and cycle specific, the patient still choose the cycle option.
    • Patient did not know the pensil button represent edit the drug list.
  • Doctor
    • Was confused about the drug list next to the calendar. 

Feedback:

  • Suggested to have a PDR system that will check the side effects of all the drugs that user is taking.
  • When the user delete drugs, it will send notification to the doctor.
  • Can potentially integrate technology of using phone to scan the bar code to enter the medication info  

User 2

Observations:

  • Patient
    • User tried to find the History button on the tab area
    • want the edit to be next to the medication button
  • Doctor
    • Confused about the drug type selection, same problem as in the patient app

Feedback:

  • Give doctor "contract indication," which will tell the doctor what medication not to prescribe to the patient when the patient is using other medication
  • App can also record the mood and pain level of the patient for doctor's need

User 3

Observations:

  • Patient
    • Did not check the box before clicking on the edit button
    • Didn't know how to distinguish missed it and took it button
  • Doctor
    • Confused about whether the he needed to click on drug A button first in order to edit the drug

Feedback:

  • Give better description or tutorial for the app
  • No labels

1 Comment

  1. Prototype: Photos: Clear and shows the important states of the system.
    Iteration Changes: Were made  based on observations, and were thoughtful and analytical

    Briefing & scenario tasks:
    Briefing: Clear, and concise. Specific to each type of user group being tested.
    Tasks: Numerous tasks (some of which could be clssified under the same high-level tasks and are more of steps)

    User testing observations: No. of users: 6. Good!
    Observations: Thorough observations and feedback recevied. It would have been better to identify these problems according to which dimensions (learnability/efficiency/safety) they belonged to. Also, the observations could have high-level take-aways, in addition to listing the problems encoutered. (e.g., The time selector was not visible, and there was an issue with internal consistency by using the same ccle length dropdown and clock widget when they should have been different)

    Wiki presentation: Good

    Overall: The photographs added for the prototype iteration, and the description did well to convey the signs of iterative design. Overall, good job! I think the project is coming along well!