...
- Task 2
- Did not realize that the search box implements only prefix search. Entered keywords like "abc" and "player".
- Located Had to locate the entry for "Project 1: An ABC Music Player" by manually searching through all the entries.
- Had some difficulty to go back to the dashboard from an annotated page. Did not remember that the button "Saved Pages" would bring her back to the dashboard. Recommended changing the wording to "All pages".
- The task was successfully completed otherwise.
- Task 3
- In the share dialog box, the "plus" button was not pressed before clicking "done".
- The task was successfully completed otherwise.
...
- Task 1
- Entered the URL for the Wikipedia homepagemain page. Tried to use the search box there to find a desired page before finding that the search box was disabled.
- Thought that highlighting a piece of already highlighted text would un-highlight it. Took quite a while to realize the delete button would show up when clicking on it.
- Tried to delete a note by highlighting the text in the note box.
- The task was successfully completed otherwise.
- Task 2
- Mistook the search box in the dashboard page with the functionality to "add a new page".
- Did not realize that the search box implements only prefix search. Entered keywords like "abc" and "player".
- Then tried to enter a URL in the search box to get to the page created in the last task.
- Finally, had to locate the entry for "Project 1: An ABC Music Player" by manually searching through all the entries.
- The task was successfully completed otherwise.
...
User 3 (Mechanical Engineering Undergraduate)
- Task 1
- Entered the URL for the Wikipedia main page. Tried to use the search box there to find a desired page before finding that the search box was disabled.
- Then tried to use the URL box as the google search box by entering a keyword. At this point the facilitator told her that a URL was needed.
- Tried to click the shortcut link to jump to some section in the Wikipedia article. Realized that hyperlinks are disabled.
- Didn't know how to add notes. Was looking for the button without success.
- Recommended that clicking (in addition to highlighting) should also make the annotation toolbar appear.
- The task was successfully completed otherwise.
- Task 2
- First used the search box thinking that it implements substring search. Then realized it actually implements prefix search. Found page successfully.
- The task was successfully completed otherwise.
- Task 3
- In the share dialog box, the "plus" button was not pressed before clicking "done".
- The task was successfully completed otherwise.
Interestingly, all three of our users chose a Wikipedia page even though nothing about Wikipedia was mentioned in any verbal or written description throughout the testing. This may indicate that Wikipedia articles are among the most popular webpages to be annotated and more effort should be geared to make our interface more usable for Wikipedia articles.
...