Design
Evaluation
Users
We personally approached our recruited users and asked about their interest to a test user for WebAnnotator. All three of them agreed immediately so we did not have to look for a 4th candidate.
The first user is a CS researcher at MIT. The other two are undergraduates of different age and do not major in CS. We believe that this well represents our user population (recall: students and researchers). Moreover, Our users are quite diverse as their academic backgrounds are different.
Nonetheless, our users may lack the diversity in age as they are all under 25.
Procedure
Our users were asked to perform the following tasks. A short briefing of what WebAnnotator achieves was given at the beginning. However, no information about the interface was mentioned. We also encouraged our users to speak up about their thought process. No demo was performed.
...