Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 4.0

...

  1. Find a tour of MIT's campus.
  2. Follow a tour around MIT's campus.
  3. Make a tour of MIT's dorms that includes Baker, East Campus, and Burton-Conner.

Observations

(right now these are the direct notes; we need to analyze/summarize them)

...

Observations of Original Interface

The list below is a summary of our observations from user studies. For more information, view the paper prototyping notes that we took during the trials.

  • Task 1: Find a tour
    • The home screen was not confusing, users knew what they wanted to click on.
    • When presented with a blank map, users were unsure what to do to find a tour.
    • Users thought that selecting landmarks for a tour felt like building a new tour. It was unclear that they were choosing search criteria.
    • It was not clear that users should switch tabs to remove landmarks from their criteria.
    • The "View Tours" button should be greyed out to indicate that it is not enabled at the start
    • Tapped on the general area of MIT, but there was no response
    • Tapped "View Tasks", but there was no response
    • Tapped on a landmark (Killian Court), and the info popped up
    • Thought that he was searching for tours, but the text "Add Tours" makes it seems as if he was creating a tour
    • Said there was not enough visibility on the original screen of what's in the database (i.e. display something on the map)
    • Should grey out the "View Tour" button if it's not active
    • If there's 1 tour with the landmarks chosen, should it go straight to the tour details instead of the list view?
  • Task 2: Follow a tour
    • The "Begin Most users found the "Follow Tour" button is not visible (wanted to click on the landmarks to start the tour). Consider moving to the top?
    • Keep scale in mind - will the list of landmarks be scrollable, etc.
    • Why can't I start the tour where I am? Or at another place of my choosing?
    • How can I reorder the landmarks on the tour?
    • Thought the arrows would change the view to show different maps/tours
    • There's a problem in the mental model of the arrows between left/right and up/down
    • Maybe we should highlight the nearest landmark
    • When do you click the arrow, there is no feedback in the list to show that it has advanced
    • Maybe if you embed unique icons into the map, users would see a relationship between the list and the mapeasily, although one thought it should be more prominent
    • Users did not know what their first step should be, as there was no path from their current location to the start of the tour.
    • Users expected some sort of feedback as they moved around, such as highlighting the closest landmark.
    • The arrows to flip through the directions were confusing, most users did not understand what they were for. One user was confused because left/right arrows were scrolling the directions up/down.
    • Some users wanted the ability to edit the tour as they were following it, perhaps by removing landmarks or changing the order.
  • Task 3: Create a tour
    • Don't see any way to exit the current view, except the standard Android back button. Users don't like to use that if they're deep in an app
    • Maybe add a "modify tour" button so users can just alter a pre-existing tour
    • Take advantage of the mobile app - maybe allow the user to make a tour as they're walking around to each landmark
    • Same "Add to Tour" text as when finding a tour, but a different effect - confusing
    • Added landmarks to the tours in the wrong order, at first unsure how to reorder
    • "If I want the tour to backtrack... how do I do that?"
    • Liked the list interface for reordering the tour
    • Consider combining the list and map views onto one page, although you may have to drag landmarks far (and that would be inconvenient if the screen was split)
    • "I don't know estimated time", maybe we should provide distance/time/stops
    • Also could provide distance/time/stops feedback on the screen as the user is building the tour
  • User 2
    • Task 1: Find a tour
      • At first, wanted to select an area on the map (by dragging an area with multitouch) to define where the tour was going to take place
      • When that didn't work, tapped directly on map and added landmark to tour
      • Didn't understand what "adding" a landmark to the tour did until he saw the help text
      • Pressed "View Selected" to see what it did, realized that it was to edit what he had already selected
      • Once the 1 tour was returned, he knew the arrow meant to click it to select it
      • "All the things listed are in the tour"
      • Wanted to remove things from the tour - it included landmarks he hadn't selected
    • Task 2: Follow a tour
      • Found the "Follow Tour" button easily
      • Clicked arrows immediately... didn't like the result, but he knew how to undo it
      • Confused by what the arrows mean in general
      • "I walk up to the Media Lab... what happens?"
      • Wanted to see an arrow leading him to the start point of the tour
    • Task 3: Create a tour
      • Hit the "Back" button repeatedly until he saw the home screen
      • Clicked on the landmarks he wanted to add, seemed familiar with the interface
      • "I'm familiar with the campus so it's easy to locate" landmarks
      • Very averse to typing or using voice to search, would much rather click on places
      • "This isn't the shortest path", tried to drag the path to modify it
      • Saw the "Save Tour" button when he wanted it, and clicked it
      • It might make sense to put the map/list view on the same page
  • User 3
    • Task 1: Find a tour
      • Clicked "Find a Tour"
      • Initially looked at the map a long time, looked unsure what to do
      • Later commented "I was hoping to see landmarks to choose from"
      • After selecting two landmarks, he hit "Find Tour"
        • We asked him what he expected to see, he said he expected to see a list of tours that include those two locations (help text probably assisted on that one)
    • Task 2: Follow a tour
      • Found and clicked "Begin Tour" immediately
      • Expected a path from current location to the beginning of the tour, or "wherever I'm supposed to go"
      • Touched the Killian Court list item because he wanted to go there, did not have the expected effect
      • "I walk to Killian... then I follow the path to Kresge"
      • Only interested in the landmarks he chose, did not want to have to stop at the others
      • "I would expect it to tell me where to go" (as in specific instructions)
      • Not sure what the arrows are, maybe there are more/other landmarks to look at
      • You could also show other interesting stuff on the way to a landmark, and show more info about the landmark when you get close to it
    • Task 3: Create a tour
      • "Keep hitting back until I see the home screen"
      • Didn't know where Burton-Conner was, but he knew to search for it
      • We asked what he would do if he wanted to change the order, he said he would try to drag the path, or look to the bottom for an "edit" button next to "savE"
      • When he went to the list view, he realized he could drag the order around

Summary & Analysis of Original Interface

Observations of Revised Interface

(right now these are the direct notes; we need to analyze/summarize them)

    • Users remembered the "Create a tour" button on the home screen, and mostly knew to use the Android back button to get there. One user also wanted a virtual back button.
    • Some users thought they might want to start with an existing tour and modify it, instead of starting a tour from scratch. Our application does not currently support that feature.
    • One user added the landmarks in an inefficient order, but did not realize that the order you add the landmarks was also the tour order until the map drew the tour path. It was also not clear to the user to switch tabs in order to remove/reorder landmarks.
    • The affordances on the landmarks in list view did communicate to the users that they could reorder the list.
    • When adding a landmark that the users did not know the location of, it was clear to the users that they could search to find it.
    • Some users felt that the list view and map view should be combined into one view, because they're so closely linked.

Observations of Revised Interface

The list below is a summary of our observations from user studies with a revised paper prototype. For more information, view the paper prototyping notes that we took during the trials.

  • Task 1: Find a tour
    • Users wanted to see a list version of all tours and have a way to filter that list, rather than start with the landmarks and then filter
    • Users wanted to see routes shown/made based on user's location
    • In the revised interface, users were not confused about how to find a tour, and they knew what to do
  • Task 2: Follow a tour
    • Users found the "Follow Tour" button easily and knew what to do when following the tour (which was not the case before the revisions)
    • Users felt that the tour should react to user's location and give directions based off of geolocations
    • Users felt that there should be an easy way to modify tour once they had started
    User 1
    • Task 1: Find a tour
      •  "I want to include things on MIT's campus"
      • Clicked on Killian, Stata, and Kresge to add them
      • "I want my tour to have 3 places"
      • Saw the text that said 1 tour was found, but he misinterpreted it. "I assume this now says 3... oh, I misread it"
      • Clicked view tours, and then on the MIT tour
    • Task 2: Follow a tour
    •  Clicked follow tour immediately, then began to narrate what he would do
    • "I will go outside and orient myself." "I walk down Memorial Drive" "I follow the green line to Kresge"
    • Had a good understanding of what he should do, which was not present before the revisions
    • Wondered if he could reorder the path while following the tour
  • Task 3: Create a tour
    •  Did NOT use Users remembered the "create Create a tour" button on the home screen, but instead went back to the MIT tour and clicked "modify"
    • Removed all landmarks in the tour
    • Searched for the dorms because he wasn't sure exactly where they were, but he did not realize he could just click on them
    • Confused about the blank time boxes... perhaps they should be autopopulated with something
    • General comments
      • "When finding a tour, it seemed like I was building a tour instead of searching"
      • Wanted to see all the tours, and then have the option to filter (instead of putting in search criteria first)
  • User 2
    • Task 1: Find a tour
      • First, he asked to understand the phone interface: what do the Android buttons at the botton do?
      • Described what he's viewing and remarks that he understands what he's seeing
        • "there's a map that knows where I am by geolocating"
        • "lots of pins" "pins are landmarks"
      • He selected three landmarks
      • It made sense and he pressed "View Selected" to see the tours 
        • claims that this app helps understand the city better, gives an "inverted sense of city"
    • Task 2: Follow a tour
      • Found the "Follow Tour" button easily
      • He said that he was in an "interesting predicament" when he first started following tour, closer to another stop, but tour "wants me to go to Kresge first"
        • He asked himself, what should I do "follow the app or disobey?"
      • He decided to follow the tour, which is easy to do
      • Clearly understood steps of following a tour
      • Confused about how to go back to home screen?
        • There is no easy way
    • Task 3: Create a tour
      • Finally he hit the "Back" button repeatedly until he saw the home screen
      • Seemed familiar with the interface
      • Added Baker, dismissed Baker, and added Burton-Connor to the tour because he did it in the wrong order
      • After he added Burton-Connor, he remarked that he now sees that he could've rearranged them and that its clear
      • Saw the "Save Tour" button when he wanted it, and clicked it
    • General Observations/Comments
      • He commented that he wished he could reorder the events once following a tour
        • Have a modify button on the follow tour screen
      • Was glad that it reacted to you disobeying the tour (because the tour is location-based)
      • Asked if there was a way to specify stop time in addition to travel time
      • Wished he could add his own descriptions about the stop to the stop description
  • User 3
    • Task 1: Find a tour
      • Comments that it "geo-locates me"
      • Initially confused by all the landmarks. 
        • Clicks on the list options button expecting to see a list view
        • Asks for a list view where he can just check all the landmarks he wants
        • Gives example of NYC and says would just want to check off "Sears Tower, Empire State Building, etc"
      • After selecting two landmarks, he hits "Find Tour"
    • Task 2: Follow a tour
      • Found and clicked "Begin Tour" immediately
      • Wanted to start somewhere else then what told by tour
        • Said he wouldn't follow tour if it didn't make sense to him, but he would not take the time to modify tour either
        • He would just follow what he wanted and would want the app to follow along with him and keep track of where he's going
    • Task 3: Create a tour
      • "Keep hitting back until I see the home screen"
      • "how big is the description bubble on the phone?"
      • When adding landmarks, he wanted to add his own descriptions for the stops
    • General Comments/Observations
      • Should make the route based on user's geolocation, instead of have user modify routes
      • Wanted to add custom locations
      • Wanted to add/edit description of specific stops
      • Should be able to develop routes on the fly
        • "the user shouldn't have to tell the app where he/she's going"

Summary & Analysis of Revised Interface

Prototype Iteration

(we need to do this)

To Do

...

    • and mostly knew to use the Android back button to get there.
      • Users, however, thought it might be useful to have a quick button to get to home from other screens
    • Users wanted to add custom locations
    • Users wanted to take already known landmarks and add their own descriptions
    • Users asked if there was an easy way to detail the expected spent time at each stop when creating a tour

Prototype Iteration

First Round Changes

  • Screen #2 - Changed text next to "View Tours" button from directions to a display of the number of locations selected and the number of tours that contain those selections.
    • Accomplishes the goal of letting users know the purpose of selecting landmarks from the map in a more efficient manner by providing useful information and eliminating the need for explicit instructions
  • Screen #2 - Populate the map with all the available landmarks.
    • Users now have the ability to see what landmarks are available and no longer have to guess places on the map.
  • Screen #8 - Removed the arrows intended to move forward/backward between steps in the directions.  User can now select which location they wish to go to by selecting it from the list.
    • Arrows were confusing for users and did not provide that much benefit.  This change accomplishes the same task in a more intuitive manner.

Second Round Changes

  • Screen #3 - Changed button to "Select for Tour."
    • "Add to Tour" was giving users the wrong message.  This new wording points them in the right direction.
  • Screen #3 - Add "Average Time Spent Here" to pop-up info when landmarks are clicked.
    • Useful information for users.
  • Screen #7 - Added a "Modify Tour" button that takes users to the create tour area with the selected tour's landmarks already in place.
    • Allows users to modify preexisting tours (add desired landmarks, remove unwanted landmarks, reorder landmarks) without having to create a new tour from scratch.
  • Screen #8 - Added and "Edit" button that allows users to reorder the landmarks in the tour.
    • Feature for users that do not wish to follow the landmarks in the predetermined order.  Useful if starting location is far from the start of the tour

...