Prototype

Briefing

Tasks

Round 1 Observations

User 1

Observations during trial

• Initially hit "manual" instead of "QR" when adding contact
• Got new mail when on contact screen, initially clicked their only contact to try to read the message. When the option menu popped up, they realized this was wrong and clicked the inbox icon.
• Clicked directly on the lock icon when adding Rob to contacts (this is correct, but the whole name was acceptable)
• Quickly clicked straight to contact list hen told to remove contact (correct)

User comments

• Was not clear how to remove all messages for a user initially
  • Looked for some remove-all command before trying to delete the contact
  • Found the remove-all button on attempting to delete
• Concerned about how to delete all messages after removing a contact (We didn't think of this yet--so something to keep in mind)
• Described it as "Overall very straightforward"
• Multiple/single person chat icons were fairly clear
• Wants to know how they would revert to single chat with a person when in multi-chat, having both run in parallel.

User 2

Observations during trial

• Took a couple seconds to find the "Add contact" button on the contact page, though it's the first/only they tried
• Asked "do you have a QR code?" to the 3rd party when prompted
  • Maybe we should make this step more obvious or explicit? Many people would have no idea what QR code means, even if they were looking at one.
• Wasn't too certain initially clicking "identity" to show QR code, though remarked "not immediately obvious, though makes sense. 'Identity' is good."
• On receiving message, took a little while to decide to click the message. Wasn't sure if it would bring to a chat window or if they would reply somehow from that page.
• "How would I add Rob to the chat?"
  • The other person added them to the chat, so I should be able to--otherwise that seems sketchy in a 'secure' application.
• "How do I know it's Rob?"
  • Concerned with adding contact they have not personally verified; notion of contact & trust tied in users mind
    • Should add a new color, indicating an added contact that is not explicitly trusted. (Yellow)
• Clicked lock icon next to Rob's name to add. Was concerned that the area was just the lock (it's not)
  • May be worth making it somehow clear the action area is the lock and name by tying them visually.

User comments

• Confused as to trusting vs adding as contact
  • "I can never message someone I don't trust--I consider a contact/trust to be different things"
• "Why would I want to have all-traces of a conversation deleted?"
  • Later remarked they understand it may be important for different users, just not them personally
• Linguistically confusing with using delete and remove interchangeably in the interface
• Make it more obvious that "Remove all messages" isn't a "confirm action" checkbox for safety, as it's a completely separate option
• I can't message someone I can't trust
  • Goes back to adding a new contact type, untrusted but on contact list with yellow icon.
• We should maybe add a "verified badge in addition to the lock icon" -- better clarity for n00bs.
• The lock icon has a good trust affordance

User 3

Observations during trial

• Was very quick opening contacts and clicking the add contact button; found them easily
• Remarked we may want to show a picture of a QR code instead of just saying "QR code" for clarity
• Was quick to hit identity when sharing contact information
• Clicked on name to open chat
• Surprised that when adding Rob, GUI elements turned red
  • "looks sketch" -- "does not look secure at all"
• Adding Rob to contacts was "so easy" compared to adding someone in person

• "Worried if I delete [Rob] first then I can't delete messages"

  • Was happy to see the open there on delete all messages when removing contact

User comments

• "Worried about paper trail" -- record on other party's phone despite deleting
  • e.g. group chat, wiping their messages leaves them on the other person's phone. Also, any messages said to them would still be there in a group chat setting, potentially giving stuff away.
• It's way too easy to add someone who is added to a chat, esp in comparison to normal addition of a contact
  • "Felt weird to add" via added introduction
  • Would "rather add everyone securely"
• Add an added-but-unverified category

Overall Observations

• Add a 3rd category of icon, a user who's a contact but not 'trusted' -- yellow icon would be a good indicator of this
• Allow inviting people to chat to make everything make sense
• Make it clear it's possible to wipe messages w/o deleting
• Make the 'wipe all messages' checkbox more obvious as to it's purpose--it's not a 'confirm action' checkbox, which it may be mistaken for by an inattentive user
• Make it clearer the lock icon AND name are clickable when in chat by tying them together somehow, so user isn't trying overly hard to aim on the lock only

Iteration 2