First Iteration of paper prototype: Usability issues
Host 1:
Setup:
*confused by why "upload" doesn't do anything (expecting some feedback?)
*not obvious what private/public means (for group's' viewing permissions) - maybe use different words
*might want to add more groups
Reviewing feedback:
*after clicking on the floating general comment on the bottom right hand side, wonders how to un-collapse
*when filtering feedback, confused by X,Y comments vs comments list
*not sure about tabs, would expects entirely new content, not filter -> maybe use boxes checked/unchecked to indicate filtering
*didn't notice/understand version UI ("timeline" confusing); suggested thumbnails for different versions
Host 2:
Setup:
*Doesn't see how to drag and drop art. confused as to lack of feedback in dialog. wonders why it doesn't show art, unclear how to advance. wonders why the upload link shows on the left
*Trouble finding next step button “customize critique”
*find back button “customize critique” confusing
Reviewing feedback:
*Thinks timeline is a slider, would like to drag it to review feedback from different times, then tries to press it
*Doesn't immediately see who entered a specific comment
*wonders about the difference between annotations (comments localized on the pictures) vs overall comments on the right
*unsure how to filter comments by categories
Host 3:
Setup:
*wondered if anything happens when dragging art into dotted square. Clicked upload after dragging art, confused about what the dialog box does, wanted to upload cat's photo again. didn't see anything happen after drag.
*not immediately clear how to get to the next step, but then found customized critique button.
Reviewing feedback:
*Hits friends tab first, taps technical comments, then general (never collapses)
*Presses mentor tab, accidentally erases checkbox on Technical.
*Clicks on URL in comment, but no UI for this
*wanted to slide timeline slider
Commenter 1:
*Tried to drag the timeline “cursor”, surprised cannot drag, thought timeline would allow you to drag
*Unsure which version they are on - marker highlighting under timeline not clear enough
*Does not understand what the bottom right box is for (this was the box to fill comments not localized on the artwork picture)
*Highlighted Categories on the left are confusing. Expected they would change the image (as a filter?)
*when making a localized comment: would expect to be able to select/change (within the enlarged “bubble”) which “category” it pertains to rather than picking the type on the side bar.
Commenter 2:
(same person as Host 2)
*unclear that she can actually choose other categories (besides the one selected by default) on the left hand side. Thought that this comment markup area was for her comment
*confused about function of timeline
*not obvious how to enter localized comments on picture (and this is after she knew that there was such a feature, from seeing the results as an artist reviewer), but then, cursors over to cat's face, able to enter comment.
*POST button: would expets visual confirmation or dialog box for what it does – thought that entering a comment would already post it
Commenter 3:
*Wonders what the “post” button does – thought comments appeared automatically, assumed she is done
*searching for who requested feedback
*see cursor for comments
*thinks the color green (for “default” category) is “her” color, instead of color of category (in comments)
*wants to edit her comments (both localized on the picture, and the non-localized on the right?) – type but cannot currently.
*Side bar on the left not intuitive - thinks of it as filters for comments of a category
Second Iteration of paper prototype: Usability issues
Host 4:
Setup:
*setting a title: feel there could be a default title (such as the file name)
*not clear what a reviewer group is "I don't know if this means the reviewer can see the groups or i can see the groups". Would rather instead be asked "would do you like your reviewers to be?"
Reviewing Feedback:
*did not try to explore the groups tabs at the top by herself, unsure what the effect of the tab may be ("would the default be all if there aren't multiple groups? I expected to see friends since this is the only group who I asked for feedback").
Host 5:
Setup:
*unclean about the meaning of groups
Reviewing feedback:
*unclear what an overall comment is.
*wondering at first who the comment is from.
Host 6:
(same as commenter 6)
Setup:
*setup progress: would like to have a progress bar in the bottom (i.e. "step 1 of 3"). Also a way to skip to the end.
*categories: not completely sure how to use these categories, may want to ask a specific type of feedback that does not fit under these, through an optional textbox
*group members: wondered who are the members of each groups (mentors, colleagues). Ideally would drop down list of email in each? Define your groups with a drop down?
*group public/private: not clear. Maybe "drag for public/private comments"
Review feedback:
*efficiency/safety issue: if host mouse through annotation on picture, it scrolls to the corresponding comment on right, host loses their position, which is disturbing if they scrolled to a particular comment on the right. No need for this double display.
*versions: would like to know how the feedback compares.
Commenter 4:
(same person as Host 4)
"am i supposed to give general feedback?" -- wasn't sure if the feedback category was what she selects or what the artist dictates. does it mean I am supposed to give technical feedback "coincidence that this category one is green?" confusing default selection
*confused about "double duty": "i don't know why there are two ways to annotate, but clicking and by dragging. it makes me feel like there are two tasks i'm supposed to do instead of just one task. I think the click anywhere to annotate thing was more clear than the pin thing". "are there comments that aren't annotations?"
*comments with the pen and then dragging is less obvious to this user than clicking anywhere on picture to annotate
editing the comments on the right hand side: "which one is edit?" -- confused about the pin icon indicating that the comment was also an annotation. pin for annotation too close to edit they are similar confusing. feels like pin would be less confusing if it wasn't next to the edit button --> it looks like a button rather than just a label
*"drag to annotate is vague", i didn't know it meant to drag to a specific location, also have the option only once you've typed something"
Commenter 5:
(same person as Host 5)
*category input not obvious: upon entering an annotation by clicking, was not clear she should select the category (e.g. "technical") on her own (as opposed to the default)
*wanted to decide who will see her comment but currently this is not supported as the host decided on visibility.
*would like to zoom in (magnifying glass) on a section of the picture to look better (especially if area is cluttered with feedback icons) and add comment, but currently not supported
*would copy paste a comment on the right to hover. could not see the pin.
*confused about the difference between comments on the right and annotations (double display in some cases)
Commenter 6:
*want to be able to hide the icons in the picture, so I can see the picture. only if I mouse over the image they all show up.
*wanted to zoom, can't see the details
*want to see the name of the artist who drew this piece, as well as what it is called (missing title)
*want to drag the symbols to edit the place of the annotation (safety issue)
*about the pin (comment on the right and then dragging): "would be cool to start without the call out and then arrows to the spot with pin."
*would like to see aggregated results maybe after the star rating
*may want to reply to a specific comment and annotation. agree/disagree with other people suggestions. on the other hand not sure want to see other people's feedback. discussion is good if a lot of people suggest the same things.
*may spend some time scrolling through
*From usability: icons are good. pins similar for google map. pencil are good. X appears after the comment can be clicked for editing (for safety)
*categories really confusing - forced to make a decision. what if it's more than one categories. from a usability perspective: hard to understand the symbols/categories.