First Iteration of paper prototype
Host 1:
Setup stage:
*confused by why "upload" doesn't do anything (expecting some feedback?)
*not obvious what private/public means (for group's' viewing permissions) - maybe use different words
*might want to add more groups
Reviewing feedback stage:
*after clicking on the floating general comment on the bottom right hand side, wonders how to un-collapse
*when filtering feedback, confused by X,Y comments vs comments list
*not sure about tabs, would expects entirely new content, not filter -> maybe use boxes checked/unchecked to indicate filtering
*didn't notice/understand version UI ("timeline" confusing); suggested thumbnails for different versions
Host 2:
Setup stage:
*Doesn't see how to drag and drop art. confused as to lack of feedback in dialog. wonders why it doesn't show art, unclear how to advance. wonders why the upload link shows on the left
*Trouble finding next step button “customize critique”
*find back button “customize critique” confusing
Reviewing feedback stage:*Thinks timeline is a slider, would like to drag it to review feedback from different times, then tries to press it
*expects to see only comments pertaining to a specific version being viewed (good, this is the intend behavior)
*Doesn't immediately see who entered a specific comment
*wonders about the difference between annotations (comments localized on the pictures) vs overall comments on the right
*unsure how to filter comments by categories
*tabs are obvious
Host 3:
Setup stage:
*wondered if anything happens when dragging art into dotted square. Clicked upload after dragging art, confused about what the dialog box does, wanted to upload cat's photo again. didn't see anything happen after drag.
*not immediately clear how to get to the next step, but then found customized critique button.
Reviewing feedback stage:
*Hits friends tab first, taps technical comments, then general (never collapses)
*Presses mentor tab, accidentally erases checkbox on Technical.
*Clicks on URL in comment, but no UI for this
*wanted to slide timeline slider
*goes back to friends tab, then colleagues. satisfied things it's cool.
Commenter 1:
*Tried to drag the timeline “cursor”, surprised cannot drag, thought timeline would allow you to drag
*Unsure which version they are on - marker highlighting under timeline not clear enough
*Does not understand what the bottom right box is for (this was the box to fill comments not localized on the artwork picture)
*Highlighted Categories on the left are confusing. Expected they would change the image (as a filter?)
*when making a localized comment: would expect to be able to select/change (within the enlarged “bubble”) which “category” it pertains to rather than picking the type on the side bar.
Commenter 2:
(same person as Host 2)
*unclear that she can actually choose other categories (besides the one selected by default) on the left hand side. Thought that this comment markup area was for her comment
*confused about function of timeline
*no problem with star rating
*not obvious how to enter localized comments on picture (and this is after she knew that there was such a feature, from seeing the results as an artist reviewer), but then, cursors over to cat's face, able to enter comment.
*satisfies with bottom right comment UI
*POST button: would expets visual confirmation or dialog box for what it does – thought that entering a comment would already post it
Commenter 3:
*Wonders what the “post” button does – thought comments appeared automatically, assumed she is done*looking for who requested feedback* *
*see cursor for comments
*knows to click under timeline
*notices difference between location specific and other comments
*thinks the color green (for “default” category) is “her” color, instead of color of category (in comments)
*wants to edit her comments (both localized on the picture, and the non-localized on the right?) – type but cannot currently.
*Side bar on the left not intuitive - thinks of it as filters for comments of a category
Second Iteration of paper prototype
Host 4:
Setup stage:
*smooth upload (through browsing image files, clicking on an image to select it).
*setting a title: feel there could be a default title (such as the file name)
*not clear what a reviewer group is "I don't know if this means the reviewer can see the groups or i can see the groups". Would rather instead be asked "would do you like your reviewers to be?"
*select private: wanted the commenters see comments from within their groups only
Reviewing Feedback stage:
*overall rating very clear
*understand meaning of categories filters on the side
*satisfied to see annotation symbols on picture expand with comments
*satisfied with the exploration of previous versions by clicking
*did not try to explore the groups tabs at the top by herself, unsure what the effect of the tab may be ("would the default be all if there aren't multiple groups? I expected to see friends since this is the only group who I asked for feedback").
Host 5:
Setup stage:
*unclean about the meaning of groups
Review feedback stage:
*unclear what an overall comment is.
*wondering at first who the comment is from.
Host 6:
(same as commenter 6)
Setup stage:
*setup progress: would like to have a progress bar in the bottom (i.e. "step 1 of 3"). Also a way to skip to the end.
*categories: not completely sure how to use these categories, may want to ask a specific type of feedback that does not fit under these, through an optional textbox
*group members: wondered who are the members of each groups (mentors, colleagues). Ideally would drop down list of email in each? Define your groups with a drop down?
*group public/private: not clear. Maybe "drag for public/private comments"
Review feedback stage:
*no learnability issue with scrolling through comments, with filtering the comment by categories, expanding them, finding comments from previous version
*efficiency/safety issue: if host mouse through annotation on picture, it scrolls to the corresponding comment on right, host loses their position, which is disturbing if they scrolled to a particular comment on the right. No need for this double display.
*versions: would like to know how the feedback compares.
Commenter 4:
(same person as Host 4)
"am i supposed to give general feedback?" -- wasn't sure if the feedback category was what she selects or what the artist dictates
does it mean I am supposed to give technical feedback "coincidence that this category one is green?" confusing default selection
if I click hoover a comment is created
don't know why there are 2 ways to annotate: by clicking or annotating. "i don't know why there are two ways by annotating, but clicking and by dragging. it makes me feel like there are two tasks i'm supposed to do instead of just one task. I think the click anywhere to annotate thing was more clear than the pin thing". - "are there comments that aren't annotations?"
click anywhere to annotate was clear, more clear than the comments with the pen
edit the comments on the right hand side: "which one is edit?" "between the two icons i don't know what's edit and what's something else" -- was confused about the pin icon indicating that the comment was also an annotation. pin for annotation too close to edit they are similar confusing. feels like pin would be less confusing if it wasn't next to the edit button --> it looks like a button rather than just a label
- sees somebody else's comment and clicks on it to expand it --> "that's cool!"
- if she wanted to make a high level photo, she would just put it in the overall comments section and not worry about it
- "drag to annotate is kinda vague, i didn't know it meant to drag to a specific location, also have the option only once you've typed something"
Commenter 5:
(same person as Host 5)
I want to say that the grass needs more texture. I click on the grass. a bubble pops up. can I reference a painting. that's technical select radio button (was not clear that she would select the technical on her own non default)
rate the overall quality of the paining.
could I decide who will see my comments? (currently does not support it)
how about option to zoom in (magnifying glass) to look and add comments
would copy paste a comment on the right to hover. could not see the pin.
is it confusing that comments /annotation
Commenter 6:
hovering ove the emotional annotation. see the comment from Amy
I click on the sun. see the circle dot (what is it?). I see symbols what are these? "great sun maybe a little more..." I select technical
press enter. symbol appear on the sun. comment appears on the right
I can't see the details want to zoom.
Who draw this? (need a name of my friend the artist)
what is this called ? (title missing)
click on the reminds me of comment from kyle and see the URL link
really like. 4 star rating -> change it to 3 stars
comments on the tail - emotional
changed my mind on previous comment. remove it X on the right
I want to drag the symbols to be draggable to edit the place of the annotation
now general comment on the left .
anything happens when I hover on the right comment. yes it highlights the annotations.
The pin is optional . would be cool to start without the call out and then arrows to the spot with pin.
comments are color coded.
After you vote maybe see aggregate results
want to reply to this comment and annotation. agree/disagree with other people suggestions
not sure I want to see other people's feedback. discussion is good if a lot of people suggest the same things.
I may spend some time scrolling through
From usability: icons are good. pins similar for google map. pencil are good.
X appears after the comment can be clicked for editing (for safety)
categories really confusing
force me to make a decision. what if it's more than one categories.
Usability: hard to understand the symbols/categories. Maybe hashtags?
want to be able to hide the icons in the picture, so I can see the picture.
only if I mouse over the image they all show up.
two ways of exploring comments is nice.