First Iteration of paper prototype: Usability issues
Host 1:
Setup stage:
*confused by why "upload" doesn't do anything (expecting some feedback?)
*not obvious what private/public means (for group's' viewing permissions) - maybe use different words
*might want to add more groups
Reviewing feedback stage:
*after clicking on the floating general comment on the bottom right hand side, wonders how to un-collapse
*when filtering feedback, confused by X,Y comments vs comments list
*not sure about tabs, would expects entirely new content, not filter -> maybe use boxes checked/unchecked to indicate filtering
*didn't notice/understand version UI ("timeline" confusing); suggested thumbnails for different versions
Host 2:
Setup stage:
*Doesn't see how to drag and drop art. confused as to lack of feedback in dialog. wonders why it doesn't show art, unclear how to advance. wonders why the upload link shows on the left
*Trouble finding next step button “customize critique”
*then, find back button “customize critique” confusing
Reviewing feedback stage:
*Thinks timeline is a slider, would like to drag it to review feedback from different times, then tries to press it
*expects to see only comments pertaining to a specific version being viewed (good, this is the intend behavior)
*Doesn't immediately see who entered a specific comment
*wonders about the difference between annotations (comments localized on the pictures) vs overall comments on the right
*unsure how to filter comments by categories
*tabs are obvious
Host 3:
Setup stage:
*wondered if anything happens when dragging art into dotted square. Clicked upload after dragging art, confused about what the dialog box does, wanted to upload cat's photo again. didn't see anything happen after drag.
*not immediately clear how to get to the next step, but then found customized critique button.
Reviewing feedback stage:
*Hits friends tab first, taps technical comments, then general (never collapses)
*Presses mentor tab, accidentally erases checkbox on Technical.
*Clicks on URL in comment, but no UI for this
*wanted to slide timeline slider *goes back to friends tab, then colleagues. satisfied things it's cool.
Commenter 1:
*Tried to drag the timeline “cursor”, surprised cannot drag, thought timeline would allow you to drag
*Unsure which version they are on - marker highlighting under timeline not clear enough
*Does not understand what the bottom right box is for (this was the box to fill comments not localized on the artwork picture)
*Highlighted Categories on the left are confusing. Expected they would change the image (as a filter?)
*when making a localized comment: would expect to be able to select/change (within the enlarged “bubble”) which “category” it pertains to rather than picking the type on the side bar.
...
*unclear that she can actually choose other categories (besides the one selected by default) on the left hand side. Thought that this comment markup area was for her comment
*confused about function of timeline
*no problem with star rating
*not obvious how to enter localized comments on picture (and this is after she knew that there was such a feature, from seeing the results as an artist reviewer), but then, cursors over to cat's face, able to enter comment.
*satisfies with bottom right comment UI
*POST button: would expets visual confirmation or dialog box for what it does – thought that entering a comment would already post it
...
*Wonders what the “post” button does – thought comments appeared automatically, assumed she is done
*looking searching for who requested feedback* *
*see cursor for comments
*knows to click under timeline
*notices difference between location specific and other comments
*thinks the color green (for “default” category) is “her” color, instead of color of category (in comments)
*wants to edit her comments (both localized on the picture, and the non-localized on the right?) – type but cannot currently.
*Side bar on the left not intuitive - thinks of it as filters for comments of a category
Second Iteration of paper prototype: Usability issues
Host 4:
Setup stage:
pressed the browse then click an image then press done
press title portrait - Feel they could have *setting a title: feel there could be a default title (like such as the file name) - "I don't know why it's untitled--maybe should have a default title from filename"
press next
press choose critique category. Select emotionalselect review group.
*not clear what a reviewer group is instead say "would do you like your reviewers to be " - "review groups felt like a term she was not familiar with--would rather have it posed as a quest: 'who do you want to review?'" - "I don't know if this means the reviewer can see the groups or i can see the groups"
select private: want the review see comments from within groups
Feedback stage:
Cool, I got 4.5!
I wonder if these tags (categories) were made by the reviewer or if I made them. - "I wonder if the reviewers made the tags or if i made them some time in the past--if the reviewers made them then that's cool"
-was able to understand meaning of icons from categories on the side
-noticed that the comments cover the photo when expanded - Expands annotation symbols
. Would rather instead be asked "would do you like your reviewers to be?"
Reviewing Feedback:
*"would the default be "All" in the tabs if their are not multiple categories"
explores version: want to click on older version "haha rob miller likes it"
"filter by" deselect all and click emotionnal
"reminds me" of brings up
did not try to explore the groups tabs at the top by herself. , unsure what the effect of the tab may be ("would the default be all if there aren't multiple groups? confusing I expect expected to see friends since this is want I selectedthe only group who I asked for feedback").
Host 5:
Setup stage:
first thing I would do is title it. upload picture. get replaced done
customize my critique
i would like both emotional and technical then next
"i would like only my mentors to see..." "what is other groups mean?". (after explanation) "I want these people not to see..."
Review feedback stage:
who wrote those tags?
if I only want to see this type of feedback? ok i would click these boxes
overall comments: how do I know from who. now I want to only see from mentor. ok. now what my colleagues said
what's an overall comment?
what do my friend say? reminds me of will bring hyperlink in browser
I want to see last updated version
cool that's awesome
:
*unclean about the meaning of groups
Reviewing feedback:
*unclear what an overall comment is.
*wondering at first who the comment is from.
Host 6:
(same as commenter 6)
Setup stage:
drag the picture from desktop. Enter title on top. Next.
would be nice *setup progress: would like to have a progress bar in the bottom (i.e. "step 1 of 3 on the bottom")
. Also a way to skip to the end.
Click everything in categories (maybe I don't know the difference between contextual or Technical... some help?) maybe I *categories: not completely sure how to use these categories, may want to ask a specific question type of feedback that does not fit under something. Not sure how to use these categories. Maybe optional textbox asking for specific type of feedbackgroups: Are these groups I have already setup. Who these, through an optional textbox
*group members: wondered who are the members of these each groups ? (mentors, colleagues). Ideally would drop down list of email in each? Define your groups with a drop down?
select mentors colleagues private
I don't really understand what private/public will be. maybe less text here, change the title "drag here for public comments" "drag here for private comments"
Review feedback stage:
Like the overall rating
bunch of comments I can scroll through on rate. I like it. Also filters.
expanding by clicking will scroll to that comment on the right and expand comment
if only check general. Have only general comments
looks like there are version. I want to see comments for old version. click on it. refresh the picture.
curious what mentors said about it. I see a rating and comments from mentors. version did not change. change the comments
confusing: if I mouse on annotation it also scrolls on the right, I lose my position. No need to double display, I don't want to lose my position if I scrolled somewhere on the right.
categories confusing.
*group public/private: not clear. Maybe "drag for public/private comments"
Review feedback:
*efficiency/safety issue: if host mouse through annotation on picture, it scrolls to the corresponding comment on right, host loses their position, which is disturbing if they scrolled to a particular comment on the right. No need for this double display.
*versions: would like versions I want to know how the feedback compares.
Commenter 4:
(same person as Host 4)
does "am i supposed to give general feedback?" -- wasn't sure if the feedback category was what she selects or what the artist dictates. does it mean I am supposed to give technical feedback "coincidence that this category one is green?" confusing default selection if I click hoover a comment is created
*confused about "double duty": "i don't know why there are 2 two ways to annotate: by clicking or annotating., but clicking and by dragging. it makes me feel like there are two tasks i'm supposed to do instead of just one task. I think the click anywhere to annotate thing was clear, more clear than the pin thing". "are there comments that aren't annotations?"
*comments with the pen and then dragging is less obvious to this user than clicking anywhere on picture to annotate
editing edit the comments on the right . hand side: "which one is edit.
this hoovers is confusing,
right menus: pin ?" -- confused about the pin icon indicating that the comment was also an annotation. pin for annotation too close to edit they are similar confusing. feels like pin would be less confusing if it wasn't next to the edit button --> it looks like a button rather than just a label
*"drag to annotate is vague", i didn't know it meant to drag to a specific location, also have the option only once you've typed something"
Commenter 5:
(same person as Host 5)
I want to say that the grass needs more texture. I click on the grass. a bubble pops up. can I reference a painting. that's technical select radio button (was not clear that she would select the technical on her own non default)
rate the overall quality of the paining.
could I decide who will see my comments? (currently does not support it)
how about option *category input not obvious: upon entering an annotation by clicking, was not clear she should select the category (e.g. "technical") on her own (as opposed to the default)
*wanted to decide who will see her comment but currently this is not supported as the host decided on visibility.
*would like to zoom in (magnifying glass) on a section of the picture to look better (especially if area is cluttered with feedback icons) and add commentscomment, but currently not supported
*would copy paste a comment on the right to hover. could not see the pin. is it confusing that comments /annotation
*confused about the difference between comments on the right and annotations (double display in some cases)
Commenter 6:
hovering ove the emotional annotation. see the comment from Amy
I click on the sun. see the circle dot (what is it?). I see symbols what are these? "great sun maybe a little more..." I select technical
press enter. symbol appear on the sun. comment appears on the right
I *want to be able to hide the icons in the picture, so I can see the picture. only if I mouse over the image they all show up.
*wanted to zoom, can't see the details
*want to zoom.
Who draw this? (need a see the name of my friend the artist )
what is this called ? (title missing)
click on the reminds me of comment from kyle and see the URL link
really like. 4 star rating -> change it to 3 stars
comments on the tail - emotional
changed my mind on previous comment. remove it X on the right
I who drew this piece, as well as what it is called (missing title)
*want to drag the symbols to be draggable to edit the place of the annotation
now general comment on the left .
anything happens when I hover on the right comment. yes it highlights the annotations.
The pin is optional . (safety issue)
*about the pin (comment on the right and then dragging): "would be cool to start without the call out and then arrows to the spot with pin.
comments are color coded.
After you vote maybe see aggregate results
"
*would like to see aggregated results maybe after the star rating
*may want to reply to this a specific comment and annotation. agree/disagree with other people suggestionsnot sure I . on the other hand not sure want to see other people's feedback. discussion is good if a lot of people suggest the same things.
I *may spend some time scrolling through
*From usability: icons are good. pins similar for google map. pencil are good.
X appears after the comment can be clicked for editing (for safety)
*categories really confusing
force me - forced to make a decision. what if it's more than one categories.
Usability from a usability perspective: hard to understand the symbols/categories. Maybe hashtags?want to be able to hide the icons in the picture, so I can see the picture.
only if I mouse over the image they all show up.two ways of exploring comments is nice.