Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

We approached students who were already sitting in front of a computer, in the MIT Student Center computer cluster. We found two female and one male test user. Our target user population is skewed towards the female population, because we observed that female students tend to shop online more frequently. However, we built Wishdex with the hope that it would appeal to male users as well, and made sure to find at least one male test user.

Process

We followed the following set of steps with each test user. We made sure that the test environment was as standardized as possible.

  1. The facilitator reads the briefing (see Briefing section) to the test user.
  2. The facilitator reads each task one by one (see Tasks section). After each task is read, the user attempts to complete the task while vocalizing their feedback. Where appropriate, the facilitator encourages the user to provide feedback.
  3. The observer records the feedback given by the test user.
Roles
  • Susie Fu facilitated the test.
  • Emily Zhao observed the users.
  • Ashutosh Singhal was on call to perform last minute bug fixes.

...

Our application is Wishdex.com, a site that helps you keep wishlists. You can keep track of items you find online, show your friends and family gifts you want for Christmas or your birthday, and see what your friends are interested in or check out popular items on the site. We're doing this test to get some feedback on how well we've designed the user interface. There are probably a lot of problems with the design, and we need help finding them. Keep in mind that we're testing the computer system, not you. Also, the results of this test will be kept completely confidential, and you can stop and leave the test at any time. My name is Susie, and I'll be reading out the tasks we want you to perform. This is Emily, and she'll be taking some notes to help us remember the problems we find.

Note that we did not use a demo as part of our briefing. The motivation for this was that we wanted our site to be usable without a demo to the test users we were able to find. We designed Wishdex.com to be a site that someone who falls under our target test definition can go to and instantly be able to use.

Tasks
  1. Log in
  2. Managing
    1. Create a new wishdex called "Birthday Wishlist"
    2. Add new item from Anthropologie.com to this wishdex
    3. After adding the item, change the item description
    4. Create another wishdex "Christmas" and move this item to the 2nd wishdex
    5. Share "Christmas" with your mom
    6. After some thought, you decided to buy this item on Anthropologie.com. You still want to keep the item on your wishdex, though, but you want to mark that you've acquired it.
    7. Delete an item
  3. Exploring
    1. Browse popular wishdexes on the Popular page
    2. Check out the recent activity
  4. Friends
    1. Find Emily's wishdex, "Cool Patterns"
    2. Like one of the dresses in her Wishdex
    3. You want to buy this item for her, so claim the item and view the item on the Anthropologie.com website
    4. Copy an item that you like into your own "Birthday Wishlist" wishdex

...