Point of View:
Arjun is a 40 years old father living in Mumbai, India whose son Raj hose son Raj is a working professional recently moved to San Francisco
- wants to recreate the narratives of his son's stories with immersive visual representation
Scenario:
his son tells him interesting stories (some sample stories below)** his son told him how amazing it was to drive to LA from SFO through Highway 1 along the pacific coast
a story about his son's hiking to glacier point (Yesomite)
a story about his visit to Google's Mountain View Campus
a story about Stanford University's beautiful Palm Drive entrance and the oval
Raj had an amazing weekend. He calls his father Arjun to tell him about his weekend experience in the bay area.
- how amazing it was to drive to LA from SFO through Highway 1 along the pacific coast
- hiking to glacier point (Yesomite)
- his visit to Google's Mountain View Campus
- Stanford University's beautiful Palm Drive entrance and the oval
Raj also shares some images and posts on Facebook/Twitter describing his weekend experience.
Goals:
- His parents and friends back home want to create the narratives of his son's stories with immersive visual representation.
Design Sketches
Set 1 (Anant)
|
|
|
|---|---|---|
|
|
|
Text |
Text |
Text |
Set 2 (Alex)
Set 3 (Katya)
|
|
|
|---|---|---|
|
|
|
Direct manipulation keyboard computer interface. |
Desktop interface based on entering information verbally. |
iPad/iPhone speech interface. |
Final (Anant)
Final (Katya)
|
|
|---|---|
|
STEP 1: Arjun talks to his son, Raj, on iPad or iPhone. Raj describes how amazing it was to drive to LA from SFO through Highway 1. Teleport automatically stores spatial descriptions mentioned by Raj. |
|
STEP 2: After talking to Raj, Arjun scrolls through spatial descriptions stored and picks one. Avatar ask whether he wants to travel by foot or car and then how would he like to describe the route: 1) by start and end 2) by landmarks 3) by a reference object. |
|
Step 3: Depending on the option there are three possible moves: 1) say start and end locations; wait while the animation is generated; watch the animation. 2) say landmark locations; wait while the animation is generated; watch the animation. 3) say the reference object; use 'move forwards','move backward', 'turn right' and 'turn left' commands to navigate around the object. |
|
STEP 4: Interaction viewing of animation. While watching the animation by tilting the phone to the right or left Arjun can interactively change viewing angle of the animation. |
|
STEP 5: By Tapping over the objects Arjun can see additional information, such as name of the object, the weather at the moment of the conversation or even additional images if added by his son. |
Learnability
- Interface extensively uses visual clues that make interaction extremely intuitive for elderly people who are often not accustomed to the use of conventional desktops. Visual clues take advantage of conventional metaphors and colour.
- The use of metaphors and colour scheme are both internally and externally consistent.
- Furthermore, speech based interaction reduces cognitive load by sequentially offering relevant options.
Efficiency
- Speech based interaction alone may be inefficient for users who use the system very often. The fact that the system asks the same questions can become irritating after some point.
- Nevertheless, the targeted user group is elderly people for whom physical manipulation often may pose additional challenges. From this point of view the interface is considered efficient.
Safety
- The interface is extremely safe because the system asks questions sequentially and in case of noisy input asks additional questions that help to disambiguate input.