Field
Lab
Examples
Recorded
sessions           
Lab  &  Field
A comparison of Usability Testing environments
iSchool Web applicationss
UT Campus Map redesign
Larry Archer
When to test in the Lab
When to test in the Field
reproducability and quantifiable results
team of 2+
observers
longer test sessions
access to a lab, budget
 
 
tighter budget
shorter schedule
broader target audience
convenience  users
context of use
 
 
Larry Archer
larcher@spoon.cx
http://www.spoon.cx/~larcher/
Goals
improved usability
scalability and maintenance

Technologies
HTML, JavaScript
Google Maps API
Map data as KML files (XML)

GeoTeaching
team project for the iSchool course "Understanding and Serving Users"
Texas Legacy Project
Target audience:
   Geography teachers in Texas
Testing in the IX Lab
Field Testing
recruited test users
two-person team
one facilitator
one observer
TechSmith Morae
Users:
      participants 
      donors
Target Audience: 
   students, 
   faculty, 
   staff, 
   visitors
Silverback
vnc2swf
CamStudio
... and others
Silverback
http://silverbackapp.com/
records  mouse, keyboard, screen, & user's face
uses built-in camera
inexpensive
Mac only
vnc2swf
open source
(written in Python)
cross platform
affordable (free!)
save as Flash video
less than intuitive interface

Test tasks

finding general information
donating
registering as a volunteer
registering as a rider
fund-raising activities

this presentation - http://prezi.com/70797/
Testing 
on-location
Workplace
Computer lab
Cafe

User 
selection
controlled environment 
often at least one observer
Deciding which to use
Users:
iSchool students
IT Lab staff 

Test Tasks:
reserve & checkout equipment
account management
Results
Results
Testing and Development Process
iSchool Capstone Project
Hill Country Ride for AIDS
 
New Map Prototype
Test tasks
Gotchas
careful when testing multiple users at the same location
be prepared to deal with interruptions
 
locating buildings by name
identifying buildings by location
nearby parking
paths across campus*
Source:  http://www.cubefigures.com
Source: Flickr -- http://www.flickr.com/photos/cafemama/389407794/
any convenient location
less formal
Source:  http://www.ischool.utexas.edu/technology/ixlab/
Non-profit Web site
http://camstudio.org
http://www.unixuser.org/~euske/vnc2swf/
http://silverbackapp.com
Test tasks:
    finding maps, lesson plans, 
    videos about a certain region

Usability test plan and final report:
http://www.spoon.cx/projects/usability/ischool/
more highlights / callouts
"Guerrilla Usability Testing"
Source:  http://www.flickr.com/photos/ischoolitlab/384909790/ 
Lab
Field
Source: Flickr -- http://www.flickr.com/photos/cafemama/389407794/
- lab access
- participant incentives
Thank you
Questions?