establishing cutting-edge technology in a federal ... cutting-edge technology in a federal...

22
Establishing cutting-edge technology in a federal government usability lab: Eye tracking at the Census Bureau in 2010 Kathleen T. Ashenfelter U.S. Census Bureau Statistical Research Division FedCASIC 2010 Washington, D.C. March 18, 2010

Upload: phungkiet

Post on 03-May-2018

215 views

Category:

Documents


2 download

TRANSCRIPT

Establishing cutting-edge technology in afederal government usability lab: Eye tracking

at the Census Bureau in 2010

Kathleen T. Ashenfelter

U.S. Census BureauStatistical Research Division

FedCASIC 2010Washington, D.C.March 18, 2010

Usability Laboratory at the U.S. Census Bureau Thank you

Outline

1 U.S. Census Bureau Usability LabUsability Lab OverviewEye–Tracking TechnologyEye–Tracking CapabilityNew Set–UpTips for Acquiring New Lab Equipment

2 Thank you

2

Usability Laboratory at the U.S. Census Bureau Thank you

Census 2010: 10 Questions, 10 Minutes

3

Usability Laboratory at the U.S. Census Bureau Thank you

Census Usability Lab Overview

Small laboratory in the Statistical Research DivisionCapabilities:

Expert reviewsLow–to–High–Fidelity usability studiesCard–sorting analysesEye–tracking studiesAccessibility evaluations

4

Usability Laboratory at the U.S. Census Bureau Thank you

Census Usability Lab Overview

Used in scientific research for over 100 yearsWill tell you where users are focusing on a stimulusOvert attention is important

If users do not see features on a survey or Web site, theywill not act on them or click on them

5

Usability Laboratory at the U.S. Census Bureau Thank you

Former Set–up

Tobii 2250 Eye Tracker50 Hz sampling rate

PC w/1 GB RAMNot much hard drive storage

Tobii Clearview software (no longer supported)

6

Usability Laboratory at the U.S. Census Bureau Thank you

Lab Research Needs

Analyze the usability of online surveys, Web sites, andinterfacesTest usability of paper forms, brochures, and mailingmaterialsAccessibility TestingIncreasing Demand for Eye-tracking data

7

Usability Laboratory at the U.S. Census Bureau Thank you

New Set–up

Tobii T120 Eye Tracker120 Hz sampling rateOn–screen stimuli

New Dell T7500 Workstation4 GB RAMRAID 5 configuration

Tobii Studio SoftwareMore detailed analysis capabilityIncludes logging capability

8

Usability Laboratory at the U.S. Census Bureau Thank you

T120 Set–up

9

Usability Laboratory at the U.S. Census Bureau Thank you

New Set–up

Tobii X120 Eye Tracker120 Hz sampling rateAny real–world stimuliWorks best for two–dimensional objects

New Dell T7500 Workstation4 GB RAMRAID 5 configuration

10

Usability Laboratory at the U.S. Census Bureau Thank you

Tobii Studio

Improved calibration capabilityMore detailed analysis capabilityExpanded statistics on Average Fixation Duration,Number of fixations, etc.Creates comparative tables and chartsIncludes logging capability

11

Usability Laboratory at the U.S. Census Bureau Thank you

X120 Set–up

12

Usability Laboratory at the U.S. Census Bureau Thank you

Eye–Tracking Analysis: Quantitative Measures

Areas of Interest (AOIs): Items we are interested in testingNumber of Fixations: How often a participant looks atsomething (AOIs)Mean Fixation Duration: How long a participant looks atsomething (AOIs)Time to First FixationNumber of mouse clicksOrder of Fixations : Can tell where a participant looksfirst, most often, etc.

13

Usability Laboratory at the U.S. Census Bureau Thank you

Example Eye–Tracking Analysis-T120

14

Usability Laboratory at the U.S. Census Bureau Thank you

Eye–Tracking Analysis-T120

15

Usability Laboratory at the U.S. Census Bureau Thank you

Example Eye–Tracking Analysis-T120

16

Usability Laboratory at the U.S. Census Bureau Thank you

Example Eye–Tracking Analysis-X120

17

Usability Laboratory at the U.S. Census Bureau Thank you

Example Eye–Tracking Analysis-X120

18

Usability Laboratory at the U.S. Census Bureau Thank you

Tips for Acquiring New Lab Equipment

Federal Desktop Core Compliance (FDCC)Required for Federal Desktop MachinesSoftware must pass FDCC testing unless Special PurposeMachineTobii Studio does not pass FDCC testing

Uses a plug-in to Internet Explorer that is blocked bysecurity settings

19

Usability Laboratory at the U.S. Census Bureau Thank you

Tips for Acquiring New Lab Equipment

Ask questions about computer inputs/outputsDigital or Analog output?Network configuration required?

Ask about issues that similar labs have faced and what thesolutions wereAllow extra time

20

Usability Laboratory at the U.S. Census Bureau Thank you

Allow Extra Time

21

Usability Laboratory at the U.S. Census Bureau Thank you

Thank you!

Thank–you for your attentionThank–you to the usability teamFor more information, [email protected]

22