To intervene or not to intervene: An investigation of three think-aloud protocols in usability testing

Alhadreti, Obead and Mayhew, Pam (2017) To intervene or not to intervene: An investigation of three think-aloud protocols in usability testing. Journal of Usability Studies, 12 (3). pp. 111-132. ISSN 1931-3357

[thumbnail of Accepted manuscript]
Preview
PDF (Accepted manuscript) - Accepted Version
Download (732kB) | Preview

Abstract

This paper presents the results of a study investigating the use of three think-aloud methods in website usability testing: the concurrent think-aloud, the speech-communication, and the active intervention methods. These three methods were compared through an evaluation of a library website, which involved four points of comparison: overall task performance, test participants’ experiences, the quantity and quality of usability problems discovered, and the cost of employing the methods. Data were collected from 60 individuals, with 20 participants allocated to each testing method, who were asked to complete a set of nine experimental tasks. The results of the study revealed that the three variations enabled the identification of a similar number of usability problems and types. However, the active intervention method was found to cause some reactivity, modifying participants’ interaction with the interface, and negatively affecting their feelings towards the evaluator. The active intervention method also required much greater investment than did the other two methods in terms of evaluators' time.

Item Type: Article
Uncontrolled Keywords: usability testing,user studies,user experiences,think-aloud protocols,human-computer interaction
Faculty \ School: Faculty of Science > School of Computing Sciences
UEA Research Groups: Faculty of Science > Research Groups > Data Science and Statistics
Faculty of Science > Research Groups > Smart Emerging Technologies
Related URLs:
Depositing User: Pure Connector
Date Deposited: 19 Sep 2017 05:07
Last Modified: 19 Aug 2022 00:01
URI: https://ueaeprints.uea.ac.uk/id/eprint/64914
DOI:

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item