Crowdsourced measurement of reaction times to audiovisual stimuli with various degrees of asynchrony

Bazilinskyy, P., De Winter, J. C. F.

Human Factors, 60, 1192–120 (2018)

ABSTRACT Objective: This study aimed to replicate past research concerning reaction times to audiovisual stimuli with different stimulus onset asynchrony (SOA), using a large sample of crowdsourcing respondents. Background: Research has shown that reaction times are fastest when an auditory and a visual stimulus are presented simultaneously and that SOA causes an increase in reaction time, this increase being dependent on stimulus intensity. Research on audiovisual SOA has been conducted with small numbers of participants. Method: 1,823 participants each performed 176 reaction time trials consisting of 29 SOA levels and three visual intensity levels, using CrowdFlower, with a compensation of USD 0.20 per participant. Results were verified with a local web-in-lab study (N = 34). Results: The results replicated past research, with a V-shape of mean reaction time as a function of SOA, the V-shape being stronger for lower intensity visual stimuli. The level of SOA affected mainly the right side of the reaction time distribution, whereas the fastest 5% were hardly affected. The variability of reaction times was higher for the crowdsourcing study than for the web-in-lab study. Conclusion: Crowdsourcing is a promising medium for reaction-time research that involves small temporal differences in stimulus presentation. The observed effects of SOA can be explained by an independent-channels mechanism, and also by some participants not perceiving the auditory or visual stimulus, hardware variability, misinterpretation of the task instructions, or lapses in attention. Application: The obtained knowledge on the distribution of reaction times may benefit the design of warning systems.