Turking in the time of COVID
Author(s)
Arechar, Antonio A.; Rand, David Gertler
Download13428_2021_1588_ReferencePDF.pdf (864.3Kb)
Open Access Policy
Open Access Policy
Creative Commons Attribution-Noncommercial-Share Alike
Terms of use
Metadata
Show full item recordAbstract
Abstract
On March 16, 2020, the US Government introduced strict social distancing protocols for the United States in an effort to stem the spread of the COVID-19 pandemic. This had an immediate major effect on the job market, with millions of Americans forced to find alternative ways to make a living from home. As online labor markets like Amazon Mechanical Turk (MTurk) play a major role in social science research, concerns have been raised that the pandemic may be reducing the diversity of subjects participating in experiments. Here, we investigate this possibility empirically. Specifically, we look at 15,539 responses gathered in 23 studies run on MTurk between February and July 2020, examining the distribution of gender, age, ethnicity, political preference, and analytic cognitive style. We find notable changes on some of the measures following the imposition of nationwide social distancing: participants are more likely to be less reflective (as measured by the Cognitive Reflection Test), and somewhat less likely to be white, Democrats (traditionally over-represented on MTurk), and experienced with MTurk. Most of these differences are explained by an influx of new participants into the MTurk subject pool who are more diverse and representative – but also less attentive – than previous MTurkers.
Date issued
2021-05-07Department
Sloan School of Management; Massachusetts Institute of Technology. Institute for Data, Systems, and SocietyJournal
Behavior research methods
Publisher
Springer US
Citation
Arechar, Antonio A. and Rand, David G. 2021. "Turking in the time of COVID."
Version: Author's final manuscript
ISSN
1554-351X