Exploring Citizen Psych-Science and the Motivations of Errordiary Volunteers

Charlene Jennett; Dominic J. Furniss; Ioanna Iacovides; Sarah Wiseman; Sandy J. J. Gould; Anna L. Cox

doi:10.15346/hc.v1i2.10

Authors

Charlene Jennett University College London
Dominic J. Furniss University College London
Ioanna Iacovides University College London
Sarah Wiseman University College London
Sandy J. J. Gould University College London
Anna L. Cox University College London

DOI:

https://doi.org/10.15346/hc.v1i2.10

Keywords:

Citizen science, Psychology, Motivation, Human Error

Abstract

Previous research investigating motivations in citizen science have focused mostly on environmental citizen science projects. In this paper we focus specifically on citizen psychology projects, which we term 'citizen psych-science'. We argue that citizen psych-science differs from typical citizen science projects because volunteers are asked to contribute personal data. Furthermore we argue that the personal nature of such contributions can have unanticipated consequences on volunteer's motivations to contribute and their experiences of participating in the project. Exploring these issues in more detail, we describe four research studies that we conducted with Errordiary, a citizen psych-science project where volunteers tweet about their everyday experiences of human error. These studies included: (1) an interview study to explore motivations of 8 Errordiary volunteers, and (2) one workshop and two focus groups, to explore the potential of attracting new communities to the project. One of our main findings is that the risks associated with sharing errors on Errordiary, such as negative perceptions from others, being viewed as incompetent at your workplace, may counteract a person’s general good will to help researchers. We suggest several ways that researchers can help citizen psych-science volunteers feel like they are in a safe space to contribute their experiences towards research. These include clearly communicating the purpose of their research, allowing the use of pseudonyms, explaining how data is protected, and ensuring that proper monitoring controls are in place.

References

Adams, A. and Sasse, M. A. (2001). Privacy in multimedia communications: Protecting users, not just data. In A.

Blandford, J. Vanderdonkt & P. Gray (Eds.), People and Computers XV - Interaction without frontiers. Joint Proceedings of HCI2001 and ICM2001, pp. 49-64. Springer.

Bonney, R., Ballard, H., Jordan, R., McCallie, E., Phillips, T., Shirk, J. and Wilderman, C. (2009). Public participation in scientiﬁc research: Deﬁning the field and assessing its potential for informal science education. A CAISE Inquiry Group Report, Washington DC, Tech. Rep., 2009.

Causer, T. and Wallace, V. (2012). Building a volunteer community: Results and findings from Transcribe Bentham. Digital Humanities Quarterly 6 (2).

Code of Human Research Ethics. (2010). The British Psychological Society [On-line] http://www.bps.org.uk/publications/policy-and-guidelines/research-guidelines-policy-documents/research-guidelines-poli

Crowston, K. and Prestopnik, N.R. (2013). Motivation and data quality in a citizen science game: A design science evaluation. Proceedings of HICSS 2013, 450–459.

Eveleigh, A., Jennett, C., Blandford, A., Brohan, P. and Cox, A. L. (2014). Designing for dabblers and deterring drop-outs in citizen science. Proceedings of CHI ’14, ACM Press, 2986-2994.

Furniss, D., Back, J. and Blandford, A. (2012). Cognitive resilience: Can we use Twitter to make strategies more tangible? Proceedings of ECCE 2012, 96-99.

Gallagher, S., Wallace, S., Nathan, Y. and McGrath, D. (2013). ''Soft and Fluffy'': Medical students' attitudes toward psychology in medical education. Journal of Health Psychology, DOI: 10.1177/1359105313499780

Gould, S. J. J., Furniss, D. J., Jennett, C., Wiseman, S., Iacovides, I. and Cox, A. L. (2014). MOODs: building massive open online diaries for researchers, teachers and contributors. Proceedings of CHI EA ’14, ACM Press, 2281-2286.

Grant, R. W. and Sugarman, J. (2004). Ethics in human subjects research: Do incentives matter? Journal of Medicine and Philosophy 29 (6), 717–738.

Haklay, M. (2013). Citizen science and volunteered geographic information: Overview and typology of participation. In D. Sui et al. (Eds.) Crowdsourcing Geographic Knowledge: VGI in Theory and Practice, pp.105-122. Springer Netherlands.

Iacovides, I., Jennett, C. Cornish-Trestrail, C. and Cox, A. L. (2013). Do games attract or sustain engagement in citizen science?: A study of volunteers motivations. Proceedings of CHI EA ’13, ACM Press, 1101-1106.

Jennett, C., Eveleigh, A., Mathieu, K., Ajani, Z. and Cox, A. L. (2013). Creativity in citizen cyberscience: All for one and one for all. ACM WebSci 2013, 'Creativity and Attention in the Age of the Web' Workshop.

Kloetzer, L., Schneider, D., Jennett, C., Iacovides, I., Eveleigh, A., Cox, A.L. and Gold, M. (2013). Learning by volunteer computing, thinking and gaming: What and how are volunteers learning by participating in Virtual Citizen Science? Conference abstract at ESREA 2013.

Krull, D. S. and Silvera, D. H. (2013). The stereotyping of science: Superﬁcial details inﬂuence perceptions of what is scientiﬁc. Journal of Applied Psychology 43, 1660–1667.

Norman, D.A. (1981). Categorisation of action slips. Psychological Review 88 (1), 1–15.

Nosek,B. A., Banaji, M. R. and Greenwald, A. G. (2002). E-Research: Ethics, Security, Design, and Control in Psychological Research on the Internet. Journal of Social Issues 58 (1), 161-176.

Nov, O., Arazy, O. and Anderson, D. (2010). Crowdsourcing for science: Understanding and enhancing SciSourcing contribution. Proceedings of CSCW 2010, workshop on the ‘Changing Dynamics of Scientific Collaborations’.

Nov, O., Arazy, O., and Anderson, D. (2011). Dusting for science: motivation and participation of digital citizen science volunteers. Proceedings of iConference 2011, 68–74.

Raddick, M.J., Bracey, G., Gay, P.L., et al. (2010). Galaxy Zoo: Exploring the Motivations of Citizen Science Volunteers. Astronomy Education Review 9 (1), 010103.

Raddick, M.J., Bracey, G., Gay, P.L., et al. (2013). Galaxy Zoo: Motivations of Citizen Scientists. arXiv preprint, arXiv:1303.6886.

Reed, J., Raddick, M.J., Lardner, A., and Carney, K. (2013). An exploratory factor analysis of motivations for participating in Zooniverse, a collection of virtual citizen science projects. Proceedings of HICSS 2013, 610–619.

Rotman, D., Preece, J., Hammock, J., Procita, K., Hansen, D., Parr, C., Lewis, D. and Jacobs, D. (2012). Dynamic changes in motivation in collaborative citizen-science projects. Proceedings of CSCW 2012, ACM Press, 217-226.

Rush, M. A., Phillips, J. S. and Panek, P. E. (1978). Subject recruitment bias: The paid volunteer subject. Perceptual and Motor Skills, 47,443-449.

Sharp, E. C., Pelletier, L. G and Lévesque, C. (2006). The double-edged sword of rewards for participation in psychology experiments. Canadian Journal of Behavioural Science 38 (3), 269-277.

Weber, S.J. and Cook, T.P. )1972)/ Subject effects in laboratory research: An examination of subject roles, demand characteristics, and valid inference. Psychological Bulletin 77, 273-295.

Wiseman, S. (2012). Errordiary: Support for teaching human error. ‘A contextualized curriculum for HCI’ workshop at CHI 2012.