Increasing citizen scientist accuracy with artificial intelligence on UK camera‐trap data

Sharpe, CR, Hill, RA, Chappell, HM, Green, SE, Holden, K, Fergus, P, Chalmers, C and Stephens, PA (2025) Increasing citizen scientist accuracy with artificial intelligence on UK camera‐trap data. Remote Sensing in Ecology and Conservation. ISSN 2056-3485

Preview

Text rse2.70012.pdf - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

As camera traps have become more widely used, extracting information from images at the pace they are acquired has become challenging, resulting in backlogs that delay the communication of results and the use of data for conservation and management. To ameliorate this, artificial intelligence (AI), crowdsourcing to citizen scientists and combined approaches have surfaced as solutions. Using data from the UK mammal monitoring initiative MammalWeb, we assess the accuracies of classifications from registered citizen scientists, anonymous participants and a convolutional neural network (CNN). The engagement of anonymous volunteers was facilitated by the strategic placement of MammalWeb interfaces in a natural history museum with high footfall related to the ‘Dippy on Tour’ exhibition. The accuracy of anonymous volunteer classifications gathered through public interfaces has not been reported previously, and here we consider this form of citizen science in the context of alternative forms of data acquisition. While AI models have performed well at species identification in bespoke settings, here we report model performance on a dataset for which the model in question was not explicitly trained. We also consider combining AI output with that of human volunteers to demonstrate combined workflows that produce high accuracy predictions. We find the consensus of registered users has greater overall accuracy (97%) than the consensus from anonymous contributors (71%); AI accuracy lies in between (78%). A combined approach between registered citizen scientists and AI output provides an overall accuracy of 96%. Further, when the contributions of anonymous citizen scientists are concordant with AI output, 98% accuracy can be achieved. The generality of this last finding merits further investigation, given the potential to gather classifications much more rapidly if public displays are placed in areas of high footfall. We suggest that combined approaches to image classification are optimal when the minimisation of classification errors is desired.

Item Type:	Article
Uncontrolled Keywords:	camera trapping, artificial intelligence, citizen science
Subjects:	Q Science > QA Mathematics > QA75 Electronic computers. Computer science T Technology > T Technology (General)
Divisions:	Computer Science and Mathematics
Publisher:	Wiley
Date of acceptance:	2 May 2025
Date of first compliant Open Access:	20 May 2025
Date Deposited:	20 May 2025 15:47
Last Modified:	20 May 2025 16:00
DOI or ID number:	10.1002/rse2.70012
URI:	https://researchonline.ljmu.ac.uk/id/eprint/26378

View Item