Adaptive representations of sound for automatic insect recognition
Faiß,Marius Stowell,Dan
Faiß,Marius
Stowell,Dan
Abstract
Insect population numbers and biodiversity have been rapidly declining with time, and monitoring these trends has become increasingly important for conservation measures to be effectively implemented. But monitoring methods are often invasive, time and resource intense, and prone to various biases. Many insect species produce characteristic sounds that can easily be detected and recorded without large cost or effort. Using deep learning methods, insect sounds from field recordings could be automatically detected and classified to monitor biodiversity and species distribution ranges. We implement this using recently published datasets of insect sounds (up to 66 species of Orthoptera and Cicadidae) and machine learning methods and evaluate their potential for acoustic insect monitoring. We compare the performance of the conventional spectrogram-based audio representation against LEAF, a new adaptive and waveform-based frontend. LEAF achieved better classification performance than the mel-spectrogram frontend by adapting its feature extraction parameters during training. This result is encouraging for future implementations of deep learning technology for automatic insect sound recognition, especially as larger datasets become available.
Description
Copyright: © 2023 Faiß, Stowell. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Date
2023-10-04
Journal Title
Journal ISSN
Volume Title
Publisher
Research Projects
Organizational Units
Journal Issue
Keywords
Animals, Biodiversity, Insecta, Machine Learning, Sound, Technology
Citation
Faiß, M & Stowell, D 2023, 'Adaptive representations of sound for automatic insect recognition', PLOS Computational Biology, vol. 19, no. 10, e1011541. https://doi.org/10.1371/journal.pcbi.1011541