Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

WildlifeDatasets: An open-source toolkit for animal re-identification

About

In this paper, we present WildlifeDatasets (https://github.com/WildlifeDatasets/wildlife-datasets) - an open-source toolkit intended primarily for ecologists and computer-vision / machine-learning researchers. The WildlifeDatasets is written in Python, allows straightforward access to publicly available wildlife datasets, and provides a wide variety of methods for dataset pre-processing, performance analysis, and model fine-tuning. We showcase the toolkit in various scenarios and baseline experiments, including, to the best of our knowledge, the most comprehensive experimental comparison of datasets and methods for wildlife re-identification, including both local descriptors and deep learning approaches. Furthermore, we provide the first-ever foundation model for individual re-identification within a wide range of species - MegaDescriptor - that provides state-of-the-art performance on animal re-identification datasets and outperforms other pre-trained models such as CLIP and DINOv2 by a significant margin. To make the model available to the general public and to allow easy integration with any existing wildlife monitoring applications, we provide multiple MegaDescriptor flavors (i.e., Small, Medium, and Large) through the HuggingFace hub (https://huggingface.co/BVRA).

Vojt\v{e}ch \v{C}erm\'ak, Lukas Picek, Luk\'a\v{s} Adam, Kostas Papafitsoros• 2023

Related benchmarks

TaskDatasetResultRank
Statistical Significance ComparisonAnimal Identification Datasets
P-value0.00e+0
15
Pet IdentificationPet Re-identification (test)
ROC AUC0.907
7
Individual Re-identificationHula painted frog 1.0 (Labeled set)
Top-1 ID Accuracy3.9
7
IdentificationDogFaceNet 17 (test)
Top-1 Accuracy46.07
6
VerificationDogFaceNet 17 (test)
ROC AUC0.907
6
VerificationCat Individual Images
ROC AUC0.9364
6
IdentificationCat Individual Images
Top-1 Accuracy84.21
6
Individual Feeding Rate EstimationChirp
Mean Feeding Rate13.14
4
Co-occurrence Rate EstimationChirp
Mean0.056
4
Video Re-identificationCHIRP Closed set - All
Top-1 Accuracy10
3
Showing 10 of 17 rows

Other info

Follow for update