WildlifeDatasets: An open-source toolkit for animal re-identification
About
In this paper, we present WildlifeDatasets (https://github.com/WildlifeDatasets/wildlife-datasets) - an open-source toolkit intended primarily for ecologists and computer-vision / machine-learning researchers. The WildlifeDatasets is written in Python, allows straightforward access to publicly available wildlife datasets, and provides a wide variety of methods for dataset pre-processing, performance analysis, and model fine-tuning. We showcase the toolkit in various scenarios and baseline experiments, including, to the best of our knowledge, the most comprehensive experimental comparison of datasets and methods for wildlife re-identification, including both local descriptors and deep learning approaches. Furthermore, we provide the first-ever foundation model for individual re-identification within a wide range of species - MegaDescriptor - that provides state-of-the-art performance on animal re-identification datasets and outperforms other pre-trained models such as CLIP and DINOv2 by a significant margin. To make the model available to the general public and to allow easy integration with any existing wildlife monitoring applications, we provide multiple MegaDescriptor flavors (i.e., Small, Medium, and Large) through the HuggingFace hub (https://huggingface.co/BVRA).
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Statistical Significance Comparison | Animal Identification Datasets | P-value0.00e+0 | 15 | |
| Pet Identification | Pet Re-identification (test) | ROC AUC0.907 | 7 | |
| Individual Re-identification | Hula painted frog 1.0 (Labeled set) | Top-1 ID Accuracy3.9 | 7 | |
| Identification | DogFaceNet 17 (test) | Top-1 Accuracy46.07 | 6 | |
| Verification | DogFaceNet 17 (test) | ROC AUC0.907 | 6 | |
| Verification | Cat Individual Images | ROC AUC0.9364 | 6 | |
| Identification | Cat Individual Images | Top-1 Accuracy84.21 | 6 | |
| Individual Feeding Rate Estimation | Chirp | Mean Feeding Rate13.14 | 4 | |
| Co-occurrence Rate Estimation | Chirp | Mean0.056 | 4 | |
| Video Re-identification | CHIRP Closed set - All | Top-1 Accuracy10 | 3 |