Methods · Sub-page
Self-supervised audio — learning without labels.
Learn from the recording itself, then test what the representation can do. Self-supervised pretraining and a validated downstream task are different steps.
Methods · Self-supervised audio
Self-supervised learning derives a training target from the audio itself. Audio-MAE reconstructs masked spectrogram patches during pretraining, then uses supervised fine-tuning in its reported classification experiments. This does not establish a shared training recipe for all audio models or reliable crow identity and behavior predictions. CrowLingo has not run an embedding model on its illustrative Atlas corpus.
Audio narration is unavailable while its source claims are corrected.

Learning from hidden sound
uses a training target derived from the input. Masked reconstruction is one example: hide parts of an audio spectrogram and train a model to predict them from the visible parts. It is one training approach, not the recipe for every audio model.
A concrete example: Audio-MAE
In Masked Autoencoders that Listen, Huang and colleagues describe an encoder-decoder model for audio spectrograms. Their experiment favored an 80% random masking ratio during pretraining. That is a result for this setup, not a universal setting for wildlife recordings.
- Represent the sound. Divide its spectrogram into patches.
- Hide some patches. Pass the visible patches through the encoder.
- Reconstruct. A decoder predicts the missing spectrogram information; reconstruction error provides a training signal.
- Evaluate the task. In the paper's classification experiments, the authors remove the decoder and use supervised fine-tuning of the encoder.
Labels are not required for that reconstruction target. They can still be used for later training and evaluation. The paper's supervised fine-tuning is different from claiming that every SSL application requires fine-tuning, or that every trained encoder can answer new questions without it.
What an embedding can help you investigate
An is a numerical representation that can be used as input to a comparison, clustering method or classifier. Its usefulness depends on the model, selected output, recordings and task. Reconstruction alone does not establish reliable crow species, caller or behavior labels.
The Audio-MAE authors note limits from short training recordings, imbalanced classes and transfer to rare or unseen audio events. Those are reasons to evaluate a new wildlife task with appropriate recordings and labels, not to assume the published benchmark transfers.
What this means for CrowLingo
CrowLingo has not trained or run an embedding model on its Atlas corpus. The map uses illustrative coordinates. Connecting a sound pattern to behavior requires matched observations and a tested analysis; the pipeline guide describes that proposed step. An acoustic representation is not a translation of a bird's intended message.
Source and scope
Checked November 11, 2026 against Huang et al., Masked Autoencoders that Listen, especially sections 4.3–4.4 and Appendix D. This guide explains that study's training distinction; it does not compare all audio models or report a CrowLingo experiment.