Towards Differentiable Motor Control of Bird Vocalizations - l'unam - université nantes angers le mans Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Towards Differentiable Motor Control of Bird Vocalizations

Résumé

Machine learning is ready to transform the experimental protocol of birdsong acquisition and playback in ethology and integrative neuroscience. An emerging methodology, known as differentiable digital signal processing (DDSP), allows to train neural networks for machine listening so as to fit the synthesis parameters which correspond to unlabeled audio data. In this short article, I present the value and of extending DDSP, initially developed for speech and music processing, to avian bioacoustics. The main two challenges reside in the definition of a suitable decoder and learning objective. I review some prior publications in biomechanical models of vocal production for passerines, similarity computing, and differentiable solvers of ordinary differential equations. Together, these publications hint at the feasibility of a fully automated and unsupervised algorithm for biologically plausible resynthesis of birdsong.
Fichier principal
Vignette du fichier
lostanlen2024vihar-revised.pdf (156.95 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04660514 , version 1 (23-07-2024)

Licence

Identifiants

  • HAL Id : hal-04660514 , version 1

Citer

Vincent Lostanlen. Towards Differentiable Motor Control of Bird Vocalizations. Vocal Interactions in-and-between Humans, Animals, and Robots (VIHAR), Sep 2024, Kos, Greece. ⟨hal-04660514⟩
0 Consultations
0 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More