Exploring efficient attention strategies in conformer-based sound event detection
Sound Event Detection (SED) requires models that can accurately localize and classify overlapping audio events within complex acoustic environments. Conformer-based architectures have demonstrated promising performance by leveraging self-attention to capture long-range dependencies. However, this gl...
| Authors: | ; ; ; ; |
|---|---|
| Format: | Article |
| Publication date: | 2026 |
| Country: | España |
| Institution: | Universidad Autónoma de Madrid |
| Repository: | Biblos-e Archivo. Repositorio Institucional de la UAM |
| Language: | English |
| OAI Identifier: | oai:repositorio.uam.es:10486/754400 |
| Online Access: | https://hdl.handle.net/10486/754400 https://dx.doi.org/10.1016/j.csl.2026.101967 |
| Access Level: | Open access |
| Keyword: | Sound event detection Efficient conformer Attention mechanisms DCASE Temporal resolution Informática |
| _version_ | 1878740754956812288 |
|---|---|
| author | Barahona Quirós, Sara |
| author2 | Álvarez Trejos, Juan Ignacio Lozano Díez, Alicia Ramos Castro, Daniel Torre Toledano, Doroteo |
| author2_role | author author author author |
| author_browse | Barahona Quirós, Sara Lozano Díez, Alicia Ramos Castro, Daniel Torre Toledano, Doroteo Álvarez Trejos, Juan Ignacio |
| author_facet | Barahona Quirós, Sara Álvarez Trejos, Juan Ignacio Lozano Díez, Alicia Ramos Castro, Daniel Torre Toledano, Doroteo |
| author_role | author |
| collection | Biblos-e Archivo. Repositorio Institucional de la UAM |
| description | Sound Event Detection (SED) requires models that can accurately localize and classify overlapping audio events within complex acoustic environments. Conformer-based architectures have demonstrated promising performance by leveraging self-attention to capture long-range dependencies. However, this global attention can be accumulated across layers, which can blur local temporal boundaries and reduce detection accuracy, especially for short or closely spaced events. While increasing the input sequence length can help recover temporal detail, the quadratic complexity of Conformers’ self-attention significantly increases computational costs. To address this, we propose integrating the Efficient Conformer architecture, which introduces subsampling along the input sequence length, effectively reducing the temporal dimension within blocks. This design enables processing longer input sequences at finer temporal resolution, enhancing localization accuracy without extending output length. Using the DCASE Challenge 2023 Task 4 benchmark, system performance is evaluated via the threshold-independent Polyphonic Sound Detection Score (PSDS), measuring both localization precision (PSDS1) and class robustness (PSDS2). Experiments on the DESED validation dataset demonstrate that the Efficient Conformer not only improves temporal resolution and long-range dependency modeling, but also outperforms standard Conformer and Convolutional Recurrent Neural Network (CRNN) baselines in PSDS2. Additionally, we explore lightweight attention mechanisms employing squeeze-and-excitation blocks to emulate frequency-axis translation invariance of Frequency Dynamic Convolutions (FDY). Our approach achieves performance comparable to heavier models like FDY+Conformer, while reducing computational cost by over 69%, showing promising results for Conformer-based systems in terms of precision and model efficiency |
| eu_rights_str_mv | openAccess |
| format | article |
| id | ES_d8cb755dca4fa62dbad3dac12cb41bc9 |
| institution | Universidad Autónoma de Madrid |
| instname_str | Universidad Autónoma de Madrid |
| language | eng |
| network_acronym_str | ES |
| network_name_str | España |
| oai_identifier_str | oai:repositorio.uam.es:10486/754400 |
| publishDate | 2026 |
| publishDateSort | 2026 |
| publisher | Elsevier |
| publisherStr | Elsevier |
| reponame_str | Biblos-e Archivo. Repositorio Institucional de la UAM |
| spelling | Exploring efficient attention strategies in conformer-based sound event detection Barahona Quirós, Sara Álvarez Trejos, Juan Ignacio Lozano Díez, Alicia Ramos Castro, Daniel Torre Toledano, Doroteo Sound event detection Efficient conformer Attention mechanisms DCASE Temporal resolution Informática Sound Event Detection (SED) requires models that can accurately localize and classify overlapping audio events within complex acoustic environments. Conformer-based architectures have demonstrated promising performance by leveraging self-attention to capture long-range dependencies. However, this global attention can be accumulated across layers, which can blur local temporal boundaries and reduce detection accuracy, especially for short or closely spaced events. While increasing the input sequence length can help recover temporal detail, the quadratic complexity of Conformers’ self-attention significantly increases computational costs. To address this, we propose integrating the Efficient Conformer architecture, which introduces subsampling along the input sequence length, effectively reducing the temporal dimension within blocks. This design enables processing longer input sequences at finer temporal resolution, enhancing localization accuracy without extending output length. Using the DCASE Challenge 2023 Task 4 benchmark, system performance is evaluated via the threshold-independent Polyphonic Sound Detection Score (PSDS), measuring both localization precision (PSDS1) and class robustness (PSDS2). Experiments on the DESED validation dataset demonstrate that the Efficient Conformer not only improves temporal resolution and long-range dependency modeling, but also outperforms standard Conformer and Convolutional Recurrent Neural Network (CRNN) baselines in PSDS2. Additionally, we explore lightweight attention mechanisms employing squeeze-and-excitation blocks to emulate frequency-axis translation invariance of Frequency Dynamic Convolutions (FDY). Our approach achieves performance comparable to heavier models like FDY+Conformer, while reducing computational cost by over 69%, showing promising results for Conformer-based systems in terms of precision and model efficiency This research was supported by FPI PRE2022-104808 funded by FSE, Spain as well as project PID2021-125943OB-I00 funded by MCIN/AEI/10.13039/501100011033/FEDER, UE and project PID2024-160789OB-I00 funded by MICIU/AEI/ 10.13039/501100011033/FEDER, UE Elsevier https://hdl.handle.net/10486/754400 https://dx.doi.org/10.1016/j.csl.2026.101967 |
| spellingShingle | Exploring efficient attention strategies in conformer-based sound event detection Barahona Quirós, Sara Sound event detection Efficient conformer Attention mechanisms DCASE Temporal resolution Informática |
| title | Exploring efficient attention strategies in conformer-based sound event detection |
| title_full | Exploring efficient attention strategies in conformer-based sound event detection |
| title_fullStr | Exploring efficient attention strategies in conformer-based sound event detection |
| title_full_unstemmed | Exploring efficient attention strategies in conformer-based sound event detection |
| title_short | Exploring efficient attention strategies in conformer-based sound event detection |
| title_sort | Exploring efficient attention strategies in conformer-based sound event detection |
| topic | Sound event detection Efficient conformer Attention mechanisms DCASE Temporal resolution Informática |
| topic_facet | Sound event detection Efficient conformer Attention mechanisms DCASE Temporal resolution Informática |
| url | https://hdl.handle.net/10486/754400 https://dx.doi.org/10.1016/j.csl.2026.101967 |