📊 Статистика дайджестов
Всего дайджестов: 34022 Добавлено сегодня: 0
Последнее обновление: сегодня
Авторы:
Amir Dellali, Luca A. Lanzendörfer, Florian Grötschla, Roger Wattenhofer
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
We propose SALSA-V, a multimodal video-to-audio generation model capable of
synthesizing highly synchronized, high-fidelity long-form audio from silent
video content. Our approach introduces a masked diffusion objective, enabling
audio-conditioned generation and the seamless synthesis of audio sequences of
unconstrained length. Additionally, by integrating a shortcut loss into our
training process, we achieve rapid generation of high-quality audio samples in
as few as eight sampling steps, pavin...
Авторы:
Ahmet Solak, Florian Grötschla, Luca A. Lanzendörfer, Roger Wattenhofer
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
While recent years have seen remarkable progress in music generation models,
research on their biases across countries, languages, cultures, and musical
genres remains underexplored. This gap is compounded by the lack of datasets
and benchmarks that capture the global diversity of music. To address these
challenges, we introduce GlobalDISCO, a large-scale dataset consisting of 73k
music tracks generated by state-of-the-art commercial generative music models,
along with paired links to 93k refere...
📄 Multi-bit Audio Watermarking
2025-10-04Авторы:
Luca A. Lanzendörfer, Kyle Fearne, Florian Grötschla, Roger Wattenhofer
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
We present Timbru, a post-hoc audio watermarking model that achieves
state-of-the-art robustness and imperceptibility trade-offs without training an
embedder-detector model. Given any 44.1 kHz stereo music snippet, our method
performs per-audio gradient optimization to add imperceptible perturbations in
the latent space of a pretrained audio VAE, guided by a combined message and
perceptual loss. The watermark can then be extracted using a pretrained CLAP
model. We evaluate 16-bit watermarking on...
Авторы:
Koichi Saito, Julian Tanke, Christian Simon, Masato Ishii, Kazuki Shimada, Zachary Novack, Zhi Zhong, Akio Hayakawa, Takashi Shibuya, Yuki Mitsufuji
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Prevailing Video-to-Audio (V2A) generation models operate offline, assuming
an entire video sequence or chunks of frames are available beforehand. This
critically limits their use in interactive applications such as live content
creation and emerging generative world models. To address this gap, we
introduce the novel task of frame-level online V2A generation, where a model
autoregressively generates audio from video without access to future video
frames. Furthermore, we propose SoundReactor, wh...
Авторы:
Luca A. Lanzendörfer, Frédéric Berdoz, Antonis Asonitis, Roger Wattenhofer
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Recent autoregressive transformer-based speech enhancement (SE) methods have
shown promising results by leveraging advanced semantic understanding and
contextual modeling of speech. However, these approaches often rely on complex
multi-stage pipelines and low sampling rate codecs, limiting them to narrow and
task-specific speech enhancement. In this work, we introduce DAC-SE1, a
simplified language model-based SE framework leveraging discrete
high-resolution audio representations; DAC-SE1 preser...
Авторы:
Lukas Rauch, René Heinrich, Houtan Ghaffari, Lukas Miklautz, Ilyass Moummad, Bernhard Sick, Christoph Scholz
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Although probing frozen models has become a standard evaluation paradigm,
self-supervised learning in audio defaults to fine-tuning. A key reason is that
global pooling creates an information bottleneck causing linear probes to
misrepresent the embedding quality: The $\texttt{cls}$-token discards crucial
token information about dispersed, localized events in multi-label audio. This
weakness is rooted in the mismatch between the pretraining objective (operating
globally) and the downstream task (...
📄 Benchmarking Diarization Models
2025-10-02Авторы:
Luca A. Lanzendörfer, Florian Grötschla, Cesare Blaser, Roger Wattenhofer
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Speaker diarization is the task of partitioning audio into segments according
to speaker identity, answering the question of "who spoke when" in
multi-speaker conversation recordings. While diarization is an essential task
for many downstream applications, it remains an unsolved problem. Errors in
diarization propagate to downstream systems and cause wide-ranging failures. To
this end, we examine exact failure modes by evaluating five state-of-the-art
diarization models, across four diarization ...
Авторы:
Andrea Diecidue, Carlo Alberto Barbano, Piero Fraternali, Mathieu Fontaine, Enzo Tartaglione
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Transformer-based models have become the state of the art across multiple
domains, from natural language processing to machine listening, thanks to
attention mechanisms. However, the attention layers require a large number of
parameters and high-end hardware for both training and inference. We propose a
novel pruning technique targeted explicitly at the attention mechanism, where
we decouple the pruning of the four layers in the attention block, namely:
query, keys, values and outputs' projectio...
📄 Source Separation for A Cappella Music
2025-10-02Авторы:
Luca A. Lanzendörfer, Constantin Pinkl, Florian Grötschla
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
In this work, we study the task of multi-singer separation in a cappella
music, where the number of active singers varies across mixtures. To address
this, we use a power set-based data augmentation strategy that expands limited
multi-singer datasets into exponentially more training samples. To separate
singers, we introduce SepACap, an adaptation of SepReformer, a state-of-the-art
speaker separation model architecture. We adapt the model with periodic
activations and a composite loss function t...
Авторы:
Ting-Kang Wang, Yueh-Po Peng, Li Su, Vincent K. M. Cheung
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
While automatic music transcription is well-established in music information
retrieval, most models are limited to transcribing pitch and timing information
from audio, and thus omit crucial expressive and instrument-specific nuances.
One example is playing technique on the violin, which affords its distinct
palette of timbres for maximal emotional impact. Here, we propose VioPTT
(Violin Playing Technique-aware Transcription), a lightweight, end-to-end model
that directly transcribes violin play...
Показано 31 -
40
из 80 записей