📊 Статистика дайджестов
Всего дайджестов: 34022 Добавлено сегодня: 82
Последнее обновление: сегодня
📄 Speech-Audio Compositional Attacks on Multimodal LLMs and Their Mitigation with SALMONN-Guard
2025-11-15Авторы:
Yudong Yang, Xuezhen Zhang, Zhifeng Han, Siyin Wang, Jimin Zhuang, Zengrui Jin, Jing Shao, Guangzhi Sun, Chao Zhang
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Recent progress in large language models (LLMs) has enabled understanding of both speech and non-speech audio, but exposing new safety risks emerging from complex audio inputs that are inadequately handled by current safeguards. We introduce SACRED-Bench (Speech-Audio Composition for RED-teaming) to evaluate the robustness of LLMs under complex audio-based attacks. Unlike existing perturbation-based methods that rely on noise optimization or white-box access, SACRED-Bench exploits speech-audio c...
Авторы:
Hardik B. Sailor, Aw Ai Ti, Chen Fang Yih Nancy, Chiu Ying Lay, Ding Yang, He Yingxu, Jiang Ridong, Li Jingtao, Liao Jingyi, Liu Zhuohan, Lu Yanfeng, Ma Yi, Manas Gupta, Muhammad Huzaifah Bin Md Shahrin, Nabilah Binte Md Johan, Nattadaporn Lertcheva, Pan Chunlei, Pham Minh Duc, Siti Maryam Binte Ahmad Subaidi, Siti Umairah Binte Mohammad Salleh, Sun Shuo, Tarun Kumar Vangani, Wang Qiongqiong, Won Cheng Yi Lewis, Wong Heng Meng Jeremy, Wu Jinyang, Zhang Huayun, Zhang Longyin, Zou Xunlong
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
We present MERaLiON-SER, a robust speech emotion recognition model de- signed
for English and Southeast Asian languages. The model is trained using a hybrid
objective combining weighted categorical cross-entropy and Concordance
Correlation Coefficient (CCC) losses for joint discrete and dimensional emotion
modelling. This dual approach enables the model to capture both the distinct
categories of emotion (like happy or angry) and the fine-grained, such as
arousal (intensity), valence (positivity/...
Авторы:
Mathias Rose Bjare, Giorgia Cantisani, Marco Pasini, Stefan Lattner, Gerhard Widmer
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
We argue that training autoencoders to reconstruct inputs from noised
versions of their encodings, when combined with perceptual losses, yields
encodings that are structured according to a perceptual hierarchy. We
demonstrate the emergence of this hierarchical structure by showing that, after
training an audio autoencoder in this manner, perceptually salient information
is captured in coarser representation structures than with conventional
training. Furthermore, we show that such perceptual hie...
Авторы:
Shubhr Singh, Kiran Bhat, Xavier Riley, Benjamin Resnick, John Thickstun, Walter De Brouwer
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
The proliferation of distorted, compressed, and manipulated music on modern
media platforms like TikTok motivates the development of more robust audio
fingerprinting techniques to identify the sources of musical recordings. In
this paper, we develop and evaluate new neural audio fingerprinting techniques
with the aim of improving their robustness. We make two contributions to neural
fingerprinting methodology: (1) we use a pretrained music foundation model as
the backbone of the neural architect...
Авторы:
Ali Boudaghi, Hadi Zare
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Music editing has emerged as an important and practical area of artificial
intelligence, with applications ranging from video game and film music
production to personalizing existing tracks according to user preferences.
However, existing models face significant limitations, such as being restricted
to editing synthesized music generated by their own models, requiring highly
precise prompts, or necessitating task-specific retraining, thus lacking true
zero-shot capability. Leveraging recent adva...
Авторы:
Louis Bradshaw, Alexander Spangher, Stella Biderman, Simon Colton
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
While generative models for music composition are increasingly capable, their
adoption by musicians is hindered by text-prompting, an asynchronous workflow
disconnected from the embodied, responsive nature of instrumental performance.
To address this, we introduce Aria-Duet, an interactive system facilitating a
real-time musical duet between a human pianist and Aria, a state-of-the-art
generative model, using a Yamaha Disklavier as a shared physical interface. The
framework enables a turn-taking...
Авторы:
Jonathan Morse, Azadeh Naderi, Swen Gaudl, Mark Cartwright, Amy K. Hoover, Mark J. Nelson
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Text-to-audio models are a type of generative model that produces audio
output in response to a given textual prompt. Although level generators and the
properties of the functional content that they create (e.g., playability)
dominate most discourse in procedurally generated content (PCG), games that
emotionally resonate with players tend to weave together a range of creative
and multimodal content (e.g., music, sounds, visuals, narrative tone), and
multimodal models have begun seeing at least e...
Авторы:
Dharma Teja Donepudi
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Intra-sentence multilingual speech synthesis (code-switching TTS) remains a
major challenge due to abrupt language shifts, varied scripts, and mismatched
prosody between languages. Conventional TTS systems are typically monolingual
and fail to produce natural, intelligible speech in mixed-language contexts. We
introduce Script-First Multilingual Synthesis with Adaptive Locale Resolution
(SFMS-ALR), an engine-agnostic framework for fluent, real-time code-switched
speech generation. SFMS-ALR segme...
Авторы:
Rinku Sebastian, Simon O'Keefe, Martin Trefzer
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
Extracting features from the speech is the most critical process in speech
signal processing. Mel Frequency Cepstral Coefficients (MFCC) are the most
widely used features in the majority of the speaker and speech recognition
applications, as the filtering in this feature is similar to the filtering
taking place in the human ear. But the main drawback of this feature is that it
provides only the frequency information of the signal but does not provide the
information about at what time which freq...
Авторы:
Chihiro Nagashima, Akira Takahashi, Zhi Zhong, Shusuke Takahashi, Yuki Mitsufuji
Саммари на русском не найдено
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Доступные поля: ['id', 'arxiv_id', 'title', 'authors', 'abstract', 'summary_ru', 'categories', 'published_date', 'created_at']
Annotation:
This paper explores the integration of AI technologies into the artistic
workflow through the creation of Studies for, a generative sound installation
developed in collaboration with sound artist Evala
(https://www.ntticc.or.jp/en/archive/works/studies-for/). The installation
employs SpecMaskGIT, a lightweight yet high-quality sound generation AI model,
to generate and playback eight-channel sound in real-time, creating an
immersive auditory experience over the course of a three-month exhibition...
Показано 51 -
60
из 274 записей