UniverSR: Unified and Versatile Audio Super-Resolution via Vocoder-Free Flow Matching

2510.00771v1 eess.AS, cs.AI, cs.SD, eess.SP 2025-10-04
Авторы:

Woongjib Choi, Sangmin Lee, Hyungseob Lim, Hong-Goo Kang

Abstract

In this paper, we present a vocoder-free framework for audio super-resolution that employs a flow matching generative model to capture the conditional distribution of complex-valued spectral coefficients. Unlike conventional two-stage diffusion-based approaches that predict a mel-spectrogram and then rely on a pre-trained neural vocoder to synthesize waveforms, our method directly reconstructs waveforms via the inverse Short-Time Fourier Transform (iSTFT), thereby eliminating the dependence on a separate vocoder. This design not only simplifies end-to-end optimization but also overcomes a critical bottleneck of two-stage pipelines, where the final audio quality is fundamentally constrained by vocoder performance. Experiments show that our model consistently produces high-fidelity 48 kHz audio across diverse upsampling factors, achieving state-of-the-art performance on both speech and general audio datasets.

Ссылки и действия

Связанные статьи

IS${}^3$ : Generic Impulsive--Stationary Sound Separation in Acoustic Scenes usi...

## Контекст Область рассмотрения — разработка систем анализа акустических сцен, которые могут выделять изолированные аку...

2025-09-05

Towards Low-Latency Tracking of Multiple Speakers With Short-Context Speaker Emb...

## Контекст Одна из сложностей технологий синтеза речи и транскрибирования речи в реальном времени заключается в необход...

2025-08-22