PromptReverb: Multimodal Room Impulse Response Generation Through Latent Rectified Flow Matching
2510.22439v1
cs.SD, cs.AI, I.2.6, H.5.5
2025-10-29
Авторы:
Ali Vosoughi, Yongyi Zang, Qihui Yang, Nathan Peak, Randal Leistikow, Chenliang Xu
Abstract
Room impulse response (RIR) generation remains a critical challenge for
creating immersive virtual acoustic environments. Current methods suffer from
two fundamental limitations: the scarcity of full-band RIR datasets and the
inability of existing models to generate acoustically accurate responses from
diverse input modalities. We present PromptReverb, a two-stage generative
framework that addresses these challenges. Our approach combines a variational
autoencoder that upsamples band-limited RIRs to full-band quality (48 kHz), and
a conditional diffusion transformer model based on rectified flow matching that
generates RIRs from descriptions in natural language. Empirical evaluation
demonstrates that PromptReverb produces RIRs with superior perceptual quality
and acoustic accuracy compared to existing methods, achieving 8.8% mean RT60
error compared to -37% for widely used baselines and yielding more realistic
room-acoustic parameters. Our method enables practical applications in virtual
reality, architectural acoustics, and audio production where flexible,
high-quality RIR synthesis is essential.