Direct Conditioning of Audio Diffusion Transformers on fMRI Reveals Cortical Contributions to Sound Reconstruction
cs.SD, cs.CV
Submitted: 2026-11-09
Updated: 2026-11-09
Project page: https://fidelioc55.github.io/brainSounds-website
Terminology
Sources
- DINOv2: Learning Robust Visual Features without Supervision
- MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Data
- Audio Prompt Adapter: Unleashing Music Editing Abilities for Text-to-Music with Lightweight Finetuning
- MuseControlLite: Multifunctional Music Generation with Lightweight Conditioners
- IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models
Related papers
- Speech-DRAME: A Framework for Human-Aligned Benchmarks in Speech Role-Play
- MuLaCover: Flexible Cover Song Generation via Symbolic Tonal Control
- Optimising Neural Speech Codecs for 300bps Communication using Reinforcement Learning
- Few-Shot Open-Set Audio Classification via Transductive Prototype Refinement and Class Logit Enhancement
- Spectral Masking and Interpolation Attack (SMIA): A Black-box Adversarial Attack against Voice Authentication and Anti-Spoofing Systems
- Remix the Timbre: Diffusion-Based Style Transfer Across Polyphonic Stems