TR2025-032
Task-Aware Unified Source Separation
-
- , "Task-Aware Unified Source Separation", IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), DOI: 10.1109/ICASSP49660.2025.10887819, April 2025.BibTeX TR2025-032 PDF Software
- @inproceedings{Saijo2025mar,
- author = {Saijo, Kohei and Ebbers, Janek and Germain, François G and Wichern, Gordon and {Le Roux}, Jonathan},
- title = {{Task-Aware Unified Source Separation}},
- booktitle = {IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP)},
- year = 2025,
- month = mar,
- doi = {10.1109/ICASSP49660.2025.10887819},
- url = {https://www.merl.com/publications/TR2025-032}
- }
- , "Task-Aware Unified Source Separation", IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), DOI: 10.1109/ICASSP49660.2025.10887819, April 2025.
-
MERL Contacts:
-
Research Areas:
Abstract:
Several attempts have been made to handle multiple source separation tasks such as speech enhancement, speech separation, sound event separation, music source separation (MSS), or cinematic audio source separation (CASS) with a single model. These models are trained on large-scale data including speech, instruments, or sound events and can often successfully separate a wide range of sources. However, it is still challenging for such models to cover all separation tasks because some of them are contradictory (e.g., musical instruments are separated in MSS while they have to be grouped in CASS). To overcome this issue and support all the major separation tasks, we propose a task-aware unified source separation (TUSS) model. The model uses a variable number of learnable prompts to specify which source to separate, and changes its behavior depending on the given prompts, enabling it to handle all the major separation tasks including contradictory ones. Experimental results demonstrate that the proposed TUSS model successfully handles the five major separation tasks mentioned earlier. We also provide some audio examples, including both synthetic mixtures and real recordings, to demonstrate how flexibly the TUSS model changes its behavior at inference depending on the prompts.
Software & Data Downloads
Related News & Events
-
AWARD Mitsubishi Electric Group Wins Minister of Internal Affairs and Communications Award at CEATEC 2026 for TUSS Technology Date: October 13, 2026
Awarded to: Mitsubishi Electric Group, including Mitsubishi Electric Research Laboratories (MERL)
MERL Contacts: Christoph Boeddeker; Jonathan Le Roux; Yoshiki Masuyama; Julius Richter; Gordon Wichern
Research Areas: Artificial Intelligence, Machine Learning, Speech & AudioBrief- Mitsubishi Electric Group received the Minister of Internal Affairs and Communications Award at CEATEC 2026 for its Task-Aware Unified Source Separation (TUSS) technology. Originally developed at Mitsubishi Electric Research Laboratories (MERL) and first introduced in a paper published on arXiv in October 2024 and subsequently presented at ICASSP 2025, TUSS was further advanced in collaboration with Mitsubishi Electric for real-world applications. Following a press release in August 2026, the technology was demonstrated at CEATEC 2026, held at Makuhari Messe, Japan, from October 13–16, 2026.
TUSS is a unified, prompt-driven sound separation technology that enables a single AI model to perform a wide range of sound separation and extraction tasks. By specifying the desired sound sources through prompts, the system can separate speech, singing voices, musical instruments, machinery sounds, and other acoustic events from complex mixtures, without requiring a separate model for each task. This flexibility enables applications ranging from speech enhancement and recognition to music production, machine monitoring, and acoustic scene understanding.
At CEATEC, TUSS was presented as the "ears of physical AI," demonstrating how sound separation can help robots and other intelligent systems perceive their environments beyond visual information. Potential applications include disaster response, where rescuers could identify voices calling for help amid background noise, and industrial environments, where separating machinery sounds can support anomaly detection and situational awareness. The technology was recognized for its versatility, efficiency, and potential to improve the reliability of physical AI systems operating in complex real-world environments.
The demonstration and award attracted extensive media attention in Japan, including coverage by major television networks such as NHK, TBS, TV Tokyo, TV Asahi, Fuji TV, and Nippon TV, as well as numerous newspapers and technology publications. The technology was also featured internationally on NHK World.
For more information, see the official CEATEC award announcement and a presentation of TUSS at CEATEC 2026.
- Mitsubishi Electric Group received the Minister of Internal Affairs and Communications Award at CEATEC 2026 for its Task-Aware Unified Source Separation (TUSS) technology. Originally developed at Mitsubishi Electric Research Laboratories (MERL) and first introduced in a paper published on arXiv in October 2024 and subsequently presented at ICASSP 2025, TUSS was further advanced in collaboration with Mitsubishi Electric for real-world applications. Following a press release in August 2026, the technology was demonstrated at CEATEC 2026, held at Makuhari Messe, Japan, from October 13–16, 2026.
-
EVENT MERL Contributes to ICASSP 2025 Date: Sunday, April 6, 2025 - , April 11, 2025
Location: Hyderabad, India
MERL Contacts: Wael H. Ali; Petros T. Boufounos; Radu Corcodel; Chiori Hori; Siddarth Jain; Toshiaki Koike-Akino; Jonathan Le Roux; Yanting Ma; Hassan Mansour; Yoshiki Masuyama; Joshua Rapp; Anthony Vetro; Pu (Perry) Wang; Gordon Wichern
Research Areas: Artificial Intelligence, Communications, Computational Sensing, Electronic and Photonic Devices, Machine Learning, Robotics, Signal Processing, Speech & AudioBrief- MERL has made numerous contributions to both the organization and technical program of ICASSP 2025, which is being held in Hyderabad, India from April 6-11, 2025.
Sponsorship
MERL is proud to be a Silver Patron of the conference and will participate in the student job fair on Thursday, April 10. Please join this session to learn more about employment opportunities at MERL, including openings for research scientists, post-docs, and interns.
MERL is pleased to be the sponsor of two IEEE Awards that will be presented at the conference. We congratulate Prof. Björn Erik Ottersten, the recipient of the 2025 IEEE Fourier Award for Signal Processing, and Prof. Shrikanth Narayanan, the recipient of the 2025 IEEE James L. Flanagan Speech and Audio Processing Award. Both awards will be presented in-person at ICASSP by Anthony Vetro, MERL President & CEO.
Technical Program
MERL is presenting 15 papers in the main conference on a wide range of topics including source separation, sound event detection, sound anomaly detection, speaker diarization, music generation, robot action generation from video, indoor airflow imaging, WiFi sensing, Doppler single-photon Lidar, optical coherence tomography, and radar imaging. Another paper on spatial audio will be presented at the Generative Data Augmentation for Real-World Signal Processing Applications (GenDA) Satellite Workshop.
MERL Researchers Petros Boufounos and Hassan Mansour will present a Tutorial on “Computational Methods in Radar Imaging” in the afternoon of Monday, April 7.
Petros Boufounos will also be giving an industry talk on Thursday April 10 at 12pm, on “A Physics-Informed Approach to Sensing".
About ICASSP
ICASSP is the flagship conference of the IEEE Signal Processing Society, and the world's largest and most comprehensive technical conference focused on the research advances and latest technological development in signal and information processing. The event has been attracting more than 4000 participants each year.
- MERL has made numerous contributions to both the organization and technical program of ICASSP 2025, which is being held in Hyderabad, India from April 6-11, 2025.

