UNSSOR: unsupervised neural speech separation by leveraging over-determined training mixtures

ZQ Wang, S Watanabe - Advances in Neural Information …, 2024 - proceedings.neurips.cc
In reverberant conditions with multiple concurrent speakers, each microphone acquires a
mixture signal of multiple speakers at a different location. In over-determined conditions …

Neural full-rank spatial covariance analysis for blind source separation

Y Bando, K Sekiguchi, Y Masuyama… - IEEE Signal …, 2021 - ieeexplore.ieee.org
This paper describes aneural blind source separation (BSS) method based on amortized
variational inference (AVI) of a non-linear generative model of mixture signals. A classical …

Spatial loss for unsupervised multi-channel source separation

K Saijo, R Scheibler - arxiv preprint arxiv:2204.00210, 2022 - arxiv.org
We propose a spatial loss for unsupervised multi-channel source separation. The proposed
loss exploits the duality of direction of arrival (DOA) and beamforming: the steering and …

Surrogate source model learning for determined source separation

R Scheibler, M Togami - ICASSP 2021-2021 IEEE International …, 2021 - ieeexplore.ieee.org
We propose to learn surrogate functions of universal speech priors for determined blind
speech separation. Deep speech priors are highly desirable due to their superior modelling …

Self-remixing: Unsupervised speech separation via separation and remixing

K Saijo, T Ogawa - ICASSP 2023-2023 IEEE International …, 2023 - ieeexplore.ieee.org
We present Self-Remixing, a novel self-supervised speech separation method, which refines
a pre-trained separation model in an unsupervised manner. Self-Remixing consists of a …

[PDF][PDF] Weakly-Supervised Neural Full-Rank Spatial Covariance Analysis for a Front-End System of Distant Speech Recognition.

Y Bando, T Aizawa, K Itoyama, K Nakadai - Interspeech, 2022 - isca-archive.org
This paper presents a weakly-supervised multichannel neural speech separation method for
distant speech recognition (DSR) of real conversational speech mixtures. A blind source …

USDnet: Unsupervised Speech Dereverberation via Neural Forward Filtering

ZQ Wang - arxiv preprint arxiv:2402.00820, 2024 - arxiv.org
In reverberant conditions with a single speaker, each far-field microphone records a
reverberant version of the same speaker signal at a different location. In over-determined …

Unsupervised multi-channel separation and adaptation

C Han, K Wilson, S Wisdom… - ICASSP 2024-2024 …, 2024 - ieeexplore.ieee.org
A key challenge in machine learning is to generalize from training data to an application
domain of interest. This work extends the recently-proposed mixture invariant training (MixIT) …

Location as supervision for weakly supervised multi-channel source separation of machine sounds

R Falcon-Perez, G Wichern… - 2023 IEEE Workshop …, 2023 - ieeexplore.ieee.org
In this work, we are interested in learning a model to separate sources that cannot be
recorded in isolation, such as parts of a machine that must run simultaneously in order for …

[PDF][PDF] Mentoring-Reverse Mentoring for Unsupervised Multi-Channel Speech Source Separation.

Y Nakagome, M Togami, T Ogawa, T Kobayashi - Interspeech, 2020 - interspeech2020.org
Mentoring-reverse mentoring, which is a novel knowledge transfer framework for
unsupervised learning, is introduced in multi-channel speech source separation. This …