2021 Intelligent Sensing Winter School
Target speech extraction
Marc Delcroix, NTT Communication Science Laboratories
Human selective listening ability enables us to listen to a desired speaker or sound in a mixture using clues about that speaker or sound. Target speech extraction aims at computationally reproducing this ability of humans, i.e., estimating the speech signal of the desired speaker in a speech mixture using a short enrollment utterance or video of the speaker as clues. In this talk, we will introduce neural network-based target speech extraction focusing on enrollment-based approaches. We will also briefly discuss the extension of the idea beyond speech to realize universal sound extraction, where the target signal can be any arbitrary sound.
Slides: http://cis.eecs.qmul.ac.uk/2021Winter...
As part of the 2021 Intelligent Sensing Winter School: http://cis.eecs.qmul.ac.uk/school2021...