White Rose University Consortium logo
University of Leeds logo University of Sheffield logo York University logo

Exploiting correlogram structure for robust speech recognition with multiple speech sources

Ma, N., Green, P., Barker, J. and Coy, A. (2007) Exploiting correlogram structure for robust speech recognition with multiple speech sources. Speech Communication, 49 (12). pp. 874-891. ISSN 0167-6393


Download (514Kb)


This paper addresses the problem of separating and recognising speech in a monaural acoustic mixture with the presence of competing speech sources. The proposed system treats sound source separation and speech recognition as tightly coupled processes. In the first stage sound source separation is performed in the correlogram domain. For periodic sounds, the correlogram exhibits symmetric tree-like structures whose stems are located on the delay that corresponds to multiple pitch periods. These pitch-related structures are exploited in the study to group spectral components at each time frame. Local pitch estimates are then computed for each spectral group and are used to form simultaneous pitch tracks for temporal integration. These processes segregate a spectral representation of the acoustic mixture into several time-frequency regions such that the energy in each region is likely to have originated from a single periodic sound source. The identified time-frequency regions, together with the spectral representation, are employed by a `speech fragment decoder' which employs `missing data' techniques with clean speech models to simultaneously search for the acoustic evidence that best matches model sequences. The paper presents evaluations based on artificially mixed simultaneous speech utterances. A coherence-measuring experiment is first reported which quantifies the consistency of the identified fragments with a single source. The system is then evaluated in a speech recognition task and compared to a conventional fragment generation approach. Results show that the proposed system produces more coherent fragments over different conditions, which results in significantly better recognition accuracy.

Item Type: Article
Copyright, Publisher and Additional Information: © 2007 Elsevier B.V. This is an author produced version of a paper published in Speech Communication. Uploaded in accordance with the publisher's self-archiving policy.
Institution: The University of Sheffield
Academic Units: The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield)
Depositing User: Sherpa Assistant
Date Deposited: 18 Dec 2007 16:34
Last Modified: 06 Jun 2014 00:25
Published Version: http://dx.doi.org/10.1016/j.specom.2007.05.003
Status: Published
Publisher: Elsevier B.V.
Refereed: Yes
Identification Number: 10.1016/j.specom.2007.05.003
URI: http://eprints.whiterose.ac.uk/id/eprint/3531

Actions (repository staff only: login required)