Song, L. and Lu, H. orcid.org/0000-0002-0349-2181 (2016) Proper Inner Product with Mean Displacement for Gaussian Noise Invariant ICA. In: Proceedings of The 8th Asian Conference on Machine Learning. The 8th Asian Conference on Machine Learning, November 16-18 2016, The University of Waikato, Hamilton, New Zealand. , pp. 398-413.
Abstract
Independent Component Analysis (ICA) is a classical method for Blind Source Separation (BSS). In this paper, we are interested in ICA in the presence of noise, i.e., the noisy ICA problem. Pseudo-Euclidean Gradient Iteration (PEGI) is a recent cumulant-based method that defines a pseudo Euclidean inner product to replace a quasi-whitening step in Gaussian noise invariant ICA. However, PEGI has two major limitations: 1) the pseudo Euclidean inner product is improper because it violates the positive definiteness of inner product; 2) the inner product matrix is orthogonal by design but it has gross errors or imperfections due to sample-based estimation. This paper proposes a new cumulant-based ICA method named as PIMD to address these two problems. We first define a Proper Inner product (PI) with proved positive definiteness and then relax the centering preprocessing step to a mean displacement (MD) step. Both PI and MD aim to improve the orthogonality of inner product matrix and the recovery of independent components (ICs) in sample-based estimation. We adopt a gradient iteration step to find the ICs for PIMD. Experiments on both synthetic and real data show the respective effectiveness of PI and MD as well as the superiority of PIMD over competing ICA methods. Moreover, MD can improve the performance of other ICA methods as well.
Metadata
Item Type: | Proceedings Paper |
---|---|
Authors/Creators: |
|
Copyright, Publisher and Additional Information: | © 2016 The Author(s). Reproduced in accordance with the publisher's self-archiving policy. |
Keywords: | Blind Source Separation; Noisy Independent Component Analysis; Cumulants; Inner Product; Pseudo-whitening |
Dates: |
|
Institution: | The University of Sheffield |
Academic Units: | The University of Sheffield > Faculty of Engineering (Sheffield) > Department of Computer Science (Sheffield) |
Depositing User: | Symplectic Sheffield |
Date Deposited: | 12 Jan 2017 12:05 |
Last Modified: | 12 Jan 2017 12:08 |
Published Version: | http://www.jmlr.org/proceedings/papers/v63/ |
Status: | Published |
Refereed: | Yes |
Related URLs: | |
Open Archives Initiative ID (OAI ID): | oai:eprints.whiterose.ac.uk:109948 |