+ Resolve Article
+ Follow Us
Follow on FacebookFollow on Facebook
Follow on TwitterFollow on Twitter

+ Translate
+ Subscribe to Site Feed
GeoScience Most Shared ContentMost Shared Content

Optimal linear compression under unreliable representation and robust PCA neural models

, : Optimal linear compression under unreliable representation and robust PCA neural models. IEEE Transactions on Neural Networks 10(5): 1186-1195

In a typical linear data compression system the representation variables resulting from the coding operation are assumed totally reliable and therefore the solution in the mean-squared-error sense is an orthogonal projector to the so-called principal component subspace. When the representation variables are contaminated by additive noise which is uncorrelated with the signal, the problem is called noisy principal component analysis (NPCA) and the optimal MSE solution is not a trivial extension of PCA. We first show that the problem is not well defined unless we impose explicit or implicit constraints on either the coding or the decoding operator. Second, orthogonality is not a property of the optimal solution under most constraints. Third, the signal components may or may not be reconstructed depending on the noise level. As the noise power increases, we observe rank reduction in the optimal solution under most reasonable constraints. In these cases it appears that it is preferable to omit the smaller signal components rather than attempting to reconstruct them. This phenomenon has similarities with classical information theoretical results, notably the water-filling analogy, found in parallel additive Gaussian noise channels. Finally, we show that standard Hebbian-type PCA learning algorithms are not optimally robust to noise, and propose a new Hebbian-type learning algorithm which is optimally robust in the NPCA sense.


PMID: 18252619

DOI: 10.1109/72.788657

Other references

Robertson, M., 1982: The evolutionary past of the major histocompatibility complex and the future of cellular immunology. Nature 297(5868): 629-632

Petersen, J.J., 1985: Nematode parasites. An account of the nematode parasites of mosquitoes is given, mostly devoted to those in the family Mermithidae. Brief descriptions of the 15 recognized species in 6 genera are included. A general discussion of mermithid life cycles, host specifici...

King, R.J.; Wang, D.Y.; Daly, R.J.; Darbre, P.D., 1989: Approaches to studying the role of growth factors in the progression of breast tumours from the steroid sensitive to insensitive state. Progression from steroid sensitive to autonomous proliferation can be modelled in several cultured mammary tumour cell lines by long-term withdrawal of steroids. A feature of all the four systems studied thus far is that the basal growth in the ab...

Korovina, O.N., 1986: Natural resources of wild relatives of crop plants in the European and Siberian regions of the USSR and their conservation. In all, 199 species belonging to 86 genera and 24 families have been identified as of value for breeding or cultivation. Their distribution is indicated, together with measures being undertaken for their conservation. Of 23 rare species on which d...

Babajants, L.T.; Vasiliev, A.A.; Babajants, O.V., 1999: Puccinia recondita f. sp. tritici races composition in southern Ukraine during the period from 1988 to 1996. Population of Puccinia recondita Rob. ex Desm. f. sp. tritici in southern Ukraine consisted of 56 races according to the studies performed during the period from 1988 till 1996. The race 77 was found to dominate during that period. There was no vi...

Kimmel, K., 1972: Optimal only through true teamwork. Experiences of the ZISE seminars in Koblenz. Quintessence International 3(1): 81-84

Aitken, L.M.; Chaboyer, W.; Kendall, E.; Burmeister, E., 2012: Health status after traumatic injury. This study explored the relationships between health-related quality of life and postacute factors such as patients' perceived access to information and support, perceptions of illness and ability to provide self-care after traumatic injury....

Zhou Jianbo; H.K., 1998: Tectonic activities of the Yihe-Shuhe Fault, Shandong, China during Jinning Movement. Field geological investigations and the results of (super 40) Ar/ (super 39) Ar isotopic dating demonstrate that the NNE trending ductile shear zone of the basement of the central segment of the Yihe-Shuhe fault developed during the Jinning Moveme...

Conway, J.A., 1984: The use of brodifacoum formulations for rodent control treatments against Bandicota bengalensis in food godowns in Bangladesh. In a small scale field trial, wax blocks incorporating brodifacoum were assessed for palatibility in comparison with a loose cereal bait base. This was followed by a baiting treatment using 10 g baits of brodifacoum in a mixed cereal/sugar/oil bas...

Marino, G.; Pucci, P.; Malorni, A.; Morris, H.R., 1988: Analysis of post-translational modifications by FAB mass spectrometry. Advances in Experimental Medicine and Biology 231: 651-657