+ Resolve Article
+ Follow Us
Follow on FacebookFollow on Facebook
Follow on TwitterFollow on Twitter

+ Translate
+ Subscribe to Site Feed
GeoScience Most Shared ContentMost Shared Content

Nonlinear regularization path for quadratic loss support vector machines

, : Nonlinear regularization path for quadratic loss support vector machines. IEEE Transactions on Neural Networks 22(10): 1613-1625

Regularization path algorithms have been proposed to deal with model selection problem in several machine learning approaches. These algorithms allow computation of the entire path of solutions for every value of regularization parameter using the fact that their solution paths have piecewise linear form. In this paper, we extend the applicability of regularization path algorithm to a class of learning machines that have quadratic loss and quadratic penalty term. This class contains several important learning machines such as squared hinge loss support vector machine (SVM) and modified Huber loss SVM. We first show that the solution paths of this class of learning machines have piecewise nonlinear form, and piecewise segments between two breakpoints are characterized by a class of rational functions. Then we develop an algorithm that can efficiently follow the piecewise nonlinear path by solving these rational equations. To solve these rational equations, we use rational approximation technique with quadratic convergence rate, and thus, our algorithm can follow the nonlinear path much more precisely than existing approaches such as predictor-corrector type nonlinear-path approximation. We show the algorithm performance on some artificial and real data sets.


PMID: 21880570

DOI: 10.1109/TNN.2011.2164265

Other references

Cristofolini Renato; Ghisetti Francesca; Vezzani Livio; Scarpa Roberto, 1982: Deep-seated and surficial dynamic processes of the Calabrian Arc and Southern Apennines based on geological, seismological and volcanological data. Memorie della Societa Geologica Italiana 24(part 3): 497-505

Yoshino, H.; Matsunaga, H.; Kaneko, H.; Yoshitake, A.; Nakatsuka, I.; Yamada, H., 1993: Metabolism of N-[4-chloro-2-fluoro-5-[(1-methyl-2- propynl)oxy]phenyl]-3,4,5,6-tetrahydrophthalimide (S-23121) in the rat: I. Identification of a new, sulphonic acid type of conjugate. 1. Several metabolites of 14C-labelled N-[4-chloro-2-fluoro-5-[(1-methyl- 2-propynyl)oxy]phenyl]-3,4,5,6-tetra-hydrophthalimide (S-23121) were identified. 2. The major urinary metabolites were found to be 4-chloro-2-fluoro-5-hydroxyaniline, its su...

Liszewska, E.; Reinaud, P.; Billon-Denis, E.; Dubois, O.; Robin, P.; Charpigny, G., 2008: Lysophosphatidic acid signaling during embryo development in sheep: involvement in prostaglandin synthesis. We investigated the lysophosphatidic acid (LPA) pathway during early pregnancy in sheep. LPA was detected in the uteri of early-stage pregnant ewes. Using quantitative RT-PCR, the expression of autotaxin, the LPA-generating enzyme, was found in th...

Macefield, V.G.; Elam, M., 2002: Prolonged surges of baroreflex-resistant muscle sympathetic drive during periodic breathing. We report unusual muscle sympathetic nerve activity (MSNA) in patients with Cheyne-Stokes respiration (CSR), one suffering congestive heart failure (CHF) and three with obstructive sleep apnea syndrome (OSAS). MSNA was recorded via a tungsten micr...

Traynor, K., 2005: FDA advisers vote against nonprescription lovastatin. American Journal of Health-System Pharmacy 62(5): 455-6, 460

Fluegel E.; Hentschel G., 1980: Osumilite from Zinster Kuppe, Bavaria. Lapis (Muenchen) 5(3): 14-17

Boutsiouki, P.; Clough, G., 2001: Role of nitric oxide in the vascular response to acetylcholine in human skin, in vivo. Journal of Physiology (Cambridge) 531P: 20P-21P, March

French, M.W.; Worden, R.H., 2013: Orientation of microcrystalline quartz in the Fontainebleau Formation, Paris Basin and why it preserves porosity. In sedimentary basins, deeply buried sandstones typically have low porosity due to cementation and compaction. There are several known causes of anomalous preservation of porosity in sandstones, one of which is microcrystalline quartz coatings on...

Manuel, W.W.; Premkumar, B.; Sevugaperumal, S., 1978: Note on the effect of dipping roots of seedlings in zinc sulphate and ammonium molybdate on the flowering duration of rice. 'Induced' seeds of 6 rice cv. were obtained from plants grown after dipping seedling roots in 5-20% zinc sulphate (ZS) or ammonium molybdate (AM) sol. When sown, accelerated flowering occurred in cv. CR 141-192 (5% AM treatment), delayed...

Kachalovskii, E., 1980: Multiple approach to the development of subsidiary farms. Ekonomika sel'skogo khoziaistva: (2) 11-16