Learning the Kernel Matrix with Semi-Definite Programming
Lanckriet, Gert R. G., Cristianini, Nello, Bartlett, Peter, El Ghaoui, Laurent, & Jordan, Michael I. (2002) Learning the Kernel Matrix with Semi-Definite Programming. Technical Report, UCB/CSD-02-1206. University of California, Berkeley, California (USA).
Kernel-based learning algorithms work by embedding the data into a Euclidean space, and then searching for linear relations among the embedded data points. The embedding is performed implicitly, by specifying the inner products between each pair of points in the embedding space. This information is contained in the so-called kernel matrix, a symmetric and positive definite matrix that encodes the relative positions of all points. Specifying this matrix amounts to specifying the geometry of the embedding space and inducing a notion of similarity in the input space -- classical model selection problems in machine learning. In this paper we show how the kernel matrix can be learned from data via semi-definite programming (SDP) techniques. When applied to a kernel matrix associated with both training and test data this gives a powerful transductive algorithm -- using the labelled part of the data one can learn an embedding also for the unlabelled part. The similarity between test points is inferred from training points and their labels. Importantly, these learning problems are convex, so we obtain a method for learning both the model class and the function without local minima. Furthermore, this approach leads directly to a convex method to learn the 2-norm soft margin parameter in support vector machines, solving another important open problem. Finally, the novel approach presented in the paper is supported by positive empirical results.
Impact and interest:
Citation counts are sourced monthly from and citation databases.
Citations counts from theindexing service can be viewed at the linked Google Scholar™ search.
|Additional Information:||Fulltext freely available see "Official Link" above|
|Divisions:||Current > QUT Faculties and Divisions > Division of Administrative Services
Past > Schools > Mathematical Sciences
|Copyright Owner:||Copyright 2002 the authors.|
|Deposited On:||18 Aug 2011 05:24|
|Last Modified:||18 Aug 2011 05:24|
Repository Staff Only: item control page