Shared Kernel Information Embedding for Discriminative Inference
- 4 August 2011
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 34 (4), 778-790
- https://doi.org/10.1109/tpami.2011.154
Abstract
Latent variable models, such as the GPLVM and related methods, help mitigate overfitting when learning from small or moderately sized training sets. Nevertheless, existing methods suffer from several problems: 1) complexity, 2) the lack of explicit mappings to and from the latent space, 3) an inability to cope with multimodality, and 4) the lack of a well-defined density over the latent space. We propose an LVM called the Kernel Information Embedding (KIE) that defines a coherent joint density over the input and a learned latent space. Learning is quadratic, and it works well on small data sets. We also introduce a generalization, the shared KIE (sKIE), that allows us to model multiple input spaces (e.g., image features and poses) using a single, shared latent representation. KIE and sKIE permit missing data during inference and partially labeled data during learning. We show that with data sets too large to learn a coherent global model, one can use the sKIE to learn local online models. We use sKIE for human pose inference.Keywords
This publication has 26 references indexed in Scilit:
- Parametric dimensionality reduction by unsupervised regressionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2010
- HumanEva: Synchronized Video and Motion Capture Dataset and Baseline Algorithm for Evaluation of Articulated Human MotionInternational Journal of Computer Vision, 2009
- Twin Gaussian Processes for Structured PredictionInternational Journal of Computer Vision, 2009
- Sequential Kernel Density Approximation and Its Application to Real-Time Visual TrackingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2008
- Fast algorithms for large scale conditional 3D predictionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2008
- Nonparametric Density Estimation with Adaptive, Anisotropic Kernels for Human Motion TrackingLecture Notes in Computer Science, 2007
- Spectral Latent Variable Models for Perceptual InferencePublished by Institute of Electrical and Electronics Engineers (IEEE) ,2007
- Mean shift: a robust approach toward feature space analysisIeee Transactions On Pattern Analysis and Machine Intelligence, 2002
- Elements of Information TheoryPublished by Wiley ,2001
- Multivariate Density EstimationWiley Series in Probability and Statistics, 1992