@kirk86

Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm

, and . (2016)cite arxiv:1608.04471Comment: To appear in NIPS 2016.

Abstract

We propose a general purpose variational inference algorithm that forms a natural counterpart of gradient descent for optimization. Our method iteratively transports a set of particles to match the target distribution, by applying a form of functional gradient descent that minimizes the KL divergence. Empirical studies are performed on various real world models and datasets, on which our method is competitive with existing state-of-the-art methods. The derivation of our method is based on a new theoretical result that connects the derivative of KL divergence under smooth transforms with Stein's identity and a recently proposed kernelized Stein discrepancy, which is of independent interest.

Description

[1608.04471] Stein Variational Gradient Descent: A General Purpose Bayesian Inference Algorithm

Links and resources

URL:
BibTeX key:
liu2016stein
search on:

Comments and Reviews  
(0)

There is no review or comment yet. You can write one!

Tags


Cite this publication