Bayesian optimization for adaptive MCMC
A new randomized strategy for adaptive Markov chain Monte Carlo (MCMC) using Bayesian optimization, called Bayesian-optimized MCMC, is proposed. This approach can handle non-differentiable objective functions and trades off exploration and exploitation to reduce the number of function evaluations. B...
Main Author: | |
---|---|
Language: | English |
Published: |
University of British Columbia
2011
|
Online Access: | http://hdl.handle.net/2429/30636 |
id |
ndltd-LACETR-oai-collectionscanada.gc.ca-BVAU.2429-30636 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-LACETR-oai-collectionscanada.gc.ca-BVAU.2429-306362014-03-26T03:37:28Z Bayesian optimization for adaptive MCMC Mahendran, Nimalan A new randomized strategy for adaptive Markov chain Monte Carlo (MCMC) using Bayesian optimization, called Bayesian-optimized MCMC, is proposed. This approach can handle non-differentiable objective functions and trades off exploration and exploitation to reduce the number of function evaluations. Bayesian-optimized MCMC is applied to the complex setting of sampling from constrained, discrete and densely connected probabilistic graphical models where, for each variation of the problem, one needs to adjust the parameters of the proposal mechanism automatically to ensure efficient mixing of the Markov chains. It is found that Bayesian-optimized MCMC is able to match or surpass manual tuning of the proposal mechanism by a domain expert. 2011-01-14T22:03:17Z 2011-01-14T22:03:17Z 2011 2011-01-14T22:03:17Z 2011-05 Electronic Thesis or Dissertation http://hdl.handle.net/2429/30636 eng University of British Columbia |
collection |
NDLTD |
language |
English |
sources |
NDLTD |
description |
A new randomized strategy for adaptive Markov chain Monte Carlo (MCMC) using Bayesian optimization, called Bayesian-optimized MCMC, is proposed. This approach can handle non-differentiable objective functions and trades off exploration and exploitation to reduce the number of function evaluations. Bayesian-optimized MCMC is applied to the complex setting of sampling from constrained, discrete and densely connected probabilistic graphical models where, for each variation of the problem, one needs to adjust the parameters of the proposal mechanism automatically to ensure efficient mixing of the Markov chains. It is found that Bayesian-optimized MCMC is able to match or surpass manual tuning of the proposal mechanism by a domain expert. |
author |
Mahendran, Nimalan |
spellingShingle |
Mahendran, Nimalan Bayesian optimization for adaptive MCMC |
author_facet |
Mahendran, Nimalan |
author_sort |
Mahendran, Nimalan |
title |
Bayesian optimization for adaptive MCMC |
title_short |
Bayesian optimization for adaptive MCMC |
title_full |
Bayesian optimization for adaptive MCMC |
title_fullStr |
Bayesian optimization for adaptive MCMC |
title_full_unstemmed |
Bayesian optimization for adaptive MCMC |
title_sort |
bayesian optimization for adaptive mcmc |
publisher |
University of British Columbia |
publishDate |
2011 |
url |
http://hdl.handle.net/2429/30636 |
work_keys_str_mv |
AT mahendrannimalan bayesianoptimizationforadaptivemcmc |
_version_ |
1716655845777866752 |