Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM
Abstract Parameters in climate models are usually calibrated manually, exploiting only small subsets of the available data. This precludes both optimal calibration and quantification of uncertainties. Traditional Bayesian calibration methods that allow uncertainty quantification are too expensive fo...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
American Geophysical Union (AGU)
2021-09-01
|
Series: | Journal of Advances in Modeling Earth Systems |
Subjects: | |
Online Access: | https://doi.org/10.1029/2020MS002454 |
id |
doaj-ca6237ac2485415e82640209436057c3 |
---|---|
record_format |
Article |
spelling |
doaj-ca6237ac2485415e82640209436057c32021-09-28T06:35:39ZengAmerican Geophysical Union (AGU)Journal of Advances in Modeling Earth Systems1942-24662021-09-01139n/an/a10.1029/2020MS002454Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCMOliver R. A. Dunbar0Alfredo Garbuno‐Inigo1Tapio Schneider2Andrew M. Stuart3California Institute of Technology Pasadena CA USAInstituto Tecnológico Autónomo de México Ciudad de México MéxicoCalifornia Institute of Technology Pasadena CA USACalifornia Institute of Technology Pasadena CA USAAbstract Parameters in climate models are usually calibrated manually, exploiting only small subsets of the available data. This precludes both optimal calibration and quantification of uncertainties. Traditional Bayesian calibration methods that allow uncertainty quantification are too expensive for climate models; they are also not robust in the presence of internal climate variability. For example, Markov chain Monte Carlo (MCMC) methods typically require O(105) model runs and are sensitive to internal variability noise, rendering them infeasible for climate models. Here we demonstrate an approach to model calibration and uncertainty quantification that requires only O(102) model runs and can accommodate internal climate variability. The approach consists of three stages: (a) a calibration stage uses variants of ensemble Kalman inversion to calibrate a model by minimizing mismatches between model and data statistics; (b) an emulation stage emulates the parameter‐to‐data map with Gaussian processes (GP), using the model runs in the calibration stage for training; (c) a sampling stage approximates the Bayesian posterior distributions by sampling the GP emulator with MCMC. We demonstrate the feasibility and computational efficiency of this calibrate‐emulate‐sample (CES) approach in a perfect‐model setting. Using an idealized general circulation model, we estimate parameters in a simple convection scheme from synthetic data generated with the model. The CES approach generates probability distributions of the parameters that are good approximations of the Bayesian posteriors, at a fraction of the computational cost usually required to obtain them. Sampling from this approximate posterior allows the generation of climate predictions with quantified parametric uncertainties.https://doi.org/10.1029/2020MS002454uncertainty quantificationmodel calibrationmachine learninggeneral circulation modelparametric uncertaintyinverse problem |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Oliver R. A. Dunbar Alfredo Garbuno‐Inigo Tapio Schneider Andrew M. Stuart |
spellingShingle |
Oliver R. A. Dunbar Alfredo Garbuno‐Inigo Tapio Schneider Andrew M. Stuart Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM Journal of Advances in Modeling Earth Systems uncertainty quantification model calibration machine learning general circulation model parametric uncertainty inverse problem |
author_facet |
Oliver R. A. Dunbar Alfredo Garbuno‐Inigo Tapio Schneider Andrew M. Stuart |
author_sort |
Oliver R. A. Dunbar |
title |
Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM |
title_short |
Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM |
title_full |
Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM |
title_fullStr |
Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM |
title_full_unstemmed |
Calibration and Uncertainty Quantification of Convective Parameters in an Idealized GCM |
title_sort |
calibration and uncertainty quantification of convective parameters in an idealized gcm |
publisher |
American Geophysical Union (AGU) |
series |
Journal of Advances in Modeling Earth Systems |
issn |
1942-2466 |
publishDate |
2021-09-01 |
description |
Abstract Parameters in climate models are usually calibrated manually, exploiting only small subsets of the available data. This precludes both optimal calibration and quantification of uncertainties. Traditional Bayesian calibration methods that allow uncertainty quantification are too expensive for climate models; they are also not robust in the presence of internal climate variability. For example, Markov chain Monte Carlo (MCMC) methods typically require O(105) model runs and are sensitive to internal variability noise, rendering them infeasible for climate models. Here we demonstrate an approach to model calibration and uncertainty quantification that requires only O(102) model runs and can accommodate internal climate variability. The approach consists of three stages: (a) a calibration stage uses variants of ensemble Kalman inversion to calibrate a model by minimizing mismatches between model and data statistics; (b) an emulation stage emulates the parameter‐to‐data map with Gaussian processes (GP), using the model runs in the calibration stage for training; (c) a sampling stage approximates the Bayesian posterior distributions by sampling the GP emulator with MCMC. We demonstrate the feasibility and computational efficiency of this calibrate‐emulate‐sample (CES) approach in a perfect‐model setting. Using an idealized general circulation model, we estimate parameters in a simple convection scheme from synthetic data generated with the model. The CES approach generates probability distributions of the parameters that are good approximations of the Bayesian posteriors, at a fraction of the computational cost usually required to obtain them. Sampling from this approximate posterior allows the generation of climate predictions with quantified parametric uncertainties. |
topic |
uncertainty quantification model calibration machine learning general circulation model parametric uncertainty inverse problem |
url |
https://doi.org/10.1029/2020MS002454 |
work_keys_str_mv |
AT oliverradunbar calibrationanduncertaintyquantificationofconvectiveparametersinanidealizedgcm AT alfredogarbunoinigo calibrationanduncertaintyquantificationofconvectiveparametersinanidealizedgcm AT tapioschneider calibrationanduncertaintyquantificationofconvectiveparametersinanidealizedgcm AT andrewmstuart calibrationanduncertaintyquantificationofconvectiveparametersinanidealizedgcm |
_version_ |
1716866434459500544 |