Development and application of a framework for technology and model selection under uncertainty

Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Chemical Engineering, 2010. === Cataloged from PDF version of thesis. === Includes bibliographical references (p. 205-209). === Technology selection is a complex decision problem that is often faced in process engineering. This has bee...

Full description

Bibliographic Details
Main Author: Berkelmans, Ingrid (Ingrid M.)
Other Authors: Gregory J. McRae.
Format: Others
Language:English
Published: Massachusetts Institute of Technology 2010
Subjects:
Online Access:http://hdl.handle.net/1721.1/59873
id ndltd-MIT-oai-dspace.mit.edu-1721.1-59873
record_format oai_dc
collection NDLTD
language English
format Others
sources NDLTD
topic Chemical Engineering.
spellingShingle Chemical Engineering.
Berkelmans, Ingrid (Ingrid M.)
Development and application of a framework for technology and model selection under uncertainty
description Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Chemical Engineering, 2010. === Cataloged from PDF version of thesis. === Includes bibliographical references (p. 205-209). === Technology selection is a complex decision problem that is often faced in process engineering. This has been a particularly important problem recently in the energy field, in which many new technologies have been proposed. Typically only point estimates of the chosen metrics are used in the evaluation, with uncertainty often overlooked. However, uncertainty can have a significant effect on the conclusions and decisions to be made. This work investigates the issues surrounding the uncertainty in process engineering models. Model complexity, selection bias and information gain are examined. Existing model selection methods, including Information Criteria Methods and Hypothesis Testing are analyzed, with an emphasis on how they address issues surrounding uncertainty in models. Bayes' methods are investigated in detail because they offer a mathematically sound and very flexible alternative to traditional techniques. A framework is proposed for evaluating the information difference between competing process engineering models involving uncertainties. This framework can be applied when there are competing processes (e.g. a technology selection problem) or when there are competing models for the one process (e.g. several models of the one process with different levels of complexity). The framework uses the Deterministically Equivalent Modeling Method (DEMM) and Bayes' model selection methods and consequently can be applied to black box models. The methods chosen allow assumptions required in other methods to be relaxed, while keeping computation time minimal. In particular, assumptions about output distributions are relaxed, which is important in process engineering models because equilibrium and theoretical limits can cause output distributions to be highly irregular. A major challenge has been applying Bayes' model selection methods to cases where experimental output data does not exist, which occurs when assessing new technologies. Modifications to existing model selection have been developed to address these cases. Applying this framework will give the information difference between models, and identify which parameters are driving the overall. These results can be used in a sequential decision making process, facilitating decisions over the best use of resources. This may include helping to shape experimental programs or further refinement of the models. The framework has been applied to three case studies. The first involves competing hydrogen producing thermochemical cycles. It was found that the best use of resources was to further investigate the separations involved, rather than the reactions. The second involved two versions of a refinery process. The overall uncertainty was driven by uncertainty in the fitted parameters, and consequently if a difference is to be observed then the uncertainty in these fitted parameters need to be reduced. The third case study involved competing technologies for warm syngas cleanup. The excel-based tool has been constructed so that this framework can be applied by others in the future. This tool calls Matlab to complete the required calculations, but only requires the user to enter the required inputs in Excel, making it easy for the user. === by Ingrid Berkelmans. === Ph.D.
author2 Gregory J. McRae.
author_facet Gregory J. McRae.
Berkelmans, Ingrid (Ingrid M.)
author Berkelmans, Ingrid (Ingrid M.)
author_sort Berkelmans, Ingrid (Ingrid M.)
title Development and application of a framework for technology and model selection under uncertainty
title_short Development and application of a framework for technology and model selection under uncertainty
title_full Development and application of a framework for technology and model selection under uncertainty
title_fullStr Development and application of a framework for technology and model selection under uncertainty
title_full_unstemmed Development and application of a framework for technology and model selection under uncertainty
title_sort development and application of a framework for technology and model selection under uncertainty
publisher Massachusetts Institute of Technology
publishDate 2010
url http://hdl.handle.net/1721.1/59873
work_keys_str_mv AT berkelmansingridingridm developmentandapplicationofaframeworkfortechnologyandmodelselectionunderuncertainty
AT berkelmansingridingridm frameworkfortechnologyandmodelselectionunderuncertainty
_version_ 1719031437302169600
spelling ndltd-MIT-oai-dspace.mit.edu-1721.1-598732019-05-02T15:55:38Z Development and application of a framework for technology and model selection under uncertainty Framework for technology and model selection under uncertainty Berkelmans, Ingrid (Ingrid M.) Gregory J. McRae. Massachusetts Institute of Technology. Dept. of Chemical Engineering. Massachusetts Institute of Technology. Dept. of Chemical Engineering. Chemical Engineering. Thesis (Ph. D.)--Massachusetts Institute of Technology, Dept. of Chemical Engineering, 2010. Cataloged from PDF version of thesis. Includes bibliographical references (p. 205-209). Technology selection is a complex decision problem that is often faced in process engineering. This has been a particularly important problem recently in the energy field, in which many new technologies have been proposed. Typically only point estimates of the chosen metrics are used in the evaluation, with uncertainty often overlooked. However, uncertainty can have a significant effect on the conclusions and decisions to be made. This work investigates the issues surrounding the uncertainty in process engineering models. Model complexity, selection bias and information gain are examined. Existing model selection methods, including Information Criteria Methods and Hypothesis Testing are analyzed, with an emphasis on how they address issues surrounding uncertainty in models. Bayes' methods are investigated in detail because they offer a mathematically sound and very flexible alternative to traditional techniques. A framework is proposed for evaluating the information difference between competing process engineering models involving uncertainties. This framework can be applied when there are competing processes (e.g. a technology selection problem) or when there are competing models for the one process (e.g. several models of the one process with different levels of complexity). The framework uses the Deterministically Equivalent Modeling Method (DEMM) and Bayes' model selection methods and consequently can be applied to black box models. The methods chosen allow assumptions required in other methods to be relaxed, while keeping computation time minimal. In particular, assumptions about output distributions are relaxed, which is important in process engineering models because equilibrium and theoretical limits can cause output distributions to be highly irregular. A major challenge has been applying Bayes' model selection methods to cases where experimental output data does not exist, which occurs when assessing new technologies. Modifications to existing model selection have been developed to address these cases. Applying this framework will give the information difference between models, and identify which parameters are driving the overall. These results can be used in a sequential decision making process, facilitating decisions over the best use of resources. This may include helping to shape experimental programs or further refinement of the models. The framework has been applied to three case studies. The first involves competing hydrogen producing thermochemical cycles. It was found that the best use of resources was to further investigate the separations involved, rather than the reactions. The second involved two versions of a refinery process. The overall uncertainty was driven by uncertainty in the fitted parameters, and consequently if a difference is to be observed then the uncertainty in these fitted parameters need to be reduced. The third case study involved competing technologies for warm syngas cleanup. The excel-based tool has been constructed so that this framework can be applied by others in the future. This tool calls Matlab to complete the required calculations, but only requires the user to enter the required inputs in Excel, making it easy for the user. by Ingrid Berkelmans. Ph.D. 2010-11-08T17:38:46Z 2010-11-08T17:38:46Z 2010 2010 Thesis http://hdl.handle.net/1721.1/59873 672404891 eng M.I.T. theses are protected by copyright. They may be viewed from this source for any purpose, but reproduction or distribution in any format is prohibited without written permission. See provided URL for inquiries about permission. http://dspace.mit.edu/handle/1721.1/7582 209 p. application/pdf Massachusetts Institute of Technology