Informing the use of Hyper-Parameter Optimization Through Meta-Learning

• Main Author: Sanders, Samantha Corinne
• Format: Others
• Published: BYU ScholarsArchive 2017
• Subjects: Meta-learning; Hyper-parameter optimization; Computer Sciences
• Online Access: https://scholarsarchive.byu.edu/etd/6392; https://scholarsarchive.byu.edu/cgi/viewcontent.cgi?article=7392&context=etd

One of the challenges of data mining is finding hyper-parameters for a learning algorithm that will produce the best model for a given dataset. Hyper-parameter optimization automates this process, but it can still take significant time. It has been found that hyperparameter optimization does not always result in induced models with significant improvement over default hyper-parameters, yet no systematic analysis of the role of hyper-parameter optimization in machine learning has been conducted. We propose the use of meta-learning to inform the decision to optimize hyper-parameters based on whether default hyper-parameter performance can be surpassed in a given amount of time. We will build a base of metaknowledge, through a series of experiments, to build predictive models that will assist in the decision process.