A framework to search for machine learning pipelines

Abstract

In this thesis, we present DeepMining, a framework to search for machine learning pipelines. The high-level goal of DeepMining is to solve the pipeline search problem: given a problem and a dataset, find the pipeline best-suited to solve that problem. The DeepMining platform serves as a testbed for developers to experiment with different methods of computing and evaluating machine learning pipelines. Specifically, developers have autonomy over how to evaluate different configurations in parallel, score a pipeline given a dataset and hyperparameter configuration, and efficiently search over the pipeline space. DeepMining was designed with modularity and extensibility in mind: developers can easily implement new search algorithms, scoring functions, and computation frameworks. At the same time, users can switch between these modules with minimal effort.