2026-09-23T10:36:42Zhttps://dspace.mit.edu/server/oai/requestoai:dspace.mit.edu:1721.1/1195502026-06-06T01:03:15Zcom_1721.1_7582com_1721.1_7581col_1721.1_131023
Kalyan Veeramachaneni.
Xue, William, M. Eng. Massachusetts Institute of Technology
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science.
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
2018-12-11T20:39:45Z
2018-12-11T20:39:45Z
2018
2018
http://hdl.handle.net/1721.1/119550
1076273112
Thesis: M. Eng. in Computer Science and Engineering, Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, 2018.
This electronic version was submitted by the student author. The certified thesis is available in the Institute Archives and Special Collections.
Cataloged from student-submitted PDF version of thesis.
Includes bibliographical references (pages 91-92).
In this thesis, we aim to simplify the building of end-to-end machine learning pipelines while preserving the performance of such pipelines on real data. As a solution to this, we propose the MLBlocks framework, a system that allows an end user to obtain a pipeline with only data and a list of data science blocks. Once a pipeline is specified, a user can tune its hyper-parameters, as well as fit and predictions, with minimal code. When building MLBlocks, we first develop a data science block library that seamlessly integrates third party blocks without integration code, providing a foundation for users to start building data science pipelines. We then provide the MLPipeline framework that allows users to simply tie together these blocks and perform the aforementioned tuning, fitting, and predicting operations with the resulting pipelines. Finally, we test the framework's usability as well as its ability to preserve performance on real data by running several pipelines on various data modalities and by integrating MLBlocks into a larger scale project. Since we are able to replicate the pipelines already in use, we are able to obtain identical results while dramatically simplifying application logic. We conclude that MLBlocks succeeds in providing a simple but effective solution to making the construction of high-performing end-to-end pipelines both simpler and more accessible.
by William Xue.
M.Eng. in Computer Science and Engineering
92 pages
eng
Massachusetts Institute of Technology
MIT theses are protected by copyright. They may be viewed, downloaded, or printed from this source but further reproduction or distribution in any format is prohibited without written permission.
http://dspace.mit.edu/handle/1721.1/7582
Electrical Engineering and Computer Science.
A flexible framework for composing end to end machine learning pipelines
Thesis
application/pdf
Publication
unknown
unknown
<Publication xmlns="https://www.openaire.eu/cerif-profile/1.1/" id="97279c74-d5f4-4ef7-8afd-6bca317d1f26">
<Type xmlns="https://www.openaire.eu/cerif-profile/vocab/COAR_Publication_Types">http://purl.org/coar/resource_type/c_1843</Type>
<Language>eng</Language>
<Title>A flexible framework for composing end to end machine learning pipelines</Title>
<PublishedIn>
<Publication>
</Publication>
</PublishedIn>
<PublicationDate>2018</PublicationDate>
<Authors>
<Author>
<DisplayName>Xue, William, M. Eng. Massachusetts Institute of Technology</DisplayName>
<Affiliation>
<OrgUnit>
</OrgUnit>
</Affiliation>
</Author>
</Authors>
<Editors>
</Editors>
<Publishers>
<Publisher>
<DisplayName>Massachusetts Institute of Technology</DisplayName>
<OrgUnit />
</Publisher>
</Publishers>
<License>http://dspace.mit.edu/handle/1721.1/7582</License>
<Keyword>Electrical Engineering and Computer Science.</Keyword>
<Abstract>In this thesis, we aim to simplify the building of end-to-end machine learning pipelines while preserving the performance of such pipelines on real data. As a solution to this, we propose the MLBlocks framework, a system that allows an end user to obtain a pipeline with only data and a list of data science blocks. Once a pipeline is specified, a user can tune its hyper-parameters, as well as fit and predictions, with minimal code. When building MLBlocks, we first develop a data science block library that seamlessly integrates third party blocks without integration code, providing a foundation for users to start building data science pipelines. We then provide the MLPipeline framework that allows users to simply tie together these blocks and perform the aforementioned tuning, fitting, and predicting operations with the resulting pipelines. Finally, we test the framework's usability as well as its ability to preserve performance on real data by running several pipelines on various data modalities and by integrating MLBlocks into a larger scale project. Since we are able to replicate the pipelines already in use, we are able to obtain identical results while dramatically simplifying application logic. We conclude that MLBlocks succeeds in providing a simple but effective solution to making the construction of high-performing end-to-end pipelines both simpler and more accessible.</Abstract>
<Access xmlns="http://purl.org/coar/access_right"
>
</Access>
</Publication>