MIT Libraries logoDSpace@MIT

MIT
View Item 
  • DSpace@MIT Home
  • MIT Libraries
  • MIT Theses
  • Graduate Theses
  • View Item
  • DSpace@MIT Home
  • MIT Libraries
  • MIT Theses
  • Graduate Theses
  • View Item
JavaScript is disabled for your browser. Some features of this site may not work without it.

Modeling with Attention in Demand Forecasting and Beyond

Author(s)
Ocejo Elizondo, Clemente
Thumbnail
DownloadThesis PDF (2.849Mb)
Advisor
Perakis, Georgia
Terms of use
In Copyright - Educational Use Permitted Copyright MIT http://rightsstatements.org/page/InC-EDU/1.0/
Metadata
Show full item record
Abstract
Time series forecasting is an important task in many fields from supply chain management to weather forecasting. Traditionally there have been many simple models that extrapolate trends and seasonal patterns from individual time series in order to forecast future values, but not until recently have DNNs (Deep Neural Networks) been leveraged to capture complex relationships between time series as well as within the time series. Recent advances in Transformer architectures have shown promising results in this domain but have yet to show success in a retail settings. In these settings, forecasts are needed at granular levels (product-store) where the data is quite sparse. In this work we will develop new Transformer-based models to successfully predict the demand of a retailer in a medical device manufacturing setting. We will do this by proposing new positional encoding methods that aim to capture trends that specific medical products follow. We also propose new attention mechanisms attending over features and time series independently to generate more descriptive interactions. Ultimately we hope to combine this Transformer with more traditional time series models such as Holt-Winters as a way to alleviate some of the predictive responsibility from the Transformer which require relatively large amounts of data to train as compared to traditional time series methods.
Date issued
2022-05
URI
https://hdl.handle.net/1721.1/145147
Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
Publisher
Massachusetts Institute of Technology

Collections
  • Graduate Theses

Browse

All of DSpaceCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

My Account

Login

Statistics

OA StatisticsStatistics by CountryStatistics by Department
MIT Libraries
PrivacyPermissionsAccessibilityContact us
MIT
Content created by the MIT Libraries, CC BY-NC unless otherwise noted. Notify us about copyright concerns.