Repository logo
Log in(current)
Repository logoMIT Open ScholarshipDSpace@MIT
  1. Home
  2. MIT Open Access Articles
  3. MIT Open Access Articles
  4. AI Challenge for Satellite Pattern-of-Life Identification: Dataset, Design and Results

AI Challenge for Satellite Pattern-of-Life Identification: Dataset, Design and Results

Thumbnail Image
Download
Name

40295_2025_Article_515.pdf

Size

3.04 MB

Format

Adobe PDF

Checksum (MD5)

fe77bdf8aa31c3d1fc71e9c2305711b9

Download all files submitted through automated deposit
art_1746664453852721012.zip (2.48 MB)
Author(s)
Siew, Peng M.
•
Solera, Haley E.
•
Lavezzi, Giovanni
•
Roberts, Thomas G.
•
Jang, Daniel
•
Baldsiefen, David
•
Tran, Binh
•
Yeung, Christopher
•
Johnson, Kurtis
•
Metzger, Nathan
more
Date Issued
August 4, 2025
Journal
The Journal of the Astronautical Sciences
Publisher
Springer US
Citation
Siew, P.M., Solera, H.E., Lavezzi, G. et al. AI Challenge for Satellite Pattern-of-Life Identification: Dataset, Design and Results. J Astronaut Sci 72, 41 (2025).
Version
Final published version
Abstract
Despite the availability of extensive historical data on Earth-orbiting objects, artificial intelligence (AI) adoption in space domain awareness remains limited. To address this gap, the 2024 MIT ARCLab Prize for AI Innovation in Space challenged participants to develop AI models for characterizing satellite pattern-of-life (PoL) in Geostationary Earth Orbit. The challenge focused on developing machine learning models capable of classifying behavioral patterns and detecting key transition events in multivariate time-series data. The challenge dataset comprised of 2402 satellite trajectories spanning six months with a two-hour temporal resolution. The data are generated using high-fidelity satellite propagators based on simulated trajectories, Vector Covariance Message data, and two-line elements. This dataset features diverse operational behaviors and propulsion systems, providing a robust foundation for AI analysis. The challenge attracted over 100 teams worldwide, with more than 350 submissions showcasing a diverse range of AI approaches, including deep learning architectures (CNNs, LSTMs, transformers), gradient-boosting techniques (XGBoost, CatBoost), and hybrid models. The top performing teams demonstrated AI’s effectiveness in PoL characterization, with Hawaii2024 achieving an F2 score of 0.952 on the partial test set using a CNN-LSTM hybrid approach, followed closely by Millennial-IUP and QR_Is that utilized XGBoost with tailored transition-labeling and gradient-boosted decision tree with a model-stacking strategy, respectively. This paper presents an analysis of the competition’s dataset, evaluation methodology, and top-performing solutions.
MIT Department
Massachusetts Institute of Technology. Department of Aeronautics and Astronautics
Lincoln Laboratory
Terms of Use
Creative Commons Attribution
https://creativecommons.org/licenses/by/4.0/
Persistent DSpace Link
https://hdl.handle.net/1721.1/163214
DOI of Published Version
https://doi.org/10.1007/s40295-025-00515-5
Repository logo
PrivacyPermissionsAccessibilityContact us
Repository logo
Notify us about copyright concerns.