Media Cloud: Massive Open Source Collection of Global News on the Open Web
Name
18127-Article Text-21622-1-2-20210521.pdf
Description
Published version
Size
1.27 MB
Format
Adobe PDF
Checksum (MD5)
f346ccfc49f325bdb8aec88c5b691934
Author(s)
Roberts, Hal
Bhargava, Rahul
Valiukas, Linas
Jen, Dennis
Malik, Momin M
Bishop, Cindy Sherman
Ndulue, Emily B
Dave, Aashka
Clark, Justin
Etling, Bruce
Date Issued
2021
Journal
Proceedings of the International AAAI Conference on Web and Social Media
Publisher
Association for the Advancement of Artificial Intelligence
Citation
Roberts, H., Bhargava, R., Valiukas, L., Jen, D., Malik, M. M., Bishop, C. S., Ndulue, E. B., Dave, A., Clark, J., Etling, B., Faris, R., Shah, A., Rubinovitz, J., Hope, A., D’Ignazio, C., Bermejo, F., Benkler, Y., & Zuckerman, E. (2021). Media Cloud: Massive Open Source Collection of Global News on the Open Web. Proceedings of the International AAAI Conference on Web and Social Media, 15(1), 1034-1045.
Version
Final published version
Abstract
We present the first full description of Media Cloud, an open source platform based on crawling hyperlink structure in operation for over 10 years, that for many uses will be the best way to collect data for studying the media ecosystem on the open web. We document the key choices behind what data Media Cloud collects and stores, how it processes and organizes these data, and its open API access as well as user-facing tools. We also highlight the strengths and limitations of the Media Cloud collection strategy compared to relevant alternatives. We give an overview two sample datasets generated using Media Cloud and discuss how researchers can use the platform to create their own datasets.
Description
2021 Fifteenth International AAAI Conference on Web and Social Media
MIT Department
Massachusetts Institute of Technology. Media Laboratory
Massachusetts Institute of Technology. Department of Urban Studies and Planning
Terms of Use
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1609/icwsm.v15i1.18127
