Show simple item record

dc.contributor.authorRyland Williams, Jake
dc.contributor.authorLessard, Paul R.
dc.contributor.authorDesu, Suma
dc.contributor.authorClark, Eric M.
dc.contributor.authorBagrow, James P.
dc.contributor.authorDanforth, Christopher M.
dc.contributor.authorSheridan Dodds, Peter
dc.date.accessioned2015-09-10T15:24:20Z
dc.date.available2015-09-10T15:24:20Z
dc.date.issued2015-08
dc.date.submitted2014-12
dc.identifier.issn2045-2322
dc.identifier.urihttp://hdl.handle.net/1721.1/98434
dc.description.abstractWith Zipf’s law being originally and most famously observed for word frequency, it is surprisingly limited in its applicability to human language, holding over no more than three to four orders of magnitude before hitting a clear break in scaling. Here, building on the simple observation that phrases of one or more words comprise the most coherent units of meaning in language, we show empirically that Zipf’s law for phrases extends over as many as nine orders of rank magnitude. In doing so, we develop a principled and scalable statistical mechanical method of random text partitioning, which opens up a rich frontier of rigorous text analysis via a rank ordering of mixed length phrases.en_US
dc.language.isoen_US
dc.publisherNature Publishing Groupen_US
dc.relation.isversionofhttp://dx.doi.org/10.1038/srep12209en_US
dc.rightsCreative Commons Attributionen_US
dc.rights.urihttp://creativecommons.org/licenses/by/4.0/en_US
dc.sourceNature Publishing Groupen_US
dc.titleZipf’s law holds for phrases, not wordsen_US
dc.typeArticleen_US
dc.identifier.citationRyland Williams, Jake, Paul R. Lessard, Suma Desu, Eric M. Clark, James P. Bagrow, Christopher M. Danforth, and Peter Sheridan Dodds. “Zipf’s Law Holds for Phrases, Not Words.” Scientific Reports 5 (August 11, 2015): 12209.en_US
dc.contributor.departmentMassachusetts Institute of Technology. Center for Computational Engineeringen_US
dc.contributor.mitauthorDesu, Sumaen_US
dc.relation.journalScientific Reportsen_US
dc.eprint.versionFinal published versionen_US
dc.type.urihttp://purl.org/eprint/type/JournalArticleen_US
eprint.statushttp://purl.org/eprint/status/PeerRevieweden_US
dspace.orderedauthorsRyland Williams, Jake; Lessard, Paul R.; Desu, Suma; Clark, Eric M.; Bagrow, James P.; Danforth, Christopher M.; Sheridan Dodds, Peteren_US
mit.licensePUBLISHER_CCen_US
mit.metadata.statusComplete


Files in this item

Thumbnail

This item appears in the following Collection(s)

Show simple item record