dc.contributor.author | Ryland Williams, Jake | |
dc.contributor.author | Lessard, Paul R. | |
dc.contributor.author | Desu, Suma | |
dc.contributor.author | Clark, Eric M. | |
dc.contributor.author | Bagrow, James P. | |
dc.contributor.author | Danforth, Christopher M. | |
dc.contributor.author | Sheridan Dodds, Peter | |
dc.date.accessioned | 2015-09-10T15:24:20Z | |
dc.date.available | 2015-09-10T15:24:20Z | |
dc.date.issued | 2015-08 | |
dc.date.submitted | 2014-12 | |
dc.identifier.issn | 2045-2322 | |
dc.identifier.uri | http://hdl.handle.net/1721.1/98434 | |
dc.description.abstract | With Zipf’s law being originally and most famously observed for word frequency, it is surprisingly limited in its applicability to human language, holding over no more than three to four orders of magnitude before hitting a clear break in scaling. Here, building on the simple observation that phrases of one or more words comprise the most coherent units of meaning in language, we show empirically that Zipf’s law for phrases extends over as many as nine orders of rank magnitude. In doing so, we develop a principled and scalable statistical mechanical method of random text partitioning, which opens up a rich frontier of rigorous text analysis via a rank ordering of mixed length phrases. | en_US |
dc.language.iso | en_US | |
dc.publisher | Nature Publishing Group | en_US |
dc.relation.isversionof | http://dx.doi.org/10.1038/srep12209 | en_US |
dc.rights | Creative Commons Attribution | en_US |
dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | en_US |
dc.source | Nature Publishing Group | en_US |
dc.title | Zipf’s law holds for phrases, not words | en_US |
dc.type | Article | en_US |
dc.identifier.citation | Ryland Williams, Jake, Paul R. Lessard, Suma Desu, Eric M. Clark, James P. Bagrow, Christopher M. Danforth, and Peter Sheridan Dodds. “Zipf’s Law Holds for Phrases, Not Words.” Scientific Reports 5 (August 11, 2015): 12209. | en_US |
dc.contributor.department | Massachusetts Institute of Technology. Center for Computational Engineering | en_US |
dc.contributor.mitauthor | Desu, Suma | en_US |
dc.relation.journal | Scientific Reports | en_US |
dc.eprint.version | Final published version | en_US |
dc.type.uri | http://purl.org/eprint/type/JournalArticle | en_US |
eprint.status | http://purl.org/eprint/status/PeerReviewed | en_US |
dspace.orderedauthors | Ryland Williams, Jake; Lessard, Paul R.; Desu, Suma; Clark, Eric M.; Bagrow, James P.; Danforth, Christopher M.; Sheridan Dodds, Peter | en_US |
mit.license | PUBLISHER_CC | en_US |
mit.metadata.status | Complete | |