sdata:languages

A dataset of the most commonly spoken/written languages of the world. The verified JSON dataset can be downloaded here.

Data Generation

This dataset is updated daily by an automated data service with changes pushed to the automated branch. The data service pulls data in from 2 distinct sources on the web and then aggregates, consolidates and sanitizes the data. The sources include public wikis and the US Library of Congress website; each language must exist on both sources to be included in the dataset. After the initial dataset is generated, any overrides manually defined in src/overrides.json5 are merged with the dataset. The final dataset is then written, as a JSON array in alphabetical order by their ISO defined language code (alpha2Code if defined, otherwise alpha3Code), to dist/data.json. If there are any new data changes, a commit is created and pushed by devbot to the automated branch. Lastly, if there are no open pull-requests pending, devbot creates pull-request back to the master branch to be manually verified and merged, or rejected.

Contributing and Issues

If you find incorrect data within the dataset, please create a pull-request with the corrections added to src/overrides.json5 or alternatively raise an issue.

Example JSON

[
  {
    "alpha2Code": "en",       // note: not all languages have a 2 letter code defined
    "alpha3Code": "eng",      // note: all languages have a 3 letter code defined
    "name": "English",
    "alternateNames": [],
    "nativeName": "English",
    "direction": "ltr"        // "ltr" or "rtl"
  }
]