A Geographical dATA gatherer and cataLOGER.
Gataloger features the following:
- A generic system for geographical and statistical data gathering
- A simple and easy to use format to store, transfer and process geographical information
- Plugins based on World and Spain information that can be optionally used
It consist in a console application that gathers information from several sources and generates a standard and static database. Each layer of data is fetched with a plugin, usually associated to a source. This database could be used in any application through a loading process. It allows to regenerate data files to include source changes. It current setup is created specifically to have Spanish extra details, but it can be adapted easily to be used in other territories.
Install and run.
bundle install
bundle exec bin/gataloger --prepare
The --prepare downloads external files and generates additional input files, it must be used in the first run. Downloaded files are cached, use --no-cache to force the program to download them again.
After its execution, output files will be in the output folder:
territories.tsvwill contain a territory per line, with a unique identifier (UID), a name and a territory name.territories.translations.tsvwill contain a translation per line, with a UID, locale and translation. Languages used can be set on command execution.territories.mappings.tsvwill contain different a standard association per line, with a UID, a standard code and it associated value.territories.metadata.tsvwill contain extra information per line, with a UID, and a key-value pair.
unlocode all iso 3166-2
carmen: iso-3166-2 + i18n
INE:
Towns:
- http://www.ine.es/dyngs/INEbase/es/operacion.htm?c=Estadistica_C&cid=1254736177031&menu=ultiDatos&idp=1254734710990
- http://www.ine.es/daco/daco42/codmun/codmun17/17codmun.xlsx
- http://www.ine.es/dynt3/inebase/es/index.html?padre=517&dh=1
Towns and sublevels
Postal codes