sdmx-dl
sdmx-dl is still in development and is available for test only. Do not use in production!
sdmx-dl - Easily download official statistics
sdmx-dl is a tool designed to easily download official statistics.
It is mainly based on the SDMX standard but can be extended with other APIs as well.
This project has three parts:
- a Java library that can be incorporated into other projects
- a command-line tool that allows to easily browse and download data
- a web service that serves as a bridge to any application or language
Its documentation is available at https://nbbrd.github.io/sdmx-dl/docs/.
While being in the information age, it is surprisingly difficult to get free quality statistics, even from official sources.
There are many reasons to that situation:
- Big tech lockup: the huge data collected by big tech companies are locked behind paywalls and the only bits freely available are often redacted to the point of being useless.
- Too many APIs: NGOs and governmental agencies that adhere to the open data principles don’t necessarily share a common design for their APIs and therefore require a separate development for each one.
- Time-consuming handling: data retrieval often implies tedious and error-prone manual steps.
- No native support: there are several open standards available but few-to-none are natively supported by mainstream applications.
- No catalog: there are no central catalog to discover data sources.
sdmx-dl is a SDMX-focused attempt to tackle these problems.
- Provides an easy, consistent and reliable data retrieval
- Allows data discovery and automation
- Takes care of technical difficulties and data handling
- Is designed to be used by other applications
- Is bundled with a pre-configured set of data sources
sdmx-dl CLI runs on any desktop operating system such as Microsoft Windows, Solaris OS, Apple macOS, Ubuntu and other various Linux distributions. See CLI installation for more details.
This project is written in Java and uses Apache Maven as a build tool.
It requires Java 8 as minimum version and all its dependencies are hosted on Maven Central.
The code can be build using any IDE or by just type-in the following commands in a terminal:
git clone https://github.com/nbbrd/sdmx-dl.git
cd sdmx-dl
mvn clean install
Any contribution is welcome and should be done through pull requests and/or issues.
The code of this project is licensed under the European Union Public Licence (EUPL).