Skip to content

Commit

Permalink
Merge pull request #1 from primap-community/download-dataset
Browse files Browse the repository at this point in the history
download script
  • Loading branch information
crdanielbusch authored Nov 18, 2024
2 parents e4008ee + 1145a23 commit b30b209
Show file tree
Hide file tree
Showing 95 changed files with 1,472 additions and 196 deletions.
1 change: 1 addition & 0 deletions .gitattributes
Original file line number Diff line number Diff line change
Expand Up @@ -2,3 +2,4 @@
**/.git* annex.largefiles=nothing
* annex.largefiles=((mimeencoding=binary)and(largerthan=0))
*.csv annex.largefiles=anything
*.zip annex.largefiles=anything
2 changes: 1 addition & 1 deletion .github/actions/setup/action.yml
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ runs:
uses: actions/setup-python@v5
with:
python-version: ${{ inputs.python-version }}
cache: poetry
# cache: poetry
- name: Set Poetry environment
shell: bash
run: |
Expand Down
6 changes: 3 additions & 3 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ repos:
- id: check-case-conflict
- id: check-json
- id: check-merge-conflict
- id: check-symlinks
# - id: check-symlinks - DATALAD
- id: check-yaml
- id: debug-statements
- id: detect-private-key
Expand All @@ -40,8 +40,8 @@ repos:
rev: '1.8.3'
hooks:
- id: poetry-check
- id: poetry-lock
args: [--no-update]
# - id: poetry-lock
# args: [--no-update]
- repo: https://github.com/python-poetry/poetry-plugin-export
rev: '1.8.0'
hooks:
Expand Down
5 changes: 5 additions & 0 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -77,3 +77,8 @@ virtual-environment: ## update virtual environment, create a new one if it does
poetry config virtualenvs.in-project true
poetry install --all-extras
poetry run pre-commit install

.PHONY: download_all_domains-environment
download_all_domains:
# downloads and stages (datalad save) all available data
datalad run poetry run python3 scripts/download_all_domains.py
1 change: 1 addition & 0 deletions changelog/1.feature.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
Script to download data set from FAOSTAT website.
1 change: 1 addition & 0 deletions downloaded_data/farm_gate_livestock/2023-11-09/GLE_e.pdf
1 change: 1 addition & 0 deletions downloaded_data/farm_gate_livestock/2024-11-14/GLE_e.pdf
1 change: 1 addition & 0 deletions downloaded_data/land_use_fires/2023-11-09/GI_e.pdf
1 change: 1 addition & 0 deletions downloaded_data/land_use_forests/2023-11-09/GF_e.pdf
1 change: 1 addition & 0 deletions downloaded_data/land_use_forests/2024-11-14/GF_e.pdf
Loading

0 comments on commit b30b209

Please sign in to comment.