Skip to content

Commit

Permalink
update readme
Browse files Browse the repository at this point in the history
  • Loading branch information
ChiaraFor96 committed Sep 10, 2024
1 parent b9f89de commit b6fe665
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions airflow_dags/README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,10 @@
# Airflow
[Installazione](https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html)
Deploy:
- `sudo ./deploy_swarm.sh airflow "../.airflow.env"`

## Docker registry
- `sudo ./deploy_swarm.sh registry`
- stack `dataplatform/multiple_stacks/registry.yaml`
- contact locally in the cluster at 127.0.0.0:5000
- Starting from a Docker file in a cluster machine
Expand Down Expand Up @@ -42,6 +45,7 @@ This is made in **abds-bigdata** project `ingestion-weather` module,
through the `python-service-interaction-utils/src/main/python/airflow_interaction.py` service.

### Common errors in the deploy
- The deploy should include the `.airflow.env` file (see above command)
- not pass files that are in .gitignore in the build of the container
- use service names and internal ports when refer to other services (not use exposed ports)
- set the link to services in the config to the new clusters (e.g., hdfs)
Expand Down

0 comments on commit b6fe665

Please sign in to comment.