Release Helm Chart officially

[potiuk]

Description

When we are ready, we should release the Helm Chart officially.

Use case / motivation

Discussion in Apache Software Foundation started: helm/charts#23685 about standardising policies and tools for releasing Helm Charts in ASF and we should follow it.

[potiuk]

CC: @dimberman @kaxil @ashb

[mik-laj]

I would like to leave a note here that if we publish the documentation on ArtifactsHub, we will have user-friendly reference documentation.
See:
#11077

[dimberman]

@mik-laj That's fantastic thank you!!

[ryw]

dropping a note here that we decided to defer this to post Airflow 2.0 https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+2.0+-+Planning

[dnskr]

Hi @potiuk, @ryw and others!
Do we have any updates on this issue?
Can I use this chart or can I help somehow to move forward?

I am asking because current airflow helm chart from https://charts.helm.sh/stable is still community edition which is not relevant to the doc

$ helm repo list
NAME                    URL
stable                  https://charts.helm.sh/stable

$ helm search repo stable/airflow
NAME            CHART VERSION   APP VERSION     DESCRIPTION
stable/airflow  7.13.3          1.10.12         DEPRECATED - please use: https://github.com/air...

[potiuk]

I hope we can discuss the steps to make helm "released" at the next "dev" meeting which is going to be tomorrow ..

[dnskr]

I'll be happy to contribute into it if needed.

[kaxil]

Next Steps:

• Finalize Versioning Strategy (We will start with 1.0.0 and have upgrade guide similar to core Airflow's)
• Review & Improve Current Test Coverage (Helm Chart: Add Integration tests & expand unit tests coverage #14301)
• Review Architecture (Helm Chart: Review Architecture #14302)
• Review and Improve Current Documentation (Review and Improve Current Documentation for Helm Chart #14303)
• Publish Snapshot
• Release first version on official destination (https://dist.apache.org/repos/dist/release/airflow/)
• Publish it on community hubs (and documentation on ArtifactsHub) (Publish Helm Chart on community hubs (and documentation on ArtifactsHub) #14305)

I will start creating issues for each point.

Added Notes for now: https://github.com/apache/airflow/projects/7?fullscreen=true

[kaxil]

@dnskr Can you start looking at tests and add where they are missing, that would be a great help

[thesuperzapper]

Just my 2c, but I also think there is a significant amount of documentation lacking which will make a bad first experience with the chart:

• the values.yaml file is missing comments for most values
• more general explanations are pretty sparse (it seems we currently only have short paragraphs in the README)
• examples for common environments are missing (GKE, EKS, On-Prem)

Related to this (and the discussion about versioning strategy), we should consider:

• publishing the doc's seperate to airflow itself, (because I assume we will release the chart at a different cadence to airflow)
• provide upgrade guides for major/minor version bumps of the chart

[kaxil]

Good points @thesuperzapper - I added a point to review and add lacking documentation (we can expand on the details after we create issues for each of those points).

[kaxil]

The following Project Board should help with tracking the progress as well as to all of you who would like to help with the process.

https://github.com/apache/airflow/projects/7?fullscreen=true

[lewismc]

This would be super helpful folks. I'll try my best to provide more PR's on the Chart as my experiments evolve and knowledge improves.

[kaxil]

The first version of the official Helm Chart was finally released yesterday.

Mailing List Announcement: https://lists.apache.org/thread.html/r131d839158b8a7a92a7813183cae30d248be9e330ea2faaf9e654970%40%3Cdev.airflow.apache.org%3E 🎉
📦 ArtifactHub: https://artifacthub.io/packages/helm/apache-airflow/airflow
📚 Docs: ⁨https://airflow.apache.org/docs/helm-chart/1.0.0/
🚀 Quick Start Installation Guide: https://airflow.apache.org/docs/helm-chart/1.0.0/quick-start.html

Thanks to all the contributors who made this possible.

[potiuk]

🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉 🎉

[lewismc]

Real nice work 🎉