Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ci(pr_test_build_images): Build changed products on PR #948

Open
wants to merge 20 commits into
base: main
Choose a base branch
from
Open

ci(pr_test_build_images): Build changed products on PR #948

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
20 commits
Select commit Hold shift + click to select a range
064ac88
ci(pr_test_build_images): Test that the changed product sharding works
NickLarsenNZ Dec 5, 2024
d69c6a2
ci(pr_test_build_images): Bind the step varable
NickLarsenNZ Dec 5, 2024
95f81fe
ci(pr_test_build_images): git diff against base ref
NickLarsenNZ Dec 5, 2024
8659ce4
ci(pr_test_build_images): Install tomlq
NickLarsenNZ Dec 5, 2024
9cde3c9
ci(pr_test_build_images): Fix the tomlq output structure
NickLarsenNZ Dec 5, 2024
c803c25
ci(pr_test_build_images): Sort and uniq the products
NickLarsenNZ Dec 5, 2024
6331438
ci(pr_test_build_images): Fix the trigger pattern for release branches
NickLarsenNZ Dec 5, 2024
3f91c2b
ci(pr_test_build_images): Remove workflow_dispatch trigger
NickLarsenNZ Dec 5, 2024
4a0bd55
ci(pr_test_build_images): Build images and check it is tagged correctly
NickLarsenNZ Dec 5, 2024
98dce57
ci(pr_test_build_images): See the image names produced
NickLarsenNZ Dec 5, 2024
62a9548
ci(pr_test_build_images): Publish images with PR biuldinfo in the tag
NickLarsenNZ Dec 5, 2024
05d49bb
fix(pr_test_build_images): Use - instead of + for PR number
Techassi Dec 6, 2024
17ca6bf
ci(pr_test_build_images): Add extra tag data to include PR number
Techassi Dec 6, 2024
2ea40b1
ci(pr_test_build_images): Construct the IMAGE_INDEX_MANIFEST_TAG as a…
NickLarsenNZ Dec 6, 2024
0811522
ci(pr_test_build_images): Add a note about filtering superficial chan…
NickLarsenNZ Dec 6, 2024
42e3fcd
ci(pr_test_build_images): Add versions.toml to all product directories.
NickLarsenNZ Dec 6, 2024
9570032
ci: Update stackabletech/actions to v0.5.0
NickLarsenNZ Dec 6, 2024
15fe103
ci: Remove non-existant path from path filter
NickLarsenNZ Dec 6, 2024
0c603e7
ci: Remove old release workflow (it has been replaced by the per-prod…
NickLarsenNZ Dec 6, 2024
55e3bcf
ci(pr_test_build_images): Fix krb5 version in versions.toml
NickLarsenNZ Dec 6, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
15 changes: 7 additions & 8 deletions .github/workflows/build_airflow.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,6 @@ on:
- airflow/**
- vector/**
- stackable-base/**
- .github/actions/**
- .github/workflows/build_airflow.yaml

jobs:
Expand All @@ -30,7 +29,7 @@ jobs:
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7
- id: shard
uses: stackabletech/actions/shard@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/shard@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
outputs:
Expand All @@ -53,19 +52,19 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Free Disk Space
uses: stackabletech/actions/free-disk-space@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/free-disk-space@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0

- name: Build Product Image
id: build
uses: stackabletech/actions/build-product-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/build-product-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
product-version: ${{ matrix.versions }}
build-cache-password: ${{ secrets.BUILD_CACHE_NEXUS_PASSWORD }}
sdp-version: ${{ env.SDP_VERSION }}

- name: Publish Container Image on docker.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -75,7 +74,7 @@ jobs:
source-image-uri: localhost/${{ env.PRODUCT_NAME }}:${{ steps.build.outputs.image-manifest-tag }}

- name: Publish Container Image on oci.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand All @@ -98,7 +97,7 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Publish and Sign Image Index Manifest to docker.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -107,7 +106,7 @@ jobs:
image-index-manifest-tag: ${{ matrix.versions }}-stackable${{ env.SDP_VERSION }}

- name: Publish and Sign Image Index Manifest to oci.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand Down
15 changes: 7 additions & 8 deletions .github/workflows/build_druid.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@ on:
- stackable-base/**
- java-base/**
- java-devel/**
- .github/actions/**
- .github/workflows/build_druid.yaml

jobs:
Expand All @@ -32,7 +31,7 @@ jobs:
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7
- id: shard
uses: stackabletech/actions/shard@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/shard@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
outputs:
Expand All @@ -55,19 +54,19 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Free Disk Space
uses: stackabletech/actions/free-disk-space@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/free-disk-space@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0

- name: Build Product Image
id: build
uses: stackabletech/actions/build-product-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/build-product-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
product-version: ${{ matrix.versions }}
build-cache-password: ${{ secrets.BUILD_CACHE_NEXUS_PASSWORD }}
sdp-version: ${{ env.SDP_VERSION }}

- name: Publish Container Image on docker.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -77,7 +76,7 @@ jobs:
source-image-uri: localhost/${{ env.PRODUCT_NAME }}:${{ steps.build.outputs.image-manifest-tag }}

- name: Publish Container Image on oci.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand All @@ -100,7 +99,7 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Publish and Sign Image Index Manifest to docker.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -109,7 +108,7 @@ jobs:
image-index-manifest-tag: ${{ matrix.versions }}-stackable${{ env.SDP_VERSION }}

- name: Publish and Sign Image Index Manifest to oci.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand Down
15 changes: 7 additions & 8 deletions .github/workflows/build_hadoop.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,6 @@ on:
- stackable-base/**
- java-base/**
- java-devel/**
- .github/actions/**
- .github/workflows/build_hadoop.yaml

jobs:
Expand All @@ -32,7 +31,7 @@ jobs:
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7
- id: shard
uses: stackabletech/actions/shard@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/shard@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
outputs:
Expand All @@ -55,19 +54,19 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Free Disk Space
uses: stackabletech/actions/free-disk-space@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/free-disk-space@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0

- name: Build Product Image
id: build
uses: stackabletech/actions/build-product-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/build-product-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
product-version: ${{ matrix.versions }}
build-cache-password: ${{ secrets.BUILD_CACHE_NEXUS_PASSWORD }}
sdp-version: ${{ env.SDP_VERSION }}

- name: Publish Container Image on docker.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -77,7 +76,7 @@ jobs:
source-image-uri: localhost/${{ env.PRODUCT_NAME }}:${{ steps.build.outputs.image-manifest-tag }}

- name: Publish Container Image on oci.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand All @@ -100,7 +99,7 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Publish and Sign Image Index Manifest to docker.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -109,7 +108,7 @@ jobs:
image-index-manifest-tag: ${{ matrix.versions }}-stackable${{ env.SDP_VERSION }}

- name: Publish and Sign Image Index Manifest to oci.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand Down
15 changes: 7 additions & 8 deletions .github/workflows/build_hbase.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,6 @@ on:
- stackable-base/**
- java-base/**
- java-devel/**
- .github/actions/**
- .github/workflows/build_hbase.yaml

jobs:
Expand All @@ -33,7 +32,7 @@ jobs:
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7
- id: shard
uses: stackabletech/actions/shard@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/shard@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
outputs:
Expand All @@ -56,19 +55,19 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Free Disk Space
uses: stackabletech/actions/free-disk-space@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/free-disk-space@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0

- name: Build Product Image
id: build
uses: stackabletech/actions/build-product-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/build-product-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
product-version: ${{ matrix.versions }}
build-cache-password: ${{ secrets.BUILD_CACHE_NEXUS_PASSWORD }}
sdp-version: ${{ env.SDP_VERSION }}

- name: Publish Container Image on docker.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -78,7 +77,7 @@ jobs:
source-image-uri: localhost/${{ env.PRODUCT_NAME }}:${{ steps.build.outputs.image-manifest-tag }}

- name: Publish Container Image on oci.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand All @@ -101,7 +100,7 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Publish and Sign Image Index Manifest to docker.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -110,7 +109,7 @@ jobs:
image-index-manifest-tag: ${{ matrix.versions }}-stackable${{ env.SDP_VERSION }}

- name: Publish and Sign Image Index Manifest to oci.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand Down
15 changes: 7 additions & 8 deletions .github/workflows/build_hello-world.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,6 @@ on:
# To check dependencies, run this ( you will need to consider transitive dependencies)
# bake --product PRODUCT -d | grep -v 'docker buildx bake' | jq '.target | keys[]'
- hello-world/**
- .github/actions/**
- .github/workflows/build_hello-world.yaml

jobs:
Expand All @@ -28,7 +27,7 @@ jobs:
steps:
- uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7
- id: shard
uses: stackabletech/actions/shard@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/shard@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
outputs:
Expand All @@ -51,19 +50,19 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Free Disk Space
uses: stackabletech/actions/free-disk-space@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/free-disk-space@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0

- name: Build Product Image
id: build
uses: stackabletech/actions/build-product-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/build-product-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
product-name: ${{ env.PRODUCT_NAME }}
product-version: ${{ matrix.versions }}
build-cache-password: ${{ secrets.BUILD_CACHE_NEXUS_PASSWORD }}
sdp-version: ${{ env.SDP_VERSION }}

- name: Publish Container Image on docker.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -73,7 +72,7 @@ jobs:
source-image-uri: localhost/${{ env.PRODUCT_NAME }}:${{ steps.build.outputs.image-manifest-tag }}

- name: Publish Container Image on oci.stackable.tech
uses: stackabletech/actions/publish-image@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-image@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand All @@ -96,7 +95,7 @@ jobs:
uses: actions/checkout@692973e3d937129bcbf40652eb9f2f61becf3332 # v4.1.7

- name: Publish and Sign Image Index Manifest to docker.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: docker.stackable.tech
image-registry-username: github
Expand All @@ -105,7 +104,7 @@ jobs:
image-index-manifest-tag: ${{ matrix.versions }}-stackable${{ env.SDP_VERSION }}

- name: Publish and Sign Image Index Manifest to oci.stackable.tech
uses: stackabletech/actions/publish-index-manifest@a3f7587879e9f12e04a29fd26435949aaa4fd59c # 0.2.0
uses: stackabletech/actions/publish-index-manifest@95626907fd8cae2f17c862ae40bcab1aa5a2c854 # v0.5.0
with:
image-registry-uri: oci.stackable.tech
image-registry-username: robot$sdp+github-action-build
Expand Down
Loading
Loading