Skip to content

Commit

Permalink
[SPARK-50562][INFRA] Apply Python 3.11 image in Java 21 daily build
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
Apply Python 3.11 image in Java 21 daily build

### Why are the changes needed?
to switch to the new testing images

### Does this PR introduce _any_ user-facing change?
no, infra-only

### How was this patch tested?
PR builder with:
```
      java:
        required: false
        type: string
        default: 21
      ...
      envs:
        description: Additional environment variables to set when running the tests. Should be in JSON format.
        required: false
        type: string
        default: '{"PYSPARK_IMAGE_TO_TEST": "python-311", "PYTHON_TO_TEST": "python3.11", "SKIP_MIMA": "true", "SKIP_UNIDOC": "true", "DEDICATED_JVM_SBT_TESTS": "org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormatV1Suite,org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormatV2Suite,org.apache.spark.sql.execution.datasources.orc.OrcSourceV1Suite,org.apache.spark.sql.execution.datasources.orc.OrcSourceV2Suite"}'

```

https://github.com/zhengruifeng/spark/actions/runs/12308077804/job/34352937432

### Was this patch authored or co-authored using generative AI tooling?
no

Closes apache#49168 from zhengruifeng/py_311_java21.

Authored-by: Ruifeng Zheng <[email protected]>
Signed-off-by: Ruifeng Zheng <[email protected]>
  • Loading branch information
zhengruifeng committed Dec 13, 2024
1 parent 429402b commit 98cef08
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions .github/workflows/build_java21.yml
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,8 @@ jobs:
hadoop: hadoop3
envs: >-
{
"PYSPARK_IMAGE_TO_TEST": "python-311",
"PYTHON_TO_TEST": "python3.11",
"SKIP_MIMA": "true",
"SKIP_UNIDOC": "true",
"DEDICATED_JVM_SBT_TESTS": "org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormatV1Suite,org.apache.spark.sql.execution.datasources.parquet.ParquetFileFormatV2Suite,org.apache.spark.sql.execution.datasources.orc.OrcSourceV1Suite,org.apache.spark.sql.execution.datasources.orc.OrcSourceV2Suite"
Expand Down

0 comments on commit 98cef08

Please sign in to comment.