This repository has been archived by the owner on Jan 9, 2020. It is now read-only.
v2.1.0-kubernetes-0.3.0
Pre-release
Pre-release
·
4 commits
to branch-2.1-kubernetes
since this release
Changelog:
- Support specify CPU cores and Memory restricts for driver (#340)
- Generate the application ID label irrespective of app name. (#331)
- Create base-image and minimize layer count (#324)
- Added log4j config for k8s unit tests. (#314)
- Use node affinity to launch executors on preferred nodes benefitting from data locality (#316)
- New API for custom labels and annotations. (#346)
- Allow spark driver find shuffle pods in specified namespace (#357)
- Bypass init-containers when possible (#348)
- Config for hard cpu limit on pods; default unlimited (#356)
- Allow number of executor cores to have fractional values (#361)
- Python Bindings for launching PySpark Jobs from the JVM (#364)
- Submission client redesign to use a step-based builder pattern (#365)
- Add node selectors for driver and executor pods (#355)
- Retry binding server to random port in the resource staging server test. (#378)
- set RestartPolicy=Never for executor (#367)
- Read classpath entries from SPARK_EXTRA_CLASSPATH on executors. (#383)
- Changes to support executor recovery behavior during static allocation. (#244)