diff --git a/CHANGELOG.txt b/CHANGELOG.txt index 945e480411abd..f83a41b4ea4e2 100644 --- a/CHANGELOG.txt +++ b/CHANGELOG.txt @@ -1,3 +1,87 @@ +Airflow 1.10.12, 2020-08-25 +---------------------------- + +New Features +"""""""""""" + +- Add DateTimeSensor (#9697) +- Add ClusterPolicyViolation support to airflow local settings (#10282) +- Get Airflow configs with sensitive data from Secret Backends (#9645) +- [AIRFLOW-4734] Upsert functionality for PostgresHook.insert_rows() (#8625) +- Allow defining custom XCom class (#8560) + +Bug Fixes +""""""""" + +- Add pre 1.10.11 Kubernetes Paths back with Deprecation Warning (#10067) +- Fixes PodMutationHook for backwards compatibility (#9903) +- Fix bug in executor_config when defining resources (#9935) +- Respect DAG Serialization setting when running sync_perm (#10321) +- Show correct duration on graph view for running task (#8311) (#8675) +- Fix regression in SQLThresholdCheckOperator (#9312) +- [AIRFLOW-6931] Fixed migrations to find all dependencies for MSSQL (#9891) +- Avoid sharing session with RenderedTaskInstanceFields write and delete (#9993) +- Fix clear future recursive when ExternalTaskMarker is used (#9515) +- Handle IntegrityError while creating TIs (#10136) +- Fix airflow-webserver startup errors when using Kerberos Auth (#10047) +- Fixes treatment of open slots in scheduler (#9316) (#9505) +- Fix KubernetesPodOperator reattachment (#10230) +- Fix more PodMutationHook issues for backwards compatibility (#10084) +- [AIRFLOW-5391] Do not re-run skipped tasks when they are cleared (#7276) +- Fix task_instance_mutation_hook (#9910) +- Fixes failing formatting of DAG file containing {} in docstring (#9779) +- Fix is_terminal_support_colors function (#9734) +- Fix PythonVirtualenvOperator when using ``provide_context=True`` (#8256) +- Fix issue with mounting volumes from secrets (#10366) +- BugFix: K8s Executor Multinamespace mode is evaluated to true by default (#10410) +- Make KubernetesExecutor recognize kubernetes_labels (#10412) +- Fix broken Kubernetes PodRuntimeInfoEnv (#10478) + +Improvements +"""""""""""" + +- Use Hash of Serialized DAG to determine DAG is changed or not (#10227) +- Update Serialized DAGs in Webserver when DAGs are Updated (#9851) +- Do not Update Serialized DAGs in DB if DAG did not change (#9850) +- Add __repr__ to SerializedDagModel (#9862) +- Update JS packages to latest versions (#9811) (#9921) +- UI Graph View: Focus upstream / downstream task dependencies on mouseover (#9303) +- Allow ``image`` in ``KubernetesPodOperator`` to be templated (#10068) +- [AIRFLOW-6843] Add delete_option_kwargs to delete_namespaced_pod (#7523) +- Improve process terminating in scheduler_job (#8064) +- Replace deprecated base classes used in bigquery_check_operator (#10272) +- [AIRFLOW-5897] Allow setting -1 as pool slots value in webserver (#6550) +- Limit all google-cloud api to <2.0.0 (#10317) +- [AIRFLOW-6706] Lazy load operator extra links (#7327) (#10318) +- Add Snowflake support to SQL operator and sensor (#9843) +- Makes multi-namespace mode optional (#9570) +- Pin Pyarrow < 1.0 +- Pin pymongo version to <3.11.0 +- Pin google-cloud-container to <2 (#9901) +- Dockerfile: Remove package.json and yarn.lock from the prod image (#9814) +- Dockerfile: The group of embedded DAGs should be root to be OpenShift compatible (#9794) +- Update upper limit of flask-swagger, gunicorn & jinja2 (#9684) +- Webserver: Sanitize values passed to origin param (#10334) +- Sort connection type list in add/edit page alphabetically (#8692) + +Doc only changes +"""""""""""""""" + +- Add new committers: Ry Walker & Leah Cole to project.rst (#9892) +- Add Qingping Hou to committers list (#9725) +- Updated link to official documentation (#9629) +- Create a short-link for Airflow Slack Invites (#10034) +- Fix docstrings in BigQueryGetDataOperator (#10042) +- Set language on code-block on docs/howto/email-config.rst (#10238) +- Remove duplicate line from 1.10.10 CHANGELOG (#10289) +- Improve heading on Email Configuration page (#10175) +- Fix link for the Jinja Project in docs/tutorial.rst (#10245) +- Create separate section for Cron Presets (#10247) +- Add Syntax Highlights to code-blocks in docs/best-practices.rst (#10258) +- Fix docstrings in BigQueryGetDataOperator (#10042) +- Fix typo in Task Lifecycle section (#9867) +- Make Secret Backend docs clearer about Variable & Connection View (#8913) + Airflow 1.10.11, 2020-07-10 ----------------------------- diff --git a/README.md b/README.md index 8a043fd127743..73abf84dfb2d6 100644 --- a/README.md +++ b/README.md @@ -71,7 +71,7 @@ Apache Airflow is tested with: * Sqlite - latest stable (it is used mainly for development purpose) * Kubernetes - 1.16.2, 1.17.0 -### Stable version (1.10.11) +### Stable version (1.10.12) * Python versions: 2.7, 3.5, 3.6, 3.7, 3.8 * Postgres DB: 9.6, 10 @@ -118,7 +118,7 @@ pip install apache-airflow==1.10.12 \ 2. Installing with extras (for example postgres,google) ```bash -pip install apache-airflow[postgres,google]==1.10.11 \ +pip install apache-airflow[postgres,google]==1.10.12 \ --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-1.10.12/constraints-3.7.txt" ``` @@ -130,7 +130,7 @@ of Apache Airflow. The community provides two types of support for the productio * We provide pre-build released version of production image in PyPI build from released sources of Apache Airflow - shortly after release. Those images are available in the DockerHub. You can pull those images via `docker pull apache/airflow:-pythonX.Y` - version is the - version number (for example 1.10.11). Additionally `docker pull apache/airflow` will pull latest + version number (for example 1.10.12). Additionally `docker pull apache/airflow` will pull latest stable version of the image with default python version (currently 3.6) * In `master` branch of Airflow and in `v1-10-stable` branch we provide Dockerfiles and accompanying diff --git a/UPDATING.md b/UPDATING.md index 1fa9bd94de12e..07ba1d6c7ac58 100644 --- a/UPDATING.md +++ b/UPDATING.md @@ -26,6 +26,7 @@ assists users migrating to a new version. **Table of contents** - [Airflow Master](#airflow-master) +- [Airflow 1.10.12](#airflow-11012) - [Airflow 1.10.11](#airflow-11011) - [Airflow 1.10.10](#airflow-11010) - [Airflow 1.10.9](#airflow-1109) @@ -1741,6 +1742,23 @@ Now the `dag_id` will not appear repeated in the payload, and the response forma } ``` +## Airflow 1.10.12 + +### Clearing tasks skipped by SkipMixin will skip them + +Previously, when tasks skipped by SkipMixin (such as BranchPythonOperator, BaseBranchOperator and ShortCircuitOperator) are cleared, they execute. Since 1.10.12, when such skipped tasks are cleared, +they will be skipped again by the newly introduced NotPreviouslySkippedDep. + +### The pod_mutation_hook function will now accept a kubernetes V1Pod object + +As of airflow 1.10.12, using the `airflow.contrib.kubernetes.Pod` class in the `pod_mutation_hook` is now deprecated. Instead we recommend that users +treat the `pod` parameter as a `kubernetes.client.models.V1Pod` object. This means that users now have access to the full Kubernetes API +when modifying airflow pods + +### pod_template_file option now available in the KubernetesPodOperator + +Users can now offer a path to a yaml for the KubernetesPodOperator using the `pod_template_file` parameter. + ## Airflow 1.10.11 ### Use NULL as default value for dag.description diff --git a/docs/spelling_wordlist.txt b/docs/spelling_wordlist.txt index 9cd5e85490c7f..811e722f696ba 100644 --- a/docs/spelling_wordlist.txt +++ b/docs/spelling_wordlist.txt @@ -234,6 +234,7 @@ Memorystore Mesos MessageAttributes Metastore +Multinamespace Mixin Mongo Moto @@ -279,6 +280,7 @@ Protobuf PublisherClient Pubsub Py +Pyarrow PyPI Pylint Pyspark @@ -772,6 +774,7 @@ hostname hostnames hotfix houqp +howto hql html htmlcontent @@ -921,6 +924,7 @@ moinmoin mongo mongoHook monospace +mouseover msg mssql msumit