Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

apache 2.5.1 -> affirm 2.5.1 #29

Merged
merged 1,966 commits into from
Jan 30, 2023
Merged
Changes from 1 commit
Commits
Show all changes
1966 commits
Select commit Hold shift + click to select a range
2063e14
Handle transient state errors in `RedshiftResumeClusterOperator` and …
syedahsn Nov 17, 2022
610f57f
Improve "sensor timeout" messaging (#27733)
dstandish Nov 17, 2022
325b886
Completed D400 for airflow/lineage/* directory (#27732)
bdsoha Nov 17, 2022
2631877
Completed D400 for airflow/listener/* directory (#27731)
bdsoha Nov 17, 2022
0918223
Completed D400 for airflow/api_connexion/* directory (#27718)
bdsoha Nov 17, 2022
2ad1513
Improve task deadlock messaging (#27734)
dstandish Nov 17, 2022
e9d618f
Allow datasets to be used in taskflow (#27540)
bolkedebruin Nov 17, 2022
b717853
scheduler_job, add metric for scheduler loop timer (#27605)
michaelmicheal Nov 17, 2022
2bba98f
Use Boto waiters instead of customer _await_status method for RDS Ope…
hankehly Nov 17, 2022
de99cd9
Fix formatting leftovers (#27750)
bolkedebruin Nov 17, 2022
239440d
System Test for EMR (AIP-47) (#27286)
syedahsn Nov 17, 2022
63927cb
Make custom env vars optional for job templates (#27148)
richardbadman Nov 17, 2022
9a1d24d
Replace helm chart icon (#27704)
ronahk Nov 17, 2022
83dc604
Allow SSL mode in MySQL provider (#27717)
Adityamalik123 Nov 17, 2022
7ea8475
completed D400 for airflow/callbacks/* airflow/cli/* (#27721)
bdsoha Nov 17, 2022
65bfea2
reset commits, clean submodules (#27560)
bbovenzi Nov 17, 2022
31f34e9
Expand tasks in mapped group at run time (#27491)
uranusjr Nov 17, 2022
083e71c
Align TaskGroup semantics to AbstractOperator (#27723)
uranusjr Nov 17, 2022
2d19ddd
Limit the full tests to representative items in Python/Backend matrix…
potiuk Nov 17, 2022
355b008
[FEATURE] add postgres 15 support (#27444)
raphaelauv Nov 17, 2022
5004dac
Use context managers to simplify log serve management (#27756)
dstandish Nov 17, 2022
edf3ce6
simplify notes accordion test (#27757)
bbovenzi Nov 17, 2022
973406b
Fix typing problem revealed after recent Neo4J release (#27759)
potiuk Nov 17, 2022
49471b0
Typescript files are also now triggering UI/WWW tests (#27760)
potiuk Nov 18, 2022
b2a88fd
Add: #23880 :: Audit log for AirflowModelViews(Variables/Connection) …
bhavaniravi Nov 18, 2022
49cfb64
Replace `unittests` in microsoft providers tests by pure `pytest` [Wa…
Taragolis Nov 18, 2022
640d4f9
Fix backfill queued task getting reset to scheduled state. (#23720)
snjypl Nov 18, 2022
9bad850
optimise task instances filtering (#27102)
zhiyong-ong Nov 18, 2022
e90241a
Add critical section query duration metric (#27700)
michaelmicheal Nov 18, 2022
f513268
Completed D400 for multiple folders (#27748)
bdsoha Nov 18, 2022
3b582bc
Sync context.py with context.pyi (#27770)
o-nikolas Nov 18, 2022
80cab10
Fix a deprecation warning related to airflow.utils.helpers.chain (#27…
tiokim Nov 18, 2022
bede424
Unify "full tests needed" and "run everything" in CI (#27761)
potiuk Nov 18, 2022
6bc0567
Fixups of small mistakes in release providers documentation (#27773)
potiuk Nov 18, 2022
5890b08
Document dag_file_processor_timeouts metric as deprecated (#27067)
o-nikolas Nov 19, 2022
0438628
Allow hyphens in pod id used by k8s executor (#27737)
dstandish Nov 19, 2022
8b1ebda
Fix doc strings for bigquery tests (#27794)
eladkal Nov 19, 2022
d233c12
Fix menu border color (#27789)
pierrejeambrun Nov 19, 2022
263387a
Clear TaskGroup (#26658)
pierrejeambrun Nov 20, 2022
d74c507
Installation instruction to use Colima instead of Docker Desktop (#27…
RoyNoymanW Nov 20, 2022
8a8ad47
Add logic for XComArg to pull specific map indexes (#27771)
uranusjr Nov 21, 2022
72b1c2f
Optimize TI.xcom_pull() with explicit task_ids and map_indexes (#27699)
uranusjr Nov 21, 2022
7e19647
Add a missing space in a print of initialize_virtualenv.py (#27793)
shahar1 Nov 21, 2022
d8dbdcc
Make views requiring session, keyword only args (#27790)
pierrejeambrun Nov 21, 2022
b9729d9
Don't explicitly set include_examples to False on task run command (#…
ephraimbuddy Nov 21, 2022
9c00985
Instruct users to upgrade docker-desktop instead of work around (#27809)
uranusjr Nov 21, 2022
0cf3cb1
Improve TriggerRuleDep typing and readability (#27810)
uranusjr Nov 21, 2022
2aaccaf
Metric for raw task return codes (#27155)
IKholopov Nov 22, 2022
093345c
Switch (back) to late imports (#27730)
blag Nov 22, 2022
9bae031
Add CI step to run prepare provider documentation. (#27832)
potiuk Nov 22, 2022
aaf5fd6
Add better diagnostics in case of outdated images for pre-commits (#2…
potiuk Nov 22, 2022
035315f
Add DagRun state change to the Listener plugin system(#27113)
mobuchowski Nov 22, 2022
336e065
Correct job name matching in SagemakerProcessingOperator (#27634)
ferruzzi Nov 23, 2022
0b0d299
Make DagRun state updates for paused DAGs faster (#27725)
jedcunningham Nov 23, 2022
dbb4b59
Restore removed (but used) methods in common.sql (#27843)
potiuk Nov 23, 2022
fb7c6af
Use virtual env python in the script shebang of retag_docker_images.p…
ephraimbuddy Nov 23, 2022
1486afd
UI: Update offset height if data changes (#27865)
bbovenzi Nov 23, 2022
734d156
Fix old-style typing in Base Sensor (#27871)
potiuk Nov 23, 2022
68ee3bf
Fix new warning appearing after new snowflake-connector-python (#27870)
potiuk Nov 23, 2022
a343bba
Fix templating fields and do_xcom_push in DatabricksSQLOperator (#27868)
potiuk Nov 23, 2022
5e460cb
Simplify FAB table resetting (#27869)
jedcunningham Nov 24, 2022
b18f319
Refresh next run datasets info in dags view (#27839)
bbovenzi Nov 24, 2022
adccc2d
Notes stored in separate table (#27849)
dstandish Nov 24, 2022
1f20b77
Fix suffix for pre-release cross-dependent packages (#27727)
potiuk Nov 24, 2022
e939a64
Make MappedTaskGroup depend on its expand inputs (#27876)
uranusjr Nov 24, 2022
33cc100
Allow depth-first execution (#27827)
uranusjr Nov 24, 2022
ea306c9
Fix errors in Databricks SQL operator introduced when refactoring (#2…
potiuk Nov 24, 2022
485142a
Redirect to home view when there are no valid tags in the URL (#25715)
wolfier Nov 24, 2022
80c327b
Bump common.sql provider to 1.3.1 (#27888)
potiuk Nov 24, 2022
3b032e5
Use "note" instead of "notes" in API re dag run / task instance notes…
dstandish Nov 24, 2022
efaabd9
Explicitly name the primary keys in ORM for task & dagrun notes table…
ephraimbuddy Nov 24, 2022
7d79812
task runner: notify of component start and finish (#27855)
mobuchowski Nov 24, 2022
cc18921
Update default branches for 2-5
ephraimbuddy Nov 24, 2022
82b37d3
tests: always cleanup registered test listeners (#27896)
mobuchowski Nov 24, 2022
be2de52
Remove is_mapped attribute (#27881)
uranusjr Nov 25, 2022
afa5290
Soft delete datasets that are no longer referenced in DAG schedules o…
blag Nov 25, 2022
b4ee96d
Mask audit log extra field (#27923)
ephraimbuddy Nov 25, 2022
6dc4c1c
Add allow list for imports during deserialization (#27887)
bolkedebruin Nov 25, 2022
d97bf74
Update version to 2.5.0
ephraimbuddy Nov 24, 2022
4488aea
Add release notes
ephraimbuddy Nov 24, 2022
7d1bdfb
Include correct meta tag to get dataset events (#27927)
ashb Nov 25, 2022
4a420d1
Fix deserializing Params where the default is an array (#27944)
ashb Nov 26, 2022
a16241b
Add release notes
ephraimbuddy Nov 24, 2022
963a5a3
Pass in session appropriately to _clear_dag_tis (#28003)
uranusjr Nov 30, 2022
52c2fa8
Fix failing test case for db clean in newer sqlalchemy (#28004)
potiuk Nov 30, 2022
c9a7246
Apply more masking on audit logs (#27994)
ephraimbuddy Nov 30, 2022
cd1aea4
allow scroll in triggered dag runs modal (#27965)
bbovenzi Nov 29, 2022
c0a0818
Gracefully handle whole config sections being renamed (#28008)
ashb Dec 1, 2022
fa2bec0
Add release notes
ephraimbuddy Nov 24, 2022
a6704d0
Update 2.5.0 release date (#28081)
ephraimbuddy Dec 3, 2022
5012093
Allow generation of connection URI to work when no conn type (#26765)
dstandish Dec 30, 2022
39791b6
fix: continue checking sla (#26968)
doiken Dec 14, 2022
5a565c4
Additional info about Segmentation Fault in LocalTaskJob (#27381)
Taragolis Dec 4, 2022
f8db720
Handle DAG disappearing mid-flight when dag verification happens (#27…
potiuk Nov 27, 2022
7a03761
Note which versions of Python are supported (#27798)
bertiewooster Nov 27, 2022
d174ef1
dagrun, next_dagruns_to_examine, add MySQL index hint (#27821)
michaelmicheal Nov 25, 2022
d34bd50
Make sure we can get out of a faulty scheduler state (#27834)
stijndehaes Dec 5, 2022
dcb9d47
Don't log CLI actions if db not initialized (#27851)
dstandish Dec 3, 2022
cc02bdc
fix: current_state method on TaskInstance doesn't filter by map_index…
xlanor Dec 3, 2022
5302cc2
Order TIs by map_index (#27904)
tanelk Dec 5, 2022
9733de8
Fix deadlock when chaining multiple empty mapped tasks (#27964)
ephraimbuddy Nov 29, 2022
5bb6430
Documentation for the LocalTaskJob return code counter (#27972)
IKholopov Nov 28, 2022
9aa72e4
Ignore Blackification commit from Git Blame (#27981)
uranusjr Nov 29, 2022
2016d4a
Simplify dataset subgraph logic (#27987)
bbovenzi Nov 30, 2022
7646bf6
Prevent double loading of providers from local paths (#27988)
ashb Nov 29, 2022
be004cb
Add documentation for [core] mp_start_method config (#27993)
csm10495 Nov 30, 2022
e573389
docs: copyedit DAG (#27995)
dandv Nov 30, 2022
3f3fd0f
Handle bad zip files nicely when parsing DAGs. (#28011)
potiuk Nov 30, 2022
c5a0a6b
Use asserts instead of exceptions for executor not started (#28019)
dstandish Dec 2, 2022
b322572
Add Andrey as committer (#28050)
potiuk Dec 2, 2022
51791a8
Return list of tasks that will be changed (#28066)
atrbgithub Dec 5, 2022
dacc8fc
Resolve false warning about calling conf.get on moved item (#28075)
dstandish Dec 2, 2022
7c916b7
Bump decode-uri-component from 0.2.0 to 0.2.2 in /airflow/www (#28080)
dependabot[bot] Dec 5, 2022
780a028
Add airflow.api.auth.backend.session to backend sessions in compose (…
potiuk Dec 4, 2022
4c15384
Improve handling of warnings in CI (#28096)
potiuk Dec 4, 2022
b4efb30
Don't emit FutureWarning when code not calling old key (#28109)
dstandish Dec 6, 2022
2bc0a0d
Make BaseJob.most_recent_job favor "running" jobs (#28119)
kosteev Dec 7, 2022
a7bcb4b
Improve run/task grid view actions (#28130)
bbovenzi Dec 6, 2022
b7f6d0c
Ensure the dagbag_size metric decreases when files are deleted (#28135)
ashb Dec 6, 2022
1011296
Do not warn when airflow dags tests command is used (#28138)
potiuk Dec 6, 2022
524004e
Ensure that warnings from `@dag` decorator are reported in dag file (…
ashb Dec 6, 2022
824963a
fix next run datasets error (#28165)
bbovenzi Dec 6, 2022
2bfc020
Make invalid characters exception more readable (#28181)
uranusjr Dec 7, 2022
d69af8e
Fix typo in Best Practice documentation (#28190)
pruoff Dec 7, 2022
fa37bf7
Add custom pickling hooks to LazyXComAccess (#28191)
uranusjr Dec 15, 2022
e21a315
Make live logs reading work for "other" k8s executors (#28213)
dstandish Dec 8, 2022
68a0fb7
Make arguments 'offset' and 'length' not required (#28234)
malthe Dec 9, 2022
9220218
Fix db clean warnings (#28243)
jedcunningham Dec 9, 2022
805dbc2
Convert test_task_command to Pytest and unquarantine tests in it (#28…
potiuk Dec 9, 2022
2150114
Trigger gevent monkeypatching via environment variable (#28283)
potiuk Dec 21, 2022
7f06509
Add SIGUSR2 handler for LocalTaskJob and workers to aid debugging (#2…
ashb Dec 12, 2022
4edd588
Separate ER diagram dependencies to doc_gen extra (#28346)
potiuk Dec 13, 2022
3a8768e
Remove docs package from Publish_docs.py and switch to python in sheb…
potiuk Dec 13, 2022
2653349
Correctly select a mapped task's "previous" task (#28379)
uranusjr Dec 15, 2022
97f7de2
Maintain manual scroll position in task logs (#28386)
bbovenzi Dec 19, 2022
ae49fcf
Dont show task/run durations when there is no start_date (#28395)
bbovenzi Dec 16, 2022
cf966c8
A manual run can't look like a scheduled one (#28397)
uranusjr Dec 22, 2022
d3824d5
separate callModal from dag.js (#28410)
bbovenzi Dec 22, 2022
b82f5af
Fix ti._try_number for deferred and up_for_reschedule tasks (#26993)
bbovenzi Jan 5, 2023
17fc92f
Add setters to MappedOperator on_*_callbacks (#28313)
cccs-seb Dec 13, 2022
3113f89
Re-enable Plyvel on ARM as it now builds cleanly (#28443)
potiuk Dec 18, 2022
4657a63
Add `ensure_ascii=False` in trigger dag run API (#28451)
akakakakakaa Dec 19, 2022
c57c7fc
Fix example import sentence in dates.py (#28453)
xyc-pz Dec 19, 2022
cf38e27
Fix bad pods pickled in executor_config (#28454)
dstandish Dec 26, 2022
d18367b
Ensure correct log dir in file task handler (#28477)
pingzh Jan 6, 2023
df1d322
Add retry to purge_inactive_dag_warnings (#28481)
michaelmicheal Jan 5, 2023
8157c0b
Move MyPY plugins of ours to dev folder (#28498)
potiuk Dec 20, 2022
505cfc4
Remove outdated Optional Provider Feature outdated documentation (#28…
potiuk Dec 20, 2022
f0625d4
Add AIRFLOW_PROJ_DIR to docker-compose example (#28517)
kfirgollan Dec 22, 2022
70f8ee3
Add MSSQL support for ARM Docker images (#28533)
potiuk Dec 22, 2022
287dd0d
Consider previous run in CronTriggerTimetable (#28532)
uranusjr Dec 26, 2022
2a34ec4
Emit warnings for `conf.get*` from the right source location (#28543)
ashb Dec 30, 2022
ccbdab8
navbar, cap dropdown size, and add scroll bar (#28561)
michaelmicheal Dec 30, 2022
21e6df8
Move TI setNote endpoints under TaskInstance in OpenAPI (#28566)
jedcunningham Dec 23, 2022
9a4645f
Update baseoperator.py (#28574)
abouklila Dec 29, 2022
80e7dec
Guard not-yet-expanded ti in trigger rule dep (#28592)
uranusjr Dec 28, 2022
cb2435e
Fix ``Connection.get_extra`` type (#28594)
bravmi Dec 28, 2022
2edf3ba
Use docker compose v2 command (#28605)
aaronsatae Dec 27, 2022
652c6ac
Fix Incorrect Example (#28609)
jfallt Dec 28, 2022
274304f
Minor update to Scheduler documentation (#28620)
maxnathaniel Dec 28, 2022
a4fef1f
Fix code docstrings (#28622)
stamixthereal Dec 28, 2022
9581691
Fix typo (#28623)
jbampton Dec 28, 2022
c442215
Fix UI caret direction (#28624)
vchiapaikeo Jan 2, 2023
73169bf
Add doc-strings and small improvement to email util (#28634)
stamixthereal Dec 29, 2022
e3bce86
Nest header blocks in divs to fix dagid copy nit on dag.html (#28643)
vchiapaikeo Jan 4, 2023
922963f
Remove outdated comments from base hook (#28649)
pankajastro Dec 30, 2022
7e34004
Fix `DetachedInstanceError` when finding zombies in Dag Parsing proce…
BobDu Dec 22, 2022
8b5ce05
Adding an example dag for dynamic task mapping (#28325)
amoghrajesh Dec 15, 2022
c18fe56
After running the DAG the employees table is empty. (#28353)
avicol Jan 11, 2023
214a2ff
Fix calendar view for CronTriggerTimeTable dags (#28411)
bbovenzi Dec 28, 2022
319234b
Improve provider validation pre-commit (#28516)
potiuk Dec 22, 2022
0d42c51
Add back join to zombie query that was dropped in #28198 (#28544)
jedcunningham Dec 23, 2022
5d6b445
Update pre-commit hooks (#28567)
KarshVashi Dec 24, 2022
a910d39
Change Architecture and OperatingSystem classies into Enums (#28627)
potiuk Jan 2, 2023
c0145d0
Fix minor typo in taskflow.rst (#28656)
markhatch Dec 30, 2022
0468ee7
Fix description of output redirection for access_log for gunicorn (#2…
potiuk Jan 3, 2023
6a6a258
Handle ConnectionReset exception in Executor cleanup (#28685)
maxnathaniel Jan 3, 2023
064c5c8
Fixed typo (#28687)
adilkhash Jan 3, 2023
d213afb
Row-lock TIs to be removed during mapped task expansion (#28689)
ephraimbuddy Jan 4, 2023
2528a5b
Allow XComArgs for external_task_ids of ExternalTaskSensor (#28692)
vchiapaikeo Jan 4, 2023
b4d65eb
Fix "airflow tasks render" cli command for mapped task instances (#28…
ephraimbuddy Jan 4, 2023
b33b87e
Fix some docs on using sensors with taskflow (#28708)
csm10495 Jan 4, 2023
329aad6
Add Niko to committers (#28712)
jedcunningham Jan 4, 2023
694c8c0
Bump json5 from 1.0.1 to 1.0.2 in /airflow/www (#28715)
dependabot[bot] Jan 4, 2023
65ea160
Ignore Blackification commit from Blame (#28719)
uranusjr Jan 4, 2023
4264401
Limit SQLAlchemy to below 2.0 (#28725)
potiuk Jan 4, 2023
e70f640
Clarify about docker compose (#28729)
eladkal Jan 4, 2023
62d5e47
Update CSRF token to expire with session (#28730)
maxnathaniel Jan 10, 2023
44dc2d8
Clarify that versioned constraints are fixed at release time (#28762)
potiuk Jan 6, 2023
589c83b
Only patch single label when adopting pod (#28776)
jedcunningham Jan 10, 2023
2f0916e
Fix UIAlert should_show when AUTH_ROLE_PUBLIC set (#28781)
vchiapaikeo Jan 10, 2023
e659595
Remove swagger-ui extra from connexion and install swagger-ui-dist vi…
JGoldman110 Jan 10, 2023
292592c
Update dynamic-task-mapping.rst (#28797)
sadler-elena Jan 9, 2023
7b3d591
Fix masking of non-sensitive environment variables (#28802)
ephraimbuddy Jan 9, 2023
116ca05
Update scheduler docs about low priority tasks (#28831)
eladkal Jan 11, 2023
7e9467f
Fix taskflow.rst duplicated "or" (#28839)
itaymaslo Jan 11, 2023
92235e1
Update config hash in Breeze's README.md during reinstalllation (#28148)
potiuk Dec 6, 2022
06807b2
Add inputimeout as dependency to breeze-cmd-line pre-commit deps (#28…
potiuk Dec 12, 2022
d3aeea6
Show mapped task groups in graph (#28392)
bbovenzi Dec 19, 2022
825fdf3
Only get changelog for core commits (#27900)
ephraimbuddy Nov 24, 2022
ab37ae5
Strip provider test details for mssql tests in CI (#27938)
potiuk Nov 26, 2022
bf41ca4
Make updating breeze deps via breeze easier. (#27958)
ashb Nov 28, 2022
007414a
Make breeze SVG output more stable (#27960)
ashb Nov 28, 2022
8ad86bf
better warning messages when running breeze in rosetta (#27874)
vandonr-amz Nov 30, 2022
4f0ae0d
Fix UnboundLocalError in breeze (#28126)
turbaszek Dec 5, 2022
268fe7c
Check if ghcr.io is reachable before network-bound breeze operations …
potiuk Dec 5, 2022
1fa8f43
Summarize all warnings from all builds (#28151)
potiuk Dec 6, 2022
3909409
Don't check rosetta on i386 (#28169)
dstandish Dec 6, 2022
2fed158
Force higher parallelism for waiting for images in CI (#28209)
potiuk Dec 8, 2022
56d7651
Improve caching for pre-commits in CI (#28240)
potiuk Dec 9, 2022
9081910
Proper Python Host output from composite tasks in CI (#28254)
potiuk Dec 10, 2022
8073efc
Make sure the key for k8s environment changes with requirements in CI…
potiuk Dec 12, 2022
86eb97c
Selective checks for API did not match API test specification (#28319)
potiuk Dec 12, 2022
5607ba9
Remove postgres from K8S venv (#28323)
potiuk Dec 13, 2022
2c7ef41
Fix output of error in K8s venv installation (#28322)
potiuk Dec 13, 2022
71d3060
Fix output buffering for `breeze testing test` (#28433)
potiuk Dec 18, 2022
b8efa4d
Fix redirection for selective chekcs for all workflows (#28518)
potiuk Dec 21, 2022
5eb90ef
Add VERBOSE equal to false for all just changed selective checks (#28…
potiuk Dec 21, 2022
f59105e
Re-enable `pymsql` on ARM as it now builds cleanly (#28530)
Taragolis Dec 22, 2022
c8a91a5
Wait for asset compilation to finish before starting airflow in Breez…
potiuk Dec 24, 2022
f9e535b
Output of the "dev" asset compilation for breeze available in file (#…
potiuk Dec 24, 2022
0df6a33
Allow to specify `pip` version via github URL in Docker/CI workflow (…
potiuk Jan 5, 2023
031c260
Add Andrey as allowed to use self-hosted runners (#28095)
potiuk Dec 4, 2022
93f9e1c
Fix selective checks handling error tracebacks in CI (#28514)
potiuk Dec 21, 2022
b7cf404
Remove deprecated AIPlatformConsoleLinkk from google/provider.yaml (#…
vchiapaikeo Dec 21, 2022
8dd1497
Fix tag_providers.sh (#28345)
eladkal Dec 13, 2022
d7db157
fIx isort problems introduced by recent isort release (#28434)
potiuk Dec 18, 2022
39a5d2f
Restructure Docs (#27235)
TohnJhomas Dec 16, 2022
c5d64ce
Cleanup and do housekeeping with plugin examples (#28537)
potiuk Dec 22, 2022
fafce07
Remove extra H1 & improve formatting of Listeners docs page (#28450)
nathan-contino Dec 19, 2022
c34ab42
Slightly improve description of Dynamic DAG generation preamble (#28650)
potiuk Dec 30, 2022
1a044ed
Added --integration flag to "standard" set of flags for testing comma…
potiuk Dec 9, 2022
3c885de
Add automated version replacement in example dag indexes (#28090)
potiuk Dec 5, 2022
369c635
Make secret rendering test more resilient to implementation details (…
potiuk Jan 2, 2023
1524392
Mention mapped operator in cluster policy doc (#28885)
uranusjr Jan 12, 2023
fb27486
Skip pushing early image cache for non-main branches (#28895)
potiuk Jan 12, 2023
6101280
Google have re-worked their docs site ane appear not publish objects.…
ashb Jan 10, 2023
e234beb
Validate Sphinx Inventory file header (#28838)
Taragolis Jan 10, 2023
743c237
fixup! Restructure Docs (#27235)
ephraimbuddy Jan 12, 2023
1208f4a
Rewrite kerberos security integration and unit tests (#28092)
Taragolis Dec 5, 2022
6c01117
Replace `unittests` in providers tests by pure `pytest` [Wave-3] (#27…
Taragolis Nov 26, 2022
dd14501
Replace `unittests` in providers-apache tests by pure `pytest` (#27948)
Taragolis Nov 27, 2022
d88aa5d
Move Integration tests to separate package under tests (#28170)
potiuk Dec 6, 2022
f78d285
Merge redis and rabbitmq integration into celery (#28205)
potiuk Dec 8, 2022
d879dde
Integration tests are separated into separate command and CI job (#28…
potiuk Dec 8, 2022
4ae8f42
Update Airflow version to 2.5.1
ephraimbuddy Jan 12, 2023
2ce4b56
Add Changelog for 2.5.1
ephraimbuddy Jan 12, 2023
0be7ab4
Fix task id when making the mapped task label in graph view (#28993)
bbovenzi Jan 17, 2023
9d97c5f
Limit dnspython to < 2.3.0 until eventlet incompatibitliy is solved (…
potiuk Jan 15, 2023
a0b464f
Remove limit for dnspython after eventlet got fixed (#29004)
potiuk Jan 18, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Mention mapped operator in cluster policy doc (apache#28885)
(cherry picked from commit 49e178e)
  • Loading branch information
uranusjr authored and pierrejeambrun committed Jan 12, 2023
commit 15243922225ec5468c707c714dc2ff710689d530
Original file line number Diff line number Diff line change
@@ -27,7 +27,7 @@ If you want to check or mutate DAGs or Tasks on a cluster-wide level, then a Clu
There are three types of cluster policy:

* ``dag_policy``: Takes a :class:`~airflow.models.dag.DAG` parameter called ``dag``. Runs at load time of the DAG from DagBag :class:`~airflow.models.dagbag.DagBag`.
* ``task_policy``: Takes a :class:`~airflow.models.baseoperator.BaseOperator` parameter called ``task``. The policy gets executed when the task is created during parsing of the task from DagBag at load time. This means that the whole task definition can be altered in the task policy. It does not relate to a specific task running in a DagRun. The ``task_policy`` defined is applied to all the task instances that will be executed in the future.
* ``task_policy``: Takes a parameter called ``task`` that is of type either :class:`~airflow.models.baseoperator.BaseOperator` or :class:`~airflow.models.mappedoperator.MappedOperator` (for `dynamically expanded tasks <dynamic-task-mapping>`_). The policy gets executed when the task is created during parsing of the task from DagBag at load time. This means that the whole task definition can be altered in the task policy. It does not relate to a specific task running in a DagRun. The ``task_policy`` defined is applied to all the task instances that will be executed in the future.
* ``task_instance_mutation_hook``: Takes a :class:`~airflow.models.taskinstance.TaskInstance` parameter called ``task_instance``. The ``task_instance_mutation`` applies not to a task but to the instance of a task that relates to a particular DagRun. It is executed in a "worker", not in the dag file processor, just before the task instance is executed. The policy is only applied to the currently executed run (i.e. instance) of that task.

The DAG and Task cluster policies can raise the :class:`~airflow.exceptions.AirflowClusterPolicyViolation` exception to indicate that the dag/task they were passed is not compliant and should not be loaded.
Original file line number Diff line number Diff line change
@@ -15,6 +15,8 @@
specific language governing permissions and limitations
under the License.

.. _dynamic-task-mapping:

====================
Dynamic Task Mapping
====================