Dataflow sensors - job metrics

[TobKed]

---

^ Add meaningful description above

Read the Pull Request Guidelines for more information.
In case of fundamental code change, Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in UPDATING.md.

[github-actions]

The Workflow run is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static checks,^Build docs$,^Spell check docs$,^Backport packages$,^Provider packages,^Checks: Helm tests$,^Test OpenAPI*.

[kaxil]

Can you please rebased your PR on latest Master since we have applied Black and PyUpgrade on Master

[github-actions]

The Workflow run is cancelling this PR. It has some failed jobs matching ^Pylint$,^Static checks,^Build docs$,^Spell check docs$,^Backport packages$,^Provider packages,^Checks: Helm tests$,^Test OpenAPI*.

[turbaszek]

Have you check how well it works with serialisation? Serialising a function can be problematic.cc @kaxil @mik-laj

[TobKed]

@turbaszek could you provide some more information how to test it for serialization, please? I am not so familiar with this topic

[mik-laj]

it is safe for serialization.

[TobKed]

PTAL @aaltay @mik-laj @turbaszek

[aaltay]

Nice!

[github-actions]

The PR should be OK to be merged with just subset of tests as it does not modify Core of Airflow. The committers might merge it or can add a label 'full tests needed' and re-run it to run all tests if they see it is needed!