DENG1381 - Add bqetl support for deprecation metadata #4213

alekhyamoz · 2023-08-28T19:45:15Z

Implements - https://mozilla-hub.atlassian.net/browse/DENG-1381

Checklist for reviewer:

Commits should reference a bug or github issue, if relevant (if a bug is referenced, the pull request should include the bug number in the title).
If the PR comes from a fork, trigger integration CI tests by running the Push to upstream workflow and provide the <username>:<branch> of the fork as parameter. The parameter will also show up
in the logs of the manual-trigger-required-for-fork CI task together with more detailed instructions.
If adding a new field to a query, ensure that the schema and dependent downstream schemas have been updated.
When adding a new derived dataset, ensure that data is not available already (fully or partially) and recommend extending an existing dataset in favor of creating new ones. Data can be available in the bigquery-etl repository, looker-hub or in looker-spoke-default.

For modifications to schemas in restricted namespaces (see CODEOWNERS):

Follow the change control procedure

┆Issue is synchronized with this Jira Task

dataops-ci-bot · 2023-08-29T01:48:31Z

Integration report for "Initial draft for adding deprecation support to bqetl"

`sql.diff`

Click to expand!

diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-08-29 01:45:58.000000000 +0000
@@ -1,21 +1,22 @@
-description: Aggregated metrics from Adjust data
 friendly_name: Adjust Firefox mobile installs
+description: |-
+  Aggregated metrics from Adjust data
+owners:
+- [email protected]
 labels:
-  incremental: false
   schedule: daily
-owners:
-  - [email protected]
+  owner1: rbaffourawuah
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - ga-mozilla-org-prod-001.Adjust.deliverable_*
   - moz-fx-data-shared-prod.static.country_codes_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql	2023-08-29 01:44:37.000000000 +0000
@@ -3,10 +3,10 @@
     SELECT
       COUNT(*)
     FROM
-      `{{project_id}}.{{dataset_id}}.{{table_name}}`
+      `moz-fx-data-marketing-prod.ga_derived.downloads_with_attribution_v2`
     WHERE
       download_date = @download_date
   ) > 50000
 )
 AS
-  'ETL Data Check Failed: Table {{project_id}}.{{dataset_id}}.{{table_name}} contains less than 50,000 rows for date: {{ download_date }}.'
+  'ETL Data Check Failed: Table moz-fx-data-marketing-prod.ga_derived.downloads_with_attribution_v2 contains less than 50,000 rows for date: .'
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/baseline`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.baseline_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-08-29 01:36:01.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/metrics`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.metrics_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_derived.metrics_clients_daily_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-08-29 01:36:01.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-08-29 01:45:55.000000000 +0000
@@ -1,22 +1,21 @@
----
-# Generated via bigquery_etl.glean_usage
-
 friendly_name: Metrics Clients Daily
 description: |-
   Daily per-client aggregates on top of metrics pings
 owners:
-  - [email protected]
+- [email protected]
+labels:
+  owner1: ascholtz
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: true
+    expiration_days: null
   clustering:
     fields:
       - normalized_channel
       - sample_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - accounts_backend.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-08-29 01:36:01.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-08-29 01:36:01.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: Historical Pings for `activity-stream/impression-stats`
 description: |-
   A historical view of pings sent for the
@@ -10,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,6 +1,11 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_by_experiment_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,6 +1,11 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_flat_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/on-save-recs`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.on_save_recs_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/pocket-button`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.pocket_button_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/sessions`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.sessions_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/spoc-fills`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.spoc_fills_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - pocket-tiles.pocket_tiles_data.tile_id_types
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-08-29 01:45:47.000000000 +0000
@@ -1,13 +1,13 @@
----
 friendly_name: Impression Stats By Experiment
-description: Representation of tile impression statistics,
- clustered by experiment_id to allow efficient analysis of
- individual experiments
+description: |-
+  Representation of tile impression statistics, clustered by experiment_id to allow efficient analysis of individual experiments
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -15,21 +15,17 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - experiment_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   init.sql:
   - activity_stream_bi.impression_stats_flat_v1
   query.sql:
   - activity_stream_bi.impression_stats_flat_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-08-29 01:45:47.000000000 +0000
@@ -1,11 +1,13 @@
----
 friendly_name: Impression Stats Flat
-description: Unnested representation of tile impression statistics
+description: |-
+  Unnested representation of tile impression statistics
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -13,20 +15,16 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - release_channel
       - sample_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-08-29 01:45:47.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql	2023-08-29 01:44:24.000000000 +0000
@@ -19,9 +19,8 @@
     sessions_per_user,
     sessions,
     date
-FROM `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
-WHERE (network != "Untrusted Devices")
-  AND
-  date in (
-    SELECT MAX(date) from `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
-    )
+FROM
+  `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
+WHERE
+  (network != "Untrusted Devices")
+  AND date IN (SELECT MAX(date) FROM `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`)
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-08-29 01:45:47.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql	2023-08-29 01:44:24.000000000 +0000
@@ -24,4 +24,5 @@
     daus,
     waus,
     maus
-FROM `moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1`
+FROM
+  `moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1`
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,18 +1,27 @@
----
 friendly_name: Cohort data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,18 +1,27 @@
----
 friendly_name: Deliverables data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-08-29 01:45:41.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-08-29 01:45:41.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Stats DAU dev/stage
-description: >-
+description: |-
   Reduced stats table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,11 +16,11 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-08-29 01:45:41.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-08-29 01:45:41.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Installs dev/stage
-description: >
+description: |
   Reduced daily installs table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,12 +16,12 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - amo_dev.amo_stats_dau_v2
   - amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: AMO Stats DAU
 description: |-
   Daily user statistics to power addons.mozilla.org stats pages.
@@ -8,11 +7,13 @@
   and provides all the information needed to populate the various
   "Daily Users" plots for the AMO stats dashboard.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,12 +21,12 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - amo_prod.desktop_addons_by_client_v1
   - amo_prod.fenix_addons_by_client_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,18 +1,14 @@
----
 friendly_name: AMO Stats DAU
-description: >
-  Daily install statistics to power addons.mozilla.org stats pages.
-  See bug 1654330. Note that this table uses a hashed_addon_id
-  defined as `TO_HEX(SHA256(addon_id))` because the underlying event
-  pings have limitations on length of properties attached to events
-  and addon_id values are sometimes too long. The AMO stats application
-  looks up records in this table based on the hashed_addon_id.
+description: |
+  Daily install statistics to power addons.mozilla.org stats pages. See bug 1654330. Note that this table uses a hashed_addon_id defined as `TO_HEX(SHA256(addon_id))` because the underlying event pings have limitations on length of properties attached to events and addon_id values are sometimes too long. The AMO stats application looks up records in this table based on the hashed_addon_id.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,11 +16,11 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - telemetry.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,30 +1,30 @@
----
 friendly_name: Desktop addons by client
-description: >-
-  Clients_daily-like table that records only the dimensions and addon info
-  necessary to power daily the amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table that records only the dimensions and addon info necessary to power daily the amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
-  # provide this value so that DAG generation does not have to dry run the
-  # query to get it, and that would be slow because main_v4 is referenced
-  referenced_tables: [['moz-fx-data-shared-prod', 'telemetry_stable',
-                       'main_v4']]
+  referenced_tables:
+  - - moz-fx-data-shared-prod
+    - telemetry_stable
+    - main_v4
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - telemetry.main
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,15 +1,14 @@
----
 friendly_name: Fenix addons by client
-description: >-
-  Clients_daily-like table on top of the various Firefox for Android channels
-  that records only the dimensions and addon info necessary to power the daily
-  amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table on top of the various Firefox for Android channels that records only the dimensions and addon info necessary to power the daily amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -17,11 +16,10 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - org_mozilla_fenix.metrics
@@ -29,3 +27,4 @@
   - org_mozilla_fennec_aurora.metrics
   - org_mozilla_firefox.metrics
   - org_mozilla_firefox_beta.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_app_store_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_downloads_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_usage_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -4,16 +4,20 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.app_store_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -4,16 +4,20 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.downloads_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -4,16 +4,20 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.usage_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.ad_group_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.campaign_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.keyword_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.organization_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml	2023-08-29 01:45:44.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.search_term_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml	2023-08-29 01:45:49.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__ad_group_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml	2023-08-29 01:45:49.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__campaign_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml	2023-08-29 01:45:49.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__keyword_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/organization_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/organization_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/organization_report_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/organization_report_v1/metadata.yaml	2023-08-29 01:45:49.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__organization_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/search_term_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/search_term_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/search_term_report_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/search_term_report_v1/metadata.yaml	2023-08-29 01:45:49.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__search_term_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/bedrock/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/bedrock/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/bedrock/dataset_metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/bedrock/dataset_metadata.yaml	2023-08-29 01:36:01.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/bedrock/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/bedrock/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/bedrock/deletion_request/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/bedrock/deletion_request/metadata.yaml	2023-08-29 01:45:52.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `bedrock/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   an

⚠️ Only part of the diff is displayed.

dataops-ci-bot · 2023-08-29T01:49:27Z

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

`sql.diff`

Click to expand!

diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-08-29 01:46:13.000000000 +0000
@@ -1,21 +1,22 @@
-description: Aggregated metrics from Adjust data
 friendly_name: Adjust Firefox mobile installs
+description: |-
+  Aggregated metrics from Adjust data
+owners:
+- [email protected]
 labels:
-  incremental: false
   schedule: daily
-owners:
-  - [email protected]
+  owner1: rbaffourawuah
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - ga-mozilla-org-prod-001.Adjust.deliverable_*
   - moz-fx-data-shared-prod.static.country_codes_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql	2023-08-29 01:44:19.000000000 +0000
@@ -3,10 +3,10 @@
     SELECT
       COUNT(*)
     FROM
-      `{{project_id}}.{{dataset_id}}.{{table_name}}`
+      `moz-fx-data-marketing-prod.ga_derived.downloads_with_attribution_v2`
     WHERE
       download_date = @download_date
   ) > 50000
 )
 AS
-  'ETL Data Check Failed: Table {{project_id}}.{{dataset_id}}.{{table_name}} contains less than 50,000 rows for date: {{ download_date }}.'
+  'ETL Data Check Failed: Table moz-fx-data-marketing-prod.ga_derived.downloads_with_attribution_v2 contains less than 50,000 rows for date: .'
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/baseline`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.baseline_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-08-29 01:36:59.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/metrics`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.metrics_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_derived.metrics_clients_daily_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-08-29 01:36:59.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-08-29 01:46:40.000000000 +0000
@@ -1,22 +1,21 @@
----
-# Generated via bigquery_etl.glean_usage
-
 friendly_name: Metrics Clients Daily
 description: |-
   Daily per-client aggregates on top of metrics pings
 owners:
-  - [email protected]
+- [email protected]
+labels:
+  owner1: ascholtz
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: true
+    expiration_days: null
   clustering:
     fields:
       - normalized_channel
       - sample_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - accounts_backend.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-08-29 01:36:59.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-08-29 01:36:59.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-08-29 01:46:26.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: Historical Pings for `activity-stream/impression-stats`
 description: |-
   A historical view of pings sent for the
@@ -10,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -1,6 +1,11 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_by_experiment_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-08-29 01:46:26.000000000 +0000
@@ -1,6 +1,11 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_flat_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/on-save-recs`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.on_save_recs_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/pocket-button`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.pocket_button_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/sessions`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.sessions_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/spoc-fills`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.spoc_fills_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-08-29 01:46:26.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - pocket-tiles.pocket_tiles_data.tile_id_types
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,13 +1,13 @@
----
 friendly_name: Impression Stats By Experiment
-description: Representation of tile impression statistics,
- clustered by experiment_id to allow efficient analysis of
- individual experiments
+description: |-
+  Representation of tile impression statistics, clustered by experiment_id to allow efficient analysis of individual experiments
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -15,21 +15,17 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - experiment_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   init.sql:
   - activity_stream_bi.impression_stats_flat_v1
   query.sql:
   - activity_stream_bi.impression_stats_flat_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,11 +1,13 @@
----
 friendly_name: Impression Stats Flat
-description: Unnested representation of tile impression statistics
+description: |-
+  Unnested representation of tile impression statistics
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -13,20 +15,16 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - release_channel
       - sample_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql	2023-08-29 01:44:40.000000000 +0000
@@ -19,9 +19,8 @@
     sessions_per_user,
     sessions,
     date
-FROM `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
-WHERE (network != "Untrusted Devices")
-  AND
-  date in (
-    SELECT MAX(date) from `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
-    )
+FROM
+  `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
+WHERE
+  (network != "Untrusted Devices")
+  AND date IN (SELECT MAX(date) FROM `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`)
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql	2023-08-29 01:44:40.000000000 +0000
@@ -24,4 +24,5 @@
     daus,
     waus,
     maus
-FROM `moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1`
+FROM
+  `moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1`
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-08-29 01:46:23.000000000 +0000
@@ -1,18 +1,27 @@
----
 friendly_name: Cohort data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-08-29 01:46:23.000000000 +0000
@@ -1,18 +1,27 @@
----
 friendly_name: Deliverables data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Stats DAU dev/stage
-description: >-
+description: |-
   Reduced stats table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,11 +16,11 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Installs dev/stage
-description: >
+description: |
   Reduced daily installs table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,12 +16,12 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - amo_dev.amo_stats_dau_v2
   - amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-08-29 01:46:23.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-08-29 01:46:23.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: AMO Stats DAU
 description: |-
   Daily user statistics to power addons.mozilla.org stats pages.
@@ -8,11 +7,13 @@
   and provides all the information needed to populate the various
   "Daily Users" plots for the AMO stats dashboard.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,12 +21,12 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - amo_prod.desktop_addons_by_client_v1
   - amo_prod.fenix_addons_by_client_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-08-29 01:46:23.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-08-29 01:46:23.000000000 +0000
@@ -1,18 +1,14 @@
----
 friendly_name: AMO Stats DAU
-description: >
-  Daily install statistics to power addons.mozilla.org stats pages.
-  See bug 1654330. Note that this table uses a hashed_addon_id
-  defined as `TO_HEX(SHA256(addon_id))` because the underlying event
-  pings have limitations on length of properties attached to events
-  and addon_id values are sometimes too long. The AMO stats application
-  looks up records in this table based on the hashed_addon_id.
+description: |
+  Daily install statistics to power addons.mozilla.org stats pages. See bug 1654330. Note that this table uses a hashed_addon_id defined as `TO_HEX(SHA256(addon_id))` because the underlying event pings have limitations on length of properties attached to events and addon_id values are sometimes too long. The AMO stats application looks up records in this table based on the hashed_addon_id.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,11 +16,11 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - telemetry.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-08-29 01:46:23.000000000 +0000
@@ -1,30 +1,30 @@
----
 friendly_name: Desktop addons by client
-description: >-
-  Clients_daily-like table that records only the dimensions and addon info
-  necessary to power daily the amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table that records only the dimensions and addon info necessary to power daily the amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
-  # provide this value so that DAG generation does not have to dry run the
-  # query to get it, and that would be slow because main_v4 is referenced
-  referenced_tables: [['moz-fx-data-shared-prod', 'telemetry_stable',
-                       'main_v4']]
+  referenced_tables:
+  - - moz-fx-data-shared-prod
+    - telemetry_stable
+    - main_v4
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - telemetry.main
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-08-29 01:46:23.000000000 +0000
@@ -1,15 +1,14 @@
----
 friendly_name: Fenix addons by client
-description: >-
-  Clients_daily-like table on top of the various Firefox for Android channels
-  that records only the dimensions and addon info necessary to power the daily
-  amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table on top of the various Firefox for Android channels that records only the dimensions and addon info necessary to power the daily amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -17,11 +16,10 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - org_mozilla_fenix.metrics
@@ -29,3 +27,4 @@
   - org_mozilla_fennec_aurora.metrics
   - org_mozilla_firefox.metrics
   - org_mozilla_firefox_beta.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-08-29 01:46:31.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_app_store_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-08-29 01:46:31.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_downloads_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-08-29 01:46:31.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_usage_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -4,16 +4,20 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.app_store_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -4,16 +4,20 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.downloads_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -4,16 +4,20 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.usage_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.ad_group_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.campaign_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.keyword_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.organization_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml	2023-08-29 01:46:32.000000000 +0000
@@ -1,5 +1,10 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.search_term_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__ad_group_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__campaign_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__keyword_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/organization_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/organization_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/organization_report_v1/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/organization_report_v1/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__organization_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/search_term_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/search_term_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/search_term_report_v1/metadata.yaml	2023-08-29 01:47:29.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/search_term_report_v1/metadata.yaml	2023-08-29 01:46:27.000000000 +0000
@@ -4,13 +4,14 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__search_term_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/bedrock/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/bedrock/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/bedrock/dataset_metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/bedrock/dataset_metadata.yaml	2023-08-29 01:36:59.000000000 +0000
@@ -8,3 +8,4 @@
 - role: roles/bigquery.dataViewer
   members:
   - workgroup:mozilla-confidential
+default_table_workgroup_access: null
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/bedrock/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/bedrock/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/bedrock/deletion_request/metadata.yaml	2023-08-29 01:47:28.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/bedrock/deletion_request/metadata.yaml	2023-08-29 01:46:36.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `bedrock/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,10 @@
   an

⚠️ Only part of the diff is displayed.

Click to expand!

Only in /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery: dataset_metadata.yaml
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_live/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_live/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_live/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_live/metadata.yaml	2023-09-07 18:39:36.000000000 +0000
@@ -1,7 +1,16 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-fxa-nonprod-375e.fxa_stage_logs.docker_fxa_auth_20*
   - moz-fx-fxa-nonprod-375e.fxa_stage_logs.docker_fxa_content_20*
   - moz-fx-fxa-nonprod-375e.fxa_stage_logs.stdout_20*
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_v1/metadata.yaml	2023-09-07 18:39:36.000000000 +0000
@@ -1,37 +1,35 @@
 friendly_name: Non-Prod FxA flows by date
-description: >
+description: |
   Non-Prod FxA flow_id, first seen timestamp, and last seen user id by date
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: cjms
   schedule: hourly
+  dag: bqetl_cjms_nonprod
+  owner1: srose
 scheduling:
   dag_name: bqetl_cjms_nonprod
   query_project: moz-fx-data-shared-prod
-  # delay aggregates by 2 hours, to ensure data is complete
   date_partition_parameter: null
-  destination_table:
-    >-
-    flows_v1${{
-    (execution_date - macros.timedelta(hours=2)).strftime("%Y%m%d")
+  destination_table: flows_v1${{ (execution_date - macros.timedelta(hours=2)).strftime("%Y%m%d")
     }}
   parameters:
-    - >-
-      submission_date:DATE:{{
-      (execution_date - macros.timedelta(hours=2)).strftime("%Y-%m-%d")
+  - submission_date:DATE:{{ (execution_date - macros.timedelta(hours=2)).strftime("%Y-%m-%d")
       }}
-  query_file_path:
-    # explicit query file path is necessary because the destination table
-    # includes a partition identifier that is not in the path
-    sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_v1/query.sql
+  query_file_path: sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/flows_v1/query.sql
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: false
-
-# Generated by bigquery_etl.dependency
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-cjms-nonprod-9a36.cjms_bigquery.flows_live
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/refunds_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/refunds_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/refunds_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/refunds_v1/metadata.yaml	2023-09-07 18:39:36.000000000 +0000
@@ -1,18 +1,22 @@
 friendly_name: Stripe refunds on CJ subscriptions
-description: Stripe refunds on CJ subscriptions
+description: |-
+  Stripe refunds on CJ subscriptions
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: cjms
   schedule: hourly
+  dag: bqetl_cjms_nonprod
+  owner1: srose
 scheduling:
   dag_name: bqetl_cjms_nonprod
   query_project: moz-fx-data-shared-prod
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - EXTERNAL_QUERY('moz-fx-cjms-nonprod-9a36.us.cjms-sql', 'SELECT subscription_id
@@ -20,3 +24,4 @@
   - moz-fx-data-shared-prod.stripe_external.nonprod_charge_v1
   - moz-fx-data-shared-prod.stripe_external.nonprod_invoice_v1
   - moz-fx-data-shared-prod.stripe_external.nonprod_refund_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/subscriptions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/subscriptions_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/subscriptions_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/subscriptions_v1/metadata.yaml	2023-09-07 18:39:36.000000000 +0000
@@ -1,18 +1,22 @@
 friendly_name: Stripe subscriptions attributed to CJ flows
-description: Stripe subscriptions attributed to CJ flows
+description: |-
+  Stripe subscriptions attributed to CJ flows
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: cjms
   schedule: hourly
+  dag: bqetl_cjms_nonprod
+  owner1: srose
 scheduling:
   dag_name: bqetl_cjms_nonprod
   query_project: moz-fx-data-shared-prod
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - EXTERNAL_QUERY('moz-fx-cjms-nonprod-9a36.us.cjms-sql', 'SELECT flow_id FROM aic')
@@ -23,3 +27,4 @@
   - moz-fx-data-shared-prod.stripe_external.nonprod_invoice_v1
   - moz-fx-data-shared-prod.stripe_external.nonprod_promotion_code_v1
   - moz-fx-data-shared-prod.subscription_platform_derived.nonprod_stripe_subscriptions_v1
+deprecated: false
Only in /tmp/workspace/generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery: dataset_metadata.yaml
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/flows_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/flows_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/flows_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/flows_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,11 +1,13 @@
 friendly_name: FxA flows by date
-description: >
+description: |
   FxA flow_id, first seen timestamp, and last seen user id by date
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: cjms
   schedule: hourly
+  dag: bqetl_subplat
+  owner1: srose
 scheduling:
   dag_name: bqetl_subplat
   query_project: moz-fx-data-shared-prod
@@ -14,8 +16,13 @@
     type: day
     field: submission_date
     require_partition_filter: false
-
-# Generated by bigquery_etl.dependency
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-shared-prod.firefox_accounts.fxa_all_events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/refunds_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/refunds_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/refunds_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/refunds_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,18 +1,22 @@
 friendly_name: Stripe refunds on CJ subscriptions
-description: Stripe refunds on CJ subscriptions
+description: |-
+  Stripe refunds on CJ subscriptions
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: cjms
   schedule: hourly
+  dag: bqetl_subplat
+  owner1: srose
 scheduling:
   dag_name: bqetl_subplat
   query_project: moz-fx-data-shared-prod
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - EXTERNAL_QUERY('moz-fx-cjms-prod-f3c7.us.cjms-sql', 'SELECT subscription_id FROM
@@ -20,3 +24,4 @@
   - moz-fx-data-shared-prod.stripe_external.charge_v1
   - moz-fx-data-shared-prod.stripe_external.invoice_v1
   - moz-fx-data-shared-prod.stripe_external.refund_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/subscriptions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/subscriptions_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/subscriptions_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-cjms-prod-f3c7/cjms_bigquery/subscriptions_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,18 +1,22 @@
 friendly_name: Stripe subscriptions attributed to CJ flows
-description: Stripe subscriptions attributed to CJ flows
+description: |-
+  Stripe subscriptions attributed to CJ flows
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: cjms
   schedule: hourly
+  dag: bqetl_subplat
+  owner1: srose
 scheduling:
   dag_name: bqetl_subplat
   query_project: moz-fx-data-shared-prod
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - EXTERNAL_QUERY('moz-fx-cjms-prod-f3c7.us.cjms-sql', 'SELECT flow_id FROM aic')
@@ -22,3 +26,4 @@
   - moz-fx-data-shared-prod.stripe_external.invoice_v1
   - moz-fx-data-shared-prod.stripe_external.promotion_code_v1
   - moz-fx-data-shared-prod.subscription_platform_derived.stripe_subscriptions_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/dashboard_health_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/dashboard_health_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/dashboard_health_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/dashboard_health_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,23 +1,24 @@
----
-description: >
-  Firefox performance tests that do not have a defined release criteria or that
-  are not explicitly excluded (missing_rc), have multiple release criteria
-  defined for a single test (duplicate_rc), or specify the release criteria for
-  a test that has not run in at least 28 days (invalid_rc).
+friendly_name: null
+description: |
+  Firefox performance tests that do not have a defined release criteria or that are not explicitly excluded (missing_rc), have multiple release criteria defined for a single test (duplicate_rc), or specify the release criteria for a test that has not run in at least 28 days (invalid_rc).
+owners:
+- [email protected]
 labels:
   application: firefox
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_release_criteria
+  owner1: esmyth
 scheduling:
   dag_name: bqetl_release_criteria
-  start_date: "2020-12-03"
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
+  start_date: '2020-12-03'
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - rc_flattened_test_data_v1
   - release_criteria_helper
+deprecated: false
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria: dataset_metadata.yaml
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/rc_flattened_test_data_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/rc_flattened_test_data_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/rc_flattened_test_data_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/rc_flattened_test_data_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,19 +1,23 @@
----
 friendly_name: Flattened Performance Test Data
-description: Firefox performance test data flattened to 1 row per replicate
+description: |-
+  Firefox performance test data flattened to 1 row per replicate
+owners:
+- [email protected]
 labels:
   application: firefox
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_release_criteria
+  owner1: esmyth
 scheduling:
   dag_name: bqetl_release_criteria
-  start_date: "2020-12-03"
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
+  start_date: '2020-12-03'
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - mozdata.taskclusteretl.perfherder
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/release_criteria_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/release_criteria_summary_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/release_criteria_summary_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/release_criteria_summary_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,20 +1,23 @@
----
-description: >
-  Firefox performance test data related to performance release criteria for
-  Desktop and Mobile
+friendly_name: null
+description: |
+  Firefox performance test data related to performance release criteria for Desktop and Mobile
+owners:
+- [email protected]
 labels:
   application: firefox
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_release_criteria
+  owner1: esmyth
 scheduling:
   dag_name: bqetl_release_criteria
-  start_date: "2020-12-03"
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
+  start_date: '2020-12-03'
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - release_criteria_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/release_criteria_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/release_criteria_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/release_criteria_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/release_criteria_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,22 +1,25 @@
----
-description: >
-  Firefox performance test data related to performance release criteria for
-  Desktop and Mobile
+friendly_name: null
+description: |
+  Firefox performance test data related to performance release criteria for Desktop and Mobile
+owners:
+- [email protected]
 labels:
   application: firefox
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_release_criteria
+  owner1: esmyth
 scheduling:
   dag_name: bqetl_release_criteria
-  start_date: "2020-12-03"
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
+  start_date: '2020-12-03'
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - dp2-prod.sumo.release_calendar
   - rc_flattened_test_data_v1
   - release_criteria_helper
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/stale_tests_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/stale_tests_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-bq-performance/release_criteria/stale_tests_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-bq-performance/release_criteria/stale_tests_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,20 +1,23 @@
----
-description: >
-  Firefox performance tests that have not run as recently as expected by their
-  test tier
+friendly_name: null
+description: |
+  Firefox performance tests that have not run as recently as expected by their test tier
+owners:
+- [email protected]
 labels:
   application: firefox
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_release_criteria
+  owner1: esmyth
 scheduling:
   dag_name: bqetl_release_criteria
-  start_date: "2020-12-03"
-  # destination is the whole table, not a single partition,
-  # so don't use date_partition_parameter
+  start_date: '2020-12-03'
   date_partition_parameter: null
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - release_criteria_v1
+deprecated: false
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-experiments/monitoring: dataset_metadata.yaml
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-experiments/monitoring/experimenter_experiments_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-experiments/monitoring/experimenter_experiments_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-experiments/monitoring/experimenter_experiments_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-experiments/monitoring/experimenter_experiments_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,11 +1,18 @@
----
 friendly_name: Experimenter experiments
-description: Experimenter experiments periodically imported via the
-  Experimenter API.
+description: |-
+  Experimenter experiments periodically imported via the Experimenter API.
+owners:
+- [email protected]
 labels:
-  incremental: false
   schedule: ten-minute
-owners:
-  - [email protected]
+  dag: bqetl_experimenter_experiments_import
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_experimenter_experiments_import
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-experiments/monitoring/query_cost_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-experiments/monitoring/query_cost_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-experiments/monitoring/query_cost_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-experiments/monitoring/query_cost_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,19 +1,30 @@
-description: Cost of executed experiment analysis queries.
 friendly_name: Experiment Analysis Query Costs
-labels:
-  incremental: true
+description: |-
+  Cost of executed experiment analysis queries.
 owners:
 - [email protected]
+labels:
+  incremental: true
+  dag: bqetl_experiments_daily
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_experiments_daily
-  referenced_tables: [['region-us', 'INFORMATION_SCHEMA', 'JOBS_BY_PROJECT']]
+  referenced_tables:
+  - - region-us
+    - INFORMATION_SCHEMA
+    - JOBS_BY_PROJECT
 bigquery:
   time_partitioning:
     type: day
     field: submission_timestamp
     require_partition_filter: false
-
-# Generated by bigquery_etl.dependency
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - region-us.INFORMATION_SCHEMA.JOBS_BY_PROJECT
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,21 +1,26 @@
-description: Aggregated metrics from Adjust data
 friendly_name: Adjust Firefox mobile installs
+description: |-
+  Aggregated metrics from Adjust data
+owners:
+- [email protected]
 labels:
-  incremental: false
   schedule: daily
-owners:
-  - [email protected]
+  owner1: rbaffourawuah
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - ga-mozilla-org-prod-001.Adjust.deliverable_*
   - moz-fx-data-shared-prod.static.country_codes_v1
+deprecated: false
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod: dataset_metadata.yaml
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_daily_summary_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,28 +1,38 @@
-description: Daily summary Google analytics data for blog.mozilla.org
 friendly_name: Blogs Daily Summary
+description: |-
+  Daily summary Google analytics data for blog.mozilla.org
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
   referenced_tables:
-    - ['moz-fx-data-marketing-prod', 'ga_derived', 'blogs_goals_v1']
-    - ['moz-fx-data-marketing-prod', 'ga_derived', 'blogs_sessions_v1']
+  - - moz-fx-data-marketing-prod
+    - ga_derived
+    - blogs_goals_v1
+  - - moz-fx-data-marketing-prod
+    - ga_derived
+    - blogs_sessions_v1
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
       - browser
       - blog
       - subblog
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.blogs_daily_summary_v1
@@ -30,3 +40,4 @@
   - moz-fx-data-marketing-prod.ga_derived.blogs_goals_v1
   - moz-fx-data-marketing-prod.ga_derived.blogs_sessions_v1
   - moz-fx-data-shared-prod.static.third_party_standardized_country_names
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,18 +1,26 @@
-description: Check if there is data for blogs.mozilla.org for the given date
 friendly_name: Blogs Empty Check
+description: |-
+  Check if there is data for blogs.mozilla.org for the given date
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
   destination_table: null
   query_file_path: sql/moz-fx-data-marketing-prod/ga_derived/blogs_empty_check_v1/query.sql
   referenced_tables: []
-  parameters: ['submission_date:DATE:{{ds}}']
-
-# Generated by bigquery_etl.dependency
+  parameters:
+  - submission_date:DATE:{{ds}}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-marketing-prod.66602784.ga_sessions_*
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_goals_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,23 +1,33 @@
-description: Intermediate table containing key metrics for blog.mozilla.org
 friendly_name: Blogs Goals
+description: |-
+  Intermediate table containing key metrics for blog.mozilla.org
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
   referenced_tables:
-    - ['moz-fx-data-marketing-prod', 'ga_derived', 'blogs_empty_check_v1']
+  - - moz-fx-data-marketing-prod
+    - ga_derived
+    - blogs_empty_check_v1
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
-
-# Generated by bigquery_etl.dependency
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.blogs_goals_v1
   query.sql:
   - moz-fx-data-marketing-prod.66602784.ga_sessions_*
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_landing_page_summary_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,29 +1,38 @@
-description: Daily summary Google analytics data for blog.mozilla.org
-  landing page
 friendly_name: Blogs Landing Page Summary
+description: |-
+  Daily summary Google analytics data for blog.mozilla.org landing page
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
   referenced_tables:
-    - ["moz-fx-data-marketing-prod", "ga_derived", "blogs_goals_v1"]
-    - ["moz-fx-data-marketing-prod", "ga_derived", "blogs_sessions_v1"]
+  - - moz-fx-data-marketing-prod
+    - ga_derived
+    - blogs_goals_v1
+  - - moz-fx-data-marketing-prod
+    - ga_derived
+    - blogs_sessions_v1
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - cleaned_landing_page
       - browser
       - blog
       - subblog
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.blogs_landing_page_summary_v1
@@ -32,3 +41,4 @@
   - moz-fx-data-marketing-prod.ga_derived.blogs_goals_v1
   - moz-fx-data-marketing-prod.ga_derived.blogs_sessions_v1
   - moz-fx-data-shared-prod.static.third_party_standardized_country_names
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/blogs_sessions_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,24 +1,33 @@
-description: Intermediate table containing normalized sessions
-  for blog.mozilla.org
 friendly_name: Blogs Sessions
+description: |-
+  Intermediate table containing normalized sessions for blog.mozilla.org
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
   referenced_tables:
-    - ["moz-fx-data-marketing-prod", "ga_derived", "blogs_empty_check_v1"]
+  - - moz-fx-data-marketing-prod
+    - ga_derived
+    - blogs_empty_check_v1
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
-
-# Generated by bigquery_etl.dependency
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.blogs_sessions_v1
   query.sql:
   - moz-fx-data-marketing-prod.66602784.ga_sessions_*
+deprecated: false
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived: dataset_metadata.yaml
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -32,6 +32,7 @@
   incremental: true
   schedule: daily
   owner1: gleonard
+  dag: bqetl_google_analytics_derived
 scheduling:
   dag_name: bqetl_google_analytics_derived
   referenced_tables:
@@ -45,4 +46,9 @@
     require_partition_filter: false
     expiration_days: null
   clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql	2023-09-07 18:38:40.000000000 +0000
@@ -3,10 +3,10 @@
     SELECT
       COUNT(*)
     FROM
-      `{{project_id}}.{{dataset_id}}.{{table_name}}`
+      `moz-fx-data-marketing-prod.ga_derived.downloads_with_attribution_v2`
     WHERE
       download_date = @download_date
   ) > 50000
 )
 AS
-  'ETL Data Check Failed: Table {{project_id}}.{{dataset_id}}.{{table_name}} contains less than 50,000 rows for date: {{ download_date }}.'
+  'ETL Data Check Failed: Table moz-fx-data-marketing-prod.ga_derived.downloads_with_attribution_v2 contains less than 50,000 rows for date: .'
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -47,6 +47,7 @@
   incremental: true
   schedule: daily
   owner1: gleonard
+  dag: bqetl_download_funnel_attribution
 scheduling:
   dag_name: bqetl_download_funnel_attribution
   task_name: ga_derived__downloads_with_attribution__v2
@@ -63,4 +64,9 @@
     require_partition_filter: false
     expiration_days: null
   clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/firefox_whatsnew_summary_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,10 +1,13 @@
-description: This table aggregates the traffic to Firefox "what's new" pages and the number of bounces
 friendly_name: Firefox "what's new" hits and bounces
+description: |-
+  This table aggregates the traffic to Firefox "what's new" pages and the number of bounces
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: rbaffourawuah
 scheduling:
   dag_name: bqetl_google_analytics_derived
 bigquery:
@@ -12,13 +15,17 @@
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
       - locale
       - version
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_downloads_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,10 +1,13 @@
-description: Aggregated download counts for www.mozilla.org
 friendly_name: WWW Site Downloads
+description: |-
+  Aggregated download counts for www.mozilla.org
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
 bigquery:
@@ -12,10 +15,15 @@
     type: day
     field: date
     require_partition_filter: false
-
-# Generated by bigquery_etl.dependency
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_downloads_v1
   query.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,18 +1,26 @@
-description: Check if there is data for www.mozilla.org for the given date
 friendly_name: WWW Site Empty Check
+description: |-
+  Check if there is data for www.mozilla.org for the given date
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
   destination_table: null
   query_file_path: sql/moz-fx-data-marketing-prod/ga_derived/www_site_empty_check_v1/query.sql
   referenced_tables: []
-  parameters: ['submission_date:DATE:{{ds}}']
-
-# Generated by bigquery_etl.dependency
+  parameters:
+  - submission_date:DATE:{{ds}}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-marketing-prod.65789850.ga_sessions_*
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_events_metrics_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,10 +1,13 @@
-description: Aggregated metrics about events on www.mozilla.org
 friendly_name: WWW Site Event Metrics
+description: |-
+  Aggregated metrics about events on www.mozilla.org
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
 bigquery:
@@ -12,16 +15,20 @@
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - page_name
       - event_category
       - event_action
       - event_label
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_events_metrics_v1
   query.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_hits_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,23 +1,33 @@
-description: Normalized individual hits for www.mozilla.org
 friendly_name: WWW Site Hits
+description: |-
+  Normalized individual hits for www.mozilla.org
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
   referenced_tables:
-    - ['moz-fx-data-marketing-prod', 'ga_derived', 'www_site_empty_check_v1']
+  - - moz-fx-data-marketing-prod
+    - ga_derived
+    - www_site_empty_check_v1
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
-
-# Generated by bigquery_etl.dependency
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1
   query.sql:
   - moz-fx-data-marketing-prod.65789850.ga_sessions_*
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_landing_page_metrics_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,10 +1,13 @@
-description: Aggregated metrics for the www.mozilla.org landing page
 friendly_name: WWW Site Landing Page Metrics
+description: |-
+  Aggregated metrics for the www.mozilla.org landing page
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
 bigquery:
@@ -12,17 +15,21 @@
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - page_name
       - country
       - locale
       - medium
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_landing_page_metrics_v1
   query.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_downloads_v1
   - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_metrics_summary_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,10 +1,13 @@
-description: Aggregated metrics for www.mozilla.org
 friendly_name: WWW Site Metrics Summary
+description: |-
+  Aggregated metrics for www.mozilla.org
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
 bigquery:
@@ -12,14 +15,17 @@
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
       - browser
       - source
       - medium
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_metrics_summary_v1
@@ -27,3 +33,4 @@
   - moz-fx-data-marketing-prod.65789850.ga_sessions_*
   - moz-fx-data-marketing-prod.ga_derived.www_site_downloads_v1
   - moz-fx-data-shared-prod.static.third_party_standardized_country_names
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/www_site_page_metrics_v1/metadata.yaml	2023-09-07 18:40:05.000000000 +0000
@@ -1,10 +1,13 @@
-description: Aggregated metrics per page on www.mozilla.org
 friendly_name: WWW Site Page Metrics
+description: |-
+  Aggregated metrics per page on www.mozilla.org
+owners:
+- [email protected]
 labels:
   incremental: true
   schedule: daily
-owners:
-  - [email protected]
+  dag: bqetl_google_analytics_derived
+  owner1: ascholtz
 scheduling:
   dag_name: bqetl_google_analytics_derived
 bigquery:
@@ -12,16 +15,20 @@
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - page_name
       - country
       - locale
       - medium
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   init.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_page_metrics_v1
   query.sql:
   - moz-fx-data-marketing-prod.ga_derived.www_site_hits_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/baseline`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.baseline_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-09-07 18:28:38.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/metrics`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.metrics_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_derived.metrics_clients_daily_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-09-07 18:28:38.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-09-07 18:40:02.000000000 +0000
@@ -1,22 +1,25 @@
----
-# Generated via bigquery_etl.glean_usage
-
 friendly_name: Metrics Clients Daily
 description: |-
   Daily per-client aggregates on top of metrics pings
 owners:
-  - [email protected]
+- [email protected]
+labels:
+  owner1: ascholtz
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: true
+    expiration_days: null
   clustering:
     fields:
       - normalized_channel
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - accounts_backend.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-09-07 18:28:38.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-09-07 18:39:58.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-09-07 18:28:38.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-09-07 18:39:20.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-09-07 18:39:54.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgro

⚠️ Only part of the diff is displayed.

alekhyamoz · 2023-09-07T18:57:51Z

@whd and @scholtzan I have updated the code based on your comments.
Added

bigquery-etl/bigquery_etl/cli/metadata.py

Line 51 in bd3a9ae

if not dataset_metadata_path.exists():

to ignore dirs that do not have dataset metadata yaml file.

whd

r+wc

whd · 2023-09-11T18:03:18Z

sql/moz-fx-cjms-nonprod-9a36/cjms_bigquery/dataset_metadata.yaml

@@ -0,0 +1,14 @@
+friendly_name: cjms non prod derived tables


I believe we discussed this in slack, but I'm of the opinion that we should (for now) only create dataset_metadata.yaml files in moz-fx-data-shared-prod, since that's where they are authoritative. So you should delete all of these dataset_metadata.yaml files.

There's actually a single dataset_metadata.yaml file https://github.com/mozilla/bigquery-etl/blob/bd3a9ae0b2e9c289ac93e67e426189d78749c2fd/sql/moz-fx-data-marketing-prod/adjust_derived/dataset_metadata.yaml that exists in a non-shared-prod dir and is technically incorrect. I think removing that can be handled in a separate PR.

bigquery_etl/cli/metadata.py

whd · 2023-09-11T19:50:48Z

bigquery_etl/metadata/parse_metadata.py

    workgroup_access: list = attr.ib(DEFAULT_WORKGROUP_ACCESS)

+    def __attrs_post_init__(self):
+        """Set default table workgroup access to workgroup access."""


Actually, it appears that this block makes it so that a default value is always available, which means the logic in most recent suggestion won't do anything. I suppose that explains some earlier logic that was writing this file all the time redundantly. It seems fine to do that but there are probably ways to avoid it as well.

dataops-ci-bot · 2023-09-11T21:49:40Z

Integration report for "Remove unwanted dataset metadata yamls"

`sql.diff`

Click to expand!

diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-09-11 21:47:20.000000000 +0000
@@ -1,21 +1,26 @@
-description: Aggregated metrics from Adjust data
 friendly_name: Adjust Firefox mobile installs
+description: |-
+  Aggregated metrics from Adjust data
+owners:
+- [email protected]
 labels:
-  incremental: false
   schedule: daily
-owners:
-  - [email protected]
+  owner1: rbaffourawuah
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - ga-mozilla-org-prod-001.Adjust.deliverable_*
   - moz-fx-data-shared-prod.static.country_codes_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/ga_derived/downloads_with_attribution_v2/checks.sql	2023-09-11 21:45:48.000000000 +0000
@@ -3,10 +3,10 @@
     SELECT
       COUNT(*)
     FROM
-      `{{project_id}}.{{dataset_id}}.{{table_name}}`
+      `moz-fx-data-marketing-prod.ga_derived.downloads_with_attribution_v2`
     WHERE
       download_date = @download_date
   ) > 50000
 )
 AS
-  'ETL Data Check Failed: Table {{project_id}}.{{dataset_id}}.{{table_name}} contains less than 50,000 rows for date: {{ download_date }}.'
+  'ETL Data Check Failed: Table moz-fx-data-marketing-prod.ga_derived.downloads_with_attribution_v2 contains less than 50,000 rows for date: .'
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/baseline`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.baseline_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-09-11 21:37:38.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/metrics`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.metrics_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_derived.metrics_clients_daily_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-09-11 21:37:38.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-09-11 21:47:17.000000000 +0000
@@ -1,22 +1,25 @@
----
-# Generated via bigquery_etl.glean_usage
-
 friendly_name: Metrics Clients Daily
 description: |-
   Daily per-client aggregates on top of metrics pings
 owners:
-  - [email protected]
+- [email protected]
+labels:
+  owner1: ascholtz
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: true
+    expiration_days: null
   clustering:
     fields:
       - normalized_channel
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - accounts_backend.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-09-11 21:37:38.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-09-11 21:47:12.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-09-11 21:37:38.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: Historical Pings for `activity-stream/impression-stats`
 description: |-
   A historical view of pings sent for the
@@ -10,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,6 +1,16 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_by_experiment_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,6 +1,16 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_flat_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/on-save-recs`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.on_save_recs_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/pocket-button`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.pocket_button_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/sessions`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.sessions_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/spoc-fills`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.spoc_fills_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - pocket-tiles.pocket_tiles_data.tile_id_types
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,13 +1,13 @@
----
 friendly_name: Impression Stats By Experiment
-description: Representation of tile impression statistics,
- clustered by experiment_id to allow efficient analysis of
- individual experiments
+description: |-
+  Representation of tile impression statistics, clustered by experiment_id to allow efficient analysis of individual experiments
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -15,21 +15,17 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - experiment_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   init.sql:
   - activity_stream_bi.impression_stats_flat_v1
   query.sql:
   - activity_stream_bi.impression_stats_flat_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,11 +1,13 @@
----
 friendly_name: Impression Stats Flat
-description: Unnested representation of tile impression statistics
+description: |-
+  Unnested representation of tile impression statistics
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -13,20 +15,16 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - release_channel
       - sample_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/view.sql	2023-09-11 21:45:35.000000000 +0000
@@ -19,9 +19,8 @@
     sessions_per_user,
     sessions,
     date
-FROM `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
-WHERE (network != "Untrusted Devices")
-  AND
-  date in (
-    SELECT MAX(date) from `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
-    )
+FROM
+  `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`
+WHERE
+  (network != "Untrusted Devices")
+  AND date IN (SELECT MAX(date) FROM `moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1`)
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/view.sql	2023-09-11 21:45:35.000000000 +0000
@@ -24,4 +24,5 @@
     daus,
     waus,
     maus
-FROM `moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1`
+FROM
+  `moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1`
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,18 +1,31 @@
----
 friendly_name: Cohort data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,18 +1,31 @@
----
 friendly_name: Deliverables data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Stats DAU dev/stage
-description: >-
+description: |-
   Reduced stats table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,11 +16,16 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   query.sql:
   - amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Installs dev/stage
-description: >
+description: |
   Reduced daily installs table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,12 +16,17 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   query.sql:
   - amo_dev.amo_stats_dau_v2
   - amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: AMO Stats DAU
 description: |-
   Daily user statistics to power addons.mozilla.org stats pages.
@@ -8,11 +7,13 @@
   and provides all the information needed to populate the various
   "Daily Users" plots for the AMO stats dashboard.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,12 +21,17 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - amo_prod.desktop_addons_by_client_v1
   - amo_prod.fenix_addons_by_client_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,18 +1,14 @@
----
 friendly_name: AMO Stats DAU
-description: >
-  Daily install statistics to power addons.mozilla.org stats pages.
-  See bug 1654330. Note that this table uses a hashed_addon_id
-  defined as `TO_HEX(SHA256(addon_id))` because the underlying event
-  pings have limitations on length of properties attached to events
-  and addon_id values are sometimes too long. The AMO stats application
-  looks up records in this table based on the hashed_addon_id.
+description: |
+  Daily install statistics to power addons.mozilla.org stats pages. See bug 1654330. Note that this table uses a hashed_addon_id defined as `TO_HEX(SHA256(addon_id))` because the underlying event pings have limitations on length of properties attached to events and addon_id values are sometimes too long. The AMO stats application looks up records in this table based on the hashed_addon_id.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,11 +16,16 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - telemetry.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,30 +1,35 @@
----
 friendly_name: Desktop addons by client
-description: >-
-  Clients_daily-like table that records only the dimensions and addon info
-  necessary to power daily the amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table that records only the dimensions and addon info necessary to power daily the amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
-  # provide this value so that DAG generation does not have to dry run the
-  # query to get it, and that would be slow because main_v4 is referenced
-  referenced_tables: [['moz-fx-data-shared-prod', 'telemetry_stable',
-                       'main_v4']]
+  referenced_tables:
+  - - moz-fx-data-shared-prod
+    - telemetry_stable
+    - main_v4
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - telemetry.main
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,15 +1,14 @@
----
 friendly_name: Fenix addons by client
-description: >-
-  Clients_daily-like table on top of the various Firefox for Android channels
-  that records only the dimensions and addon info necessary to power the daily
-  amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table on top of the various Firefox for Android channels that records only the dimensions and addon info necessary to power the daily amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -17,11 +16,15 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - org_mozilla_fenix.metrics
@@ -29,3 +32,4 @@
   - org_mozilla_fennec_aurora.metrics
   - org_mozilla_firefox.metrics
   - org_mozilla_firefox_beta.metrics
+deprecated: false
Only in /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/analysis: bqetl_default_task_v1
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_app_store_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_downloads_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-09-11 21:47:06.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_usage_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -4,16 +4,24 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.app_store_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -4,16 +4,24 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.downloads_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -4,16 +4,24 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.usage_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.ad_group_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.campaign_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.keyword_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.organization_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml	2023-09-11 21:47:02.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.search_term_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml	2023-09-11 21:48:19.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared

⚠️ Only part of the diff is displayed.

dataops-ci-bot · 2023-09-11T22:03:37Z

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

`sql.diff`

Click to expand!

diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-09-11 22:00:49.000000000 +0000
@@ -1,21 +1,26 @@
-description: Aggregated metrics from Adjust data
 friendly_name: Adjust Firefox mobile installs
+description: |-
+  Aggregated metrics from Adjust data
+owners:
+- [email protected]
 labels:
-  incremental: false
   schedule: daily
-owners:
-  - [email protected]
+  owner1: rbaffourawuah
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - ga-mozilla-org-prod-001.Adjust.deliverable_*
   - moz-fx-data-shared-prod.static.country_codes_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/baseline`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.baseline_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-09-11 21:50:55.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/metrics`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.metrics_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_derived.metrics_clients_daily_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-09-11 21:50:55.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-09-11 22:00:46.000000000 +0000
@@ -1,22 +1,25 @@
----
-# Generated via bigquery_etl.glean_usage
-
 friendly_name: Metrics Clients Daily
 description: |-
   Daily per-client aggregates on top of metrics pings
 owners:
-  - [email protected]
+- [email protected]
+labels:
+  owner1: ascholtz
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: true
+    expiration_days: null
   clustering:
     fields:
       - normalized_channel
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - accounts_backend.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-09-11 21:50:55.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-09-11 22:00:42.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-09-11 21:50:55.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: Historical Pings for `activity-stream/impression-stats`
 description: |-
   A historical view of pings sent for the
@@ -10,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,6 +1,16 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_by_experiment_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,6 +1,16 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_flat_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/on-save-recs`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.on_save_recs_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/pocket-button`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.pocket_button_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/sessions`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.sessions_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/spoc-fills`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.spoc_fills_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - pocket-tiles.pocket_tiles_data.tile_id_types
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,13 +1,13 @@
----
 friendly_name: Impression Stats By Experiment
-description: Representation of tile impression statistics,
- clustered by experiment_id to allow efficient analysis of
- individual experiments
+description: |-
+  Representation of tile impression statistics, clustered by experiment_id to allow efficient analysis of individual experiments
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -15,21 +15,17 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - experiment_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   init.sql:
   - activity_stream_bi.impression_stats_flat_v1
   query.sql:
   - activity_stream_bi.impression_stats_flat_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,11 +1,13 @@
----
 friendly_name: Impression Stats Flat
-description: Unnested representation of tile impression statistics
+description: |-
+  Unnested representation of tile impression statistics
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -13,20 +15,16 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - release_channel
       - sample_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,18 +1,31 @@
----
 friendly_name: Cohort data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,18 +1,31 @@
----
 friendly_name: Deliverables data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-09-11 22:00:30.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-09-11 22:00:30.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Stats DAU dev/stage
-description: >-
+description: |-
   Reduced stats table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,11 +16,16 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   query.sql:
   - amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-09-11 22:00:30.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-09-11 22:00:30.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Installs dev/stage
-description: >
+description: |
   Reduced daily installs table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,12 +16,17 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   query.sql:
   - amo_dev.amo_stats_dau_v2
   - amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: AMO Stats DAU
 description: |-
   Daily user statistics to power addons.mozilla.org stats pages.
@@ -8,11 +7,13 @@
   and provides all the information needed to populate the various
   "Daily Users" plots for the AMO stats dashboard.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,12 +21,17 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - amo_prod.desktop_addons_by_client_v1
   - amo_prod.fenix_addons_by_client_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,18 +1,14 @@
----
 friendly_name: AMO Stats DAU
-description: >
-  Daily install statistics to power addons.mozilla.org stats pages.
-  See bug 1654330. Note that this table uses a hashed_addon_id
-  defined as `TO_HEX(SHA256(addon_id))` because the underlying event
-  pings have limitations on length of properties attached to events
-  and addon_id values are sometimes too long. The AMO stats application
-  looks up records in this table based on the hashed_addon_id.
+description: |
+  Daily install statistics to power addons.mozilla.org stats pages. See bug 1654330. Note that this table uses a hashed_addon_id defined as `TO_HEX(SHA256(addon_id))` because the underlying event pings have limitations on length of properties attached to events and addon_id values are sometimes too long. The AMO stats application looks up records in this table based on the hashed_addon_id.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,11 +16,16 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - telemetry.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,30 +1,35 @@
----
 friendly_name: Desktop addons by client
-description: >-
-  Clients_daily-like table that records only the dimensions and addon info
-  necessary to power daily the amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table that records only the dimensions and addon info necessary to power daily the amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
-  # provide this value so that DAG generation does not have to dry run the
-  # query to get it, and that would be slow because main_v4 is referenced
-  referenced_tables: [['moz-fx-data-shared-prod', 'telemetry_stable',
-                       'main_v4']]
+  referenced_tables:
+  - - moz-fx-data-shared-prod
+    - telemetry_stable
+    - main_v4
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - telemetry.main
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-09-11 22:00:37.000000000 +0000
@@ -1,15 +1,14 @@
----
 friendly_name: Fenix addons by client
-description: >-
-  Clients_daily-like table on top of the various Firefox for Android channels
-  that records only the dimensions and addon info necessary to power the daily
-  amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table on top of the various Firefox for Android channels that records only the dimensions and addon info necessary to power the daily amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -17,11 +16,15 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - org_mozilla_fenix.metrics
@@ -29,3 +32,4 @@
   - org_mozilla_fennec_aurora.metrics
   - org_mozilla_firefox.metrics
   - org_mozilla_firefox_beta.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/analysis/bqetl_default_task_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/analysis/bqetl_default_task_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/analysis/bqetl_default_task_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/analysis/bqetl_default_task_v1/metadata.yaml	2023-09-11 22:00:30.000000000 +0000
@@ -6,6 +6,15 @@
   has at least one task, otherwise the DAG would be invalid.
 owners:
 - [email protected]
+labels:
+  dag: bqetl_default
+  owner1: telemetry-alerts
 scheduling:
   dag_name: bqetl_default
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_app_store_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_downloads_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_usage_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -4,16 +4,24 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.app_store_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -4,16 +4,24 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.downloads_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -4,16 +4,24 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.usage_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/ad_group_report/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.ad_group_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/campaign_report/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.campaign_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/keyword_report/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.keyword_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/organization_report/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.organization_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads/search_term_report/metadata.yaml	2023-09-11 22:00:40.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.apple_ads_external.search_term_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ad_group_report_v1/metadata.yaml	2023-09-11 22:00:30.000000000 +0000
@@ -4,13 +4,18 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__ad_group_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml	2023-09-11 22:02:17.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/campaign_report_v1/metadata.yaml	2023-09-11 22:00:30.000000000 +0000
@@ -4,13 +4,18 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
+  dag: bqetl_fivetran_apple_ads
+  owner1: kik
 scheduling:
   dag_name: bqetl_fivetran_apple_ads
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.dbt_fivetran_transformation_apple_search_ads.apple_search_ads__campaign_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/keyword_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/apple_ads_external/ke

diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/dataset_metadata.yaml	2023-09-12 18:36:28.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-marketing-prod/adjust_derived/firefox_mobile_installs_v1/metadata.yaml	2023-09-12 18:36:28.000000000 +0000
@@ -1,21 +1,26 @@
-description: Aggregated metrics from Adjust data
 friendly_name: Adjust Firefox mobile installs
+description: |-
+  Aggregated metrics from Adjust data
+owners:
+- [email protected]
 labels:
-  incremental: false
   schedule: daily
-owners:
-  - [email protected]
+  owner1: rbaffourawuah
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - country
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - ga-mozilla-org-prod-001.Adjust.deliverable_*
   - moz-fx-data-shared-prod.static.country_codes_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/accounts_events/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/baseline/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/baseline`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.baseline_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/dataset_metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/deletion_request/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/events_unnested/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-backend/metrics`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_stable.metrics_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend/metrics_clients_daily/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_backend_derived.metrics_clients_daily_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/dataset_metadata.yaml	2023-09-12 18:36:23.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_backend_derived/metrics_clients_daily_v1/metadata.yaml	2023-09-12 18:36:23.000000000 +0000
@@ -1,22 +1,25 @@
----
-# Generated via bigquery_etl.glean_usage
-
 friendly_name: Metrics Clients Daily
 description: |-
   Daily per-client aggregates on top of metrics pings
 owners:
-  - [email protected]
+- [email protected]
+labels:
+  owner1: ascholtz
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: true
+    expiration_days: null
   clustering:
     fields:
       - normalized_channel
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - accounts_backend.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/accounts_events/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/accounts-events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.accounts_events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/dataset_metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/deletion_request/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/deletion-request`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.deletion_request_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `accounts-frontend/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,14 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend/events_unnested/metadata.yaml	2023-09-12 18:36:18.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.accounts_frontend.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/accounts_frontend_derived/dataset_metadata.yaml	2023-09-12 18:26:03.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/dataset_metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,10 +1,14 @@
 friendly_name: Activity Stream
-# yamllint disable rule:line-length
 description: |-
   User-facing views related to document namespace activity-stream; see https://github.com/mozilla-services/mozilla-pipeline-schemas/tree/generated-schemas/schemas/activity-stream
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/events/metadata.yaml	2023-09-12 18:36:04.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/events`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.events_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats/metadata.yaml	2023-09-12 18:36:04.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: Historical Pings for `activity-stream/impression-stats`
 description: |-
   A historical view of pings sent for the
@@ -10,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_by_experiment/metadata.yaml	2023-09-12 18:36:04.000000000 +0000
@@ -1,6 +1,16 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_by_experiment_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/impression_stats_flat/metadata.yaml	2023-09-12 18:36:04.000000000 +0000
@@ -1,6 +1,16 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_bi.impression_stats_flat_v1
   - moz-fx-data-shared-prod.pocket.spoc_tile_ids
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/on_save_recs/metadata.yaml	2023-09-12 18:36:04.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/on-save-recs`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.on_save_recs_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/pocket_button/metadata.yaml	2023-09-12 18:36:04.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/pocket-button`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.pocket_button_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/sessions/metadata.yaml	2023-09-12 18:36:04.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/sessions`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.sessions_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/spoc_fills/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,5 +1,3 @@
-# Generated via ./bqetl generate stable_views
----
 friendly_name: Historical Pings for `activity-stream/spoc-fills`
 description: |-
   A historical view of pings sent for the
@@ -11,8 +9,15 @@
   and to contain only one row per distinct `document_id` within a given date.
 
   Clustering fields: `normalized_channel`, `sample_id`
-
-# Generated by bigquery_etl.dependency
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - moz-fx-data-shared-prod.activity_stream_stable.spoc_fills_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream/tile_id_types/metadata.yaml	2023-09-12 18:36:04.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/prefect
 references:
   view.sql:
   - pocket-tiles.pocket_tiles_data.tile_id_types
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/dataset_metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -5,6 +5,12 @@
 dataset_base_acl: stable
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:pocket/external
+  - workgroup:pocket/prefect
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_by_experiment_v1/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -1,13 +1,13 @@
----
 friendly_name: Impression Stats By Experiment
-description: Representation of tile impression statistics,
- clustered by experiment_id to allow efficient analysis of
- individual experiments
+description: |-
+  Representation of tile impression statistics, clustered by experiment_id to allow efficient analysis of individual experiments
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -15,21 +15,17 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - experiment_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   init.sql:
   - activity_stream_bi.impression_stats_flat_v1
   query.sql:
   - activity_stream_bi.impression_stats_flat_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/activity_stream_bi/impression_stats_flat_v1/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -1,11 +1,13 @@
----
 friendly_name: Impression Stats Flat
-description: Unnested representation of tile impression statistics
+description: |-
+  Unnested representation of tile impression statistics
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: activity_stream
   schedule: daily
+  dag: bqetl_activity_stream
+  owner1: anicholson
 scheduling:
   dag_name: bqetl_activity_stream
 bigquery:
@@ -13,20 +15,16 @@
     type: day
     field: submission_timestamp
     require_partition_filter: true
-    expiration_days: 180
+    expiration_days: 180.0
   clustering:
     fields:
       - release_channel
       - sample_id
 workgroup_access:
-  - role: roles/bigquery.dataViewer
+- role: roles/bigquery.dataViewer
     members:
-      # to avoid permissions desync mozilla-confidential access is only granted
-      # at the dataset-level for now
-      # - workgroup:mozilla-confidential
       - workgroup:pocket/external
-
-# Generated by bigquery_etl.dependency
 references:
   query.sql:
   - activity_stream_stable.impression_stats_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_cohort/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_cohort_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/adjust_kpi_deliverables/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.adjust_derived.adjust_deliverables_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust/dataset_metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_cohort_v1/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,18 +1,31 @@
----
 friendly_name: Cohort data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust using the https://api.adjust.com/kpis/v1/{app token}/cohorts link. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/adjust_deliverables_v1/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,18 +1,31 @@
----
 friendly_name: Deliverables data from external source Adjust
-description: >
-  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}.
-  Please note that the API token used is Marlene Hirose's personal Adjust API token
+description: |
+  This table represents data downloaded from Adjust link using https://api.adjust.com/kpis/v1/{app token}. Please note that the API token used is Marlene Hirose's personal Adjust API token
 owners:
-  - [email protected]
+- [email protected]
 labels:
-  incremental: false
+  dag: bqetl_adjust
+  owner1: mhirose
 scheduling:
   dag_name: bqetl_adjust
   date_partition_parameter: date
-  arguments: ["--date", "{{ ds }}", "--adjust_api_token", "{{ var.value.ADJUST_API_TOKEN}}", "--adjust_app_list", "{{ var.value.ADJUST_APP_TOKEN_LIST}}"]
+  arguments:
+  - --date
+  - '{{ ds }}'
+  - --adjust_api_token
+  - '{{ var.value.ADJUST_API_TOKEN}}'
+  - --adjust_app_list
+  - '{{ var.value.ADJUST_APP_TOKEN_LIST}}'
 bigquery:
   time_partitioning:
     type: day
     field: date
     require_partition_filter: false
+    expiration_days: null
+  clustering: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/adjust_derived/dataset_metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau/metadata.yaml	2023-09-12 18:35:59.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_dau_v2/metadata.yaml	2023-09-12 18:35:59.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Stats DAU dev/stage
-description: >-
+description: |-
   Reduced stats table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,11 +16,16 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   query.sql:
   - amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs/metadata.yaml	2023-09-12 18:35:59.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_dev.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/amo_stats_installs_v3/metadata.yaml	2023-09-12 18:35:59.000000000 +0000
@@ -1,13 +1,14 @@
----
 friendly_name: AMO Installs dev/stage
-description: >
+description: |
   Reduced daily installs table for dev and stage versions of the AMO service.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -15,12 +16,17 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 references:
   query.sql:
   - amo_dev.amo_stats_dau_v2
   - amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_dev/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_dev/dataset_metadata.yaml	2023-09-12 18:35:59.000000000 +0000
@@ -4,6 +4,11 @@
 dataset_base_acl: stable
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/nonprod
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_dau_v2
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_dau_v2/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,4 +1,3 @@
----
 friendly_name: AMO Stats DAU
 description: |-
   Daily user statistics to power addons.mozilla.org stats pages.
@@ -8,11 +7,13 @@
   and provides all the information needed to populate the various
   "Daily Users" plots for the AMO stats dashboard.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,12 +21,17 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - amo_prod.desktop_addons_by_client_v1
   - amo_prod.fenix_addons_by_client_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,5 +1,15 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   view.sql:
   - moz-fx-data-shared-prod.amo_prod.amo_stats_installs_v3
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/amo_stats_installs_v3/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,18 +1,14 @@
----
 friendly_name: AMO Stats DAU
-description: >
-  Daily install statistics to power addons.mozilla.org stats pages.
-  See bug 1654330. Note that this table uses a hashed_addon_id
-  defined as `TO_HEX(SHA256(addon_id))` because the underlying event
-  pings have limitations on length of properties attached to events
-  and addon_id values are sometimes too long. The AMO stats application
-  looks up records in this table based on the hashed_addon_id.
+description: |
+  Daily install statistics to power addons.mozilla.org stats pages. See bug 1654330. Note that this table uses a hashed_addon_id defined as `TO_HEX(SHA256(addon_id))` because the underlying event pings have limitations on length of properties attached to events and addon_id values are sometimes too long. The AMO stats application looks up records in this table based on the hashed_addon_id.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -20,11 +16,16 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - hashed_addon_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - telemetry.events
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/dataset_metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -4,6 +4,11 @@
 dataset_base_acl: stable
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/desktop_addons_by_client_v1/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,30 +1,35 @@
----
 friendly_name: Desktop addons by client
-description: >-
-  Clients_daily-like table that records only the dimensions and addon info
-  necessary to power daily the amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table that records only the dimensions and addon info necessary to power daily the amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
-  # provide this value so that DAG generation does not have to dry run the
-  # query to get it, and that would be slow because main_v4 is referenced
-  referenced_tables: [['moz-fx-data-shared-prod', 'telemetry_stable',
-                       'main_v4']]
+  referenced_tables:
+  - - moz-fx-data-shared-prod
+    - telemetry_stable
+    - main_v4
 bigquery:
   time_partitioning:
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - telemetry.main
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/amo_prod/fenix_addons_by_client_v1/metadata.yaml	2023-09-12 18:36:05.000000000 +0000
@@ -1,15 +1,14 @@
----
 friendly_name: Fenix addons by client
-description: >-
-  Clients_daily-like table on top of the various Firefox for Android channels
-  that records only the dimensions and addon info necessary to power the daily
-  amo_stats_dau_v2 query.
+description: |-
+  Clients_daily-like table on top of the various Firefox for Android channels that records only the dimensions and addon info necessary to power the daily amo_stats_dau_v2 query.
 owners:
-  - [email protected]
+- [email protected]
 labels:
   application: amo
   incremental: true
   schedule: daily
+  dag: bqetl_amo_stats
+  owner1: kik
 scheduling:
   dag_name: bqetl_amo_stats
 bigquery:
@@ -17,11 +16,15 @@
     type: day
     field: submission_date
     require_partition_filter: false
+    expiration_days: null
   clustering:
     fields:
       - sample_id
-
-# Generated by bigquery_etl.dependency
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+  - workgroup:amo/prod
 references:
   query.sql:
   - org_mozilla_fenix.metrics
@@ -29,3 +32,4 @@
   - org_mozilla_fennec_aurora.metrics
   - org_mozilla_firefox.metrics
   - org_mozilla_firefox_beta.metrics
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/analysis/bqetl_default_task_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/analysis/bqetl_default_task_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/analysis/bqetl_default_task_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/analysis/bqetl_default_task_v1/metadata.yaml	2023-09-12 18:35:59.000000000 +0000
@@ -6,6 +6,15 @@
   has at least one task, otherwise the DAG would be invalid.
 owners:
 - [email protected]
+labels:
+  dag: bqetl_default
+  owner1: telemetry-alerts
 scheduling:
   dag_name: bqetl_default
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references: {}
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/analysis/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/analysis/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/analysis/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/analysis/dataset_metadata.yaml	2023-09-12 18:35:59.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/dataset_metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: view
 user_facing: true
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_app_store_territory_source_type_report/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_app_store_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_downloads_territory_source_type_report/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_downloads_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store/firefox_usage_territory_source_type_report/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -1,5 +1,14 @@
-
-# Generated by bigquery_etl.dependency
+friendly_name: null
+description: |-
+  None
+owners: []
+labels: {}
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   view.sql:
   - moz-fx-data-shared-prod.app_store_external.firefox_usage_territory_source_type_report_v1
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/dataset_metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/dataset_metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/dataset_metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/dataset_metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -4,6 +4,10 @@
 dataset_base_acl: derived
 user_facing: false
 labels: {}
+default_table_workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 workgroup_access:
 - role: roles/bigquery.dataViewer
   members:
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_app_store_territory_source_type_report_v1/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -4,16 +4,24 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.app_store_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-09-12 18:38:22.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_downloads_territory_source_type_report_v1/metadata.yaml	2023-09-12 18:36:10.000000000 +0000
@@ -4,16 +4,24 @@
 owners:
 - [email protected]
 labels:
-  incremental: false
-bigquery:
-  clustering:
-    fields: ['app_id', 'date', 'territory']
+  dag: bqetl_fivetran_copied_tables
+  owner1: frank
 scheduling:
   dag_name: bqetl_fivetran_copied_tables
   date_partition_parameter: null
   depends_on_past: false
-
-# Generated by bigquery_etl.dependency
+bigquery:
+  time_partitioning: null
+  clustering:
+    fields:
+    - app_id
+    - date
+    - territory
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
 references:
   query.sql:
   - moz-fx-data-bq-fivetran.firefox_app_store.downloads_territory_source_type_report
+deprecated: false
diff -bur --no-dereference /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/app_store_external/firefox_usage_territory_source_type_report_v1/metadata.yaml
--- /tmp/work

⚠️ Only part of the diff is displayed.

whd · 2023-09-12T19:13:28Z

https://github.com/mozilla/private-bigquery-etl/commit/dbc0d01b41c947833718e926ba2f1ce8ab58af31 has the generated diff from this change. From my cursory scan it looks correct with some miscellaneous formatting changes but does have some interesting effects:

Some comments from other generation logic e.g. # Generated by bigquery_etl.dependency, # Generated via ./bqetl generate stable_views are lost due to the final stage metadata enrichment.
Some fields e.g. friendly_name get explicitly set to null when unset. This shouldn't have any downstream effects but I'm not sure.

@scholtzan do you think it's worth trying to preserve comments in generated metadata?

scholtzan · 2023-09-13T14:51:10Z

There shouldn't be downstream effects from this.

Afaik we can't preserve comments. Once we parse the metadata files and enrich them with additional information the comments are lost. I think we'd need to use a different library for working with yaml files, ruamel should be preserving comments, for example. But making those changes would be more significant, and I don't think we consume comments from metadata files anywhere.

alekhyamoz added 2 commits August 18, 2023 15:57

Support bq dataset deprecation process (metadata)

9c0e14d

Add bqetl metadata cli command

c03c279

alekhyamoz force-pushed the DENG1381-support_deprecation branch 8 times, most recently from 7f3093e to 9cb8958 Compare August 28, 2023 21:46

Initial draft for adding deprecation support to bqetl

dd80ffb

alekhyamoz force-pushed the DENG1381-support_deprecation branch from 1e36fce to dd80ffb Compare August 29, 2023 01:33

alekhyamoz requested review from scholtzan and whd August 29, 2023 12:53

scholtzan reviewed Aug 29, 2023

View reviewed changes

alekhyamoz force-pushed the DENG1381-support_deprecation branch 3 times, most recently from 3900d3c to 5f82349 Compare August 29, 2023 18:43

Incorporate Anna's feedback

14c44c1

alekhyamoz force-pushed the DENG1381-support_deprecation branch from 47b944b to 14c44c1 Compare August 29, 2023 18:54

alekhyamoz force-pushed the DENG1381-support_deprecation branch 2 times, most recently from 7a87a6e to faf30c8 Compare September 1, 2023 19:58

Fix based on whd's feedback

08985b5

alekhyamoz force-pushed the DENG1381-support_deprecation branch 2 times, most recently from 3d918a3 to 45a54a7 Compare September 1, 2023 21:18

mozilla deleted a comment from dataops-ci-bot Sep 1, 2023

Add dataset metadata yaml for ga_derived

a0bcedb

alekhyamoz force-pushed the DENG1381-support_deprecation branch from e0294bb to a0bcedb Compare September 7, 2023 16:34

Ignore dirs that do not have dataset_metadata yaml

798ebf1

alekhyamoz force-pushed the DENG1381-support_deprecation branch from 32df3a0 to 798ebf1 Compare September 7, 2023 17:46

whd approved these changes Sep 11, 2023

View reviewed changes

whd reviewed Sep 11, 2023

View reviewed changes

Remove unwanted dataset metadata yamls

f05e634

alekhyamoz force-pushed the DENG1381-support_deprecation branch from bd3a9ae to f05e634 Compare September 11, 2023 21:35

Merge branch 'main' into DENG1381-support_deprecation

d2bfbc5

alekhyamoz and others added 2 commits September 11, 2023 20:22

Update bigquery_etl/cli/metadata.py

0615c1c

Co-authored-by: whd <[email protected]>

Merge branch 'main' into DENG1381-support_deprecation

6d5fd35

Merge branch 'main' into DENG1381-support_deprecation

d1430d8

whd merged commit 2e916eb into main Sep 12, 2023

whd deleted the DENG1381-support_deprecation branch September 12, 2023 18:47

sean-rose mentioned this pull request Sep 20, 2023

Consistently call bqetl metadata update when generating SQL in CI #4332

Merged

5 tasks

whd mentioned this pull request Sep 27, 2023

Create dataset for Greenhouse derived tables #4355

Closed

5 tasks

Iinh mentioned this pull request Nov 3, 2023

Make sure that metadata friendly_name and description are not None #4513

Merged

5 tasks

ANich mentioned this pull request Dec 15, 2023

Add "deprecated" boolean to metadata.yaml #1827

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

DENG1381 - Add bqetl support for deprecation metadata #4213

DENG1381 - Add bqetl support for deprecation metadata #4213

alekhyamoz commented Aug 28, 2023 •

edited by data-sync-user

Loading

dataops-ci-bot commented Aug 29, 2023

dataops-ci-bot commented Aug 29, 2023

dataops-ci-bot commented Aug 29, 2023

dataops-ci-bot commented Sep 7, 2023

dataops-ci-bot commented Sep 7, 2023

dataops-ci-bot commented Sep 7, 2023

dataops-ci-bot commented Sep 7, 2023

alekhyamoz commented Sep 7, 2023

whd left a comment

whd Sep 11, 2023

whd Sep 11, 2023

dataops-ci-bot commented Sep 11, 2023

dataops-ci-bot commented Sep 11, 2023

dataops-ci-bot commented Sep 12, 2023

dataops-ci-bot commented Sep 12, 2023

dataops-ci-bot commented Sep 12, 2023

whd commented Sep 12, 2023

scholtzan commented Sep 13, 2023

DENG1381 - Add bqetl support for deprecation metadata #4213

DENG1381 - Add bqetl support for deprecation metadata #4213

Conversation

alekhyamoz commented Aug 28, 2023 • edited by data-sync-user Loading

dataops-ci-bot commented Aug 29, 2023

Integration report for "Initial draft for adding deprecation support to bqetl"

sql.diff

dataops-ci-bot commented Aug 29, 2023

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

sql.diff

dataops-ci-bot commented Aug 29, 2023

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

sql.diff

dataops-ci-bot commented Sep 7, 2023

Integration report for "Ignore dirs that do not have dataset_metadata yaml"

sql.diff

dataops-ci-bot commented Sep 7, 2023

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

sql.diff

dataops-ci-bot commented Sep 7, 2023

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

sql.diff

dataops-ci-bot commented Sep 7, 2023

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

sql.diff

alekhyamoz commented Sep 7, 2023

whd left a comment

Choose a reason for hiding this comment

whd Sep 11, 2023

Choose a reason for hiding this comment

whd Sep 11, 2023

Choose a reason for hiding this comment

dataops-ci-bot commented Sep 11, 2023

Integration report for "Remove unwanted dataset metadata yamls"

sql.diff

dataops-ci-bot commented Sep 11, 2023

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

sql.diff

dataops-ci-bot commented Sep 12, 2023

Integration report for "Update bigquery_etl/cli/metadata.py"

sql.diff

dataops-ci-bot commented Sep 12, 2023

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

sql.diff

dataops-ci-bot commented Sep 12, 2023

Integration report for "Merge branch 'main' into DENG1381-support_deprecation"

sql.diff

whd commented Sep 12, 2023

scholtzan commented Sep 13, 2023

alekhyamoz commented Aug 28, 2023 •

edited by data-sync-user

Loading

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`

`sql.diff`