cdc: add checkpoint progress metrics per changefeed #132281
Assignees
Labels
A-cdc
Change Data Capture
branch-release-23.2
Used to mark GA and release blockers, technical advisories, and bugs for 23.2
branch-release-24.1
Used to mark GA and release blockers, technical advisories, and bugs for 24.1
branch-release-24.2
Used to mark GA and release blockers, technical advisories, and bugs for 24.2
branch-release-24.3
Used to mark GA and release blockers, technical advisories, and bugs for 24.3
C-enhancement
Solution expected to add code/behavior + preserve backward-compat (pg compat issues are exception)
E-quick-win
Likely to be a quick win for someone experienced.
T-cdc
Comments
rharding6373
added
C-enhancement
![blathers[crl]](https://avatars.githubusercontent.com/in/59700?s=40&u=373d9101a12edc3847d2fb6ae78e3adcfb4ca41e&v=4){kind=avatar}
|
cc @cockroachdb/cdc |
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 17, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 18, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 18, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Dec 19, 2024
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
craig bot
pushed a commit
that referenced
this issue
Dec 19, 2024
137534: changefeedccl: add scoping support for max_behind_nanos r=andyyang890,asg0451 a=aerfrei Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Epic: none Fixes: #132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels. Co-authored-by: Aerin Freilich <[email protected]>
|
Based on the specified backports for linked PR #137534, I applied the following new label(s) to this issue: branch-release-23.2, branch-release-24.1, branch-release-24.2, branch-release-24.3. Please adjust the labels as needed to match the branches actually affected by this issue, including adding any known older branches. 🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf. |
blathers-crl
bot
added
branch-release-24.1
blathers-crl bot
pushed a commit
that referenced
this issue
Jan 16, 2025
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Fixes: #132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
blathers-crl bot
pushed a commit
that referenced
this issue
Jan 16, 2025
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Fixes: #132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Jan 16, 2025
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Jan 17, 2025
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
aerfrei
added a commit
to aerfrei/cockroach
that referenced
this issue
Jan 17, 2025
Currently, changefeed.max_behind_nanos is a measurement of the lag of the furthest behind changefeed. We'd like to be able to support scoping/grouping changefeeds. This applies scoping to that metric similar to the scoping on changefeed.aggregator_progress. Fixes: cockroachdb#132281 Release note (ops change): the changefeed.max_behind_nanos metric now supports scoping with metric labels.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
The
changefeed.max_behind_nanosmetric currently only reflects the lag of the furthest behind changefeed. However, there are times when it's useful to differentiate changefeed's progress. For example, if a cluster has multiple lagging changefeeds or a customer wants to check if a specific changefeed is lagging via a scoped metric label. We should make a scoped version of this metric.Jira issue: CRDB-42917
Epic CRDB-42868
The text was updated successfully, but these errors were encountered: