Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[admin-tool] Add stores set filter to cluster-batch-task #1543

Merged
merged 2 commits into from
Feb 19, 2025

Conversation

xunyin8
Copy link
Contributor

@xunyin8 xunyin8 commented Feb 18, 2025

[admin-tool] Add stores set filter to cluster-batch-task

Add new optional parameter STORE_FILTER_FILE to CLUSTER_BATCH_TASK to perform cluster batch task only on the intersection of provided stores and stores in the cluster. This is useful when you have a list of problematic stores that you'd like to perform some repair on, e.g. re-push system store but instead of doing it to all stores in a cluster you can just run CLUSTER_BATCH_TASK with this store list for all clusters and it will only do what's necessary.

If needed in the future we can also add other set operations like complement. Which will do some operation on the stores in the cluster excluding stores in the provided filter file.

How was this PR tested?

verified in test environment.

Does this PR introduce any user-facing changes?

  • No. You can skip the rest of this section.
  • Yes. Make sure to explain your proposed changes and call out the behavior change.

Add new optional parameter STORE_FILTER_FILE to CLUSTER_BATCH_TASK to perform
cluster batch task only on the intersection of provided stores and stores in
the cluster. This is useful when you have a list of problematic stores that
you'd like to perform some repair on, e.g. re-push system store but instead
of doing it to all stores in a cluster you can just run CLUSTER_BATCH_TASK
with this store list for all clusters and it will only do what's necessary.

If needed in the future we can also add other set operations like complement.
Which will do some operation on the stores in the cluster excluding stores in
the provided filter file.
@xunyin8 xunyin8 changed the title [admin-tool] Add store list filter to cluster-batch-task [admin-tool] Add stores set filter to cluster-batch-task Feb 18, 2025
@xunyin8 xunyin8 requested a review from majisourav99 February 19, 2025 05:11
Copy link
Contributor

@lluwm lluwm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@xunyin8 xunyin8 merged commit fc8a642 into linkedin:main Feb 19, 2025
58 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants