Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

configure tiering on CS via ttl #12095

Merged
merged 9 commits into from
Dec 4, 2024
Merged

Conversation

swalrus1
Copy link
Collaborator

  • configure sequence of tiers on CS via TTL instead of TIERING_RULE
  • remove TIERING_RULE and table property "tiering"

Copy link

github-actions bot commented Nov 28, 2024

2024-11-28 12:12:09 UTC Pre-commit check linux-x86_64-relwithdebinfo for baacc5a has started.
2024-11-28 12:12:44 UTC Artifacts will be uploaded here
2024-11-28 12:16:49 UTC ya make is running...
🔴 2024-11-28 12:29:35 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Nov 28, 2024

2024-11-28 12:14:23 UTC Pre-commit check linux-x86_64-release-asan for baacc5a has started.
2024-11-28 12:14:35 UTC Artifacts will be uploaded here
2024-11-28 12:18:10 UTC ya make is running...
🔴 2024-11-28 12:40:29 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Nov 28, 2024

2024-11-28 12:55:55 UTC Pre-commit check linux-x86_64-relwithdebinfo for f6bcbd2 has started.
2024-11-28 12:56:06 UTC Artifacts will be uploaded here
2024-11-28 12:59:29 UTC ya make is running...
🔴 2024-11-28 13:23:56 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Nov 28, 2024

2024-11-28 12:56:26 UTC Pre-commit check linux-x86_64-release-asan for f6bcbd2 has started.
2024-11-28 12:56:38 UTC Artifacts will be uploaded here
2024-11-28 12:59:58 UTC ya make is running...
🔴 2024-11-28 13:15:27 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Nov 28, 2024

2024-11-28 15:22:14 UTC Pre-commit check linux-x86_64-relwithdebinfo for 50b8c5f has started.
2024-11-28 15:22:25 UTC Artifacts will be uploaded here
2024-11-28 15:25:45 UTC ya make is running...
🟡 2024-11-28 16:45:58 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
33207 30367 0 9 2719 112

2024-11-28 16:48:50 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-11-28 17:00:28 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
816 (only retried tests) 698 0 9 0 109

2024-11-28 17:00:41 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-11-28 17:12:27 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
753 (only retried tests) 636 0 9 0 108

🟢 2024-11-28 17:12:36 UTC Build successful.
🟢 2024-11-28 17:12:58 UTC ydbd size 2.5 GiB changed* by -2.8 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 2f89980 merge: 50b8c5f diff diff %
ydbd size 2 686 661 376 Bytes 2 683 703 832 Bytes -2.8 MiB -0.110%
ydbd stripped size 482 255 888 Bytes 482 072 368 Bytes -179.2 KiB -0.038%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 28, 2024

2024-11-28 15:22:22 UTC Pre-commit check linux-x86_64-release-asan for 50b8c5f has started.
2024-11-28 15:22:38 UTC Artifacts will be uploaded here
2024-11-28 15:26:02 UTC ya make is running...
🟡 2024-11-28 16:56:53 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15768 15689 0 23 7 49

🟢 2024-11-28 16:58:10 UTC Build successful.
🟢 2024-11-28 16:58:40 UTC ydbd size 4.9 GiB changed* by -5.6 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 2f89980 merge: 50b8c5f diff diff %
ydbd size 5 281 015 488 Bytes 5 275 164 344 Bytes -5.6 MiB -0.111%
ydbd stripped size 1 361 303 664 Bytes 1 360 712 464 Bytes -577.3 KiB -0.043%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 29, 2024

2024-11-29 09:53:09 UTC Pre-commit check linux-x86_64-relwithdebinfo for 08c4eaa has started.
2024-11-29 09:53:21 UTC Artifacts will be uploaded here
2024-11-29 09:56:47 UTC ya make is running...
🔴 2024-11-29 10:23:33 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Nov 29, 2024

2024-11-29 09:55:01 UTC Pre-commit check linux-x86_64-release-asan for 08c4eaa has started.
2024-11-29 09:55:12 UTC Artifacts will be uploaded here
2024-11-29 09:58:32 UTC ya make is running...
🔴 2024-11-29 10:30:56 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Nov 29, 2024

2024-11-29 11:09:33 UTC Pre-commit check linux-x86_64-release-asan for 271e9ca has started.
2024-11-29 11:09:44 UTC Artifacts will be uploaded here
2024-11-29 11:13:23 UTC ya make is running...
🟡 2024-11-29 13:02:09 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15774 15684 0 26 11 53

🟢 2024-11-29 13:03:27 UTC Build successful.
🟢 2024-11-29 13:03:57 UTC ydbd size 4.9 GiB changed* by -5.6 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 38aef7d merge: 271e9ca diff diff %
ydbd size 5 281 729 264 Bytes 5 275 877 128 Bytes -5.6 MiB -0.111%
ydbd stripped size 1 361 445 552 Bytes 1 360 853 776 Bytes -577.9 KiB -0.043%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 29, 2024

2024-11-29 11:09:47 UTC Pre-commit check linux-x86_64-relwithdebinfo for 271e9ca has started.
2024-11-29 11:09:59 UTC Artifacts will be uploaded here
2024-11-29 11:13:37 UTC ya make is running...
🟡 2024-11-29 12:50:51 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
33213 30377 0 6 2718 112

2024-11-29 12:53:36 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-11-29 13:05:07 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
707 (only retried tests) 595 0 5 0 107

2024-11-29 13:05:18 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-11-29 13:16:38 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
658 (only retried tests) 548 0 4 0 106

🟢 2024-11-29 13:16:51 UTC Build successful.
🟢 2024-11-29 13:17:15 UTC ydbd size 2.5 GiB changed* by -2.8 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 38aef7d merge: 271e9ca diff diff %
ydbd size 2 687 159 720 Bytes 2 684 205 440 Bytes -2.8 MiB -0.110%
ydbd stripped size 482 300 752 Bytes 482 120 912 Bytes -175.6 KiB -0.037%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 29, 2024

2024-11-29 16:44:13 UTC Pre-commit check linux-x86_64-relwithdebinfo for c19918c has started.
2024-11-29 16:44:24 UTC Artifacts will be uploaded here
2024-11-29 16:47:45 UTC ya make is running...
🟡 2024-11-29 17:52:49 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
33216 30379 0 4 2719 114

2024-11-29 17:55:32 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-11-29 18:06:55 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
794 (only retried tests) 686 0 2 0 106

2024-11-29 18:07:07 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-11-29 18:18:52 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
634 (only retried tests) 526 0 2 0 106

🟢 2024-11-29 18:19:01 UTC Build successful.
🟢 2024-11-29 18:19:23 UTC ydbd size 2.5 GiB changed* by -2.8 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 1b51ba9 merge: c19918c diff diff %
ydbd size 2 687 209 616 Bytes 2 684 299 648 Bytes -2.8 MiB -0.108%
ydbd stripped size 482 315 024 Bytes 482 134 416 Bytes -176.4 KiB -0.037%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 29, 2024

2024-11-29 16:44:14 UTC Pre-commit check linux-x86_64-release-asan for c19918c has started.
2024-11-29 16:44:26 UTC Artifacts will be uploaded here
2024-11-29 16:47:45 UTC ya make is running...
🟡 2024-11-29 17:59:23 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15777 15708 0 16 5 48

🟢 2024-11-29 18:00:39 UTC Build successful.
🟢 2024-11-29 18:01:09 UTC ydbd size 4.9 GiB changed* by -5.5 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 1b51ba9 merge: c19918c diff diff %
ydbd size 5 281 843 344 Bytes 5 276 082 576 Bytes -5.5 MiB -0.109%
ydbd stripped size 1 361 475 568 Bytes 1 360 900 112 Bytes -562.0 KiB -0.042%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 30, 2024

2024-11-30 17:24:00 UTC Pre-commit check linux-x86_64-relwithdebinfo for 2631d0d has started.
2024-11-30 17:24:12 UTC Artifacts will be uploaded here
2024-11-30 17:27:32 UTC ya make is running...
🟡 2024-11-30 18:53:49 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
33217 30382 0 1 2720 114

2024-11-30 18:56:30 UTC ya make is running... (failed tests rerun, try 2)
🟡 2024-11-30 19:08:21 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
771 (only retried tests) 661 0 1 0 109

2024-11-30 19:08:32 UTC ya make is running... (failed tests rerun, try 3)
🔴 2024-11-30 19:19:50 UTC Some tests failed, follow the links below.

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
686 (only retried tests) 577 0 1 0 108

🟢 2024-11-30 19:19:59 UTC Build successful.
🟢 2024-11-30 19:20:19 UTC ydbd size 2.5 GiB changed* by -2.8 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: d7f99d9 merge: 2631d0d diff diff %
ydbd size 2 689 984 872 Bytes 2 687 074 832 Bytes -2.8 MiB -0.108%
ydbd stripped size 482 801 776 Bytes 482 621 104 Bytes -176.4 KiB -0.037%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 30, 2024

2024-11-30 17:24:13 UTC Pre-commit check linux-x86_64-release-asan for 2631d0d has started.
2024-11-30 17:24:24 UTC Artifacts will be uploaded here
2024-11-30 17:27:45 UTC ya make is running...
🟡 2024-11-30 18:58:05 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15778 15706 0 18 7 47

🟢 2024-11-30 18:59:21 UTC Build successful.
🟢 2024-11-30 18:59:50 UTC ydbd size 4.9 GiB changed* by -5.5 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: d7f99d9 merge: 2631d0d diff diff %
ydbd size 5 287 623 784 Bytes 5 281 858 992 Bytes -5.5 MiB -0.109%
ydbd stripped size 1 363 139 440 Bytes 1 362 559 952 Bytes -565.9 KiB -0.043%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 30, 2024

2024-11-30 19:26:57 UTC Pre-commit check linux-x86_64-relwithdebinfo for 9013a6e has started.
2024-11-30 19:27:09 UTC Artifacts will be uploaded here
2024-11-30 19:30:40 UTC ya make is running...
🟡 2024-11-30 21:06:14 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
33217 30384 0 1 2719 113

2024-11-30 21:08:57 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-11-30 21:20:20 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
780 (only retried tests) 674 0 0 0 106

🟢 2024-11-30 21:20:30 UTC Build successful.
🟢 2024-11-30 21:20:48 UTC ydbd size 2.5 GiB changed* by -2.8 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 7466d62 merge: 9013a6e diff diff %
ydbd size 2 691 029 656 Bytes 2 688 123 728 Bytes -2.8 MiB -0.108%
ydbd stripped size 483 252 592 Bytes 483 076 016 Bytes -172.4 KiB -0.037%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Nov 30, 2024

2024-11-30 19:26:59 UTC Pre-commit check linux-x86_64-release-asan for 9013a6e has started.
2024-11-30 19:27:10 UTC Artifacts will be uploaded here
2024-11-30 19:30:31 UTC ya make is running...
🟡 2024-11-30 21:09:43 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15778 15706 0 16 7 49

🟢 2024-11-30 21:11:01 UTC Build successful.
🟢 2024-11-30 21:11:29 UTC ydbd size 4.9 GiB changed* by -5.5 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: 7466d62 merge: 9013a6e diff diff %
ydbd size 5 289 692 488 Bytes 5 283 923 528 Bytes -5.5 MiB -0.109%
ydbd stripped size 1 364 389 456 Bytes 1 363 805 808 Bytes -570.0 KiB -0.043%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@swalrus1 swalrus1 marked this pull request as ready for review December 2, 2024 08:08
@swalrus1 swalrus1 requested a review from a team as a code owner December 2, 2024 08:08
ivanmorozov333
ivanmorozov333 previously approved these changes Dec 4, 2024
gridnevvvit
gridnevvvit previously approved these changes Dec 4, 2024
Copy link

github-actions bot commented Dec 4, 2024

2024-12-04 07:45:44 UTC Pre-commit check linux-x86_64-release-asan for 950a0a4 has started.
2024-12-04 07:45:56 UTC Artifacts will be uploaded here
2024-12-04 07:49:31 UTC ya make is running...
🔴 2024-12-04 08:03:20 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Dec 4, 2024

2024-12-04 07:46:02 UTC Pre-commit check linux-x86_64-relwithdebinfo for 950a0a4 has started.
2024-12-04 07:46:14 UTC Artifacts will be uploaded here
2024-12-04 07:49:51 UTC ya make is running...
🔴 2024-12-04 08:14:32 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Dec 4, 2024

2024-12-04 10:14:05 UTC Pre-commit check linux-x86_64-release-asan for 82661dd has started.
2024-12-04 10:14:16 UTC Artifacts will be uploaded here
2024-12-04 10:17:48 UTC ya make is running...
🔴 2024-12-04 10:39:26 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Dec 4, 2024

2024-12-04 10:15:02 UTC Pre-commit check linux-x86_64-relwithdebinfo for 82661dd has started.
2024-12-04 10:15:10 UTC Artifacts will be uploaded here
2024-12-04 10:18:28 UTC ya make is running...
🔴 2024-12-04 10:24:10 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Dec 4, 2024

2024-12-04 11:54:42 UTC Pre-commit check linux-x86_64-relwithdebinfo for 1a27cf8 has started.
2024-12-04 11:54:51 UTC Artifacts will be uploaded here
2024-12-04 11:58:10 UTC ya make is running...
🟡 2024-12-04 13:27:30 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
33264 30433 0 3 2719 109

2024-12-04 13:30:16 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-04 13:42:08 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
669 (only retried tests) 563 0 0 0 106

🟢 2024-12-04 13:42:17 UTC Build successful.
🟢 2024-12-04 13:42:36 UTC ydbd size 2.5 GiB changed* by -2.8 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: d7df471 merge: 1a27cf8 diff diff %
ydbd size 2 701 815 712 Bytes 2 698 848 344 Bytes -2.8 MiB -0.110%
ydbd stripped size 483 605 200 Bytes 483 421 712 Bytes -179.2 KiB -0.038%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 4, 2024

2024-12-04 11:55:13 UTC Pre-commit check linux-x86_64-release-asan for 1a27cf8 has started.
2024-12-04 11:55:49 UTC Artifacts will be uploaded here
2024-12-04 11:59:52 UTC ya make is running...
🟡 2024-12-04 13:37:27 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
15793 15714 0 24 6 49

🟢 2024-12-04 13:38:45 UTC Build successful.
🟢 2024-12-04 13:39:14 UTC ydbd size 4.9 GiB changed* by -5.6 MiB, which is <= 0 Bytes vs main: OK

ydbd size dash main: d7df471 merge: 1a27cf8 diff diff %
ydbd size 5 308 357 800 Bytes 5 302 501 120 Bytes -5.6 MiB -0.110%
ydbd stripped size 1 365 621 584 Bytes 1 365 031 984 Bytes -575.8 KiB -0.043%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

@swalrus1 swalrus1 merged commit b2da93a into ydb-platform:main Dec 4, 2024
10 checks passed
@swalrus1 swalrus1 deleted the ttl-tiering branch December 10, 2024 09:13
zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Jan 2, 2025
Conflicts:
	ydb/core/tx/schemeshard/common/validation.h
	ydb/core/tx/tiering/rule/manager.cpp
	ydb/core/tx/tiering/rule/object.cpp
	ydb/public/sdk/cpp/client/ydb_table/table.cpp
zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Jan 5, 2025
Conflicts:
	ydb/core/tx/schemeshard/common/validation.h
	ydb/core/tx/tiering/rule/manager.cpp
	ydb/core/tx/tiering/rule/object.cpp
	ydb/public/sdk/cpp/client/ydb_table/table.cpp
zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Jan 5, 2025
Conflicts:
	ydb/core/tx/schemeshard/common/validation.h
	ydb/core/tx/tiering/rule/manager.cpp
	ydb/core/tx/tiering/rule/object.cpp
	ydb/public/sdk/cpp/client/ydb_table/table.cpp
zverevgeny pushed a commit to zverevgeny/ydb that referenced this pull request Jan 8, 2025
Conflicts:
	ydb/core/tx/schemeshard/common/validation.h
	ydb/core/tx/tiering/rule/manager.cpp
	ydb/core/tx/tiering/rule/object.cpp
	ydb/public/sdk/cpp/client/ydb_table/table.cpp
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants