Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

YQ-3988 Add stop session reason #12839

Open
wants to merge 5 commits into
base: main
Choose a base branch
from

Conversation

kardymonds
Copy link
Collaborator

Changelog entry

...

Changelog category

  • Not for changelog (changelog entry is not required)

Additional information

...

@kardymonds kardymonds requested a review from a team as a code owner December 20, 2024 12:50
Copy link

github-actions bot commented Dec 20, 2024

2024-12-20 12:52:06 UTC Pre-commit check linux-x86_64-relwithdebinfo for 3f0ac5a has started.
2024-12-20 12:52:18 UTC Artifacts will be uploaded here
2024-12-20 12:55:22 UTC ya make is running...
🟡 2024-12-20 14:22:46 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
29231 26281 0 3 2831 116

2024-12-20 14:25:38 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-20 14:37:39 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
164 (only retried tests) 54 0 0 0 110

🟢 2024-12-20 14:37:46 UTC Build successful.
🟢 2024-12-20 14:38:05 UTC ydbd size 2.1 GiB changed* by +9.5 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: a580b00 merge: 3f0ac5a diff diff %
ydbd size 2 235 533 360 Bytes 2 235 543 112 Bytes +9.5 KiB +0.000%
ydbd stripped size 477 922 896 Bytes 477 924 560 Bytes +1.6 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 20, 2024

2024-12-20 12:52:16 UTC Pre-commit check linux-x86_64-release-asan for 3f0ac5a has started.
2024-12-20 12:52:28 UTC Artifacts will be uploaded here
2024-12-20 12:55:22 UTC ya make is running...
🟡 2024-12-20 14:28:51 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
12294 12222 0 17 6 49

🟢 2024-12-20 14:29:57 UTC Build successful.
🟡 2024-12-20 14:30:20 UTC ydbd size 3.6 GiB changed* by +125.2 KiB, which is >= 100.0 KiB vs main: Warning

ydbd size dash main: d30aab1 merge: 3f0ac5a diff diff %
ydbd size 3 866 120 024 Bytes 3 866 248 248 Bytes +125.2 KiB +0.003%
ydbd stripped size 1 350 476 240 Bytes 1 350 512 144 Bytes +35.1 KiB +0.003%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 23, 2024

2024-12-23 14:47:15 UTC Pre-commit check linux-x86_64-relwithdebinfo for 14bdc08 has started.
2024-12-23 14:47:30 UTC Artifacts will be uploaded here
2024-12-23 14:50:24 UTC ya make is running...
🔴 2024-12-23 15:06:16 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Dec 23, 2024

2024-12-23 14:49:33 UTC Pre-commit check linux-x86_64-release-asan for 14bdc08 has started.
2024-12-23 14:49:46 UTC Artifacts will be uploaded here
2024-12-23 14:52:54 UTC ya make is running...
🔴 2024-12-23 15:11:48 UTC Build failed, see the logs. Also see fail summary

Copy link

github-actions bot commented Dec 23, 2024

2024-12-23 20:13:58 UTC Pre-commit check linux-x86_64-release-asan for 566ed38 has started.
2024-12-23 20:14:23 UTC Artifacts will be uploaded here
2024-12-23 20:17:17 UTC ya make is running...
🟡 2024-12-23 21:18:29 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
12298 12215 0 24 11 48

🟢 2024-12-23 21:19:35 UTC Build successful.
🟢 2024-12-23 21:19:59 UTC ydbd size 3.6 GiB changed* by +16.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 4f48bf5 merge: 566ed38 diff diff %
ydbd size 3 865 642 504 Bytes 3 865 658 840 Bytes +16.0 KiB +0.000%
ydbd stripped size 1 350 675 856 Bytes 1 350 680 400 Bytes +4.4 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Dec 23, 2024

2024-12-23 20:16:35 UTC Pre-commit check linux-x86_64-relwithdebinfo for 566ed38 has started.
2024-12-23 20:16:47 UTC Artifacts will be uploaded here
2024-12-23 20:19:43 UTC ya make is running...
🟡 2024-12-23 21:15:46 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
29184 26215 0 13 2840 116

2024-12-23 21:18:08 UTC ya make is running... (failed tests rerun, try 2)
🟢 2024-12-23 21:30:07 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
195 (only retried tests) 84 0 0 0 111

🟢 2024-12-23 21:30:13 UTC Build successful.
🟢 2024-12-23 21:30:32 UTC ydbd size 2.1 GiB changed* by +9.6 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 4f48bf5 merge: 566ed38 diff diff %
ydbd size 2 235 025 960 Bytes 2 235 035 776 Bytes +9.6 KiB +0.000%
ydbd stripped size 477 982 320 Bytes 477 984 048 Bytes +1.7 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

GrigoriyPA
GrigoriyPA previously approved these changes Dec 24, 2024
@@ -421,6 +427,19 @@ Y_UNIT_TEST_SUITE(RowDispatcherTests) {
MockStopSession(Source1Connection2, PartitionId0, ReadActorId2);
ExpectStopSession(session2, PartitionId0);
}

// TODO: not working GrabEdgeEvent()
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

А точно этот комментарий нужен?

@@ -867,7 +871,7 @@ template <class TEventPtr>
bool TDqPqRdReadActor::CheckSession(SessionInfo& session, const TEventPtr& ev, ui64 partitionId) {
if (ev->Cookie != session.Generation) {
SRC_LOG_W("Wrong message generation (" << typeid(TEventPtr).name() << "), sender " << ev->Sender << " cookie " << ev->Cookie << ", session generation " << session.Generation << ", send TEvStopSession");
SendStopSession(ev->Sender, partitionId, ev->Cookie);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Не до конца понимаю почему нельзя было послать новый generation. Который сейчас в dq_pq_rd_read_actor и по нему в row_dispatcher все старые поудалять?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Предположим что клиент в RD не удалился (сообщение не дошло и т.п.).
Далее может быть 2 случая когда read_actor переподключается к RD (предположим одна партиция):

  1. read_actor идет к тому же RD. RD на StartSession видит бОльший generation и пересоздает клиента,
  2. read_actor идет к другому же RD (координатор сменился и раздал другое распределение). Теперь read_actor о старом RD ничего не знает. В старом RD сессия жива и RD периодически посылает heartbeat. read_actor (на heartbeat) отвечает StopSession при этом проставляя невалидный SeqNo (он и не знает какой нужен т.к. сессия удалена).

Эту проблему можно решить по другому, например на StopSession не проверять SeqNo.

Copy link

github-actions bot commented Jan 8, 2025

2025-01-08 21:14:25 UTC Pre-commit check linux-x86_64-release-asan for 9c1a035 has started.
2025-01-08 21:14:36 UTC Artifacts will be uploaded here
2025-01-08 21:17:32 UTC ya make is running...
🟡 2025-01-08 22:13:55 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
11720 11661 0 26 3 30

2025-01-08 22:14:54 UTC ya make is running... (failed tests rerun, try 2)
🟡 2025-01-08 22:27:01 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet Going to retry failed tests...

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
97 (only retried tests) 63 0 7 0 27

2025-01-08 22:27:10 UTC ya make is running... (failed tests rerun, try 3)
🟡 2025-01-08 22:38:48 UTC Some tests failed, follow the links below. This fail is not in blocking policy yet

Test history | Ya make output | Test bloat | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
63 (only retried tests) 31 0 6 0 26

🟢 2025-01-08 22:38:55 UTC Build successful.
🟢 2025-01-08 22:39:22 UTC ydbd size 3.6 GiB changed* by +16.0 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 9f31130 merge: 9c1a035 diff diff %
ydbd size 3 873 834 368 Bytes 3 873 850 704 Bytes +16.0 KiB +0.000%
ydbd stripped size 1 350 684 240 Bytes 1 350 688 784 Bytes +4.4 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Copy link

github-actions bot commented Jan 8, 2025

2025-01-08 21:16:53 UTC Pre-commit check linux-x86_64-relwithdebinfo for 9c1a035 has started.
2025-01-08 21:17:04 UTC Artifacts will be uploaded here
2025-01-08 21:20:00 UTC ya make is running...
🟡 2025-01-08 22:08:07 UTC Some tests failed, follow the links below. Going to retry failed tests...

Test history | Ya make output | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
25635 23129 0 1 2383 122

2025-01-08 22:10:14 UTC ya make is running... (failed tests rerun, try 2)
🟢 2025-01-08 22:21:37 UTC Tests successful.

Test history | Ya make output | Test bloat | Test bloat

TESTS PASSED ERRORS FAILED SKIPPED MUTED?
180 (only retried tests) 61 0 0 0 119

🟢 2025-01-08 22:21:43 UTC Build successful.
🟢 2025-01-08 22:22:01 UTC ydbd size 2.1 GiB changed* by +9.6 KiB, which is < 100.0 KiB vs main: OK

ydbd size dash main: 9f31130 merge: 9c1a035 diff diff %
ydbd size 2 244 317 464 Bytes 2 244 327 288 Bytes +9.6 KiB +0.000%
ydbd stripped size 472 336 560 Bytes 472 338 288 Bytes +1.7 KiB +0.000%

*please be aware that the difference is based on comparing your commit and the last completed build from the post-commit, check comparation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants