Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

roachtest: cdc/mixed-versions failed #87574

Closed
cockroach-teamcity opened this issue Sep 8, 2022 · 24 comments
Closed

roachtest: cdc/mixed-versions failed #87574

cockroach-teamcity opened this issue Sep 8, 2022 · 24 comments
Labels
branch-release-22.2 Used to mark GA and release blockers, technical advisories, and bugs for 22.2 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Milestone

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Sep 8, 2022

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ f8e04f32b84a9727c9e813d0096bde2de64d5675:

		fingerprints did not match at 1662617698019678761.2147483647: 6254378665352111213 vs 7617915627026385923
		fingerprints did not match at 1662617698019678762.0000000000: 3557925160385525612 vs -4223408860566994661
		fingerprints did not match at 1662617698119052685.2147483647: 3557925160385525612 vs -4223408860566994661
		fingerprints did not match at 1662617698119052686.0000000000: 1262264668828303956 vs -6433338271953708980
		fingerprints did not match at 1662617698219042783.2147483647: 1262264668828303956 vs -6433338271953708980
		fingerprints did not match at 1662617698219042784.0000000000: -8688739974076997691 vs 6206739571626662719
		fingerprints did not match at 1662617698319498910.2147483647: -8688739974076997691 vs 6206739571626662719
		fingerprints did not match at 1662617698319498911.0000000000: -4614394126629028433 vs 8968351431385022630
		fingerprints did not match at 1662617698419021731.2147483647: -4614394126629028433 vs 8968351431385022630
		fingerprints did not match at 1662617698419021732.0000000000: -3363634691231629673 vs -2316610995547971540
		fingerprints did not match at 1662617698526638167.2147483647: -3363634691231629673 vs -2316610995547971540
		fingerprints did not match at 1662617698526638168.0000000000: 2281251363869082383 vs 6995095511815755776
		fingerprints did not match at 1662617698619429371.2147483647: 2281251363869082383 vs 6995095511815755776
		fingerprints did not match at 1662617698619429372.0000000000: -4480665012254053975 vs 7601601331095237531
		fingerprints did not match at 1662617698719540633.2147483647: -4480665012254053975 vs 7601601331095237531
		fingerprints did not match at 1662617698719540634.0000000000: 6030768765329030790 vs -4793090476322123801
		fingerprints did not match at 1662617698818954402.2147483647: 6030768765329030790 vs -4793090476322123801

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-19418

@cockroach-teamcity cockroach-teamcity added branch-release-22.2 Used to mark GA and release blockers, technical advisories, and bugs for 22.2 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Sep 8, 2022
@cockroach-teamcity cockroach-teamcity added this to the 22.2 milestone Sep 8, 2022
@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 1bfe9bcda653f55ed3b4216610433b51b2ef0d8f:

		fingerprints did not match at 1662790513537306784.2147483647: 6030768765329030790 vs 7457307615780058956
		fingerprints did not match at 1662790513537306785.0000000000: -5194059977877580309 vs -8996283297191486431
		fingerprints did not match at 1662790513637332886.2147483647: -5194059977877580309 vs -8996283297191486431
		fingerprints did not match at 1662790513637332887.0000000000: -7648071544139881222 vs 6997912096822232471
		fingerprints did not match at 1662790513736849072.2147483647: -7648071544139881222 vs 6997912096822232471
		fingerprints did not match at 1662790513736849073.0000000000: 7356670587232018918 vs -8840696575015586920
		fingerprints did not match at 1662790513837171366.2147483647: 7356670587232018918 vs -8840696575015586920
		fingerprints did not match at 1662790513837171367.0000000000: -40752066590147370 vs 6818900537205415660
		fingerprints did not match at 1662790513936559787.2147483647: -40752066590147370 vs 6818900537205415660
		fingerprints did not match at 1662790513936559788.0000000000: 3533434108108108034 vs 1336418130294214155
		fingerprints did not match at 1662790514037214202.2147483647: 3533434108108108034 vs 1336418130294214155
		fingerprints did not match at 1662790514037214203.0000000000: -3231425772498384226 vs 8752197723836175014
		fingerprints did not match at 1662790514136549626.2147483647: -3231425772498384226 vs 8752197723836175014
		fingerprints did not match at 1662790514136549627.0000000000: -3873424178694992450 vs 8587140924771826330
		fingerprints did not match at 1662790514237156476.2147483647: -3873424178694992450 vs 8587140924771826330
		fingerprints did not match at 1662790514237156477.0000000000: 8607791985598828270 vs -3975228584142951330
		fingerprints did not match at 1662790514337360775.2147483647: 8607791985598828270 vs -3975228584142951330

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@renatolabs renatolabs removed the release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. label Sep 10, 2022
@renatolabs
Copy link
Contributor

Release blocker label removed, see #87251 (comment).

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 9b62adaceb821a96d325a8ce30f35952ec48e9e5:

		fingerprints did not match at 1662876816430518824.2147483647: -4534180154201858110 vs 1662530942508550419
		fingerprints did not match at 1662876816430518825.0000000000: 5953914986731972728 vs 4847109996583874160
		fingerprints did not match at 1662876816530695434.2147483647: 5953914986731972728 vs 4847109996583874160
		fingerprints did not match at 1662876816530695435.0000000000: -6354639917585771722 vs -2712994749642619765
		fingerprints did not match at 1662876816630090671.2147483647: -6354639917585771722 vs -2712994749642619765
		fingerprints did not match at 1662876816630090672.0000000000: -2013728773566020 vs -6347874082179142412
		fingerprints did not match at 1662876816731067863.2147483647: -2013728773566020 vs -6347874082179142412
		fingerprints did not match at 1662876816731067864.0000000000: 5219887851009666207 vs -6465833274222781254
		fingerprints did not match at 1662876816830734692.2147483647: 5219887851009666207 vs -6465833274222781254
		fingerprints did not match at 1662876816830734693.0000000000: -2741107848803484723 vs -8333913670438707525
		fingerprints did not match at 1662876816931045558.2147483647: -2741107848803484723 vs -8333913670438707525
		fingerprints did not match at 1662876816931045559.0000000000: -2719266329703377247 vs 8243199563553539275
		fingerprints did not match at 1662876817030157702.2147483647: -2719266329703377247 vs 8243199563553539275
		fingerprints did not match at 1662876817030157703.0000000000: 1889878099117468095 vs -601471872470245122
		fingerprints did not match at 1662876817130922760.2147483647: 1889878099117468095 vs -601471872470245122
		fingerprints did not match at 1662876817130922761.0000000000: -2502799354773033355 vs 9073518982203574590
		fingerprints did not match at 1662876817230413532.2147483647: -2502799354773033355 vs 9073518982203574590

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 58d24a3e81a743a9a77bd4e8bf0bd27180eb3c04:

		fingerprints did not match at 1663049781322269289.0000000000: -8117819521452585836 vs -1858534262071710152
		fingerprints did not match at 1663049783422144330.2147483647: 635615074301852436 vs -1858534262071710152
		fingerprints did not match at 1663049783422144331.0000000000: 7801530611091435395 vs 8810381630239901073
		fingerprints did not match at 1663049783521661821.2147483647: 7801530611091435395 vs 8810381630239901073
		fingerprints did not match at 1663049783521661822.0000000000: -6200670060489069714 vs -4615465285254299268
		fingerprints did not match at 1663049783621665936.2147483647: -6200670060489069714 vs -4615465285254299268
		fingerprints did not match at 1663049783621665937.0000000000: -3300855289816955235 vs -4309566395988923249
		fingerprints did not match at 1663049783821842668.2147483647: 827122250860401160 vs -4309566395988923249
		fingerprints did not match at 1663049783821842669.0000000000: -6174408414085987420 vs 7285635895321787683
		fingerprints did not match at 1663049783921780118.2147483647: -6174408414085987420 vs 7285635895321787683
		fingerprints did not match at 1663049783921780119.0000000000: 7278139384188719408 vs -6175848746352578633
		fingerprints did not match at 1663049784021622973.2147483647: 7278139384188719408 vs -6175848746352578633
		fingerprints did not match at 1663049784021622974.0000000000: -8932962686922147498 vs 5425820227670247377
		fingerprints did not match at 1663049784121927798.2147483647: -8932962686922147498 vs 5425820227670247377
		fingerprints did not match at 1663049784121927799.0000000000: -5865945072624610426 vs 7051552301819129089
		fingerprints did not match at 1663049784521559634.2147483647: -4024965578553332403 vs 7051552301819129089
		fingerprints did not match at 1663049784521559635.0000000000: 5750391641289633396 vs -1858534262071710152

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ ba1686e00bb140b67ba9ecc154d949795c2555b6:

		fingerprints did not match at 1663136189212790795.0000000000: -5808020502071172591 vs -4990524811582727305
		fingerprints did not match at 1663136189312932555.2147483647: -5808020502071172591 vs -4990524811582727305
		fingerprints did not match at 1663136189312932556.0000000000: -1091669101769571579 vs 7579571560478491702
		fingerprints did not match at 1663136189413021732.2147483647: -1091669101769571579 vs 7579571560478491702
		fingerprints did not match at 1663136189413021733.0000000000: 5270773181903130777 vs -3401311899872798806
		fingerprints did not match at 1663136189513401509.2147483647: 5270773181903130777 vs -3401311899872798806
		fingerprints did not match at 1663136189513401510.0000000000: 552495283147539828 vs -7042702821276351929
		fingerprints did not match at 1663136189612631188.2147483647: 552495283147539828 vs -7042702821276351929
		fingerprints did not match at 1663136189612631189.0000000000: -2630812117978763488 vs 4797717614856841235
		fingerprints did not match at 1663136189713029003.2147483647: -2630812117978763488 vs 4797717614856841235
		fingerprints did not match at 1663136189713029004.0000000000: 4715969356084427808 vs -2838413775089812717
		fingerprints did not match at 1663136189813083603.2147483647: 4715969356084427808 vs -2838413775089812717
		fingerprints did not match at 1663136189813083604.0000000000: -6702308734955758723 vs 4257323480393899086
		fingerprints did not match at 1663136189912898550.2147483647: -6702308734955758723 vs 4257323480393899086
		fingerprints did not match at 1663136189912898551.0000000000: -8152954731541731962 vs 1671805571514589877
		fingerprints did not match at 1663136190013205916.2147483647: -8152954731541731962 vs 1671805571514589877
		fingerprints did not match at 1663136190013205917.0000000000: 2546654260350590020 vs -4990524811582727305

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 21e14668fc212614785cb3739378378a0aac4539:

		fingerprints did not match at 1663222479616496744.2147483647: -4739565189912597938 vs -4859391312716182281
		fingerprints did not match at 1663222479616496745.0000000000: -5504122105430115108 vs 567592528849745871
		fingerprints did not match at 1663222479715930944.2147483647: -5504122105430115108 vs 567592528849745871
		fingerprints did not match at 1663222479715930945.0000000000: 5596921088790281501 vs 3555011823536773283
		fingerprints did not match at 1663222479815978253.2147483647: 5596921088790281501 vs 3555011823536773283
		fingerprints did not match at 1663222479815978254.0000000000: -4534180154201858110 vs -6600976962439687654
		fingerprints did not match at 1663222479916188301.2147483647: -4534180154201858110 vs -6600976962439687654
		fingerprints did not match at 1663222479916188302.0000000000: 5953914986731972728 vs 7170100776665825987
		fingerprints did not match at 1663222480016547431.2147483647: 5953914986731972728 vs 7170100776665825987
		fingerprints did not match at 1663222480016547432.0000000000: -6354639917585771722 vs 1149529905776989046
		fingerprints did not match at 1663222480116209544.2147483647: -6354639917585771722 vs 1149529905776989046
		fingerprints did not match at 1663222480116209545.0000000000: -2013728773566020 vs 3060953465234209155
		fingerprints did not match at 1663222480216689654.2147483647: -2013728773566020 vs 3060953465234209155
		fingerprints did not match at 1663222480216689655.0000000000: 5219887851009666207 vs -7182747823694039826
		fingerprints did not match at 1663222480316618803.2147483647: 5219887851009666207 vs -7182747823694039826
		fingerprints did not match at 1663222480316618804.0000000000: -2741107848803484723 vs 2866513747775676861
		fingerprints did not match at 1663222480415889154.2147483647: -2741107848803484723 vs 2866513747775676861

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ a7b39a0d0155e2571412e0279848bb0f15486c4c:

		fingerprints did not match at 1663309209831795902.2147483647: 1372422410277235260 vs -644492358040706055
		fingerprints did not match at 1663309209831795903.0000000000: -4342219698499743932 vs 2862258860895471233
		fingerprints did not match at 1663309209931844764.2147483647: -4342219698499743932 vs 2862258860895471233
		fingerprints did not match at 1663309209931844765.0000000000: 8377907026850843817 vs -8051924337442552468
		fingerprints did not match at 1663309210031363173.2147483647: 8377907026850843817 vs -8051924337442552468
		fingerprints did not match at 1663309210031363174.0000000000: 7055737263841287999 vs -8795920550223112454
		fingerprints did not match at 1663309210131483020.2147483647: 7055737263841287999 vs -8795920550223112454
		fingerprints did not match at 1663309210131483021.0000000000: 8830650832608990112 vs -7022983937702946203
		fingerprints did not match at 1663309210231194491.2147483647: 8830650832608990112 vs -7022983937702946203
		fingerprints did not match at 1663309210231194492.0000000000: -7495589626010381804 vs 8358627610461723601
		fingerprints did not match at 1663309210331450818.2147483647: -7495589626010381804 vs 8358627610461723601
		fingerprints did not match at 1663309210331450819.0000000000: 913381584148562597 vs -1681702199457707168
		fingerprints did not match at 1663309210431401466.2147483647: 913381584148562597 vs -1681702199457707168
		fingerprints did not match at 1663309210431401467.0000000000: -2810103633280737454 vs 4396954515679467159
		fingerprints did not match at 1663309210531815695.2147483647: -2810103633280737454 vs 4396954515679467159
		fingerprints did not match at 1663309210531815696.0000000000: -159579544876656190 vs 1859019400392134663
		fingerprints did not match at 1663309210631380907.2147483647: -159579544876656190 vs 1859019400392134663

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ aac413cd4ca62f3392029b42219ebb2788979fb8:

		fingerprints did not match at 1663395312503347255.2147483647: -2489600576355715892 vs 3393307023241204292
		fingerprints did not match at 1663395312503347256.0000000000: -1433091115170499720 vs 2195778099443570160
		fingerprints did not match at 1663395312603243324.2147483647: -1433091115170499720 vs 2195778099443570160
		fingerprints did not match at 1663395312603243325.0000000000: 6748550462791955196 vs -179524820024157243
		fingerprints did not match at 1663395312703056241.2147483647: 6748550462791955196 vs -179524820024157243
		fingerprints did not match at 1663395312703056242.0000000000: 384988654794082948 vs 6769477170042991493
		fingerprints did not match at 1663395312803346522.2147483647: 384988654794082948 vs 6769477170042991493
		fingerprints did not match at 1663395312803346523.0000000000: -5672357680437602008 vs 468484678502454232
		fingerprints did not match at 1663395312902724404.2147483647: -5672357680437602008 vs 468484678502454232
		fingerprints did not match at 1663395312902724405.0000000000: 5918564612052816920 vs 4526026967928234116
		fingerprints did not match at 1663395313003655672.2147483647: 5918564612052816920 vs 4526026967928234116
		fingerprints did not match at 1663395313003655673.0000000000: 2951460263943482404 vs 1939395041683145294
		fingerprints did not match at 1663395313103584352.2147483647: 2951460263943482404 vs 1939395041683145294
		fingerprints did not match at 1663395313103584353.0000000000: 6556161823038496416 vs -3780656704210887035
		fingerprints did not match at 1663395313202911600.2147483647: 6556161823038496416 vs -3780656704210887035
		fingerprints did not match at 1663395313202911601.0000000000: -8028733552359343936 vs 135239846208485605
		fingerprints did not match at 1663395313303114830.2147483647: -8028733552359343936 vs 135239846208485605

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ edeefa9120e86739808ca43fc52d4cbac813fab3:

		fingerprints did not match at 1663654733721550477.0000000000: 4931560254718524483 vs 3572591657754287225
		fingerprints did not match at 1663654733821041563.2147483647: 4931560254718524483 vs 3572591657754287225
		fingerprints did not match at 1663654733821041564.0000000000: 1089575471818755240 vs 6489261862523535214
		fingerprints did not match at 1663654733920467820.2147483647: 1089575471818755240 vs 6489261862523535214
		fingerprints did not match at 1663654733920467821.0000000000: -2525841362198361040 vs -1365367132675886422
		fingerprints did not match at 1663654734021602631.2147483647: -2525841362198361040 vs -1365367132675886422
		fingerprints did not match at 1663654734021602632.0000000000: -3719115253234700060 vs 7476927107328099035
		fingerprints did not match at 1663654734121385962.2147483647: -3719115253234700060 vs 7476927107328099035
		fingerprints did not match at 1663654734121385963.0000000000: 7613399973809895620 vs -4582353550480743561
		fingerprints did not match at 1663654734221304628.2147483647: 7613399973809895620 vs -4582353550480743561
		fingerprints did not match at 1663654734221304629.0000000000: 8488720469185859444 vs 5458343604015576565
		fingerprints did not match at 1663654734321319424.2147483647: 8488720469185859444 vs 5458343604015576565
		fingerprints did not match at 1663654734321319425.0000000000: -1434243490846531100 vs -3007879735798850519
		fingerprints did not match at 1663654734421140314.2147483647: -1434243490846531100 vs -3007879735798850519
		fingerprints did not match at 1663654734421140315.0000000000: -3959092496559086252 vs 7639271415720948223
		fingerprints did not match at 1663654734520958297.2147483647: -3959092496559086252 vs 7639271415720948223
		fingerprints did not match at 1663654734520958298.0000000000: 1741063390815702884 vs 3572591657754287225

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ ac55929f9367f7dee41118f95d07a17b667b4d50:

		fingerprints did not match at 1663740922030523870.2147483647: 6030768765329030790 vs -8407274489499791096
		fingerprints did not match at 1663740922030523871.0000000000: -5194059977877580309 vs -9096668687567238396
		fingerprints did not match at 1663740922130521314.2147483647: -5194059977877580309 vs -9096668687567238396
		fingerprints did not match at 1663740922130521315.0000000000: -7648071544139881222 vs 4742032525034922915
		fingerprints did not match at 1663740922230715615.2147483647: -7648071544139881222 vs 4742032525034922915
		fingerprints did not match at 1663740922230715616.0000000000: 7356670587232018918 vs 6222211458950549680
		fingerprints did not match at 1663740922330710599.2147483647: 7356670587232018918 vs 6222211458950549680
		fingerprints did not match at 1663740922330710600.0000000000: -40752066590147370 vs 1495388728098283764
		fingerprints did not match at 1663740922430598655.2147483647: -40752066590147370 vs 1495388728098283764
		fingerprints did not match at 1663740922430598656.0000000000: 3533434108108108034 vs -7598488104417542713
		fingerprints did not match at 1663740922530689360.2147483647: 3533434108108108034 vs -7598488104417542713
		fingerprints did not match at 1663740922530689361.0000000000: -3231425772498384226 vs 2260727758105123574
		fingerprints did not match at 1663740922630218891.2147483647: -3231425772498384226 vs 2260727758105123574
		fingerprints did not match at 1663740922630218892.0000000000: -3873424178694992450 vs 584170428582524394
		fingerprints did not match at 1663740922730535059.2147483647: -3873424178694992450 vs 584170428582524394
		fingerprints did not match at 1663740922730535060.0000000000: 8607791985598828270 vs 769607980559229054
		fingerprints did not match at 1663740922830826395.2147483647: 8607791985598828270 vs 769607980559229054

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ a33d71dcd904c771d1297323d8d206b8b59d40bf:

		fingerprints did not match at 1663828171589725222.0000000000: 5256307250327113958 vs -6902312347413734662
		fingerprints did not match at 1663828171889935162.2147483647: -9114755401191358163 vs -6902312347413734662
		fingerprints did not match at 1663828171889935163.0000000000: 1544117151435699536 vs -4424591038251562628
		fingerprints did not match at 1663828172089411892.2147483647: -5115600467960988815 vs -4424591038251562628
		fingerprints did not match at 1663828172089411893.0000000000: 1323322400487716096 vs -218095540283043431
		fingerprints did not match at 1663828172389420553.2147483647: 4542465277380051724 vs -218095540283043431
		fingerprints did not match at 1663828172389420554.0000000000: 2611060318693921283 vs -1050100489134741374
		fingerprints did not match at 1663828173289446355.2147483647: -6278985080527590385 vs -1050100489134741374
		fingerprints did not match at 1663828173289446356.0000000000: 9171366054573558170 vs 6096730893229080824
		fingerprints did not match at 1663828173389531810.2147483647: 9171366054573558170 vs 6096730893229080824
		fingerprints did not match at 1663828173389531811.0000000000: -3179360249616010138 vs -9188270093932320974
		fingerprints did not match at 1663828173589501880.2147483647: -6077806080649589981 vs -9188270093932320974
		fingerprints did not match at 1663828173589501881.0000000000: 4354544112785141894 vs -6548960119095808142
		fingerprints did not match at 1663828173789959382.2147483647: -2679000574125654447 vs -6548960119095808142
		fingerprints did not match at 1663828173789959383.0000000000: 6637646016122795219 vs 8706437399579535736
		fingerprints did not match at 1663828173889418485.2147483647: 6637646016122795219 vs 8706437399579535736
		fingerprints did not match at 1663828173889418486.0000000000: 355445304640617469 vs -1050100489134741374

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ c037b5e5ce491a4a2b6e33401b00a05c2b117c73:

		fingerprints did not match at 1663913757511126972.2147483647: 5642257841359097307 vs 638389246355996630
		fingerprints did not match at 1663913757511126973.0000000000: -1562923977438540234 vs 5739626596368927902
		fingerprints did not match at 1663913757610893939.2147483647: -1562923977438540234 vs 5739626596368927902
		fingerprints did not match at 1663913757610893940.0000000000: 131113346679225497 vs -9214362933822511651
		fingerprints did not match at 1663913757711182051.2147483647: 131113346679225497 vs -9214362933822511651
		fingerprints did not match at 1663913757711182052.0000000000: -1859202900654541259 vs 1982876732732338092
		fingerprints did not match at 1663913757811063414.2147483647: -1859202900654541259 vs 1982876732732338092
		fingerprints did not match at 1663913757811063415.0000000000: -1364977990252488880 vs -2498104513744467345
		fingerprints did not match at 1663913757911213752.2147483647: -1364977990252488880 vs -2498104513744467345
		fingerprints did not match at 1663913757911213753.0000000000: 2315425068916571091 vs -879318487515645959
		fingerprints did not match at 1663913758010983480.2147483647: 2315425068916571091 vs -879318487515645959
		fingerprints did not match at 1663913758010983481.0000000000: 672970890222394728 vs -3468544333663825591
		fingerprints did not match at 1663913758111326889.2147483647: 672970890222394728 vs -3468544333663825591
		fingerprints did not match at 1663913758111326890.0000000000: -1887681618928739741 vs 7741227019120029723
		fingerprints did not match at 1663913758211022653.2147483647: -1887681618928739741 vs 7741227019120029723
		fingerprints did not match at 1663913758211022654.0000000000: -1185300974471122077 vs 638389246355996630
		fingerprints did not match at 1663913758310822770.2147483647: -1185300974471122077 vs 638389246355996630

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 8eb9026a0ccbf3411341de62438a678fda1b64cd:

		fingerprints did not match at 1664000018172534840.2147483647: -4327442118895736506 vs -7488632929901113001
		fingerprints did not match at 1664000018172534841.0000000000: -4739565189912597938 vs 4809209602477905543
		fingerprints did not match at 1664000018271711293.2147483647: -4739565189912597938 vs 4809209602477905543
		fingerprints did not match at 1664000018271711294.0000000000: -5504122105430115108 vs -445230079539663425
		fingerprints did not match at 1664000018371974877.2147483647: -5504122105430115108 vs -445230079539663425
		fingerprints did not match at 1664000018371974878.0000000000: 5596921088790281501 vs -3501628335740419373
		fingerprints did not match at 1664000018471969076.2147483647: 5596921088790281501 vs -3501628335740419373
		fingerprints did not match at 1664000018471969077.0000000000: -4534180154201858110 vs 6509629535817287786
		fingerprints did not match at 1664000018572347795.2147483647: -4534180154201858110 vs 6509629535817287786
		fingerprints did not match at 1664000018572347796.0000000000: 5953914986731972728 vs -7083292134176827213
		fingerprints did not match at 1664000018671720397.2147483647: 5953914986731972728 vs -7083292134176827213
		fingerprints did not match at 1664000018671720398.0000000000: -6354639917585771722 vs -1026340623352887034
		fingerprints did not match at 1664000018771520099.2147483647: -6354639917585771722 vs -1026340623352887034
		fingerprints did not match at 1664000018771520100.0000000000: -2013728773566020 vs -3149996315619875853
		fingerprints did not match at 1664000018871531884.2147483647: -2013728773566020 vs -3149996315619875853
		fingerprints did not match at 1664000018871531885.0000000000: 5219887851009666207 vs 7089658770518224542
		fingerprints did not match at 1664000018971498842.2147483647: 5219887851009666207 vs 7089658770518224542

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 492c3c88c3d3ce46ccf835dbf4e85f33293b8ab4:

		fingerprints did not match at 1664172859142426212.2147483647: -5504122105430115108 vs -6938626673724847177
		fingerprints did not match at 1664172859142426213.0000000000: 5596921088790281501 vs -6268863605598542629
		fingerprints did not match at 1664172859242189838.2147483647: 5596921088790281501 vs -6268863605598542629
		fingerprints did not match at 1664172859242189839.0000000000: -4534180154201858110 vs 4337507150695460450
		fingerprints did not match at 1664172859341843193.2147483647: -4534180154201858110 vs 4337507150695460450
		fingerprints did not match at 1664172859341843194.0000000000: 5953914986731972728 vs -300574583327621445
		fingerprints did not match at 1664172860241910624.2147483647: 5284953782078420757 vs -300574583327621445
		fingerprints did not match at 1664172860241910625.0000000000: 1450909813359251334 vs -6054472895784290055
		fingerprints did not match at 1664172860341878540.2147483647: 1450909813359251334 vs -6054472895784290055
		fingerprints did not match at 1664172860341878541.0000000000: 583589532243642920 vs -8602147153929022241
		fingerprints did not match at 1664172860442299199.2147483647: 583589532243642920 vs -8602147153929022241
		fingerprints did not match at 1664172860442299200.0000000000: -71035702248901932 vs -6282454251916727236
		fingerprints did not match at 1664172860542175796.2147483647: -71035702248901932 vs -6282454251916727236
		fingerprints did not match at 1664172860542175797.0000000000: -1340635877996899893 vs 6886764399351665924
		fingerprints did not match at 1664172860641682387.2147483647: -1340635877996899893 vs 6886764399351665924
		fingerprints did not match at 1664172860641682388.0000000000: 3541606921596067522 vs -5317863480272223890
		fingerprints did not match at 1664172860742574329.2147483647: 3541606921596067522 vs -5317863480272223890

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 1f718803f084451c1b061db5a69bfc62feb1c457:

		fingerprints did not match at 1664259305352814369.2147483647: -4327442118895736506 vs -8667351308283557320
		fingerprints did not match at 1664259305352814370.0000000000: -4739565189912597938 vs -396570581615916752
		fingerprints did not match at 1664259305452393404.2147483647: -4739565189912597938 vs -396570581615916752
		fingerprints did not match at 1664259305452393405.0000000000: -5504122105430115108 vs -586636038874832990
		fingerprints did not match at 1664259305552895427.2147483647: -5504122105430115108 vs -586636038874832990
		fingerprints did not match at 1664259305552895428.0000000000: 5596921088790281501 vs 714653599743254115
		fingerprints did not match at 1664259305653134209.2147483647: 5596921088790281501 vs 714653599743254115
		fingerprints did not match at 1664259305653134210.0000000000: -4534180154201858110 vs -8838898563410412356
		fingerprints did not match at 1664259305753150665.2147483647: -4534180154201858110 vs -8838898563410412356
		fingerprints did not match at 1664259305753150666.0000000000: 5953914986731972728 vs 1650069640959920902
		fingerprints did not match at 1664259305852508818.2147483647: 5953914986731972728 vs 1650069640959920902
		fingerprints did not match at 1664259305852508819.0000000000: -6354639917585771722 vs -8071615039620013571
		fingerprints did not match at 1664259305953270169.2147483647: -6354639917585771722 vs -8071615039620013571
		fingerprints did not match at 1664259305953270170.0000000000: -2013728773566020 vs -989226886339016318
		fingerprints did not match at 1664259306052790544.2147483647: -2013728773566020 vs -989226886339016318
		fingerprints did not match at 1664259306052790545.0000000000: 5219887851009666207 vs -871759193852462644
		fingerprints did not match at 1664259306153132655.2147483647: 5219887851009666207 vs -871759193852462644

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 08974d4b0433a14aa83251a44df9659eb8e3ae65:

		fingerprints did not match at 1664346192339647048.0000000000: 3740463823534177074 vs -9221746241482082607
		fingerprints did not match at 1664346194838916255.2147483647: 6161878118411065800 vs -9221746241482082607
		fingerprints did not match at 1664346194838916256.0000000000: 855834099328480735 vs 6888220154257565494
		fingerprints did not match at 1664346194939243524.2147483647: 855834099328480735 vs 6888220154257565494
		fingerprints did not match at 1664346194939243525.0000000000: 2939112991847632371 vs 7578653316171142525
		fingerprints did not match at 1664346195039510124.2147483647: 2939112991847632371 vs 7578653316171142525
		fingerprints did not match at 1664346195039510125.0000000000: 668858312347791617 vs 8225930354851380347
		fingerprints did not match at 1664346195139581409.2147483647: 668858312347791617 vs 8225930354851380347
		fingerprints did not match at 1664346195139581410.0000000000: -900406835276628589 vs -7665413937619783920
		fingerprints did not match at 1664346195239320972.2147483647: -900406835276628589 vs -7665413937619783920
		fingerprints did not match at 1664346195239320973.0000000000: -2712924288220854032 vs -435453120627489142
		fingerprints did not match at 1664346195339003743.2147483647: -2712924288220854032 vs -435453120627489142
		fingerprints did not match at 1664346195339003744.0000000000: -2890233738110834184 vs -2433004075599473600
		fingerprints did not match at 1664346195439510322.2147483647: -2890233738110834184 vs -2433004075599473600
		fingerprints did not match at 1664346195439510323.0000000000: 1484683201837581021 vs 543466459152004536
		fingerprints did not match at 1664346195539310449.2147483647: 1484683201837581021 vs 543466459152004536
		fingerprints did not match at 1664346195539310450.0000000000: 5678159814141781108 vs -6807638474598728186

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 860584a59dee73d7a66ce882c668cef6eb2556f7:

		fingerprints did not match at 1664432200529120075.2147483647: 813995478687224060 vs 8180783645800195532
		fingerprints did not match at 1664432200529120076.0000000000: 1748804359933575320 vs 7100241189985400232
		fingerprints did not match at 1664432200628887780.2147483647: 1748804359933575320 vs 7100241189985400232
		fingerprints did not match at 1664432200628887781.0000000000: 328497207466154500 vs -4609250915920502748
		fingerprints did not match at 1664432200729176089.2147483647: 328497207466154500 vs -4609250915920502748
		fingerprints did not match at 1664432200729176090.0000000000: 2546238083038536302 vs 7431102100830889
		fingerprints did not match at 1664432200829099697.2147483647: 2546238083038536302 vs 7431102100830889
		fingerprints did not match at 1664432200829099698.0000000000: -2211126991146367702 vs 2638217491127805533
		fingerprints did not match at 1664432200928821697.2147483647: -2211126991146367702 vs 2638217491127805533
		fingerprints did not match at 1664432200928821698.0000000000: -6827121554090250642 vs 4784099433922282353
		fingerprints did not match at 1664432201029089560.2147483647: -6827121554090250642 vs 4784099433922282353
		fingerprints did not match at 1664432201029089561.0000000000: -3693992842927796500 vs -3858025877389720879
		fingerprints did not match at 1664432201129272438.2147483647: -3693992842927796500 vs -3858025877389720879
		fingerprints did not match at 1664432201129272439.0000000000: -713795152892595612 vs -1918882296426700705
		fingerprints did not match at 1664432201228788934.2147483647: -713795152892595612 vs -1918882296426700705
		fingerprints did not match at 1664432201228788935.0000000000: -1685739414245521954 vs 5679789485870937345
		fingerprints did not match at 1664432201329191759.2147483647: -1685739414245521954 vs 5679789485870937345

	cluster.go:1940,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:908: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1957
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1938
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:908
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 600df9f5c387a07fd9b4ba5e54f8b8240645176f:

		fingerprints did not match at 1664604888433619835.0000000000: -4239418400742319003 vs -1461863932213069000
		fingerprints did not match at 1664604890134198908.2147483647: -5529341206820454671 vs -1461863932213069000
		fingerprints did not match at 1664604890134198909.0000000000: 6157093536183077516 vs -1686836063933282497
		fingerprints did not match at 1664604890233922306.2147483647: 6157093536183077516 vs -1686836063933282497
		fingerprints did not match at 1664604890233922307.0000000000: -2038405608268677929 vs 3964090952311223852
		fingerprints did not match at 1664604890334187806.2147483647: -2038405608268677929 vs 3964090952311223852
		fingerprints did not match at 1664604890334187807.0000000000: 2678199378722670667 vs -1397626857443949550
		fingerprints did not match at 1664604890433608241.2147483647: 2678199378722670667 vs -1397626857443949550
		fingerprints did not match at 1664604890433608242.0000000000: -3963971527344539867 vs -2067071093161848209
		fingerprints did not match at 1664604890533567816.2147483647: -3963971527344539867 vs -2067071093161848209
		fingerprints did not match at 1664604890533567817.0000000000: -6237968835159868134 vs -8430157839997060464
		fingerprints did not match at 1664604890634115945.2147483647: -6237968835159868134 vs -8430157839997060464
		fingerprints did not match at 1664604890634115946.0000000000: 2509658337070443388 vs -2480822842404706321
		fingerprints did not match at 1664604890734453559.2147483647: 2509658337070443388 vs -2480822842404706321
		fingerprints did not match at 1664604890734453560.0000000000: -5562716876130955509 vs -1104849887044430602
		fingerprints did not match at 1664604890833883833.2147483647: -5562716876130955509 vs -1104849887044430602
		fingerprints did not match at 1664604890833883834.0000000000: -254706112014795493 vs 8495977114400039838

	cluster.go:1977,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:930: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1994
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1975
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:930
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 36e4cb1677e055e67fa3cfdce81dea18cf10df33:

		fingerprints did not match at 1664691226717473747.0000000000: 6041867303931095263 vs 3712274589503053897
		fingerprints did not match at 1664691227617029878.2147483647: 3557925160385525612 vs 3712274589503053897
		fingerprints did not match at 1664691227617029879.0000000000: 1262264668828303956 vs 1396286310870963569
		fingerprints did not match at 1664691227717147317.2147483647: 1262264668828303956 vs 1396286310870963569
		fingerprints did not match at 1664691227717147318.0000000000: -8688739974076997691 vs -8822682509866530592
		fingerprints did not match at 1664691227816852128.2147483647: -8688739974076997691 vs -8822682509866530592
		fingerprints did not match at 1664691227816852129.0000000000: -4614394126629028433 vs -4822637244003292534
		fingerprints did not match at 1664691227917530759.2147483647: -4614394126629028433 vs -4822637244003292534
		fingerprints did not match at 1664691227917530760.0000000000: -3363634691231629673 vs -3191622672429028942
		fingerprints did not match at 1664691228017615370.2147483647: -3363634691231629673 vs -3191622672429028942
		fingerprints did not match at 1664691228017615371.0000000000: 2281251363869082383 vs 2111148088595256362
		fingerprints did not match at 1664691228117653253.2147483647: 2281251363869082383 vs 2111148088595256362
		fingerprints did not match at 1664691228117653254.0000000000: -4480665012254053975 vs -4380429113581715828
		fingerprints did not match at 1664691228216914370.2147483647: -4480665012254053975 vs -4380429113581715828
		fingerprints did not match at 1664691228216914371.0000000000: 6030768765329030790 vs 5860718284324268451
		fingerprints did not match at 1664691228317622341.2147483647: 6030768765329030790 vs 5860718284324268451
		fingerprints did not match at 1664691228317622342.0000000000: -5194059977877580309 vs -5400359115741117746

	cluster.go:1977,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:930: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1994
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1975
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:930
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 36e4cb1677e055e67fa3cfdce81dea18cf10df33:

		fingerprints did not match at 1664777694597653648.0000000000: 6041867303931095263 vs 4687451091051984057
		fingerprints did not match at 1664777695497152272.2147483647: 3557925160385525612 vs 4687451091051984057
		fingerprints did not match at 1664777695497152273.0000000000: 1262264668828303956 vs 158283585591892182
		fingerprints did not match at 1664777695597773053.2147483647: 1262264668828303956 vs 158283585591892182
		fingerprints did not match at 1664777695597773054.0000000000: -8688739974076997691 vs 7225937886568826420
		fingerprints did not match at 1664777695697330243.2147483647: -8688739974076997691 vs 7225937886568826420
		fingerprints did not match at 1664777695697330244.0000000000: -4614394126629028433 vs 8542639229162225607
		fingerprints did not match at 1664777695797199783.2147483647: -4614394126629028433 vs 8542639229162225607
		fingerprints did not match at 1664777695797199784.0000000000: -3363634691231629673 vs -4934160151585678219
		fingerprints did not match at 1664777695897919838.2147483647: -3363634691231629673 vs -4934160151585678219
		fingerprints did not match at 1664777695897919839.0000000000: 2281251363869082383 vs -3768068447325742655
		fingerprints did not match at 1664777695997031655.2147483647: 2281251363869082383 vs -3768068447325742655
		fingerprints did not match at 1664777695997031656.0000000000: -4480665012254053975 vs 2135052795386484988
		fingerprints did not match at 1664777696097338740.2147483647: -4480665012254053975 vs 2135052795386484988
		fingerprints did not match at 1664777696097338741.0000000000: 6030768765329030790 vs 6612423729475711919
		fingerprints did not match at 1664777696197152827.2147483647: 6030768765329030790 vs 6612423729475711919
		fingerprints did not match at 1664777696197152828.0000000000: -5194059977877580309 vs -5400359115741117746

	cluster.go:1977,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:930: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1994
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1975
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:930
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ c8e834ea52234d65b530beda7877a50dee7a3d2a:

		fingerprints did not match at 1664864083413893288.2147483647: -5562716876130955509 vs -6145480331062555468
		fingerprints did not match at 1664864083413893289.0000000000: -254706112014795493 vs -2014087150768374108
		fingerprints did not match at 1664864083514613533.2147483647: -254706112014795493 vs -2014087150768374108
		fingerprints did not match at 1664864083514613534.0000000000: 7066323282439273684 vs -2754524781837465882
		fingerprints did not match at 1664864083614158952.2147483647: 7066323282439273684 vs -2754524781837465882
		fingerprints did not match at 1664864083614158953.0000000000: -6916236375604006530 vs -7013085087807310429
		fingerprints did not match at 1664864083714902564.2147483647: -6916236375604006530 vs -7013085087807310429
		fingerprints did not match at 1664864083714902565.0000000000: 3999707760843721962 vs -3774323251296847183
		fingerprints did not match at 1664864083814572340.2147483647: 3999707760843721962 vs -3774323251296847183
		fingerprints did not match at 1664864083814572341.0000000000: 5107952655738488672 vs 2359965586378033454
		fingerprints did not match at 1664864083913941299.2147483647: 5107952655738488672 vs 2359965586378033454
		fingerprints did not match at 1664864083913941300.0000000000: 1524765628433356464 vs 4956682186235188415
		fingerprints did not match at 1664864084014656589.2147483647: 1524765628433356464 vs 4956682186235188415
		fingerprints did not match at 1664864084014656590.0000000000: 6474381745540279503 vs 5268673039942055918
		fingerprints did not match at 1664864084114392763.2147483647: 6474381745540279503 vs 5268673039942055918
		fingerprints did not match at 1664864084114392764.0000000000: 8495977114400039838 vs -3390666572621247458
		fingerprints did not match at 1664864084213923085.2147483647: 8495977114400039838 vs -3390666572621247458

	cluster.go:1977,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:930: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1994
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1975
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:930
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 18da6141d87f76c04f74ad6f9685fa619b97738a:

		fingerprints did not match at 1664950620779887611.0000000000: -4815635210481034869 vs -7890515708225038336
		fingerprints did not match at 1664950620880620822.2147483647: -4815635210481034869 vs -7890515708225038336
		fingerprints did not match at 1664950620880620823.0000000000: 986111504673410225 vs -3514775489621327583
		fingerprints did not match at 1664950620980548162.2147483647: 986111504673410225 vs -3514775489621327583
		fingerprints did not match at 1664950620980548163.0000000000: -6127506639742499737 vs 1027533174817436418
		fingerprints did not match at 1664950621080107191.2147483647: -6127506639742499737 vs 1027533174817436418
		fingerprints did not match at 1664950621080107192.0000000000: 5704159374101350257 vs 7528223403185258928
		fingerprints did not match at 1664950621180163131.2147483647: 5704159374101350257 vs 7528223403185258928
		fingerprints did not match at 1664950621180163132.0000000000: 1691810840837606227 vs -9193818132253118390
		fingerprints did not match at 1664950621280598210.2147483647: 1691810840837606227 vs -9193818132253118390
		fingerprints did not match at 1664950621280598211.0000000000: -460428798080952546 vs 3041413037895599468
		fingerprints did not match at 1664950621380469135.2147483647: -460428798080952546 vs 3041413037895599468
		fingerprints did not match at 1664950621380469136.0000000000: 7356736747141904299 vs 8700302988107110612
		fingerprints did not match at 1664950621480206599.2147483647: 7356736747141904299 vs 8700302988107110612
		fingerprints did not match at 1664950621480206600.0000000000: 6296788248995041721 vs 8127255116520396343
		fingerprints did not match at 1664950621580499646.2147483647: 6296788248995041721 vs 8127255116520396343
		fingerprints did not match at 1664950621580499647.0000000000: -7193529376367807878 vs -7890515708225038336

	cluster.go:1977,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:930: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1994
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1975
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:930
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2 @ 64049e4b9210de3af4a1d814a9af0123b59a055f:

test artifacts and logs in: /artifacts/cdc/mixed-versions/run_1
	test_runner.go:1061,test_runner.go:960: test timed out (30m0s)

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@renatolabs
Copy link
Contributor

Fixed by #89535.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
branch-release-22.2 Used to mark GA and release blockers, technical advisories, and bugs for 22.2 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot.
Projects
None yet
Development

No branches or pull requests

2 participants