Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

roachtest: cdc/mixed-versions failed #89365

Closed
cockroach-teamcity opened this issue Oct 5, 2022 · 3 comments
Closed

roachtest: cdc/mixed-versions failed #89365

cockroach-teamcity opened this issue Oct 5, 2022 · 3 comments
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-testeng TestEng Team
Milestone
22.2

Comments

@cockroach-teamcity
Copy link
Member

cockroach-teamcity commented Oct 5, 2022 •
edited by cockroach-jira-scripts
Loading

roachtest.cdc/mixed-versions failed with artifacts on release-22.2.0 @ 9bb8a7faf624dcd23ce60e2a8a805ef863b10f72:

		fingerprints did not match at 1664951207468882443.0000000000: 5212659281798687439 vs 7402074325015538381
		fingerprints did not match at 1664951212368533590.2147483647: -6112538512033142964 vs 7402074325015538381
		fingerprints did not match at 1664951212368533591.0000000000: 4358652593210960515 vs 3278410918921870244
		fingerprints did not match at 1664951212468446169.2147483647: 4358652593210960515 vs 3278410918921870244
		fingerprints did not match at 1664951212468446170.0000000000: 4321188847073703832 vs 7895227375448708307
		fingerprints did not match at 1664951212568070651.2147483647: 4321188847073703832 vs 7895227375448708307
		fingerprints did not match at 1664951212568070652.0000000000: -2751476174379880534 vs 3726409902188097001
		fingerprints did not match at 1664951212668732590.2147483647: -2751476174379880534 vs 3726409902188097001
		fingerprints did not match at 1664951212668732591.0000000000: 8775182127932281077 vs -1209358623441129455
		fingerprints did not match at 1664951212768649086.2147483647: 8775182127932281077 vs -1209358623441129455
		fingerprints did not match at 1664951212768649087.0000000000: 561611299580842312 vs 5730296702046121000
		fingerprints did not match at 1664951212867764637.2147483647: 561611299580842312 vs 5730296702046121000
		fingerprints did not match at 1664951212867764638.0000000000: 2829157773592028405 vs -9154182476112178362
		fingerprints did not match at 1664951212968640304.2147483647: 2829157773592028405 vs -9154182476112178362
		fingerprints did not match at 1664951212968640305.0000000000: -7211264684033238642 vs 8113245320718480385
		fingerprints did not match at 1664951213068133255.2147483647: -7211264684033238642 vs 8113245320718480385
		fingerprints did not match at 1664951213068133256.0000000000: 5650243023344413630 vs 7402074325015538381

	cluster.go:1977,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:930: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1994
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1975
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:930
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-20229
@cockroach-teamcity cockroach-teamcity added branch-release-22.2.0 C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. labels Oct 5, 2022
@cockroach-teamcity cockroach-teamcity added this to the 22.2 milestone Oct 5, 2022
@blathers-crl blathers-crl bot added the T-testeng TestEng Team label Oct 5, 2022
@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2.0 @ aa794afea629fcbe0210c9a9b32303320cff7e48:

		fingerprints did not match at 1665123233664378024.2147483647: -6936336332825746162 vs -1964470347799685272
		fingerprints did not match at 1665123233664378025.0000000000: 1409761268530863826 vs 7534970901624220852
		fingerprints did not match at 1665123233764530728.2147483647: 1409761268530863826 vs 7534970901624220852
		fingerprints did not match at 1665123233764530729.0000000000: 4869156571652056015 vs 4282007582466377223
		fingerprints did not match at 1665123233864432965.2147483647: 4869156571652056015 vs 4282007582466377223
		fingerprints did not match at 1665123233864432966.0000000000: -9147261054238506853 vs -4430413990010731123
		fingerprints did not match at 1665123233963993437.2147483647: -9147261054238506853 vs -4430413990010731123
		fingerprints did not match at 1665123233963993438.0000000000: -7936440079256142921 vs -3955168599439907068
		fingerprints did not match at 1665123234063997280.2147483647: -7936440079256142921 vs -3955168599439907068
		fingerprints did not match at 1665123234063997281.0000000000: -3462726794276188825 vs -548358993193430793
		fingerprints did not match at 1665123234163850351.2147483647: -3462726794276188825 vs -548358993193430793
		fingerprints did not match at 1665123234163850352.0000000000: -7259789532578113597 vs 6782750420211515394
		fingerprints did not match at 1665123234263975588.2147483647: -7259789532578113597 vs 6782750420211515394
		fingerprints did not match at 1665123234263975589.0000000000: -4670772747091317773 vs -3970712325312376575
		fingerprints did not match at 1665123234364481369.2147483647: -4670772747091317773 vs -3970712325312376575
		fingerprints did not match at 1665123234364481370.0000000000: -7763292159935404365 vs -5182296994150468885
		fingerprints did not match at 1665123234464314026.2147483647: -7763292159935404365 vs -5182296994150468885

	cluster.go:1977,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:930: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1994
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1975
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:930
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@cockroach-teamcity cockroach-teamcity mentioned this issue Oct 8, 2022
Closed
@cockroach-teamcity
Copy link
Member Author

roachtest.cdc/mixed-versions failed with artifacts on release-22.2.0 @ 776e9f889dec6fec9b4011e82c523c648b72254e:

		fingerprints did not match at 1665383082990301175.0000000000: -470813426613393680 vs -5956441904659062343
		fingerprints did not match at 1665383083890482327.2147483647: -4458922585719064465 vs -5956441904659062343
		fingerprints did not match at 1665383083890482328.0000000000: 7515892337342156331 vs 2730196400959856468
		fingerprints did not match at 1665383083990946415.2147483647: 7515892337342156331 vs 2730196400959856468
		fingerprints did not match at 1665383083990946416.0000000000: 2777717203750902991 vs -1283771828994213949
		fingerprints did not match at 1665383084090998063.2147483647: 2777717203750902991 vs -1283771828994213949
		fingerprints did not match at 1665383084090998064.0000000000: 4784647829079451446 vs -8485924352990945760
		fingerprints did not match at 1665383084190528373.2147483647: 4784647829079451446 vs -8485924352990945760
		fingerprints did not match at 1665383084190528374.0000000000: -683860787519288773 vs -8287934871422282551
		fingerprints did not match at 1665383084290958593.2147483647: -683860787519288773 vs -8287934871422282551
		fingerprints did not match at 1665383084290958594.0000000000: -3695669643939366348 vs 1053762480119315147
		fingerprints did not match at 1665383084390765447.2147483647: -3695669643939366348 vs 1053762480119315147
		fingerprints did not match at 1665383084390765448.0000000000: -7051485899023836963 vs 1484812399075628689
		fingerprints did not match at 1665383084491277851.2147483647: -7051485899023836963 vs 1484812399075628689
		fingerprints did not match at 1665383084491277852.0000000000: 3611704405121637411 vs 7045460085217381613
		fingerprints did not match at 1665383084590828911.2147483647: 3611704405121637411 vs 7045460085217381613
		fingerprints did not match at 1665383084590828912.0000000000: -8344425071249348892 vs -7507136734267882065

	cluster.go:1977,cdc.go:1472,cdc.go:1906,mixed_version_cdc.go:114,panic.go:884,test_impl.go:265,mixed_version_cdc.go:252,versionupgrade.go:197,mixed_version_cdc.go:337,mixed_version_cdc.go:58,test_runner.go:930: cluster.RunE: context canceled
		(1) attached stack trace
		  -- stack trace:
		  | main.(*clusterImpl).RunE
		  | 	main/pkg/cmd/roachtest/cluster.go:1994
		  | main.(*clusterImpl).Run
		  | 	main/pkg/cmd/roachtest/cluster.go:1975
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.kafkaManager.stop
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1472
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.setupKafka.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/cdc.go:1906
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).Cleanup
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:114
		  | runtime.gopanic
		  | 	GOROOT/src/runtime/panic.go:884
		  | main.(*testImpl).Fatalf
		  | 	main/pkg/cmd/roachtest/test_impl.go:265
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*cdcMixedVersionTester).assertValid.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:252
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.(*versionUpgradeTest).run
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/versionupgrade.go:197
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runCDCMixedVersions
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:337
		  | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerCDCMixedVersions.func1
		  | 	github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/mixed_version_cdc.go:58
		  | main.(*testRunner).runTest.func2
		  | 	main/pkg/cmd/roachtest/test_runner.go:930
		  | runtime.goexit
		  | 	GOROOT/src/runtime/asm_amd64.s:1594
		Wraps: (2) cluster.RunE
		Wraps: (3) context canceled
		Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *errors.errorString

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_ssd=0

Help

See: roachtest README

See: How To Investigate (internal)

Same failure on other branches

This test on roachdash | Improve this report!

@srosenberg
Copy link
Member

should be resolved after the backport is merged: #89536

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
C-test-failure Broken test (automatically or manually discovered). O-roachtest O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-testeng TestEng Team
Projects
None yet
Milestone
22.2
Development

No branches or pull requests
2 participants
@srosenberg @cockroach-teamcity