Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature](cooldown)backup cooldown data #45587

Conversation

justfortaste
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Dec 18, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@justfortaste
Copy link
Contributor Author

run buildall

@justfortaste justfortaste force-pushed the backup_cooldown_data_master_squash branch from 795d9a6 to 60b9dc2 Compare December 18, 2024 07:47
@justfortaste justfortaste changed the base branch from master to auto-pick-44768-branch-2.1 December 18, 2024 07:48
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@justfortaste justfortaste changed the base branch from auto-pick-44768-branch-2.1 to master December 18, 2024 07:50
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.86% (10132/26071)
Line Coverage: 29.78% (85181/286014)
Region Coverage: 28.82% (43680/151550)
Branch Coverage: 25.36% (22192/87492)
Coverage Report: http://coverage.selectdb-in.cc/coverage/795d9a6a2d1ea62c5831d3527f89e3a3e81fdedb_795d9a6a2d1ea62c5831d3527f89e3a3e81fdedb/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39792 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 795d9a6a2d1ea62c5831d3527f89e3a3e81fdedb, data reload: false

------ Round 1 ----------------------------------
q1	17713	7434	7296	7296
q2	2066	180	178	178
q3	10651	1062	1179	1062
q4	10545	683	780	683
q5	7621	2655	2689	2655
q6	236	149	148	148
q7	1005	655	612	612
q8	9255	1837	1926	1837
q9	6637	6390	6423	6390
q10	6997	2310	2301	2301
q11	478	259	245	245
q12	425	214	220	214
q13	17791	2869	2893	2869
q14	247	207	214	207
q15	557	497	493	493
q16	666	576	601	576
q17	986	546	515	515
q18	7450	6768	6777	6768
q19	1340	1035	1060	1035
q20	454	177	174	174
q21	4081	3276	3230	3230
q22	362	312	304	304
Total cold run time: 107563 ms
Total hot run time: 39792 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7256	7195	7161	7161
q2	324	223	226	223
q3	2912	2834	2919	2834
q4	2061	1862	1830	1830
q5	5668	5659	5621	5621
q6	231	144	148	144
q7	2277	1844	1761	1761
q8	3431	3558	3501	3501
q9	8835	9024	8985	8985
q10	3634	3582	3527	3527
q11	606	513	500	500
q12	855	606	600	600
q13	10793	3200	3021	3021
q14	300	276	282	276
q15	573	510	502	502
q16	676	643	642	642
q17	1857	1641	1602	1602
q18	8359	7707	7772	7707
q19	1733	1573	1527	1527
q20	2137	1857	1876	1857
q21	5714	5495	5468	5468
q22	682	584	585	584
Total cold run time: 70914 ms
Total hot run time: 59873 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195661 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 795d9a6a2d1ea62c5831d3527f89e3a3e81fdedb, data reload: false

query1	1330	969	985	969
query2	6250	2509	2368	2368
query3	11060	4911	5039	4911
query4	33106	23332	23180	23180
query5	4240	466	471	466
query6	303	192	193	192
query7	3984	306	308	306
query8	309	238	231	231
query9	9758	2739	2721	2721
query10	434	254	243	243
query11	17842	14981	15081	14981
query12	164	101	99	99
query13	1584	445	437	437
query14	9455	6807	7229	6807
query15	265	202	196	196
query16	8168	446	464	446
query17	1629	621	578	578
query18	1935	295	305	295
query19	381	155	156	155
query20	124	114	113	113
query21	207	111	109	109
query22	4883	4386	4431	4386
query23	34440	33678	33600	33600
query24	10883	2490	2587	2490
query25	582	409	411	409
query26	719	153	153	153
query27	2099	329	370	329
query28	6892	2494	2488	2488
query29	732	413	429	413
query30	254	156	145	145
query31	1031	840	820	820
query32	95	58	54	54
query33	697	307	296	296
query34	944	528	521	521
query35	893	762	761	761
query36	1132	953	936	936
query37	126	74	71	71
query38	4315	4155	4223	4155
query39	1504	1517	1455	1455
query40	201	103	95	95
query41	43	43	42	42
query42	116	108	101	101
query43	542	526	482	482
query44	1218	835	835	835
query45	192	193	169	169
query46	1177	751	758	751
query47	2011	1943	1962	1943
query48	424	318	333	318
query49	935	384	382	382
query50	815	398	390	390
query51	7348	7241	7163	7163
query52	100	95	89	89
query53	257	181	183	181
query54	1145	406	426	406
query55	82	84	79	79
query56	261	244	246	244
query57	1269	1150	1178	1150
query58	233	232	226	226
query59	3365	3307	3106	3106
query60	281	247	251	247
query61	115	107	110	107
query62	865	669	655	655
query63	216	198	190	190
query64	3600	669	635	635
query65	3259	3198	3205	3198
query66	728	292	287	287
query67	15778	15448	15496	15448
query68	5895	553	542	542
query69	501	263	244	244
query70	1169	1052	1024	1024
query71	504	248	243	243
query72	6988	4185	4078	4078
query73	801	355	356	355
query74	9972	8841	8853	8841
query75	3884	2615	2669	2615
query76	4590	1087	1118	1087
query77	658	275	275	275
query78	10692	9470	9339	9339
query79	2024	607	609	607
query80	976	411	436	411
query81	506	236	224	224
query82	388	117	117	117
query83	185	144	156	144
query84	286	65	66	65
query85	981	299	293	293
query86	372	290	290	290
query87	4655	4552	4298	4298
query88	4152	2213	2188	2188
query89	442	288	282	282
query90	2145	191	189	189
query91	141	105	106	105
query92	64	51	50	50
query93	4071	551	543	543
query94	891	281	290	281
query95	393	247	247	247
query96	650	288	279	279
query97	2871	2693	2679	2679
query98	221	208	204	204
query99	1575	1318	1324	1318
Total cold run time: 304968 ms
Total hot run time: 195661 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.29 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 795d9a6a2d1ea62c5831d3527f89e3a3e81fdedb, data reload: false

query1	0.04	0.03	0.03
query2	0.09	0.05	0.04
query3	0.23	0.05	0.06
query4	1.66	0.07	0.08
query5	0.42	0.40	0.41
query6	1.17	0.66	0.66
query7	0.02	0.02	0.02
query8	0.06	0.05	0.04
query9	0.55	0.50	0.49
query10	0.54	0.57	0.56
query11	0.16	0.12	0.12
query12	0.16	0.13	0.13
query13	0.61	0.60	0.60
query14	2.84	2.69	2.76
query15	0.91	0.83	0.83
query16	0.37	0.39	0.38
query17	1.00	1.04	1.06
query18	0.19	0.18	0.18
query19	1.96	1.90	2.04
query20	0.02	0.01	0.02
query21	15.36	0.67	0.66
query22	4.44	7.38	1.82
query23	18.26	1.35	1.40
query24	2.13	0.22	0.22
query25	0.15	0.08	0.09
query26	0.26	0.18	0.18
query27	0.08	0.08	0.08
query28	13.27	1.16	1.16
query29	12.65	3.39	3.35
query30	0.24	0.05	0.06
query31	2.87	0.40	0.41
query32	3.24	0.48	0.47
query33	3.12	3.15	3.14
query34	16.69	4.51	4.48
query35	4.64	4.52	4.57
query36	0.66	0.47	0.47
query37	0.21	0.17	0.16
query38	0.15	0.15	0.14
query39	0.06	0.04	0.04
query40	0.17	0.13	0.13
query41	0.09	0.06	0.05
query42	0.07	0.06	0.06
query43	0.05	0.06	0.04
Total cold run time: 111.86 s
Total hot run time: 33.29 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants