Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improvement](create table) add backend details to creating table failed msg #41463

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

yujun777
Copy link
Collaborator

No description provided.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@yujun777
Copy link
Collaborator Author

run buildall

@yujun777 yujun777 changed the title [improvement](create table) add backend details for creating table failed [improvement](create table) add backend details to creating table failed msg Sep 29, 2024
Copy link
Contributor

@deardeng deardeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 40653 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ef863648b68a2e363b9d2aac36fedd8d6f85298c, data reload: false

------ Round 1 ----------------------------------
q1	17704	7317	7203	7203
q2	2009	284	274	274
q3	11999	1035	1146	1035
q4	10567	756	787	756
q5	7745	2861	2745	2745
q6	240	151	151	151
q7	1015	635	626	626
q8	9377	1938	2003	1938
q9	7391	6404	6381	6381
q10	6990	2305	2347	2305
q11	439	247	248	247
q12	417	222	213	213
q13	17780	2990	2976	2976
q14	237	201	215	201
q15	570	522	527	522
q16	668	578	578	578
q17	963	570	489	489
q18	7135	6598	6795	6598
q19	1347	999	944	944
q20	486	204	193	193
q21	3993	3357	3294	3294
q22	1123	984	985	984
Total cold run time: 110195 ms
Total hot run time: 40653 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7225	7190	7224	7190
q2	329	230	222	222
q3	3010	2917	2976	2917
q4	2145	1906	1914	1906
q5	5737	5714	5717	5714
q6	237	151	143	143
q7	2290	1862	1793	1793
q8	3378	3528	3432	3432
q9	8840	8859	8805	8805
q10	3564	3559	3530	3530
q11	583	494	496	494
q12	862	637	620	620
q13	10300	3187	3225	3187
q14	307	275	280	275
q15	579	529	531	529
q16	685	638	643	638
q17	1842	1649	1593	1593
q18	8244	7806	7469	7469
q19	1733	1408	1479	1408
q20	2111	1882	1886	1882
q21	5557	5408	5417	5408
q22	1126	1047	1065	1047
Total cold run time: 70684 ms
Total hot run time: 60202 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191401 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ef863648b68a2e363b9d2aac36fedd8d6f85298c, data reload: false

query1	899	394	413	394
query2	6268	2068	1961	1961
query3	8687	194	202	194
query4	33245	23564	23616	23564
query5	3500	481	474	474
query6	282	172	188	172
query7	4209	308	305	305
query8	291	225	227	225
query9	9684	2638	2652	2638
query10	437	280	267	267
query11	17890	15119	15293	15119
query12	156	114	99	99
query13	1577	456	428	428
query14	9593	7173	7213	7173
query15	244	164	178	164
query16	7659	422	469	422
query17	1601	610	584	584
query18	1551	319	307	307
query19	242	156	155	155
query20	118	111	113	111
query21	212	106	110	106
query22	4764	4431	4463	4431
query23	35159	34320	34268	34268
query24	11080	2874	2822	2822
query25	628	424	406	406
query26	1317	162	170	162
query27	2486	304	300	300
query28	7212	2403	2390	2390
query29	870	437	431	431
query30	257	147	150	147
query31	1040	807	810	807
query32	96	53	59	53
query33	762	300	299	299
query34	919	507	514	507
query35	910	751	718	718
query36	1114	939	971	939
query37	152	88	87	87
query38	3975	3857	3860	3857
query39	1524	1428	1392	1392
query40	264	97	98	97
query41	50	44	44	44
query42	111	96	96	96
query43	534	485	482	482
query44	1199	810	806	806
query45	199	168	167	167
query46	1150	720	746	720
query47	1938	1810	1831	1810
query48	433	354	357	354
query49	975	378	387	378
query50	820	430	417	417
query51	7075	6858	7003	6858
query52	97	84	84	84
query53	252	179	178	178
query54	1321	459	470	459
query55	78	72	76	72
query56	273	253	256	253
query57	1237	1151	1161	1151
query58	231	275	246	246
query59	3142	2949	2854	2854
query60	288	271	266	266
query61	105	101	101	101
query62	895	670	674	670
query63	211	184	185	184
query64	5085	690	604	604
query65	3257	3238	3205	3205
query66	1304	306	310	306
query67	15699	15620	15537	15537
query68	3933	585	568	568
query69	431	292	300	292
query70	1145	1080	1115	1080
query71	349	271	277	271
query72	6881	3930	3975	3930
query73	756	335	353	335
query74	9878	8959	8977	8959
query75	3411	2707	2611	2611
query76	2557	824	912	824
query77	440	293	286	286
query78	10397	9592	9561	9561
query79	2265	584	581	581
query80	2199	473	452	452
query81	587	241	238	238
query82	726	138	146	138
query83	281	136	137	136
query84	267	82	73	73
query85	1289	300	286	286
query86	353	294	293	293
query87	4442	4304	4350	4304
query88	3798	2403	2386	2386
query89	410	292	291	291
query90	2114	189	186	186
query91	150	106	109	106
query92	67	49	51	49
query93	1154	530	538	530
query94	969	289	273	273
query95	353	247	252	247
query96	609	279	280	279
query97	3258	3128	3090	3090
query98	220	193	196	193
query99	1695	1276	1302	1276
Total cold run time: 298217 ms
Total hot run time: 191401 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.21 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ef863648b68a2e363b9d2aac36fedd8d6f85298c, data reload: false

query1	0.05	0.05	0.04
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.65	0.10	0.10
query5	0.50	0.51	0.51
query6	1.14	0.73	0.72
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.57	0.50	0.50
query10	0.55	0.58	0.54
query11	0.14	0.11	0.10
query12	0.14	0.11	0.10
query13	0.61	0.59	0.59
query14	2.79	2.84	2.72
query15	0.90	0.82	0.82
query16	0.40	0.39	0.38
query17	1.06	1.04	1.00
query18	0.20	0.19	0.18
query19	1.91	1.77	2.03
query20	0.02	0.01	0.01
query21	15.66	0.59	0.57
query22	2.62	1.89	1.66
query23	16.97	1.14	0.85
query24	3.18	1.43	0.86
query25	0.23	0.11	0.04
query26	0.49	0.13	0.14
query27	0.03	0.05	0.04
query28	10.49	1.09	1.07
query29	12.60	3.19	3.18
query30	0.25	0.06	0.06
query31	2.86	0.38	0.38
query32	3.28	0.46	0.45
query33	2.98	3.01	3.00
query34	16.88	4.48	4.47
query35	4.47	4.47	4.52
query36	0.67	0.50	0.49
query37	0.08	0.05	0.05
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.12	0.14
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 107.11 s
Total hot run time: 32.21 s

@yujun777
Copy link
Collaborator Author

run buildall

@yujun777
Copy link
Collaborator Author

run buildall

@yujun777
Copy link
Collaborator Author

run feut

1 similar comment
@yujun777
Copy link
Collaborator Author

run feut

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40969 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c3126726cecde743a3f1104669b67401a0a2c1ab, data reload: false

------ Round 1 ----------------------------------
q1	18241	7570	7404	7404
q2	2293	166	167	166
q3	11197	1181	1164	1164
q4	10810	779	775	775
q5	7824	2958	2859	2859
q6	242	153	155	153
q7	1003	654	624	624
q8	9566	1932	1935	1932
q9	6595	6386	6404	6386
q10	7002	2301	2307	2301
q11	456	258	254	254
q12	396	218	216	216
q13	17782	3011	2994	2994
q14	249	210	213	210
q15	563	535	511	511
q16	661	574	583	574
q17	974	613	509	509
q18	7250	6615	6776	6615
q19	1339	907	1009	907
q20	479	203	202	202
q21	4006	3212	3230	3212
q22	1083	1001	1003	1001
Total cold run time: 110011 ms
Total hot run time: 40969 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7281	7280	7275	7275
q2	319	238	223	223
q3	2906	2760	2758	2758
q4	1966	1696	1719	1696
q5	5383	5418	5432	5418
q6	229	142	149	142
q7	2155	1746	1697	1697
q8	3225	3409	3451	3409
q9	8536	8492	8509	8492
q10	3452	3428	3428	3428
q11	574	484	471	471
q12	775	583	575	575
q13	5104	3018	2973	2973
q14	299	277	262	262
q15	557	521	517	517
q16	665	645	628	628
q17	1800	1568	1549	1549
q18	7687	7451	7333	7333
q19	1652	1566	1429	1429
q20	2051	1830	1816	1816
q21	5475	5252	5195	5195
q22	1071	988	1008	988
Total cold run time: 63162 ms
Total hot run time: 58274 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190650 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c3126726cecde743a3f1104669b67401a0a2c1ab, data reload: false

query1	987	361	372	361
query2	6513	2048	1975	1975
query3	6700	215	223	215
query4	34163	23367	23385	23367
query5	4358	464	439	439
query6	265	165	159	159
query7	4618	303	317	303
query8	303	245	221	221
query9	9514	2647	2643	2643
query10	487	280	277	277
query11	18060	15186	15330	15186
query12	161	103	108	103
query13	1678	480	432	432
query14	10729	7330	6651	6651
query15	252	174	174	174
query16	8062	423	475	423
query17	1669	580	566	566
query18	2129	299	314	299
query19	371	143	152	143
query20	115	108	108	108
query21	221	102	105	102
query22	4479	4356	4241	4241
query23	36088	34360	34308	34308
query24	11205	2836	2841	2836
query25	562	404	446	404
query26	1055	166	164	164
query27	2816	298	294	294
query28	7980	2413	2429	2413
query29	675	443	435	435
query30	322	152	155	152
query31	1050	799	827	799
query32	95	58	58	58
query33	784	304	308	304
query34	934	523	513	513
query35	899	738	727	727
query36	1137	922	948	922
query37	142	97	85	85
query38	4043	3830	3926	3830
query39	1447	1435	1406	1406
query40	288	100	99	99
query41	48	48	44	44
query42	117	95	97	95
query43	524	484	478	478
query44	1310	815	795	795
query45	195	168	168	168
query46	1138	706	746	706
query47	1932	1830	1836	1830
query48	443	357	344	344
query49	1242	412	403	403
query50	802	421	428	421
query51	7101	6780	6828	6780
query52	105	93	85	85
query53	266	193	185	185
query54	1140	476	484	476
query55	78	75	78	75
query56	296	258	276	258
query57	1275	1164	1140	1140
query58	241	255	272	255
query59	3164	2853	3004	2853
query60	293	266	267	266
query61	108	104	103	103
query62	900	671	662	662
query63	227	185	184	184
query64	5255	644	609	609
query65	3310	3187	3200	3187
query66	1289	317	298	298
query67	15994	15536	15540	15536
query68	4774	563	544	544
query69	447	296	300	296
query70	1145	1144	1116	1116
query71	335	273	277	273
query72	6311	3991	3961	3961
query73	769	350	343	343
query74	10464	8900	9118	8900
query75	3448	2655	2663	2655
query76	2738	909	900	900
query77	471	290	290	290
query78	10679	9527	9467	9467
query79	2607	587	607	587
query80	1162	455	462	455
query81	588	243	245	243
query82	670	141	134	134
query83	214	137	141	137
query84	247	83	82	82
query85	1927	294	288	288
query86	507	301	282	282
query87	4678	4333	4338	4333
query88	3533	2430	2405	2405
query89	402	282	285	282
query90	2215	194	189	189
query91	144	108	105	105
query92	71	50	51	50
query93	1659	551	538	538
query94	1272	272	267	267
query95	353	256	258	256
query96	625	280	280	280
query97	3204	3143	3180	3143
query98	215	198	192	192
query99	1708	1293	1284	1284
Total cold run time: 305731 ms
Total hot run time: 190650 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.07 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c3126726cecde743a3f1104669b67401a0a2c1ab, data reload: false

query1	0.05	0.04	0.04
query2	0.06	0.03	0.02
query3	0.23	0.07	0.07
query4	1.64	0.10	0.09
query5	0.50	0.52	0.49
query6	1.13	0.73	0.73
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.49	0.48
query10	0.56	0.57	0.54
query11	0.13	0.13	0.11
query12	0.14	0.10	0.11
query13	0.62	0.59	0.59
query14	2.73	2.70	2.84
query15	0.90	0.81	0.83
query16	0.38	0.40	0.39
query17	1.07	1.06	1.04
query18	0.24	0.21	0.22
query19	1.98	1.84	2.01
query20	0.01	0.01	0.00
query21	15.35	0.58	0.55
query22	2.88	2.76	2.61
query23	17.18	0.99	0.82
query24	2.93	0.74	1.21
query25	0.35	0.07	0.08
query26	0.35	0.14	0.14
query27	0.04	0.04	0.05
query28	10.76	1.09	1.07
query29	12.56	3.21	3.18
query30	0.24	0.06	0.05
query31	2.87	0.38	0.40
query32	3.26	0.45	0.47
query33	2.99	3.00	3.04
query34	16.77	4.46	4.43
query35	4.49	4.48	4.54
query36	0.68	0.48	0.50
query37	0.09	0.06	0.05
query38	0.04	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.14
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.16 s
Total hot run time: 33.07 s

dataroaring
dataroaring previously approved these changes Sep 30, 2024
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 30, 2024
@yujun777
Copy link
Collaborator Author

run external

@yujun777
Copy link
Collaborator Author

run p0

@yujun777 yujun777 marked this pull request as draft September 30, 2024 03:09
@yujun777 yujun777 marked this pull request as ready for review September 30, 2024 03:14
@yujun777
Copy link
Collaborator Author

run buildall

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Sep 30, 2024
@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40536 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 47000717b356964a52959394f6eccbba00dd9346, data reload: false

------ Round 1 ----------------------------------
q1	17585	7378	7320	7320
q2	2019	298	276	276
q3	12197	1073	1207	1073
q4	10570	775	802	775
q5	7756	2840	2858	2840
q6	236	148	147	147
q7	1028	636	622	622
q8	9344	1931	2045	1931
q9	6650	6458	6378	6378
q10	6934	2276	2305	2276
q11	444	245	248	245
q12	416	222	226	222
q13	17802	2973	2947	2947
q14	247	219	217	217
q15	566	533	526	526
q16	640	579	582	579
q17	968	533	580	533
q18	7238	6450	6613	6450
q19	1338	1023	883	883
q20	476	208	203	203
q21	3905	3085	3285	3085
q22	1112	1011	1008	1008
Total cold run time: 109471 ms
Total hot run time: 40536 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7298	7228	7244	7228
q2	335	230	231	230
q3	2951	2941	2949	2941
q4	2133	1834	1829	1829
q5	5747	5739	5768	5739
q6	229	147	144	144
q7	2254	1858	1827	1827
q8	3352	3616	3425	3425
q9	8913	8933	8921	8921
q10	3561	3568	3495	3495
q11	562	500	501	500
q12	826	674	652	652
q13	9127	3147	3151	3147
q14	318	277	277	277
q15	573	533	529	529
q16	686	630	648	630
q17	1857	1657	1619	1619
q18	8295	7767	7655	7655
q19	1719	1463	1481	1463
q20	2092	1867	1861	1861
q21	5566	5493	5507	5493
q22	1210	1109	1015	1015
Total cold run time: 69604 ms
Total hot run time: 60620 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191915 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 47000717b356964a52959394f6eccbba00dd9346, data reload: false

query1	843	402	398	398
query2	6249	2041	2048	2041
query3	8688	193	201	193
query4	33542	23534	23581	23534
query5	3698	461	456	456
query6	278	174	163	163
query7	4193	305	310	305
query8	274	225	219	219
query9	9504	2626	2642	2626
query10	461	289	268	268
query11	17670	15026	15221	15026
query12	148	101	97	97
query13	1573	476	441	441
query14	9445	7560	7721	7560
query15	260	176	181	176
query16	7458	425	418	418
query17	1778	636	611	611
query18	2022	340	312	312
query19	368	169	153	153
query20	128	112	113	112
query21	221	106	109	106
query22	4709	4510	4683	4510
query23	34973	35145	34121	34121
query24	11061	2874	2886	2874
query25	523	409	400	400
query26	704	160	169	160
query27	2152	302	301	301
query28	7401	2414	2393	2393
query29	676	446	429	429
query30	275	155	150	150
query31	1046	815	813	813
query32	99	54	55	54
query33	768	304	304	304
query34	939	519	517	517
query35	891	734	719	719
query36	1144	959	989	959
query37	152	86	86	86
query38	4027	3961	3901	3901
query39	1621	1570	1448	1448
query40	212	95	96	95
query41	48	43	45	43
query42	111	96	95	95
query43	526	492	487	487
query44	1201	801	795	795
query45	196	167	167	167
query46	1143	716	715	715
query47	1950	1888	1824	1824
query48	457	363	336	336
query49	908	417	401	401
query50	821	428	427	427
query51	7202	6970	6863	6863
query52	102	87	88	87
query53	251	195	186	186
query54	1215	467	514	467
query55	80	73	76	73
query56	282	254	255	254
query57	1278	1158	1105	1105
query58	235	221	266	221
query59	3169	3078	3000	3000
query60	310	255	273	255
query61	108	106	103	103
query62	863	661	644	644
query63	217	189	185	185
query64	3943	643	614	614
query65	3255	3186	3202	3186
query66	842	302	302	302
query67	16084	15712	15410	15410
query68	4891	555	563	555
query69	455	299	311	299
query70	1157	1140	1124	1124
query71	359	273	273	273
query72	6157	3901	3969	3901
query73	771	348	345	345
query74	10389	8946	9104	8946
query75	3493	2656	2680	2656
query76	2751	884	902	884
query77	580	290	296	290
query78	10462	9593	9539	9539
query79	2216	587	605	587
query80	2566	456	440	440
query81	590	237	240	237
query82	696	136	134	134
query83	294	134	129	129
query84	280	76	76	76
query85	1428	293	289	289
query86	410	306	307	306
query87	4487	4464	4215	4215
query88	3955	2449	2402	2402
query89	404	292	296	292
query90	2027	186	183	183
query91	142	111	111	111
query92	62	48	52	48
query93	1896	552	547	547
query94	1120	299	256	256
query95	354	254	251	251
query96	613	279	286	279
query97	3281	3139	3155	3139
query98	218	207	192	192
query99	1551	1311	1296	1296
Total cold run time: 299026 ms
Total hot run time: 191915 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.15 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 47000717b356964a52959394f6eccbba00dd9346, data reload: false

query1	0.04	0.05	0.04
query2	0.06	0.02	0.02
query3	0.23	0.06	0.06
query4	1.63	0.10	0.10
query5	0.52	0.49	0.53
query6	1.13	0.72	0.73
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.49	0.49
query10	0.54	0.56	0.55
query11	0.14	0.11	0.11
query12	0.13	0.11	0.11
query13	0.61	0.60	0.59
query14	2.72	2.72	2.79
query15	0.90	0.82	0.83
query16	0.39	0.39	0.38
query17	1.03	1.06	1.07
query18	0.20	0.20	0.19
query19	1.94	1.84	1.99
query20	0.01	0.01	0.01
query21	15.35	0.60	0.59
query22	2.87	1.90	2.77
query23	16.96	0.88	0.81
query24	2.78	0.39	0.58
query25	0.23	0.12	0.11
query26	0.37	0.15	0.13
query27	0.04	0.04	0.04
query28	11.84	1.07	1.07
query29	12.58	3.24	3.21
query30	0.25	0.06	0.07
query31	2.86	0.38	0.37
query32	3.28	0.46	0.46
query33	3.00	3.02	3.03
query34	17.10	4.43	4.45
query35	4.53	4.45	4.50
query36	0.68	0.47	0.47
query37	0.09	0.06	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.15	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 108.04 s
Total hot run time: 32.15 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants