executor, planner, util: optimize query statements summary table by conditional pushdown

[TszKitLo40]

Signed-off-by: Zijie Lu [email protected]

What problem does this PR solve?

Issue Number: close #26379

Bench:
Generate 3000 statements to filling statemens summary , and each SQL length is 10240 byte.

1. Use loadgen to generated load:
   bin/loadgen payload gen-stmt --stmt-cnt 3000 --query-len 10240 --host 172.16.5.40 --port 4019 --concurrency 10
   The generated SQL is look like this:
   select * from t_gen_stmt_1 where a = 1 or b = 1 or c = 1 union all select * from t_gen_stmt_2 where a = 2 or b = 2 or c = 2 union all ... ... ...

2. Wait generated statements(SQL) fill in the statemens summary.

3. Bench the SQL: select * from information_schema.cluster_statements_summary where digest = 'xxx';

Bellow is the bench result compare with the master:

	Master	This PR
Query duration	2.96s	0.01s

Problem Summary:

What is changed and how it works?

What's Changed:
optimize query statements summary table by avoid decode plan by conditional pushdown
How it Works:
By using conditional pushdown, filter the digest in logical optimization phase.

Check List

Tests

• Unit test
• Integration test
• Manual test (add detailed scripts or steps below)
• No code

Side effects

• Performance regression: Consumes more CPU
• Performance regression: Consumes more Memory
• Breaking backward compatibility

Documentation

• Affects user behaviors
• Contains syntax changes
• Contains variable changes
• Contains experimental features
• Changes MySQL compatibility

Release note

None.

[ti-chi-bot]

[REVIEW NOTIFICATION]

This pull request has been approved by:

• crazycs520
• djshow832

To complete the pull request process, please ask the reviewers in the list to review by filling /cc @reviewer in the comment.
After your PR has acquired the required number of LGTMs, you can assign this pull request to the committer in the list by filling /assign @committer in the comment to help you merge this pull request.

The full list of commands accepted by this bot can be found here.

Reviewer can indicate their review by submitting an approval review.
Reviewer can cancel approval by submitting a request changes review.

[crazycs520]

Got panic when i query following query:

select digest from `STATEMENTS_SUMMARY` where digest='';

[crazycs520]

/rebuild

[crazycs520]

/run-all-tests

[crazycs520]

@djshow832 @jyz0309 PTAL

[crazycs520]

@qw4990 @djshow832 PTAL

[djshow832]

Please modify the PR title: it doesn't avoid decoding plans.

[crazycs520]

You can add following test in executor/explainfor_test.go.

func (s *testSuite) TestExplainStatementsSummary(c *C) {
	tk := testkit.NewTestKitWithInit(c, s.store)
	tk.MustQuery("desc select * from information_schema.statements_summary").Check(testkit.Rows(
		`MemTableScan_4 10000.00 root table:STATEMENTS_SUMMARY `))
	tk.MustQuery("desc select * from information_schema.statements_summary where digest is null").Check(testutil.RowsWithSep("|",
		`Selection_5|8000.00|root| isnull(Column#5)`, `└─MemTableScan_6|10000.00|root|table:STATEMENTS_SUMMARY|`))
	tk.MustQuery("desc select * from information_schema.statements_summary where digest = 'abcdefg'").Check(testutil.RowsWithSep(" ",
		`MemTableScan_5 10000.00 root table:STATEMENTS_SUMMARY digests: ["abcdefg"]`))
	tk.MustQuery("desc select * from information_schema.statements_summary where digest in ('a','b','c')").Check(testutil.RowsWithSep(" ",
		`MemTableScan_5 10000.00 root table:STATEMENTS_SUMMARY digests: ["a","b","c"]`))
}

[TszKitLo40]

done

[TszKitLo40]

/run-all-tests

[crazycs520]

@djshow832 PTAL

[djshow832]

Please resolve conflicts @TszKitLo40

[crazycs520]

/merge

[ti-chi-bot]

This pull request has been accepted and is ready to merge.

Commit hash: aec6347