From 01b215caa16656b1388b49b3befe6e4798895364 Mon Sep 17 00:00:00 2001 From: ti-srebot Date: Tue, 1 Jun 2021 19:09:31 +0800 Subject: [PATCH 01/19] update v5.0.2 release notes at 2021-06-01T19:09:30 Signed-off-by: ti-srebot --- releases/5.0.2.md | 119 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 119 insertions(+) create mode 100644 releases/5.0.2.md diff --git a/releases/5.0.2.md b/releases/5.0.2.md new file mode 100644 index 0000000000000..2dc6fcf28153d --- /dev/null +++ b/releases/5.0.2.md @@ -0,0 +1,119 @@ +--- +title: tidb v5.0.2 Release Notes +category: Releases +aliases: ['/docs/dev/releases/v5.0.2/'] +--- + +# tidb v5.0.2 Release Notes + +Release date: June 01, 2021 + +TiDB version: v5.0.2 + +## Bug Fixes + ++ TiDB + + - Fix index join panic on prefix index on some cases [#24824](https://github.com/pingcap/tidb/pull/24824) + - Fix the issue point get cached plan of prepared statement is incorrectly used by in transaction point get statement. [#24765](https://github.com/pingcap/tidb/pull/24765) + - Fix write wrong prefix index value when collation is ascii_bin/latin1_bin [#24680](https://github.com/pingcap/tidb/pull/24680) + - Fix the issue that ongoing transaction could be aborted by the gc worker. [#24652](https://github.com/pingcap/tidb/pull/24652) + - Fix bug that point query maybe get wrong on the clustered index when new-collation enabled but new-row-format disabled [#24611](https://github.com/pingcap/tidb/pull/24611) + - Refactor converting partition keys for shuffle hash join [#24490](https://github.com/pingcap/tidb/pull/24490) + - Fix panic when building plan for a query containing HAVING clause. [#24489](https://github.com/pingcap/tidb/pull/24489) + - Planner: fix column pruning bug for Apply and Join [#24437](https://github.com/pingcap/tidb/pull/24437) + - Fix the bug that primary lock fallen back from async commit cannot be resolved. [#24397](https://github.com/pingcap/tidb/pull/24397) + - Statistics: fix a statistics GC problem that can cause duplicated fm-sketch records [#24357](https://github.com/pingcap/tidb/pull/24357) + - Avoid unnecessary pessimistic rollback when pessimistic locking receives ErrKeyExists [#23800](https://github.com/pingcap/tidb/pull/23800) + ++ TiFlash + + - Fix the potential concurrency problem when clone the shared delta index. [#2033](https://github.com/pingcap/tics/pull/2033) + - Fix the bug that incomplete data may make TiFlash fail to restart [#2003](https://github.com/pingcap/tics/pull/2003) + - Fix the problem that old dmfile is not removed atomically [#1925](https://github.com/pingcap/tics/pull/1925) + - Fix the issue that TiFlash may panic when `compaction filter` is enabled [#1891](https://github.com/pingcap/tics/pull/1891) + - Fix problem ExchangeSender will sometimes send duplicated data chunks [#1883](https://github.com/pingcap/tics/pull/1883) + - Fix problem that TiFlash can not resolve fallen back async commit lock [#1870](https://github.com/pingcap/tics/pull/1870) + - Fix unexpected timezone cast which may cause wrong result if the return column contains timestamp column [#1827](https://github.com/pingcap/tics/pull/1827) + - Fix a bug that TiFlash crash during Segment Split. [#1823](https://github.com/pingcap/tics/pull/1823) + ++ Tools + + - BR + + * Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1148](https://github.com/pingcap/br/pull/1148) + +## Improvements + ++ TiDB + + - Skip reading mysql.stats_histograms if cached stats is up-to-date [#24317](https://github.com/pingcap/tidb/pull/24317) + ++ TiFlash + + - Support push down filter on timestamp type column to storage layer. [#1906](https://github.com/pingcap/tics/pull/1906) + - Apply Region snapshots by ingesting files to greatly reduce the memory usage [#1867](https://github.com/pingcap/tics/pull/1867) + - Optimize the table lock to avoid reading and DDL jobs from blocking each other [#1858](https://github.com/pingcap/tics/pull/1858) + - Fix bug that execution info for non root mpp task is not acurate enough [#1840](https://github.com/pingcap/tics/pull/1840) + - Fix the problem that obsolete data may not be removed when there is no more write to the storage. [#1828](https://github.com/pingcap/tics/pull/1828) + +## Others + ++ TiDB + + - Update parser to fix lexer bug [#25015](https://github.com/pingcap/tidb/pull/25015) + - Fixed issue-24746, no longer allowing `INSERT INTO table PARTITION () ... ON DUPLICATE KEY UPDATE` to read from non-listed partitions [#25000](https://github.com/pingcap/tidb/pull/25000) + - Fix "index out of range" error when a SQL contains both group by and union. [#24551](https://github.com/pingcap/tidb/pull/24551) + - Fix wrong collation for concat function [#24301](https://github.com/pingcap/tidb/pull/24301) + - Fix global variable collation_server does not take effect in new session [#24156](https://github.com/pingcap/tidb/pull/24156) + ++ TiKV + + - ```release-note [#10278](https://github.com/tikv/tikv/pull/10278) + - No release notes [#10273](https://github.com/tikv/tikv/pull/10273) + - Enable hibernate regions by default (i.e. `raftstore.hibernate-regions = true`). [#10266](https://github.com/tikv/tikv/pull/10266) + - Fix CDC OOM issue caused by reading old values. [#10246](https://github.com/tikv/tikv/pull/10246) + - BR now supports S3-compatible storage using virtual-host addressing style. [#10243](https://github.com/tikv/tikv/pull/10243) + - Fix read empty value for the clustered primary key column in the secondary index when collation is latin1_bin. [#10239](https://github.com/tikv/tikv/pull/10239) + - Add `abort-on-panic` config, which allow core dump to be generated when panic. Users still need to correctly config the environment to enable core dump. [#10216](https://github.com/tikv/tikv/pull/10216) + - No release note. (The bug is not released yet.) [#10214](https://github.com/tikv/tikv/pull/10214) + - Support ingesting default-cf and write-cf sst in one raft command. [#10202](https://github.com/tikv/tikv/pull/10202) + - Support back pressure CDC scan speed. [#10151](https://github.com/tikv/tikv/pull/10151) + - Reduce memory usage of CDC initial scan. [#10133](https://github.com/tikv/tikv/pull/10133) + - Fix sysbench point-get performance regression when TiKV readpool is not busy. [#10115](https://github.com/tikv/tikv/pull/10115) + - Improve CDC old value cache hit ratio in pessimistic txn [#10089](https://github.com/tikv/tikv/pull/10089) + - Approximate split range evenly [#10086](https://github.com/tikv/tikv/pull/10086) + ++ PD + + - Fix offline_stats statistic after merge offline peer [#3615](https://github.com/pingcap/pd/pull/3615) + ++ TiFlash + + - Support int/real as real [#1928](https://github.com/pingcap/tics/pull/1928) + ++ Tools + + - BR + + * Fix the issue that restore from `mysql` schema would failed. [#1143](https://github.com/pingcap/br/pull/1143) + * BR would check cluster version of backup now. [#1091](https://github.com/pingcap/br/pull/1091) + * Fix the issue that log restore lost delete key during restore. [#1083](https://github.com/pingcap/br/pull/1083) + * BR now support backing up user tables created in the `mysql` schema. [#1078](https://github.com/pingcap/br/pull/1078) + * Fix a bug that caused, when backup failed, nothing would be printed to terminal. [#1043](https://github.com/pingcap/br/pull/1043) + * Fix a bug that caused BR send too many useless RPCs to TiKV. [#1037](https://github.com/pingcap/br/pull/1037) + + - TiCDC + + * Add metrics for table memory consumption [#1885](https://github.com/pingcap/ticdc/pull/1885) + * Owner: When tikv_gc_life_time is greater than gcttl, use tikv_gc_life_time to calculate the lower bound of gcSafePoint. [#1872](https://github.com/pingcap/ticdc/pull/1872) + * Reduce memory malloc in sort heap to avoid too much CPU overhead. [#1863](https://github.com/pingcap/ticdc/pull/1863) + * Flow Control bug fix (no released version affected) [#1859](https://github.com/pingcap/ticdc/pull/1859) + * Support sink flow control to reduce OOM [#1840](https://github.com/pingcap/ticdc/pull/1840) + * Fix a bug about resolved ts stopped when move a table. [#1828](https://github.com/pingcap/ticdc/pull/1828) + * Fix a deadlock bug in the kv client that deadlock happens when large stale regions exist. [#1801](https://github.com/pingcap/ticdc/pull/1801) + * Modified the update strategy of gcSafePoint. Fix the problem that TiKV GC safe point is blocked indefinitely due to TiCDC changefeed checkpoint stagnation. [#1759](https://github.com/pingcap/ticdc/pull/1759) + * Revert the update for explicit_defaults_for_timestamp which requires `SUPER` privilege when replicating to MySQL. [#1750](https://github.com/pingcap/ticdc/pull/1750) + * Add stale temporary files clean-up in Unified Sorter, and forbids sharing sort-dir. [#1742](https://github.com/pingcap/ticdc/pull/1742) + * Aadd http handler for failpoint [#1733](https://github.com/pingcap/ticdc/pull/1733) + * Fix time zone lost in Avro output. [#1712](https://github.com/pingcap/ticdc/pull/1712) From c853e8e5785b7a72e3be9036200b40268297ebd1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 1 Jun 2021 19:20:09 +0800 Subject: [PATCH 02/19] add toc --- TOC.md | 1 + releases/{5.0.2.md => release-5.0.2.md} | 88 +++++++++++++------------ releases/release-notes.md | 1 + 3 files changed, 47 insertions(+), 43 deletions(-) rename releases/{5.0.2.md => release-5.0.2.md} (77%) diff --git a/TOC.md b/TOC.md index 3b9d1a4360834..fae8f7baf4d3e 100644 --- a/TOC.md +++ b/TOC.md @@ -539,6 +539,7 @@ + [All Releases](/releases/release-notes.md) + [TiDB Roadmap](/roadmap.md) + v5.0 + + [5.0.2](/releases/release-5.0.2.md) + [5.0.1](/releases/release-5.0.1.md) + [5.0 GA](/releases/release-5.0.0.md) + [5.0.0-rc](/releases/release-5.0.0-rc.md) diff --git a/releases/5.0.2.md b/releases/release-5.0.2.md similarity index 77% rename from releases/5.0.2.md rename to releases/release-5.0.2.md index 2dc6fcf28153d..535571db6d69a 100644 --- a/releases/5.0.2.md +++ b/releases/release-5.0.2.md @@ -1,14 +1,28 @@ --- -title: tidb v5.0.2 Release Notes -category: Releases -aliases: ['/docs/dev/releases/v5.0.2/'] +title: TiDB 5.0.2 Release Notes --- -# tidb v5.0.2 Release Notes +# TiDB 5.0.2 Release Notes -Release date: June 01, 2021 +Release date: June 9, 2021 -TiDB version: v5.0.2 +TiDB version: 5.0.2 + +## Compatibility Changes + +## New Features + +## Improvements + ++ TiDB + + - Skip reading mysql.stats_histograms if cached stats is up-to-date [#24317](https://github.com/pingcap/tidb/pull/24317) + ++ TiFlash + + - Support push down filter on timestamp type column to storage layer. [#1906](https://github.com/pingcap/tics/pull/1906) + - Apply Region snapshots by ingesting files to greatly reduce the memory usage [#1867](https://github.com/pingcap/tics/pull/1867) + - Optimize the table lock to avoid reading and DDL jobs from blocking each other [#1858](https://github.com/pingcap/tics/pull/1858) ## Bug Fixes @@ -36,28 +50,16 @@ TiDB version: v5.0.2 - Fix problem that TiFlash can not resolve fallen back async commit lock [#1870](https://github.com/pingcap/tics/pull/1870) - Fix unexpected timezone cast which may cause wrong result if the return column contains timestamp column [#1827](https://github.com/pingcap/tics/pull/1827) - Fix a bug that TiFlash crash during Segment Split. [#1823](https://github.com/pingcap/tics/pull/1823) + - Fix bug that execution info for non root mpp task is not accurate enough [#1840](https://github.com/pingcap/tics/pull/1840) + - Fix the problem that obsolete data may not be removed when there is no more write to the storage [#1828](https://github.com/pingcap/tics/pull/1828) + Tools - - BR - - * Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1148](https://github.com/pingcap/br/pull/1148) - -## Improvements + - Backup & Restore (BR) -+ TiDB - - - Skip reading mysql.stats_histograms if cached stats is up-to-date [#24317](https://github.com/pingcap/tidb/pull/24317) - -+ TiFlash - - - Support push down filter on timestamp type column to storage layer. [#1906](https://github.com/pingcap/tics/pull/1906) - - Apply Region snapshots by ingesting files to greatly reduce the memory usage [#1867](https://github.com/pingcap/tics/pull/1867) - - Optimize the table lock to avoid reading and DDL jobs from blocking each other [#1858](https://github.com/pingcap/tics/pull/1858) - - Fix bug that execution info for non root mpp task is not acurate enough [#1840](https://github.com/pingcap/tics/pull/1840) - - Fix the problem that obsolete data may not be removed when there is no more write to the storage. [#1828](https://github.com/pingcap/tics/pull/1828) + + Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1148](https://github.com/pingcap/br/pull/1148) -## Others +## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 + TiDB @@ -69,7 +71,7 @@ TiDB version: v5.0.2 + TiKV - - ```release-note [#10278](https://github.com/tikv/tikv/pull/10278) + - release-note [#10278](https://github.com/tikv/tikv/pull/10278) - No release notes [#10273](https://github.com/tikv/tikv/pull/10273) - Enable hibernate regions by default (i.e. `raftstore.hibernate-regions = true`). [#10266](https://github.com/tikv/tikv/pull/10266) - Fix CDC OOM issue caused by reading old values. [#10246](https://github.com/tikv/tikv/pull/10246) @@ -94,26 +96,26 @@ TiDB version: v5.0.2 + Tools - - BR + + Backup & Restore (BR) - * Fix the issue that restore from `mysql` schema would failed. [#1143](https://github.com/pingcap/br/pull/1143) - * BR would check cluster version of backup now. [#1091](https://github.com/pingcap/br/pull/1091) - * Fix the issue that log restore lost delete key during restore. [#1083](https://github.com/pingcap/br/pull/1083) - * BR now support backing up user tables created in the `mysql` schema. [#1078](https://github.com/pingcap/br/pull/1078) - * Fix a bug that caused, when backup failed, nothing would be printed to terminal. [#1043](https://github.com/pingcap/br/pull/1043) - * Fix a bug that caused BR send too many useless RPCs to TiKV. [#1037](https://github.com/pingcap/br/pull/1037) + - Fix the issue that restore from `mysql` schema would failed. [#1143](https://github.com/pingcap/br/pull/1143) + - BR would check cluster version of backup now. [#1091](https://github.com/pingcap/br/pull/1091) + - Fix the issue that log restore lost delete key during restore. [#1083](https://github.com/pingcap/br/pull/1083) + - BR now support backing up user tables created in the `mysql` schema. [#1078](https://github.com/pingcap/br/pull/1078) + - Fix a bug that caused, when backup failed, nothing would be printed to terminal. [#1043](https://github.com/pingcap/br/pull/1043) + - Fix a bug that caused BR send too many useless RPCs to TiKV [#1037](https://github.com/pingcap/br/pull/1037) - TiCDC - * Add metrics for table memory consumption [#1885](https://github.com/pingcap/ticdc/pull/1885) - * Owner: When tikv_gc_life_time is greater than gcttl, use tikv_gc_life_time to calculate the lower bound of gcSafePoint. [#1872](https://github.com/pingcap/ticdc/pull/1872) - * Reduce memory malloc in sort heap to avoid too much CPU overhead. [#1863](https://github.com/pingcap/ticdc/pull/1863) - * Flow Control bug fix (no released version affected) [#1859](https://github.com/pingcap/ticdc/pull/1859) - * Support sink flow control to reduce OOM [#1840](https://github.com/pingcap/ticdc/pull/1840) - * Fix a bug about resolved ts stopped when move a table. [#1828](https://github.com/pingcap/ticdc/pull/1828) - * Fix a deadlock bug in the kv client that deadlock happens when large stale regions exist. [#1801](https://github.com/pingcap/ticdc/pull/1801) - * Modified the update strategy of gcSafePoint. Fix the problem that TiKV GC safe point is blocked indefinitely due to TiCDC changefeed checkpoint stagnation. [#1759](https://github.com/pingcap/ticdc/pull/1759) - * Revert the update for explicit_defaults_for_timestamp which requires `SUPER` privilege when replicating to MySQL. [#1750](https://github.com/pingcap/ticdc/pull/1750) - * Add stale temporary files clean-up in Unified Sorter, and forbids sharing sort-dir. [#1742](https://github.com/pingcap/ticdc/pull/1742) - * Aadd http handler for failpoint [#1733](https://github.com/pingcap/ticdc/pull/1733) - * Fix time zone lost in Avro output. [#1712](https://github.com/pingcap/ticdc/pull/1712) + - Add metrics for table memory consumption [#1885](https://github.com/pingcap/ticdc/pull/1885) + - Owner: When tikv_gc_life_time is greater than gcttl, use tikv_gc_life_time to calculate the lower bound of gcSafePoint. [#1872](https://github.com/pingcap/ticdc/pull/1872) + - Reduce memory malloc in sort heap to avoid too much CPU overhead. [#1863](https://github.com/pingcap/ticdc/pull/1863) + - Flow Control bug fix (no released version affected) [#1859](https://github.com/pingcap/ticdc/pull/1859) + - Support sink flow control to reduce OOM [#1840](https://github.com/pingcap/ticdc/pull/1840) + - Fix a bug about resolved ts stopped when move a table. [#1828](https://github.com/pingcap/ticdc/pull/1828) + - Fix a deadlock bug in the kv client that deadlock happens when large stale regions exist. [#1801](https://github.com/pingcap/ticdc/pull/1801) + - Modified the update strategy of gcSafePoint. Fix the problem that TiKV GC safe point is blocked indefinitely due to TiCDC changefeed checkpoint stagnation. [#1759](https://github.com/pingcap/ticdc/pull/1759) + - Revert the update for explicit_defaults_for_timestamp which requires `SUPER` privilege when replicating to MySQL. [#1750](https://github.com/pingcap/ticdc/pull/1750) + - Add stale temporary files clean-up in Unified Sorter, and forbids sharing sort-dir. [#1742](https://github.com/pingcap/ticdc/pull/1742) + - Add http handler for failpoint [#1733](https://github.com/pingcap/ticdc/pull/1733) + - Fix time zone lost in Avro output. [#1712](https://github.com/pingcap/ticdc/pull/1712) diff --git a/releases/release-notes.md b/releases/release-notes.md index f2c21a7e7f98b..7fdaaed929dc9 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -7,6 +7,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 5.0 +- [5.0.2](/releases/release-5.0.2.md) - [5.0.1](/releases/release-5.0.1.md) - [5.0 GA](/releases/release-5.0.0.md) - [5.0.0-rc](/releases/release-5.0.0-rc.md) From 60c391d88c9e86d6521d1ccafc106e6b3a2efb3a Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 2 Jun 2021 16:54:10 +0800 Subject: [PATCH 03/19] Apply suggestions from code review Co-authored-by: JaySon --- releases/release-5.0.2.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 535571db6d69a..7a5a787cfa135 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -20,7 +20,6 @@ TiDB version: 5.0.2 + TiFlash - - Support push down filter on timestamp type column to storage layer. [#1906](https://github.com/pingcap/tics/pull/1906) - Apply Region snapshots by ingesting files to greatly reduce the memory usage [#1867](https://github.com/pingcap/tics/pull/1867) - Optimize the table lock to avoid reading and DDL jobs from blocking each other [#1858](https://github.com/pingcap/tics/pull/1858) @@ -51,7 +50,6 @@ TiDB version: 5.0.2 - Fix unexpected timezone cast which may cause wrong result if the return column contains timestamp column [#1827](https://github.com/pingcap/tics/pull/1827) - Fix a bug that TiFlash crash during Segment Split. [#1823](https://github.com/pingcap/tics/pull/1823) - Fix bug that execution info for non root mpp task is not accurate enough [#1840](https://github.com/pingcap/tics/pull/1840) - - Fix the problem that obsolete data may not be removed when there is no more write to the storage [#1828](https://github.com/pingcap/tics/pull/1828) + Tools From 4e28aa4ee0c7cf403123f6a8e240f54f8289595d Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 2 Jun 2021 19:54:16 +0800 Subject: [PATCH 04/19] add tidb notes --- releases/release-5.0.2.md | 13 +++++-------- 1 file changed, 5 insertions(+), 8 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 7a5a787cfa135..174fd74d1cf00 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -38,6 +38,11 @@ TiDB version: 5.0.2 - Fix the bug that primary lock fallen back from async commit cannot be resolved. [#24397](https://github.com/pingcap/tidb/pull/24397) - Statistics: fix a statistics GC problem that can cause duplicated fm-sketch records [#24357](https://github.com/pingcap/tidb/pull/24357) - Avoid unnecessary pessimistic rollback when pessimistic locking receives ErrKeyExists [#23800](https://github.com/pingcap/tidb/pull/23800) + - Fix numeric literals cannot be recognized when set 'ANSI_QUOTES' sql_mode [#25015](https://github.com/pingcap/tidb/pull/25015) + - No longer allowing `INSERT INTO table PARTITION () ... ON DUPLICATE KEY UPDATE` to read from non-listed partitions [#25000](https://github.com/pingcap/tidb/pull/25000) + - Fix "index out of range" error when a SQL contains both group by and union. [#24551](https://github.com/pingcap/tidb/pull/24551) + - Fix wrong collation for concat function [#24301](https://github.com/pingcap/tidb/pull/24301) + - Fix global variable collation_server does not take effect in new session [#24156](https://github.com/pingcap/tidb/pull/24156) + TiFlash @@ -59,14 +64,6 @@ TiDB version: 5.0.2 ## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 -+ TiDB - - - Update parser to fix lexer bug [#25015](https://github.com/pingcap/tidb/pull/25015) - - Fixed issue-24746, no longer allowing `INSERT INTO table PARTITION () ... ON DUPLICATE KEY UPDATE` to read from non-listed partitions [#25000](https://github.com/pingcap/tidb/pull/25000) - - Fix "index out of range" error when a SQL contains both group by and union. [#24551](https://github.com/pingcap/tidb/pull/24551) - - Fix wrong collation for concat function [#24301](https://github.com/pingcap/tidb/pull/24301) - - Fix global variable collation_server does not take effect in new session [#24156](https://github.com/pingcap/tidb/pull/24156) - + TiKV - release-note [#10278](https://github.com/tikv/tikv/pull/10278) From 381c38bf37ed53efd0955ee053960466d9804d56 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 3 Jun 2021 11:06:39 +0800 Subject: [PATCH 05/19] remove 2 notes --- releases/release-5.0.2.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 174fd74d1cf00..d6590d306db8f 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -67,13 +67,11 @@ TiDB version: 5.0.2 + TiKV - release-note [#10278](https://github.com/tikv/tikv/pull/10278) - - No release notes [#10273](https://github.com/tikv/tikv/pull/10273) - Enable hibernate regions by default (i.e. `raftstore.hibernate-regions = true`). [#10266](https://github.com/tikv/tikv/pull/10266) - Fix CDC OOM issue caused by reading old values. [#10246](https://github.com/tikv/tikv/pull/10246) - BR now supports S3-compatible storage using virtual-host addressing style. [#10243](https://github.com/tikv/tikv/pull/10243) - Fix read empty value for the clustered primary key column in the secondary index when collation is latin1_bin. [#10239](https://github.com/tikv/tikv/pull/10239) - Add `abort-on-panic` config, which allow core dump to be generated when panic. Users still need to correctly config the environment to enable core dump. [#10216](https://github.com/tikv/tikv/pull/10216) - - No release note. (The bug is not released yet.) [#10214](https://github.com/tikv/tikv/pull/10214) - Support ingesting default-cf and write-cf sst in one raft command. [#10202](https://github.com/tikv/tikv/pull/10202) - Support back pressure CDC scan speed. [#10151](https://github.com/tikv/tikv/pull/10151) - Reduce memory usage of CDC initial scan. [#10133](https://github.com/tikv/tikv/pull/10133) From 5ce7a233e8b38ccc17f9ceb429b77074724a1f13 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 3 Jun 2021 16:15:20 +0800 Subject: [PATCH 06/19] add tiflash notes --- releases/release-5.0.2.md | 29 +++++++++++++---------------- 1 file changed, 13 insertions(+), 16 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index d6590d306db8f..34b942c0aec58 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -20,8 +20,9 @@ TiDB version: 5.0.2 + TiFlash - - Apply Region snapshots by ingesting files to greatly reduce the memory usage [#1867](https://github.com/pingcap/tics/pull/1867) - - Optimize the table lock to avoid reading and DDL jobs from blocking each other [#1858](https://github.com/pingcap/tics/pull/1858) + - Apply Region snapshots by ingesting files to reduce memory usage + - Optimize the table lock to avoid reading and DDL jobs blocking each other + - Support casting the integer or real type to real type ## Bug Fixes @@ -46,21 +47,21 @@ TiDB version: 5.0.2 + TiFlash - - Fix the potential concurrency problem when clone the shared delta index. [#2033](https://github.com/pingcap/tics/pull/2033) - - Fix the bug that incomplete data may make TiFlash fail to restart [#2003](https://github.com/pingcap/tics/pull/2003) - - Fix the problem that old dmfile is not removed atomically [#1925](https://github.com/pingcap/tics/pull/1925) - - Fix the issue that TiFlash may panic when `compaction filter` is enabled [#1891](https://github.com/pingcap/tics/pull/1891) - - Fix problem ExchangeSender will sometimes send duplicated data chunks [#1883](https://github.com/pingcap/tics/pull/1883) - - Fix problem that TiFlash can not resolve fallen back async commit lock [#1870](https://github.com/pingcap/tics/pull/1870) - - Fix unexpected timezone cast which may cause wrong result if the return column contains timestamp column [#1827](https://github.com/pingcap/tics/pull/1827) - - Fix a bug that TiFlash crash during Segment Split. [#1823](https://github.com/pingcap/tics/pull/1823) - - Fix bug that execution info for non root mpp task is not accurate enough [#1840](https://github.com/pingcap/tics/pull/1840) + - Fix the issue of incorrect results when cloning shared delta index concurrently + - Fix the potential issue that TiFlash fails to restart with incomplete data + - Fix the issue that old dm files are not removed atomically + - Fix the potential panic that occurs when feature `compaction filter` is enabled + - Fix the potential issue that `ExchangeSender` will send duplicated chunks + - Fix the issue that TiFlash can not resolve fallen back `async commit` lock + - Fix the issue of incorrect results when the return columns of casting timezone contains timestamp type + - Fix the issue that TiFlash panics during Segment Split + - Fix the issue that execution information about non root MPP task is not accurate + Tools - Backup & Restore (BR) - + Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1148](https://github.com/pingcap/br/pull/1148) + - Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1148](https://github.com/pingcap/br/pull/1148) ## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 @@ -83,10 +84,6 @@ TiDB version: 5.0.2 - Fix offline_stats statistic after merge offline peer [#3615](https://github.com/pingcap/pd/pull/3615) -+ TiFlash - - - Support int/real as real [#1928](https://github.com/pingcap/tics/pull/1928) - + Tools + Backup & Restore (BR) From a125d22b42253c3da35c0a26ae9bb8a7911e9a38 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Fri, 4 Jun 2021 10:20:49 +0800 Subject: [PATCH 07/19] add tools notes --- releases/release-5.0.2.md | 73 ++++++++++++++++++++++++--------------- 1 file changed, 45 insertions(+), 28 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 34b942c0aec58..87e5ee4d2a714 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -10,6 +10,12 @@ TiDB version: 5.0.2 ## Compatibility Changes ++ Tools + + + TiCDC + + - `--sort-dir` in changefeed command is deprecated, please set `--sort-dir` in server command instead [#1795](https://github.com/pingcap/ticdc/pull/1795) + ## New Features ## Improvements @@ -24,6 +30,25 @@ TiDB version: 5.0.2 - Optimize the table lock to avoid reading and DDL jobs blocking each other - Support casting the integer or real type to real type ++ Tools + + + TiCDC + + - Add metrics for table memory consumption [#1885](https://github.com/pingcap/ticdc/pull/1885) + - Reduce memory malloc in sort heap to avoid too much CPU overhead. [#1863](https://github.com/pingcap/ticdc/pull/1863) + - Modified the update strategy of gcSafePoint. Fix the problem that TiKV GC safe point is blocked indefinitely due to TiCDC changefeed checkpoint stagnation. [#1759](https://github.com/pingcap/ticdc/pull/1759) + - Deleted useless log info that may cause confusion for users. [#1759](https://github.com/pingcap/ticdc/pull/1759) + + + Backup & Restore (BR) + + - Clarify some ambiguous error message. [#1132](https://github.com/pingcap/br/pull/1132) + - Checks cluster version of a backup. [#1091](https://github.com/pingcap/br/pull/1091) + - Support backup and restore system tables in the `mysql` database.[#1143](https://github.com/pingcap/br/pull/1143) [#1078](https://github.com/pingcap/br/pull/1078) + + + Dumpling + + - Fix a bug that caused, when backup failed, nothing would be printed to terminal. [#280](https://github.com/pingcap/dumpling/pull/280) + ## Bug Fixes + TiDB @@ -59,9 +84,27 @@ TiDB version: 5.0.2 + Tools - - Backup & Restore (BR) + + TiCDC + + - Fix time zone lost in Avro output. [#1712](https://github.com/pingcap/ticdc/pull/1712) + - Add stale temporary files clean-up in Unified Sorter, and forbids sharing sort-dir. [#1742](https://github.com/pingcap/ticdc/pull/1742) + - Fix a deadlock bug in the kv client that deadlock happens when large stale regions exist. [#1801](https://github.com/pingcap/ticdc/pull/1801) + - Fix wrong usage in cdc server cli flag, `--cert-allowed-cn` [#1697](https://github.com/pingcap/ticdc/pull/1697) + - Revert the update for explicit_defaults_for_timestamp which requires `SUPER` privilege when replicating to MySQL. [#1750](https://github.com/pingcap/ticdc/pull/1750) + - Support sink flow control to reduce OOM [#1840](https://github.com/pingcap/ticdc/pull/1840) + - Fix a bug about resolved ts stopped when move a table. [#1828](https://github.com/pingcap/ticdc/pull/1828) - - Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1148](https://github.com/pingcap/br/pull/1148) + + Backup & Restore (BR) + + - Fix the issue that log restore lost delete key during restore. [#1083](https://github.com/pingcap/br/pull/1083) + - Fix a bug that caused BR send too many useless RPCs to TiKV [#1037](https://github.com/pingcap/br/pull/1037) + - Fix a bug that caused, when backup failed, nothing would be printed to terminal. [#1043](https://github.com/pingcap/br/pull/1043) + + + TiDB Lightning + + - Fix the issue that lightning panic due to batch kv greater than 4 GB. [#5739](https://github.com/pingcap/br/pull/5739) + - Fix the bug that lightning tidb backend cannot load any data when autocommit is disabled [#1125](https://github.com/pingcap/br/pull/1125) + - Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1065](https://github.com/pingcap/br/pull/1065) ## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 @@ -83,29 +126,3 @@ TiDB version: 5.0.2 + PD - Fix offline_stats statistic after merge offline peer [#3615](https://github.com/pingcap/pd/pull/3615) - -+ Tools - - + Backup & Restore (BR) - - - Fix the issue that restore from `mysql` schema would failed. [#1143](https://github.com/pingcap/br/pull/1143) - - BR would check cluster version of backup now. [#1091](https://github.com/pingcap/br/pull/1091) - - Fix the issue that log restore lost delete key during restore. [#1083](https://github.com/pingcap/br/pull/1083) - - BR now support backing up user tables created in the `mysql` schema. [#1078](https://github.com/pingcap/br/pull/1078) - - Fix a bug that caused, when backup failed, nothing would be printed to terminal. [#1043](https://github.com/pingcap/br/pull/1043) - - Fix a bug that caused BR send too many useless RPCs to TiKV [#1037](https://github.com/pingcap/br/pull/1037) - - - TiCDC - - - Add metrics for table memory consumption [#1885](https://github.com/pingcap/ticdc/pull/1885) - - Owner: When tikv_gc_life_time is greater than gcttl, use tikv_gc_life_time to calculate the lower bound of gcSafePoint. [#1872](https://github.com/pingcap/ticdc/pull/1872) - - Reduce memory malloc in sort heap to avoid too much CPU overhead. [#1863](https://github.com/pingcap/ticdc/pull/1863) - - Flow Control bug fix (no released version affected) [#1859](https://github.com/pingcap/ticdc/pull/1859) - - Support sink flow control to reduce OOM [#1840](https://github.com/pingcap/ticdc/pull/1840) - - Fix a bug about resolved ts stopped when move a table. [#1828](https://github.com/pingcap/ticdc/pull/1828) - - Fix a deadlock bug in the kv client that deadlock happens when large stale regions exist. [#1801](https://github.com/pingcap/ticdc/pull/1801) - - Modified the update strategy of gcSafePoint. Fix the problem that TiKV GC safe point is blocked indefinitely due to TiCDC changefeed checkpoint stagnation. [#1759](https://github.com/pingcap/ticdc/pull/1759) - - Revert the update for explicit_defaults_for_timestamp which requires `SUPER` privilege when replicating to MySQL. [#1750](https://github.com/pingcap/ticdc/pull/1750) - - Add stale temporary files clean-up in Unified Sorter, and forbids sharing sort-dir. [#1742](https://github.com/pingcap/ticdc/pull/1742) - - Add http handler for failpoint [#1733](https://github.com/pingcap/ticdc/pull/1733) - - Fix time zone lost in Avro output. [#1712](https://github.com/pingcap/ticdc/pull/1712) From 77238435e9fe259707b8e62d15acde9967fadfd3 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 7 Jun 2021 10:30:37 +0800 Subject: [PATCH 08/19] address comments from nolouch and hicqu --- releases/release-5.0.2.md | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 87e5ee4d2a714..3155a7c1eec31 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -110,13 +110,11 @@ TiDB version: 5.0.2 + TiKV - - release-note [#10278](https://github.com/tikv/tikv/pull/10278) - Enable hibernate regions by default (i.e. `raftstore.hibernate-regions = true`). [#10266](https://github.com/tikv/tikv/pull/10266) - Fix CDC OOM issue caused by reading old values. [#10246](https://github.com/tikv/tikv/pull/10246) - BR now supports S3-compatible storage using virtual-host addressing style. [#10243](https://github.com/tikv/tikv/pull/10243) - - Fix read empty value for the clustered primary key column in the secondary index when collation is latin1_bin. [#10239](https://github.com/tikv/tikv/pull/10239) + - Allow to read empty value for the clustered primary key column in the secondary index when collation is latin1_bin. [#10239](https://github.com/tikv/tikv/pull/10239) - Add `abort-on-panic` config, which allow core dump to be generated when panic. Users still need to correctly config the environment to enable core dump. [#10216](https://github.com/tikv/tikv/pull/10216) - - Support ingesting default-cf and write-cf sst in one raft command. [#10202](https://github.com/tikv/tikv/pull/10202) - Support back pressure CDC scan speed. [#10151](https://github.com/tikv/tikv/pull/10151) - Reduce memory usage of CDC initial scan. [#10133](https://github.com/tikv/tikv/pull/10133) - Fix sysbench point-get performance regression when TiKV readpool is not busy. [#10115](https://github.com/tikv/tikv/pull/10115) @@ -126,3 +124,7 @@ TiDB version: 5.0.2 + PD - Fix offline_stats statistic after merge offline peer [#3615](https://github.com/pingcap/pd/pull/3615) + - Fix the issue that leader re-election be slow when there are many stores [#3719] (https://github.com/tikv/pd/pull/3719) + - Fix the panic issue about remove evict leader scheduler from a nonexistent store +[#3679](https://github.com/tikv/pd/pull/3679) + - Fix the statistic issue that offline Peer not clean after been merged [#3614](https://github.com/tikv/pd/pull/3614) From fc181e87f775367bb1d4ab32bcdd66fb6c26f881 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 7 Jun 2021 10:31:59 +0800 Subject: [PATCH 09/19] move pd notes to bug fix --- releases/release-5.0.2.md | 16 ++++++++-------- 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 3155a7c1eec31..146dee995bc94 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -70,6 +70,14 @@ TiDB version: 5.0.2 - Fix wrong collation for concat function [#24301](https://github.com/pingcap/tidb/pull/24301) - Fix global variable collation_server does not take effect in new session [#24156](https://github.com/pingcap/tidb/pull/24156) ++ PD + + - Fix offline_stats statistic after merge offline peer [#3615](https://github.com/pingcap/pd/pull/3615) + - Fix the issue that leader re-election be slow when there are many stores [#3719](https://github.com/tikv/pd/pull/3719) + - Fix the panic issue about remove evict leader scheduler from a nonexistent store +[#3679](https://github.com/tikv/pd/pull/3679) + - Fix the statistic issue that offline Peer not clean after been merged [#3614](https://github.com/tikv/pd/pull/3614) + + TiFlash - Fix the issue of incorrect results when cloning shared delta index concurrently @@ -120,11 +128,3 @@ TiDB version: 5.0.2 - Fix sysbench point-get performance regression when TiKV readpool is not busy. [#10115](https://github.com/tikv/tikv/pull/10115) - Improve CDC old value cache hit ratio in pessimistic txn [#10089](https://github.com/tikv/tikv/pull/10089) - Approximate split range evenly [#10086](https://github.com/tikv/tikv/pull/10086) - -+ PD - - - Fix offline_stats statistic after merge offline peer [#3615](https://github.com/pingcap/pd/pull/3615) - - Fix the issue that leader re-election be slow when there are many stores [#3719] (https://github.com/tikv/pd/pull/3719) - - Fix the panic issue about remove evict leader scheduler from a nonexistent store -[#3679](https://github.com/tikv/pd/pull/3679) - - Fix the statistic issue that offline Peer not clean after been merged [#3614](https://github.com/tikv/pd/pull/3614) From ef11fc9a4507c810677d67a0997502b89c9c3452 Mon Sep 17 00:00:00 2001 From: qupeng Date: Mon, 7 Jun 2021 13:28:26 +0800 Subject: [PATCH 10/19] classify things about tikv Signed-off-by: qupeng --- releases/release-5.0.2.md | 35 ++++++++++++++++++++--------------- 1 file changed, 20 insertions(+), 15 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 146dee995bc94..1fa5b6316651c 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -18,12 +18,25 @@ TiDB version: 5.0.2 ## New Features ++ TiKV + + - Enable hibernate regions by default (i.e. `raftstore.hibernate-regions = true`). [#10266](https://github.com/tikv/tikv/pull/10266) + ## Improvements + TiDB - Skip reading mysql.stats_histograms if cached stats is up-to-date [#24317](https://github.com/pingcap/tidb/pull/24317) ++ TiKV + + - BR now supports S3-compatible storage using virtual-host addressing style. [#10243](https://github.com/tikv/tikv/pull/10243) + - Support back pressure CDC scan speed. [#10151](https://github.com/tikv/tikv/pull/10151) + - Reduce memory usage of CDC initial scan. [#10133](https://github.com/tikv/tikv/pull/10133) + - Fix sysbench point-get performance regression when TiKV readpool is not busy. [#10115](https://github.com/tikv/tikv/pull/10115) + - Improve CDC old value cache hit ratio in pessimistic txn [#10089](https://github.com/tikv/tikv/pull/10089) + - Approximate split range evenly [#10086](https://github.com/tikv/tikv/pull/10086) + + TiFlash - Apply Region snapshots by ingesting files to reduce memory usage @@ -74,10 +87,15 @@ TiDB version: 5.0.2 - Fix offline_stats statistic after merge offline peer [#3615](https://github.com/pingcap/pd/pull/3615) - Fix the issue that leader re-election be slow when there are many stores [#3719](https://github.com/tikv/pd/pull/3719) - - Fix the panic issue about remove evict leader scheduler from a nonexistent store -[#3679](https://github.com/tikv/pd/pull/3679) + - Fix the panic issue about remove evict leader scheduler from a nonexistent store [#3679](https://github.com/tikv/pd/pull/3679) - Fix the statistic issue that offline Peer not clean after been merged [#3614](https://github.com/tikv/pd/pull/3614) ++ TiKV + + - Fix CDC OOM issue caused by reading old values. [#10246](https://github.com/tikv/tikv/pull/10246) + - Allow to read empty value for the clustered primary key column in the secondary index when collation is latin1_bin. [#10239](https://github.com/tikv/tikv/pull/10239) + - Add `abort-on-panic` config, which allow core dump to be generated when panic. Users still need to correctly config the environment to enable core dump. [#10216](https://github.com/tikv/tikv/pull/10216) + + TiFlash - Fix the issue of incorrect results when cloning shared delta index concurrently @@ -114,17 +132,4 @@ TiDB version: 5.0.2 - Fix the bug that lightning tidb backend cannot load any data when autocommit is disabled [#1125](https://github.com/pingcap/br/pull/1125) - Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1065](https://github.com/pingcap/br/pull/1065) -## 以下 note 未分类。请将以下 note 进行分类 (New feature, Improvements, Bug fixes, Compatibility Changes 四类)，并移动到上面对应的标题下。如果某条 note 为多余的，请删除。如果漏抓取了 note，请手动补充 - -+ TiKV - - Enable hibernate regions by default (i.e. `raftstore.hibernate-regions = true`). [#10266](https://github.com/tikv/tikv/pull/10266) - - Fix CDC OOM issue caused by reading old values. [#10246](https://github.com/tikv/tikv/pull/10246) - - BR now supports S3-compatible storage using virtual-host addressing style. [#10243](https://github.com/tikv/tikv/pull/10243) - - Allow to read empty value for the clustered primary key column in the secondary index when collation is latin1_bin. [#10239](https://github.com/tikv/tikv/pull/10239) - - Add `abort-on-panic` config, which allow core dump to be generated when panic. Users still need to correctly config the environment to enable core dump. [#10216](https://github.com/tikv/tikv/pull/10216) - - Support back pressure CDC scan speed. [#10151](https://github.com/tikv/tikv/pull/10151) - - Reduce memory usage of CDC initial scan. [#10133](https://github.com/tikv/tikv/pull/10133) - - Fix sysbench point-get performance regression when TiKV readpool is not busy. [#10115](https://github.com/tikv/tikv/pull/10115) - - Improve CDC old value cache hit ratio in pessimistic txn [#10089](https://github.com/tikv/tikv/pull/10089) - - Approximate split range evenly [#10086](https://github.com/tikv/tikv/pull/10086) From df75ba6556710c9b8f4b49e8d40edfd1e1c719be Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 7 Jun 2021 13:42:34 +0800 Subject: [PATCH 11/19] Update releases/release-5.0.2.md --- releases/release-5.0.2.md | 2 -- 1 file changed, 2 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 1fa5b6316651c..70800acd8101c 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -131,5 +131,3 @@ TiDB version: 5.0.2 - Fix the issue that lightning panic due to batch kv greater than 4 GB. [#5739](https://github.com/pingcap/br/pull/5739) - Fix the bug that lightning tidb backend cannot load any data when autocommit is disabled [#1125](https://github.com/pingcap/br/pull/1125) - Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1065](https://github.com/pingcap/br/pull/1065) - - From 38c62de5eec60fe683c09d8696d3ea1217f61309 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Mon, 7 Jun 2021 16:48:19 +0800 Subject: [PATCH 12/19] modify tidb, tiflash, tools notes --- releases/release-5.0.2.md | 96 +++++++++++++++++++-------------------- 1 file changed, 48 insertions(+), 48 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 70800acd8101c..094736509b982 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -14,7 +14,7 @@ TiDB version: 5.0.2 + TiCDC - - `--sort-dir` in changefeed command is deprecated, please set `--sort-dir` in server command instead [#1795](https://github.com/pingcap/ticdc/pull/1795) + - Deprecate `--sort-dir` in the `cdc cli changefeed` command. Instead, set `--sort-dir` in the `cdc server` command [#1795](https://github.com/pingcap/ticdc/pull/1795) ## New Features @@ -26,7 +26,7 @@ TiDB version: 5.0.2 + TiDB - - Skip reading mysql.stats_histograms if cached stats is up-to-date [#24317](https://github.com/pingcap/tidb/pull/24317) + - Avoid frequently reading the `mysql.stats_histograms` table if the cached statistics is up-to-date to avoid high CPU usage [#24317](https://github.com/pingcap/tidb/pull/24317) + TiKV @@ -40,48 +40,47 @@ TiDB version: 5.0.2 + TiFlash - Apply Region snapshots by ingesting files to reduce memory usage - - Optimize the table lock to avoid reading and DDL jobs blocking each other - - Support casting the integer or real type to real type + - Optimize the table lock to prevent reading data and DDL jobs from blocking each other + - Support casting the `INTEGER` or `REAL` type to `REAL` type + Tools + TiCDC - - Add metrics for table memory consumption [#1885](https://github.com/pingcap/ticdc/pull/1885) - - Reduce memory malloc in sort heap to avoid too much CPU overhead. [#1863](https://github.com/pingcap/ticdc/pull/1863) - - Modified the update strategy of gcSafePoint. Fix the problem that TiKV GC safe point is blocked indefinitely due to TiCDC changefeed checkpoint stagnation. [#1759](https://github.com/pingcap/ticdc/pull/1759) - - Deleted useless log info that may cause confusion for users. [#1759](https://github.com/pingcap/ticdc/pull/1759) + - Add monitoring metrics for the table memory consumption [#1885](https://github.com/pingcap/ticdc/pull/1885) + - Optimize the memory and CPU usages during the sorting stage [#1863](https://github.com/pingcap/ticdc/pull/1863) + - Delete some useless log information that might cause confusion [#1759](https://github.com/pingcap/ticdc/pull/1759) + Backup & Restore (BR) - - Clarify some ambiguous error message. [#1132](https://github.com/pingcap/br/pull/1132) - - Checks cluster version of a backup. [#1091](https://github.com/pingcap/br/pull/1091) - - Support backup and restore system tables in the `mysql` database.[#1143](https://github.com/pingcap/br/pull/1143) [#1078](https://github.com/pingcap/br/pull/1078) + - Clarify some ambiguous error message [#1132](https://github.com/pingcap/br/pull/1132) + - Support checking the cluster version of a backup [#1091](https://github.com/pingcap/br/pull/1091) + - Support backing up and restoring system tables in the `mysql` schema [#1143](https://github.com/pingcap/br/pull/1143) [#1078](https://github.com/pingcap/br/pull/1078) + Dumpling - - Fix a bug that caused, when backup failed, nothing would be printed to terminal. [#280](https://github.com/pingcap/dumpling/pull/280) + - Fix the issue that no error is output when a backup operation fails [#280](https://github.com/pingcap/dumpling/pull/280) ## Bug Fixes + TiDB - - Fix index join panic on prefix index on some cases [#24824](https://github.com/pingcap/tidb/pull/24824) - - Fix the issue point get cached plan of prepared statement is incorrectly used by in transaction point get statement. [#24765](https://github.com/pingcap/tidb/pull/24765) - - Fix write wrong prefix index value when collation is ascii_bin/latin1_bin [#24680](https://github.com/pingcap/tidb/pull/24680) - - Fix the issue that ongoing transaction could be aborted by the gc worker. [#24652](https://github.com/pingcap/tidb/pull/24652) - - Fix bug that point query maybe get wrong on the clustered index when new-collation enabled but new-row-format disabled [#24611](https://github.com/pingcap/tidb/pull/24611) - - Refactor converting partition keys for shuffle hash join [#24490](https://github.com/pingcap/tidb/pull/24490) - - Fix panic when building plan for a query containing HAVING clause. [#24489](https://github.com/pingcap/tidb/pull/24489) - - Planner: fix column pruning bug for Apply and Join [#24437](https://github.com/pingcap/tidb/pull/24437) - - Fix the bug that primary lock fallen back from async commit cannot be resolved. [#24397](https://github.com/pingcap/tidb/pull/24397) - - Statistics: fix a statistics GC problem that can cause duplicated fm-sketch records [#24357](https://github.com/pingcap/tidb/pull/24357) - - Avoid unnecessary pessimistic rollback when pessimistic locking receives ErrKeyExists [#23800](https://github.com/pingcap/tidb/pull/23800) - - Fix numeric literals cannot be recognized when set 'ANSI_QUOTES' sql_mode [#25015](https://github.com/pingcap/tidb/pull/25015) - - No longer allowing `INSERT INTO table PARTITION () ... ON DUPLICATE KEY UPDATE` to read from non-listed partitions [#25000](https://github.com/pingcap/tidb/pull/25000) - - Fix "index out of range" error when a SQL contains both group by and union. [#24551](https://github.com/pingcap/tidb/pull/24551) - - Fix wrong collation for concat function [#24301](https://github.com/pingcap/tidb/pull/24301) - - Fix global variable collation_server does not take effect in new session [#24156](https://github.com/pingcap/tidb/pull/24156) + - Fix the panic issue caused by using the prefix index and index join in some cases [#24824](https://github.com/pingcap/tidb/pull/24824) + - Fix the issue that the prepared plan cache of `point get` is incorrectly used by the `point get` statement in the transaction [#24765](https://github.com/pingcap/tidb/pull/24765) + - Fix the issue of writing the wrong prefix index value when the collation is `ascii_bin` or `latin1_bin` [#24680](https://github.com/pingcap/tidb/pull/24680) + - Fix the issue that the ongoing transaction might be aborted by the GC worker [#24652](https://github.com/pingcap/tidb/pull/24652) + - Fix a bug that the point query might get wrong on the clustered index when `new-collation` is enabled but `new-row-format` is disabled [#24611](https://github.com/pingcap/tidb/pull/24611) + - Refactor the conversion of partition keys for shuffle hash join [#24490](https://github.com/pingcap/tidb/pull/24490) + - Fix the panic issue that occurs when building the plan for queries that contain the `HAVING` clause [#24489](https://github.com/pingcap/tidb/pull/24489) + - Fix the issue that the column pruning improvement causes the `Apply` and `Join` operators' results to go wrong [#24437](https://github.com/pingcap/tidb/pull/24437) + - Fix a bug that the primary lock fallen back from async commit cannot be resolved [#24397](https://github.com/pingcap/tidb/pull/24397) + - Fix a GC issue of statistics that might cause duplicated fm-sketch records [#24357](https://github.com/pingcap/tidb/pull/24357) + - Avoid unnecessary pessimistic rollback when the pessimistic locking receives the `ErrKeyExists` error [#23800](https://github.com/pingcap/tidb/pull/23800) + - Fix the issue that numeric literals cannot be recognized when the sql_mode contains `ANSI_QUOTES` [#25015](https://github.com/pingcap/tidb/pull/25015) + - Forbid statements such as `INSERT INTO table PARTITION () ... ON DUPLICATE KEY UPDATE` to read data from non-listed partitions [#25000](https://github.com/pingcap/tidb/pull/25000) + - Fix the potential `index out of range` error when a SQL statement contains both `GROUP BY` and `UNION` [#24551](https://github.com/pingcap/tidb/pull/24551) + - Fix the issue that the `CONCAT` function incorrectly handles the collation [#24301](https://github.com/pingcap/tidb/pull/24301) + - Fix the issue that the `collation_server` global variable does not take effect in new sessions [#24156](https://github.com/pingcap/tidb/pull/24156) + PD @@ -100,34 +99,35 @@ TiDB version: 5.0.2 - Fix the issue of incorrect results when cloning shared delta index concurrently - Fix the potential issue that TiFlash fails to restart with incomplete data - - Fix the issue that old dm files are not removed atomically - - Fix the potential panic that occurs when feature `compaction filter` is enabled - - Fix the potential issue that `ExchangeSender` will send duplicated chunks - - Fix the issue that TiFlash can not resolve fallen back `async commit` lock - - Fix the issue of incorrect results when the return columns of casting timezone contains timestamp type - - Fix the issue that TiFlash panics during Segment Split - - Fix the issue that execution information about non root MPP task is not accurate + - Fix the issue that old dm files are not removed automatically + - Fix the potential panic that occurs when the Compaction Filter feature is enabled + - Fix the potential issue that `ExchangeSender` sends duplicated data + ?- Fix the issue that TiFlash cannot resolve the fallen back Async Commit lock + - Fix the issue of incorrect results returned when the casted result of the `TIMEZONE` type contains the `TIMESTAMP` type + - Fix the TiFlash panic issue that occurs during Segment Split + - Fix the issue that the execution information about the non-root MPP task is not accurate + Tools + TiCDC - - Fix time zone lost in Avro output. [#1712](https://github.com/pingcap/ticdc/pull/1712) - - Add stale temporary files clean-up in Unified Sorter, and forbids sharing sort-dir. [#1742](https://github.com/pingcap/ticdc/pull/1742) - - Fix a deadlock bug in the kv client that deadlock happens when large stale regions exist. [#1801](https://github.com/pingcap/ticdc/pull/1801) - - Fix wrong usage in cdc server cli flag, `--cert-allowed-cn` [#1697](https://github.com/pingcap/ticdc/pull/1697) - - Revert the update for explicit_defaults_for_timestamp which requires `SUPER` privilege when replicating to MySQL. [#1750](https://github.com/pingcap/ticdc/pull/1750) - - Support sink flow control to reduce OOM [#1840](https://github.com/pingcap/ticdc/pull/1840) - - Fix a bug about resolved ts stopped when move a table. [#1828](https://github.com/pingcap/ticdc/pull/1828) + - Fix the issue that the time zone information is lost in the Avro output [#1712](https://github.com/pingcap/ticdc/pull/1712) + - Support cleaning up stale temporary files in Unified Sorter and forbids sharing the `sort-dir` directory [#1742](https://github.com/pingcap/ticdc/pull/1742) + - Fix a deadlock bug in the KV client that occurs when many stale Regions exist [#1801](https://github.com/pingcap/ticdc/pull/1801) + - Fix the wrong help information in the `cdc server cli` flag of `--cert-allowed-cn` [#1697](https://github.com/pingcap/ticdc/pull/1697) + - Revert the update for `explicit_defaults_for_timestamp` which requires the `SUPER` privilege when replicating data to MySQL [#1750](https://github.com/pingcap/ticdc/pull/1750) + - Support the sink flow control to reduce the risk of memory overflow [#1840](https://github.com/pingcap/ticdc/pull/1840) + - Fix a bug that the replication task might stop when moving a table [#1828](https://github.com/pingcap/ticdc/pull/1828) + - Fix the issue that the TiKV GC safe point is blocked due to the stagnation of TiCDC changefeed checkpoint [#1759](https://github.com/pingcap/ticdc/pull/1759) + Backup & Restore (BR) - - Fix the issue that log restore lost delete key during restore. [#1083](https://github.com/pingcap/br/pull/1083) - - Fix a bug that caused BR send too many useless RPCs to TiKV [#1037](https://github.com/pingcap/br/pull/1037) - - Fix a bug that caused, when backup failed, nothing would be printed to terminal. [#1043](https://github.com/pingcap/br/pull/1043) + ?- Fix the issue that log restore lost delete key during restore [#1083](https://github.com/pingcap/br/pull/1083) + - Fix a bug that causes BR to send too many useless RPC requests to TiKV [#1037](https://github.com/pingcap/br/pull/1037) + - Fix the issue that no error is output when a backup operation fails [#1043](https://github.com/pingcap/br/pull/1043) + TiDB Lightning - - Fix the issue that lightning panic due to batch kv greater than 4 GB. [#5739](https://github.com/pingcap/br/pull/5739) - - Fix the bug that lightning tidb backend cannot load any data when autocommit is disabled [#1125](https://github.com/pingcap/br/pull/1125) - - Fix the bug that batch split region fails due to total key size exceeds raft entry limit [#1065](https://github.com/pingcap/br/pull/1065) + - Fix the issue of TiDB Lightning panic that occurs when generating KV data [#5739](https://github.com/pingcap/br/pull/5739) + - Fix the issue that TiDB Lightning in the TiDB-backend mode cannot load any data when autocommit is disabled [#1125](https://github.com/pingcap/br/pull/1125) + - Fix a bug that the batch split region fails due to total key size exceeding the raft entry limit during the data import [#1065](https://github.com/pingcap/br/pull/1065) From 566cb016033286af2f9dd4e5273fd0aca59021a1 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 8 Jun 2021 12:04:46 +0800 Subject: [PATCH 13/19] change pr to issue in bug fixes --- releases/release-5.0.2.md | 52 +++++++++++++++++++-------------------- 1 file changed, 26 insertions(+), 26 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index 094736509b982..f2c92663b3d9f 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -65,35 +65,35 @@ TiDB version: 5.0.2 + TiDB - - Fix the panic issue caused by using the prefix index and index join in some cases [#24824](https://github.com/pingcap/tidb/pull/24824) - - Fix the issue that the prepared plan cache of `point get` is incorrectly used by the `point get` statement in the transaction [#24765](https://github.com/pingcap/tidb/pull/24765) - - Fix the issue of writing the wrong prefix index value when the collation is `ascii_bin` or `latin1_bin` [#24680](https://github.com/pingcap/tidb/pull/24680) - - Fix the issue that the ongoing transaction might be aborted by the GC worker [#24652](https://github.com/pingcap/tidb/pull/24652) - - Fix a bug that the point query might get wrong on the clustered index when `new-collation` is enabled but `new-row-format` is disabled [#24611](https://github.com/pingcap/tidb/pull/24611) + - Fix the panic issue caused by using the prefix index and index join in some cases [#24547](https://github.com/pingcap/tidb/issues/24547) [#24716](https://github.com/pingcap/tidb/issues/24716) [#24717](https://github.com/pingcap/tidb/issues/24717) + - Fix the issue that the prepared plan cache of `point get` is incorrectly used by the `point get` statement in the transaction [#24741](https://github.com/pingcap/tidb/issues/24741) + - Fix the issue of writing the wrong prefix index value when the collation is `ascii_bin` or `latin1_bin` [#24569](https://github.com/pingcap/tidb/issues/24569) + - Fix the issue that the ongoing transaction might be aborted by the GC worker [#24591](https://github.com/pingcap/tidb/issues/24591) + - Fix a bug that the point query might get wrong on the clustered index when `new-collation` is enabled but `new-row-format` is disabled [#24541](https://github.com/pingcap/tidb/issues/24541) - Refactor the conversion of partition keys for shuffle hash join [#24490](https://github.com/pingcap/tidb/pull/24490) - - Fix the panic issue that occurs when building the plan for queries that contain the `HAVING` clause [#24489](https://github.com/pingcap/tidb/pull/24489) - - Fix the issue that the column pruning improvement causes the `Apply` and `Join` operators' results to go wrong [#24437](https://github.com/pingcap/tidb/pull/24437) - - Fix a bug that the primary lock fallen back from async commit cannot be resolved [#24397](https://github.com/pingcap/tidb/pull/24397) + - Fix the panic issue that occurs when building the plan for queries that contain the `HAVING` clause [#24045](https://github.com/pingcap/tidb/issues/24045) + - Fix the issue that the column pruning improvement causes the `Apply` and `Join` operators' results to go wrong [#23887](https://github.com/pingcap/tidb/issues/23887) + - Fix a bug that the primary lock fallen back from async commit cannot be resolved [#24384](https://github.com/pingcap/tidb/issues/24384) - Fix a GC issue of statistics that might cause duplicated fm-sketch records [#24357](https://github.com/pingcap/tidb/pull/24357) - - Avoid unnecessary pessimistic rollback when the pessimistic locking receives the `ErrKeyExists` error [#23800](https://github.com/pingcap/tidb/pull/23800) - - Fix the issue that numeric literals cannot be recognized when the sql_mode contains `ANSI_QUOTES` [#25015](https://github.com/pingcap/tidb/pull/25015) - - Forbid statements such as `INSERT INTO table PARTITION () ... ON DUPLICATE KEY UPDATE` to read data from non-listed partitions [#25000](https://github.com/pingcap/tidb/pull/25000) - - Fix the potential `index out of range` error when a SQL statement contains both `GROUP BY` and `UNION` [#24551](https://github.com/pingcap/tidb/pull/24551) - - Fix the issue that the `CONCAT` function incorrectly handles the collation [#24301](https://github.com/pingcap/tidb/pull/24301) + - Avoid unnecessary pessimistic rollback when the pessimistic locking receives the `ErrKeyExists` error [#23799](https://github.com/pingcap/tidb/issues/23799) + - Fix the issue that numeric literals cannot be recognized when the sql_mode contains `ANSI_QUOTES` [#24522](https://github.com/pingcap/tidb/pull/24522) + - Forbid statements such as `INSERT INTO table PARTITION () ... ON DUPLICATE KEY UPDATE` to read data from non-listed partitions [#24746](https://github.com/pingcap/tidb/issues/24746) + - Fix the potential `index out of range` error when a SQL statement contains both `GROUP BY` and `UNION` [#24281](https://github.com/pingcap/tidb/issues/24281) + - Fix the issue that the `CONCAT` function incorrectly handles the collation [#24296](https://github.com/pingcap/tidb/issues/24296) - Fix the issue that the `collation_server` global variable does not take effect in new sessions [#24156](https://github.com/pingcap/tidb/pull/24156) -+ PD ++ TiKV - - Fix offline_stats statistic after merge offline peer [#3615](https://github.com/pingcap/pd/pull/3615) - - Fix the issue that leader re-election be slow when there are many stores [#3719](https://github.com/tikv/pd/pull/3719) - - Fix the panic issue about remove evict leader scheduler from a nonexistent store [#3679](https://github.com/tikv/pd/pull/3679) - - Fix the statistic issue that offline Peer not clean after been merged [#3614](https://github.com/tikv/pd/pull/3614) + - Fix CDC OOM issue caused by reading old values [#9996](https://github.com/tikv/tikv/issues/9996) [#9981](https://github.com/tikv/tikv/issues/9981) + - Allow to read empty value for the clustered primary key column in the secondary index when collation is latin1_bin [#24548](https://github.com/pingcap/tidb/issues/24548) + - Add `abort-on-panic` config, which allow core dump to be generated when panic. Users still need to correctly config the environment to enable core dump [#10216](https://github.com/tikv/tikv/pull/10216) -+ TiKV ++ PD - - Fix CDC OOM issue caused by reading old values. [#10246](https://github.com/tikv/tikv/pull/10246) - - Allow to read empty value for the clustered primary key column in the secondary index when collation is latin1_bin. [#10239](https://github.com/tikv/tikv/pull/10239) - - Add `abort-on-panic` config, which allow core dump to be generated when panic. Users still need to correctly config the environment to enable core dump. [#10216](https://github.com/tikv/tikv/pull/10216) + - Fix offline_stats statistic after merge offline peer [#3611](https://github.com/tikv/pd/issues/3611) + - Fix the issue that leader re-election be slow when there are many stores [#3697](https://github.com/tikv/pd/issues/3697) + - Fix the panic issue about remove evict leader scheduler from a nonexistent store [#3660](https://github.com/tikv/pd/issues/3660) + - Fix the statistic issue that offline Peer not clean after been merged [#3611](https://github.com/tikv/pd/issues/3611) + TiFlash @@ -122,12 +122,12 @@ TiDB version: 5.0.2 + Backup & Restore (BR) - ?- Fix the issue that log restore lost delete key during restore [#1083](https://github.com/pingcap/br/pull/1083) + ?- Fix the issue that log restore lost delete key during restore [#1063](https://github.com/pingcap/br/issues/1063) - Fix a bug that causes BR to send too many useless RPC requests to TiKV [#1037](https://github.com/pingcap/br/pull/1037) - Fix the issue that no error is output when a backup operation fails [#1043](https://github.com/pingcap/br/pull/1043) + TiDB Lightning - - Fix the issue of TiDB Lightning panic that occurs when generating KV data [#5739](https://github.com/pingcap/br/pull/5739) - - Fix the issue that TiDB Lightning in the TiDB-backend mode cannot load any data when autocommit is disabled [#1125](https://github.com/pingcap/br/pull/1125) - - Fix a bug that the batch split region fails due to total key size exceeding the raft entry limit during the data import [#1065](https://github.com/pingcap/br/pull/1065) + ?(死链)- Fix the issue of TiDB Lightning panic that occurs when generating KV data [#5739](https://github.com/pingcap/br/pull/5739) + - Fix the issue that TiDB Lightning in the TiDB-backend mode cannot load any data when autocommit is disabled [#1104](https://github.com/pingcap/br/issues/1104) + - Fix a bug that the batch split region fails due to total key size exceeding the raft entry limit during the data import [#969](https://github.com/pingcap/br/issues/969) From 88dbbae34d6247bab2a2b208c1aaff2261f0001b Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 8 Jun 2021 13:54:52 +0800 Subject: [PATCH 14/19] refine --- releases/release-5.0.2.md | 49 ++++++++++++++++++++------------------- 1 file changed, 25 insertions(+), 24 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index f2c92663b3d9f..fa50341a632c2 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -14,13 +14,13 @@ TiDB version: 5.0.2 + TiCDC - - Deprecate `--sort-dir` in the `cdc cli changefeed` command. Instead, set `--sort-dir` in the `cdc server` command [#1795](https://github.com/pingcap/ticdc/pull/1795) + - Deprecate `--sort-dir` in the `cdc cli changefeed` command. Instead, users can set `--sort-dir` in the `cdc server` command. [#1795](https://github.com/pingcap/ticdc/pull/1795) ## New Features + TiKV - - Enable hibernate regions by default (i.e. `raftstore.hibernate-regions = true`). [#10266](https://github.com/tikv/tikv/pull/10266) + - Enable the Hibernate Region feature by default [#10266](https://github.com/tikv/tikv/pull/10266) ## Improvements @@ -30,17 +30,17 @@ TiDB version: 5.0.2 + TiKV - - BR now supports S3-compatible storage using virtual-host addressing style. [#10243](https://github.com/tikv/tikv/pull/10243) - - Support back pressure CDC scan speed. [#10151](https://github.com/tikv/tikv/pull/10151) - - Reduce memory usage of CDC initial scan. [#10133](https://github.com/tikv/tikv/pull/10133) - - Fix sysbench point-get performance regression when TiKV readpool is not busy. [#10115](https://github.com/tikv/tikv/pull/10115) - - Improve CDC old value cache hit ratio in pessimistic txn [#10089](https://github.com/tikv/tikv/pull/10089) - - Approximate split range evenly [#10086](https://github.com/tikv/tikv/pull/10086) + - BR now supports the S3-compatible storage using the virtual-host addressing mode [#10243](https://github.com/tikv/tikv/pull/10243) + - Support the back pressure for TiCDC's scan speed [#10151](https://github.com/tikv/tikv/pull/10151) + - Reduce the memory usage of TiCDC's initial scan [#10133](https://github.com/tikv/tikv/pull/10133) + + - Improve the cache hit ratio of the TiCDC's Old Value feature in the pessimistic transaction [#10089](https://github.com/tikv/tikv/pull/10089) + - Split Regions more evenly to avoid the excessively large Region size due to the splitting speed not catching up with the writing speed [#10086](https://github.com/tikv/tikv/pull/10086) + TiFlash - Apply Region snapshots by ingesting files to reduce memory usage - - Optimize the table lock to prevent reading data and DDL jobs from blocking each other + - Optimize the table lock to prevent DDL jobs and data reads from blocking each other - Support casting the `INTEGER` or `REAL` type to `REAL` type + Tools @@ -49,11 +49,11 @@ TiDB version: 5.0.2 - Add monitoring metrics for the table memory consumption [#1885](https://github.com/pingcap/ticdc/pull/1885) - Optimize the memory and CPU usages during the sorting stage [#1863](https://github.com/pingcap/ticdc/pull/1863) - - Delete some useless log information that might cause confusion [#1759](https://github.com/pingcap/ticdc/pull/1759) + - Delete some useless log information that might cause user confusion [#1759](https://github.com/pingcap/ticdc/pull/1759) + Backup & Restore (BR) - - Clarify some ambiguous error message [#1132](https://github.com/pingcap/br/pull/1132) + - Clarify some ambiguous error messages [#1132](https://github.com/pingcap/br/pull/1132) - Support checking the cluster version of a backup [#1091](https://github.com/pingcap/br/pull/1091) - Support backing up and restoring system tables in the `mysql` schema [#1143](https://github.com/pingcap/br/pull/1143) [#1078](https://github.com/pingcap/br/pull/1078) @@ -68,7 +68,7 @@ TiDB version: 5.0.2 - Fix the panic issue caused by using the prefix index and index join in some cases [#24547](https://github.com/pingcap/tidb/issues/24547) [#24716](https://github.com/pingcap/tidb/issues/24716) [#24717](https://github.com/pingcap/tidb/issues/24717) - Fix the issue that the prepared plan cache of `point get` is incorrectly used by the `point get` statement in the transaction [#24741](https://github.com/pingcap/tidb/issues/24741) - Fix the issue of writing the wrong prefix index value when the collation is `ascii_bin` or `latin1_bin` [#24569](https://github.com/pingcap/tidb/issues/24569) - - Fix the issue that the ongoing transaction might be aborted by the GC worker [#24591](https://github.com/pingcap/tidb/issues/24591) + - Fix the issue that the ongoing transaction might be interrupted by the GC worker [#24591](https://github.com/pingcap/tidb/issues/24591) - Fix a bug that the point query might get wrong on the clustered index when `new-collation` is enabled but `new-row-format` is disabled [#24541](https://github.com/pingcap/tidb/issues/24541) - Refactor the conversion of partition keys for shuffle hash join [#24490](https://github.com/pingcap/tidb/pull/24490) - Fix the panic issue that occurs when building the plan for queries that contain the `HAVING` clause [#24045](https://github.com/pingcap/tidb/issues/24045) @@ -84,16 +84,17 @@ TiDB version: 5.0.2 + TiKV - - Fix CDC OOM issue caused by reading old values [#9996](https://github.com/tikv/tikv/issues/9996) [#9981](https://github.com/tikv/tikv/issues/9981) - - Allow to read empty value for the clustered primary key column in the secondary index when collation is latin1_bin [#24548](https://github.com/pingcap/tidb/issues/24548) - - Add `abort-on-panic` config, which allow core dump to be generated when panic. Users still need to correctly config the environment to enable core dump [#10216](https://github.com/tikv/tikv/pull/10216) + - Fix a TiCDC OOM issue caused by reading old values [#9996](https://github.com/tikv/tikv/issues/9996) [#9981](https://github.com/tikv/tikv/issues/9981) + - Fix the issue of empty value in the secondary index for the clustered primary key column when collation is `latin1_bin` [#24548](https://github.com/pingcap/tidb/issues/24548) + - Add the `abort-on-panic` configuration, which allows TiKV to generate the core dump file when panic occurs. Users still need to correctly configure the environment to enable core dump [#10216](https://github.com/tikv/tikv/pull/10216) + - Fix sysbench point-get performance regression when TiKV readpool is not busy [#10046](https://github.com/tikv/tikv/issues/10046) + PD - - Fix offline_stats statistic after merge offline peer [#3611](https://github.com/tikv/pd/issues/3611) - - Fix the issue that leader re-election be slow when there are many stores [#3697](https://github.com/tikv/pd/issues/3697) - - Fix the panic issue about remove evict leader scheduler from a nonexistent store [#3660](https://github.com/tikv/pd/issues/3660) - - Fix the statistic issue that offline Peer not clean after been merged [#3611](https://github.com/tikv/pd/issues/3611) + - Fix the issue of inaccurate `offline_stats` statistics after merging offline peers [#3611](https://github.com/tikv/pd/issues/3611) + - Fix the issue that the PD Leader re-election is slow when there are many stores [#3697](https://github.com/tikv/pd/issues/3697) + - Fix the panic issue that occurs when removing the evict leader scheduler from a non-existent store [#3660](https://github.com/tikv/pd/issues/3660) + - Fix the issue that the statistics are not updated after offline peers are merged [#3611](https://github.com/tikv/pd/issues/3611) + TiFlash @@ -102,7 +103,7 @@ TiDB version: 5.0.2 - Fix the issue that old dm files are not removed automatically - Fix the potential panic that occurs when the Compaction Filter feature is enabled - Fix the potential issue that `ExchangeSender` sends duplicated data - ?- Fix the issue that TiFlash cannot resolve the fallen back Async Commit lock + - Fix the issue that TiFlash cannot resolve the lock fallen back from async commit - Fix the issue of incorrect results returned when the casted result of the `TIMEZONE` type contains the `TIMESTAMP` type - Fix the TiFlash panic issue that occurs during Segment Split - Fix the issue that the execution information about the non-root MPP task is not accurate @@ -112,9 +113,9 @@ TiDB version: 5.0.2 + TiCDC - Fix the issue that the time zone information is lost in the Avro output [#1712](https://github.com/pingcap/ticdc/pull/1712) - - Support cleaning up stale temporary files in Unified Sorter and forbids sharing the `sort-dir` directory [#1742](https://github.com/pingcap/ticdc/pull/1742) + - Support cleaning up stale temporary files in Unified Sorter and forbid sharing the `sort-dir` directory [#1742](https://github.com/pingcap/ticdc/pull/1742) - Fix a deadlock bug in the KV client that occurs when many stale Regions exist [#1801](https://github.com/pingcap/ticdc/pull/1801) - - Fix the wrong help information in the `cdc server cli` flag of `--cert-allowed-cn` [#1697](https://github.com/pingcap/ticdc/pull/1697) + - Fix the wrong help information in the `--cert-allowed-cn` flag [#1697](https://github.com/pingcap/ticdc/pull/1697) - Revert the update for `explicit_defaults_for_timestamp` which requires the `SUPER` privilege when replicating data to MySQL [#1750](https://github.com/pingcap/ticdc/pull/1750) - Support the sink flow control to reduce the risk of memory overflow [#1840](https://github.com/pingcap/ticdc/pull/1840) - Fix a bug that the replication task might stop when moving a table [#1828](https://github.com/pingcap/ticdc/pull/1828) @@ -129,5 +130,5 @@ TiDB version: 5.0.2 + TiDB Lightning ?(死链)- Fix the issue of TiDB Lightning panic that occurs when generating KV data [#5739](https://github.com/pingcap/br/pull/5739) - - Fix the issue that TiDB Lightning in the TiDB-backend mode cannot load any data when autocommit is disabled [#1104](https://github.com/pingcap/br/issues/1104) - - Fix a bug that the batch split region fails due to total key size exceeding the raft entry limit during the data import [#969](https://github.com/pingcap/br/issues/969) + - Fix the issue that TiDB Lightning in the TiDB-backend mode cannot load any data when the autocommit is disabled [#1104](https://github.com/pingcap/br/issues/1104) + - Fix a bug that the batch split region fails due to the total key size exceeding the raft entry limit during the data import [#969](https://github.com/pingcap/br/issues/969) From 4bc2dde5e88094d990dc0ea7a60472f92c7994b7 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 8 Jun 2021 14:18:47 +0800 Subject: [PATCH 15/19] fix 2 tools notes --- releases/release-5.0.2.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index fa50341a632c2..d7c5ec7717908 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -123,12 +123,12 @@ TiDB version: 5.0.2 + Backup & Restore (BR) - ?- Fix the issue that log restore lost delete key during restore [#1063](https://github.com/pingcap/br/issues/1063) + - Fix the issue that the `DELETE` events are lost during the log restore [#1063](https://github.com/pingcap/br/issues/1063) - Fix a bug that causes BR to send too many useless RPC requests to TiKV [#1037](https://github.com/pingcap/br/pull/1037) - Fix the issue that no error is output when a backup operation fails [#1043](https://github.com/pingcap/br/pull/1043) + TiDB Lightning - ?(死链)- Fix the issue of TiDB Lightning panic that occurs when generating KV data [#5739](https://github.com/pingcap/br/pull/5739) + - Fix the issue of TiDB Lightning panic that occurs when generating KV data [#1127](https://github.com/pingcap/br/pull/1127) - Fix the issue that TiDB Lightning in the TiDB-backend mode cannot load any data when the autocommit is disabled [#1104](https://github.com/pingcap/br/issues/1104) - Fix a bug that the batch split region fails due to the total key size exceeding the raft entry limit during the data import [#969](https://github.com/pingcap/br/issues/969) From ad4f8608402c1b2b200fac45c7de9804a3a4ff1c Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 8 Jun 2021 19:41:31 +0800 Subject: [PATCH 16/19] Update release-5.0.2.md --- releases/release-5.0.2.md | 6 ++---- 1 file changed, 2 insertions(+), 4 deletions(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index d7c5ec7717908..b6027aa143c93 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -33,9 +33,8 @@ TiDB version: 5.0.2 - BR now supports the S3-compatible storage using the virtual-host addressing mode [#10243](https://github.com/tikv/tikv/pull/10243) - Support the back pressure for TiCDC's scan speed [#10151](https://github.com/tikv/tikv/pull/10151) - Reduce the memory usage of TiCDC's initial scan [#10133](https://github.com/tikv/tikv/pull/10133) - - Improve the cache hit ratio of the TiCDC's Old Value feature in the pessimistic transaction [#10089](https://github.com/tikv/tikv/pull/10089) - - Split Regions more evenly to avoid the excessively large Region size due to the splitting speed not catching up with the writing speed [#10086](https://github.com/tikv/tikv/pull/10086) + - Split Regions more evenly [#10086](https://github.com/tikv/tikv/pull/10086) + TiFlash @@ -87,11 +86,10 @@ TiDB version: 5.0.2 - Fix a TiCDC OOM issue caused by reading old values [#9996](https://github.com/tikv/tikv/issues/9996) [#9981](https://github.com/tikv/tikv/issues/9981) - Fix the issue of empty value in the secondary index for the clustered primary key column when collation is `latin1_bin` [#24548](https://github.com/pingcap/tidb/issues/24548) - Add the `abort-on-panic` configuration, which allows TiKV to generate the core dump file when panic occurs. Users still need to correctly configure the environment to enable core dump [#10216](https://github.com/tikv/tikv/pull/10216) - - Fix sysbench point-get performance regression when TiKV readpool is not busy [#10046](https://github.com/tikv/tikv/issues/10046) + - Fix the performance regression issue of `point get` queries that occurs when TiKV is not busy [#10046](https://github.com/tikv/tikv/issues/10046) + PD - - Fix the issue of inaccurate `offline_stats` statistics after merging offline peers [#3611](https://github.com/tikv/pd/issues/3611) - Fix the issue that the PD Leader re-election is slow when there are many stores [#3697](https://github.com/tikv/pd/issues/3697) - Fix the panic issue that occurs when removing the evict leader scheduler from a non-existent store [#3660](https://github.com/tikv/pd/issues/3660) - Fix the issue that the statistics are not updated after offline peers are merged [#3611](https://github.com/tikv/pd/issues/3611) From f0ee615db66ee8797e3d5555158beff7a167e81e Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 9 Jun 2021 10:16:44 +0800 Subject: [PATCH 17/19] Update releases/release-5.0.2.md Co-authored-by: JaySon --- releases/release-5.0.2.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index b6027aa143c93..eb7ecbc64ca5a 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -38,7 +38,6 @@ TiDB version: 5.0.2 + TiFlash - - Apply Region snapshots by ingesting files to reduce memory usage - Optimize the table lock to prevent DDL jobs and data reads from blocking each other - Support casting the `INTEGER` or `REAL` type to `REAL` type From 2455f24d5689bc586f1bd75fb7df7078b6afbc0a Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Wed, 9 Jun 2021 18:08:25 +0800 Subject: [PATCH 18/19] Update releases/release-5.0.2.md --- releases/release-5.0.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index eb7ecbc64ca5a..ffc813695d02e 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -128,4 +128,4 @@ TiDB version: 5.0.2 - Fix the issue of TiDB Lightning panic that occurs when generating KV data [#1127](https://github.com/pingcap/br/pull/1127) - Fix the issue that TiDB Lightning in the TiDB-backend mode cannot load any data when the autocommit is disabled [#1104](https://github.com/pingcap/br/issues/1104) - - Fix a bug that the batch split region fails due to the total key size exceeding the raft entry limit during the data import [#969](https://github.com/pingcap/br/issues/969) + - Fix a bug that the batch split Region fails due to the total key size exceeding the raft entry limit during the data import [#969](https://github.com/pingcap/br/issues/969) From 690ac021180e34decac050a7b79a7c671deb646b Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Thu, 10 Jun 2021 10:43:06 +0800 Subject: [PATCH 19/19] Update releases/release-5.0.2.md --- releases/release-5.0.2.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-5.0.2.md b/releases/release-5.0.2.md index ffc813695d02e..69e56860825d6 100644 --- a/releases/release-5.0.2.md +++ b/releases/release-5.0.2.md @@ -4,7 +4,7 @@ title: TiDB 5.0.2 Release Notes # TiDB 5.0.2 Release Notes -Release date: June 9, 2021 +Release date: June 10, 2021 TiDB version: 5.0.2