Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Optimization for lightning conflict detection #52306

Closed
lyzx2001 opened this issue Apr 2, 2024 · 2 comments · Fixed by #52656
Closed

Optimization for lightning conflict detection #52306

lyzx2001 opened this issue Apr 2, 2024 · 2 comments · Fixed by #52656
Assignees
@lyzx2001
Labels
affects-8.1 This bug affects the 8.1.x(LTS) versions. component/lightning This issue is related to Lightning of TiDB. type/enhancement The issue or PR belongs to an enhancement.

Comments

@lyzx2001
Copy link
Contributor

lyzx2001 commented Apr 2, 2024 •
edited
Loading

Enhancement

  1. Merge conflict record tables for preprocess duplicate detection and post-import conflict detection.
  2. Performance optimization for post-import conflict detection.

Merge lightning preprocess duplicate detection and post-import conflict detection:
#51036

Optimize lightning conflict recording tables:
#52393
@lyzx2001 lyzx2001 added the type/enhancement The issue or PR belongs to an enhancement. label Apr 2, 2024
@lyzx2001
Copy link
Contributor Author

lyzx2001 commented Apr 2, 2024

/assign @lyzx2001

This was referenced Apr 2, 2024
Merged
Closed
ti-chi-bot bot pushed a commit that referenced this issue Apr 15, 2024
@lyzx2001
lightning: merge conflict record tables for preprocess duplicate dete…
113b633 
…ction and post-import conflict detection (#52307)

ref #52306
@ti-chi-bot ti-chi-bot mentioned this issue Apr 15, 2024
Merged
13 tasks
3AceShowHand pushed a commit to 3AceShowHand/tidb that referenced this issue Apr 16, 2024
@lyzx2001 @3AceShowHand
lightning: merge conflict record tables for preprocess duplicate dete…
2199cad 
…ction and post-import conflict detection (pingcap#52307)

ref pingcap#52306
ti-chi-bot bot pushed a commit that referenced this issue Apr 16, 2024
@ti-chi-bot
lightning: merge conflict record tables for preprocess duplicate dete…
90ad4f5 
…ction and post-import conflict detection (#52307) (#52617)

ref #52306
@lyzx2001 lyzx2001 mentioned this issue Apr 17, 2024
Merged
13 tasks
@lyzx2001
Copy link
Contributor Author

/label affects-8.1

@ti-chi-bot ti-chi-bot bot added the affects-8.1 This bug affects the 8.1.x(LTS) versions. label Apr 24, 2024
@jebter jebter added the component/lightning This issue is related to Lightning of TiDB. label Apr 29, 2024
ti-chi-bot bot pushed a commit that referenced this issue Apr 29, 2024
@lyzx2001
lightning: performance optimization for post-import conflict detection (
ff4784e 
#52656)

close #52306
ti-chi-bot pushed a commit to ti-chi-bot/tidb that referenced this issue Apr 29, 2024
@lyzx2001 @ti-chi-bot
lightning: performance optimization for post-import conflict detection (
0eb1e4d 
pingcap#52656)

close pingcap#52306
@ti-chi-bot ti-chi-bot mentioned this issue Apr 29, 2024
Merged
13 tasks
ti-chi-bot bot pushed a commit that referenced this issue Apr 29, 2024
@ti-chi-bot
lightning: performance optimization for post-import conflict detection (
55e6391 
#52656) (#52990)

close #52306
@lyzx2001 lyzx2001 mentioned this issue May 13, 2024
Merged
13 tasks
ti-chi-bot bot pushed a commit that referenced this issue May 14, 2024
@lyzx2001
lightning: fix unstable test for conflict detection (#53225)
46d842f 
ref #52306
terry1purcell pushed a commit to terry1purcell/tidb that referenced this issue May 17, 2024
@lyzx2001 @terry1purcell
lightning: fix unstable test for conflict detection (pingcap#53225)
1fd96f4 
ref pingcap#52306
RidRisR pushed a commit to RidRisR/tidb that referenced this issue May 23, 2024
@lyzx2001 @RidRisR
lightning: fix unstable test for conflict detection (pingcap#53225)
2ce20a1 
ref pingcap#52306
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lyzx2001 lyzx2001

Labels
affects-8.1 This bug affects the 8.1.x(LTS) versions. component/lightning This issue is related to Lightning of TiDB. type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

lightning: performance optimization for post-import conflict detection lyzx2001/tidb
2 participants
@jebter @lyzx2001