Code

Sorter go routine size#3

Code

Open

sdojjy wants to merge 76 commits intoreduce-go-routine-usagesdojjy/tiflow:reduce-go-routine-usagefrom sorter-go-routine-sizesdojjy/tiflow:sorter-go-routine-sizeCopy head branch name to clipboard

+18,712-8,432

Commits

Commits on Jan 17, 2022

• reduce go routine size

  sdojjy

  committed
  45b8a5c

  Copy full SHA for 45b8a5c

• reduce go routine size

  sdojjy

  committed
  e734e65

  Copy full SHA for e734e65

Commits on Jan 18, 2022

• reduce go routine size

  sdojjy

  committed
  5c209ff

  Copy full SHA for 5c209ff

• reduce go routine size

  sdojjy

  committed
  a6b74d6

  Copy full SHA for a6b74d6

Commits on Jan 19, 2022

• address comments

  sdojjy

  committed
  1fe5ab5

  Copy full SHA for 1fe5ab5

Commits on Jan 20, 2022

• remove notifier

  sdojjy

  committed
  162401b

  Copy full SHA for 162401b

Commits on Jan 24, 2022

• Merge branch 'reduce-go-routine-usage' into sorter-go-routine-size

  Show description for 3f730cb
  sdojjy

  committed
  3f730cb

  Copy full SHA for 3f730cb

• build(deps): bump nanoid from 3.1.30 to 3.2.0 in /dm/ui (pingcap#4437)

  Show description for 239a21f
  dependabot[bot]

  authored
  239a21f

  Copy full SHA for 239a21f

• wait merger

  sdojjy

  committed
  e5ee9da

  Copy full SHA for e5ee9da

• wait merger

  sdojjy

  committed
  9dfefbb

  Copy full SHA for 9dfefbb

• pipeline(ticdc): reduce go routine size (pingcap#4334)

  Show description for 0236882
  sdojjy

  authored
  0236882

  Copy full SHA for 0236882

• wait merger

  sdojjy

  committed
  7461a8f

  Copy full SHA for 7461a8f

• mq (ticdc): Make mq sink flush resolvedTs async (pingcap#4356)

  Show description for 3e43ac0
  asddongmen

  authored
  3e43ac0

  Copy full SHA for 3e43ac0

• mq (ticdc): Make mq sink flush resolvedTs async (pingcap#4356)

  Show description for 39aaf99
  asddongmen

  authored
  39aaf99

  Copy full SHA for 39aaf99

• use ticker instead of timer

  sdojjy

  committed
  a39d7b7

  Copy full SHA for a39d7b7

• use once

  sdojjy

  committed
  2b93ae4

  Copy full SHA for 2b93ae4

• openAPI (ticdc): add some unit tests and migrate related test to testify (pingcap#4387)

  Show description for b196894
  asddongmen

  authored
  b196894

  Copy full SHA for b196894

• tests(ticdc): disable hibernate-regions-compatible to fix tiflash tests (pingcap#4460)

  Show description for 7a227b4
  overvenus

  authored
  7a227b4

  Copy full SHA for 7a227b4

Commits on Jan 25, 2022

• grafana(dm): fix grafana expr (pingcap#4405)

  Show description for 9d0ec39
  Ehco1996

  authored
  9d0ec39

  Copy full SHA for 9d0ec39

• consumer(ticdc): update the logic of consumer. (pingcap#4129)

  Show description for 43a1d78
  3AceShowHand

  authored
  43a1d78

  Copy full SHA for 43a1d78

• fix: data race (pingcap#4419)

  Show description for fd5bad5
  

  buchuitoudegou

  and

  ti-chi-bot

  authored
  fd5bad5

  Copy full SHA for fd5bad5

• dm: adjust lightning loader config (pingcap#4034)

  Show description for 990327d
  glorv

  authored
  990327d

  Copy full SHA for 990327d

• Revert "redo (ticdc): make FlushLogs in manager asynchronously (pingcap#4301)" (pingcap#4475)

  Show description for 180fa4e
  asddongmen

  authored
  180fa4e

  Copy full SHA for 180fa4e

• errors,version(ticdc): refine ErrCheckClusterVersionFromPD error (pingcap#4435)

  Show description for f51e410
  overvenus

  authored
  f51e410

  Copy full SHA for f51e410

Commits on Jan 26, 2022

• relay/meta(dm): fix potential data races after saving GTID (pingcap#4455)

  Show description for 72c5fab
  dsdashun

  authored
  72c5fab

  Copy full SHA for 72c5fab

• *(dm): add --start-time in DM master (pingcap#4261)

  Show description for 9d7ae48
  lance6716

  authored
  9d7ae48

  Copy full SHA for 9d7ae48

• tests(ticdc): Migrate several test cases to testify (pingcap#4199)

  Show description for 03c5232
  zhaoxinyu

  authored
  03c5232

  Copy full SHA for 03c5232

• docs(ticdc): add design doc for multiple topics (pingcap#4422)

  Show description for 462074a
  Rustin170506

  authored
  462074a

  Copy full SHA for 462074a

• github(dm): add release-note-none for robot pull request (pingcap#4481)

  Show description for c56c1c8
  Rustin170506

  authored
  c56c1c8

  Copy full SHA for c56c1c8

• cmd,sink(ticdc): validate changefeed params and revise error message (pingcap#4482)

  Show description for f917d36
  overvenus

  authored
  f917d36

  Copy full SHA for f917d36

Commits on Jan 27, 2022

• build(deps): bump node-fetch from 2.6.6 to 2.6.7 in /dm/ui (pingcap#4441)

  Show description for cdc9fa5
  dependabot[bot]

  authored
  cdc9fa5

  Copy full SHA for cdc9fa5

• github(dm): add missing schedule property (pingcap#4487)

  Show description for 650d748
  Rustin170506

  authored
  650d748

  Copy full SHA for 650d748

• webui(dm): always redircet to index page (pingcap#4350)

  Show description for 757decd
  Ehco1996

  authored
  757decd

  Copy full SHA for 757decd

• sink (ticdc): reduce the memory consumption by remove redundant eventBuffer in sinkNode (pingcap#4452)

  Show description for 14f8c4f
  asddongmen

  authored
  14f8c4f

  Copy full SHA for 14f8c4f

Commits on Jan 28, 2022

• master(dm): specify worker when create upstream source (pingcap#4167)

  Show description for 2b45869
  jerrylisl

  authored
  2b45869

  Copy full SHA for 2b45869

• checkpoint(dm): batch create table (pingcap#4477)

  Show description for 596f558
  buchuitoudegou

  authored
  596f558

  Copy full SHA for 596f558

Commits on Feb 7, 2022

• sink(ticdc): fix duplicated replace when batch-replace is disabled (pingcap#4502)

  Show description for f710abb
  amyangfei

  authored
  f710abb

  Copy full SHA for f710abb

• Optimistic: support start task with inconsistent upstream table schema (pingcap#3903)

  Show description for 5c7d238
  GMHDBJD

  authored
  5c7d238

  Copy full SHA for 5c7d238

• syncer(dm): Fix async flush log message (pingcap#4500)

  Show description for b0f52af
  db-will

  authored
  b0f52af

  Copy full SHA for b0f52af

Commits on Feb 8, 2022

• dm(ui): support start/pause/resume/delete task (pingcap#4412)

  Show description for 95e751f
  zoubingwu

  authored
  95e751f

  Copy full SHA for 95e751f

• pkg(both): a separate library for DML row change (pingcap#4376)

  Show description for 3c410c5
  lance6716

  authored
  3c410c5

  Copy full SHA for 3c410c5

• metrics(ticdc): add some log and metrics to owner and processorManage… (pingcap#4402)

  Show description for c4f8055
  CharlesCheung96

  authored
  c4f8055

  Copy full SHA for c4f8055

• syncer(dm): enhance error handling about add inject at dml event (pingcap#4259)

  Show description for 5459951
  WizardXiao

  authored
  5459951

  Copy full SHA for 5459951

• master(dm): add cluster id as unique identification of dm-cluster and optimize error message of code:30008 (pingcap#4493)

  Show description for da0dda8
  niubell

  authored
  da0dda8

  Copy full SHA for da0dda8

• cdc/sink: Kafka support user set configuration (pingcap#4512)

  Show description for 801bb60
  3AceShowHand

  authored
  801bb60

  Copy full SHA for 801bb60

• etcd/client(ticdc): add retry operation for etcd transaction api (pingcap#4248) (pingcap#4474)

  Show description for 8dce39f
  CharlesCheung96

  authored
  8dce39f

  Copy full SHA for 8dce39f

Commits on Feb 9, 2022

• .github(ticdc): request TiKV version (pingcap#4535)

  Show description for 7fd749e
  overvenus

  authored
  7fd749e

  Copy full SHA for 7fd749e

• metrics(dm): fix lag metrics for ddl never updated (pingcap#4491)

  Show description for be7b742
  Ehco1996

  authored
  be7b742

  Copy full SHA for be7b742

• sink(cdc): kafka producer use default configuration. (pingcap#4359)

  Show description for 1c1015b
  3AceShowHand

  authored
  1c1015b

  Copy full SHA for 1c1015b

Commits on Feb 10, 2022

• openapi(dm): add error_msg in task status (pingcap#4421)

  Show description for 85116e4
  Ehco1996

  authored
  85116e4

  Copy full SHA for 85116e4

• api,owner(ticdc): return error when api fails (pingcap#4494)

  Show description for e2d529c
  overvenus

  authored
  e2d529c

  Copy full SHA for e2d529c

• Merge branch 'master' into sorter-go-routine-size

  sdojjy

  authored
  b38ef9c

  Copy full SHA for b38ef9c

Commits on Feb 11, 2022

• syncer(dm): use DML library (pingcap#4313)

  Show description for edad7da
  lance6716

  authored
  edad7da

  Copy full SHA for edad7da

• tests(ticdc): fix canal_json_basic charset issue (pingcap#4558)

  Show description for 7bcfae4
  Rustin170506

  authored
  7bcfae4

  Copy full SHA for 7bcfae4

• cdc/metrics: Integrate sarama producer metrics (pingcap#4520)

  Show description for 8a709d7
  3AceShowHand

  authored
  8a709d7

  Copy full SHA for 8a709d7

Commits on Feb 13, 2022

• syncer(dm): fix startGTID is equal to endGTID (pingcap#4386)

  Show description for c48f208
  lance6716

  authored
  c48f208

  Copy full SHA for c48f208

• docs/media(ticdc): update cdc architecture (pingcap#4536)

  Show description for f69f168
  overvenus

  authored
  f69f168

  Copy full SHA for f69f168

• etcd (ticdc): fix a data race in unit test (pingcap#4551)

  Show description for fc3b5ad
  asddongmen

  authored
  fc3b5ad

  Copy full SHA for fc3b5ad

Commits on Feb 14, 2022

• checker(dm): support concurrent check (pingcap#3975)

  Show description for c3e8be9
  okJiang

  authored
  c3e8be9

  Copy full SHA for c3e8be9

• validation(dm): manage validator life cycle (pingcap#4479)

  Show description for 52f0ade
  D3Hunter

  authored
  52f0ade

  Copy full SHA for 52f0ade

• test(dm): fix unsteable test TestRedirectRequestToLeader (pingcap#4556)

  Show description for e230160
  Ehco1996

  authored
  e230160

  Copy full SHA for e230160

• test(dm): fix unsteable test TestFailToStartLeader (pingcap#4566)

  Show description for 7ccbdff
  Ehco1996

  authored
  7ccbdff

  Copy full SHA for 7ccbdff

• syncer(dm): implement start-task --start-time (pingcap#4485)

  Show description for 803aa92
  lance6716

  authored
  803aa92

  Copy full SHA for 803aa92

• checker(dm): support optimistic checker (pingcap#4329)

  Show description for 1fb41f9
  okJiang

  authored
  1fb41f9

  Copy full SHA for 1fb41f9

• sink(ticdc): fix Unknown system variable 'transaction_isolation' for some mysql versions (pingcap#4569)

  Show description for 67a3029
  

  maxshuang

  authored
  67a3029

  Copy full SHA for 67a3029

Commits on Feb 15, 2022

• cdc/sink: kafka sink integrate broker level metrics (pingcap#4517)

  Show description for 28fe713
  3AceShowHand

  authored
  28fe713

  Copy full SHA for 28fe713

• test(ticdc): migrate test-infra to testify for cdc/kv pkg (pingcap#2899) (pingcap#4515)

  Show description for 9ddc713
  CharlesCheung96

  authored
  9ddc713

  Copy full SHA for 9ddc713

• pkg/actor(ticdc): reduce metrics overhead (pingcap#4585)

  Show description for 87cfd44
  overvenus

  authored
  87cfd44

  Copy full SHA for 87cfd44

• ticdc(sink): remove useless AppendResolvedEvent (pingcap#4596)

  Show description for 2293dc2
  Rustin170506

  authored
  2293dc2

  Copy full SHA for 2293dc2

Commits on Feb 16, 2022

• dm: new router compatible with regular expression (pingcap#4358)

  Show description for 536d8ae
  buchuitoudegou

  authored
  536d8ae

  Copy full SHA for 536d8ae

• loader(dm): skip feature for nil etcd client (pingcap#4599)

  Show description for 744a26e
  lance6716

  authored
  744a26e

  Copy full SHA for 744a26e

• unit(dm): add Kill func for unit (pingcap#4035)

  Show description for e7b0aae
  Ehco1996

  authored
  e7b0aae

  Copy full SHA for e7b0aae

• cdc/sink: decouple opt out of statistics (pingcap#4606)

  Show description for 1c3bf68
  3AceShowHand

  authored
  1c3bf68

  Copy full SHA for 1c3bf68

• ticdc(mounter): remove unnecessary delete event decode logic (pingcap#4602)

  Show description for 2f4b706
  Rustin170506

  authored
  2f4b706

  Copy full SHA for 2f4b706

Commits on Feb 17, 2022

• Merge branch 'master' into sorter-go-routine-size

  sdojjy

  authored
  e9cb7ab

  Copy full SHA for e9cb7ab

• revert client

  sdojjy

  committed
  2592e98

  Copy full SHA for 2592e98