Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clinic: add new docs #8226

Merged
merged 109 commits into from
Mar 3, 2022
Merged
Show file tree
Hide file tree
Changes from 4 commits
Commits
Show all changes
109 commits
Select commit Hold shift + click to select a range
9321329
the-first-two-clinic-doc
qqqdan Jan 25, 2022
e6137ef
add-conent
qqqdan Jan 25, 2022
7f88e07
add-introduce-doc
qqqdan Jan 28, 2022
913f803
add-more-doc
qqqdan Feb 6, 2022
3acd1ab
change-file-name-and-fix-some-issue
qqqdan Feb 8, 2022
f7a3cf6
add-toc
qqqdan Feb 8, 2022
c84fb6b
make-change-based-on-comments
qqqdan Feb 8, 2022
696681e
Update clinic/clinic-introduce.md
qqqdan Feb 8, 2022
7bf524f
Update clinic/clinic-introduce.md
qqqdan Feb 8, 2022
f31dd58
Update clinic/clinic-data-instruction-for-tiup.md
qqqdan Feb 8, 2022
cf72171
Update clinic/clinic-data-instruction-for-tiup.md
qqqdan Feb 8, 2022
1c8b36f
Update clinic/clinic-data-instruction-for-tiup.md
qqqdan Feb 8, 2022
e7e431f
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 8, 2022
c7fc8ba
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 8, 2022
815608a
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 8, 2022
b0030e1
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 8, 2022
ccce481
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 8, 2022
71f4df1
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 8, 2022
7f5531b
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 8, 2022
a81ce79
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 8, 2022
fe5fd84
Update clinic/clinic-data-instruction-for-tiup.md
qqqdan Feb 10, 2022
b6c2035
fix-the-quotes-issues
qqqdan Feb 10, 2022
2271631
fix-all-the-comment
qqqdan Feb 10, 2022
f90fbf4
Update TOC.md
qqqdan Feb 11, 2022
418272f
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
c57d972
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
282bbad
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
5508c43
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
23c3215
Update clinic/clinic-introduce.md
qqqdan Feb 11, 2022
a575d63
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
11b0b7d
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
75f72b4
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
20ad5be
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
a471f49
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
78b13e0
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
176bd23
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
a937570
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
bb1bb68
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
4c70968
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
197aa65
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
3d40eac
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
7ed08f5
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
8428680
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
cf1a067
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
392ddcd
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
6fab81f
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Feb 11, 2022
f79f889
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
09fcc6b
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
e2c3bca
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
5804097
Update clinic/clinic-introduce.md
qqqdan Feb 11, 2022
7933e9d
Update clinic/clinic-introduce.md
qqqdan Feb 11, 2022
82e27eb
Update clinic/clinic-introduce.md
qqqdan Feb 11, 2022
4796134
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
0574ebc
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
533d21b
Update clinic/clinic-data-instruction-for-tiup.md
qqqdan Feb 11, 2022
b03be1d
Update clinic/clinic-data-instruction-for-tiup.md
qqqdan Feb 11, 2022
ecc18f7
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
9ef16ca
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
c29af56
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
cabb18c
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
3da80eb
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
ab81f3c
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
c818b92
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
02fe5f0
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
2a1cdbe
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
f3b3861
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
2bcd195
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
9b429fc
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
f7c09a4
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
1c0c6d4
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
adae501
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
6d7f1d1
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
b988ac0
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
3f7c1f1
Update clinic/Clinic-user-guide-for-Operator.md
qqqdan Feb 11, 2022
7be8ee7
update-based-on-comments
qqqdan Feb 11, 2022
e2aba26
update clinic-user-guide-for-operator.md
en-jin19 Feb 14, 2022
e1c0bb3
Only update the format of clinic-data-instruction-for-operator.md
en-jin19 Feb 14, 2022
7b4c282
only update the format of clinic-data-instruction-for-tiup.md
en-jin19 Feb 14, 2022
5c9a54a
Update clinic/clinic-introduce.md
qiancai Feb 15, 2022
5ccfef1
update a common typo in clinic-data-instruction-for-operator.md
en-jin19 Feb 15, 2022
2570a25
update a common typo
en-jin19 Feb 15, 2022
881fb10
update-based-on-comments
qqqdan Feb 15, 2022
34b9e73
Apply suggestions from code review
qqqdan Feb 16, 2022
004c02f
update-file-name
qqqdan Feb 16, 2022
fd1c1a6
update-link
qqqdan Feb 16, 2022
65af4c1
move two docs to operator repo
en-jin19 Feb 17, 2022
5af082d
update TiUP related contents
en-jin19 Feb 18, 2022
ff800e1
Apply suggestions from code review
en-jin19 Feb 21, 2022
cb59bc7
Apply suggestions from code review
en-jin19 Feb 21, 2022
1fd63a4
Apply suggestions from code review
en-jin19 Feb 21, 2022
623ca91
update
en-jin19 Feb 21, 2022
17156bc
fix CI errors
en-jin19 Feb 21, 2022
12e6291
fix a CI error
en-jin19 Feb 21, 2022
68b1aec
fix dead anchors
en-jin19 Feb 21, 2022
e829cb9
Apply suggestions from code review
en-jin19 Feb 22, 2022
79c4521
Apply suggestions from code review
en-jin19 Feb 23, 2022
3d00c32
Apply suggestions from code review
en-jin19 Feb 23, 2022
444624c
Apply suggestions from code review
en-jin19 Feb 24, 2022
dc9da0a
Apply suggestions from code review
en-jin19 Feb 24, 2022
242bc4a
Apply suggestions from code review
en-jin19 Feb 24, 2022
f8a548d
Apply suggestions from code review
en-jin19 Feb 25, 2022
96dc4ab
update "TiDB Clinic Diagnostic Data"
en-jin19 Mar 2, 2022
622c35b
update "Overview of TiDB Clinic"
en-jin19 Mar 2, 2022
9850200
Update TOC.md
en-jin19 Mar 2, 2022
b48ba7d
update "Use TiDB Clinic"
en-jin19 Mar 2, 2022
26bb1d4
fix jenkins issues
en-jin19 Mar 2, 2022
6a708ad
Update clinic/clinic-introduction.md
qqqdan Mar 3, 2022
7dee451
Update clinic/clinic-user-guide-for-tiup.md
qqqdan Mar 3, 2022
700fa8e
Apply suggestions from code review
en-jin19 Mar 3, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
130 changes: 130 additions & 0 deletions clinic/Clinic 数据采集说明 - TiUP 环境.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,130 @@
---
title: Clinic 数据采集说明 - TiUP 环境
summary: 详细说明 Clinic 采集哪些诊断数据
---

# Clinic 数据采集说明 - TiUP 环境

## 数据用途
仅用集群问题分析和诊断。
en-jin19 marked this conversation as resolved.
Show resolved Hide resolved

## 数据存储和安全
数据存储于 PingCAP 设立在 AWS S3 中国区(北京)的服务器,数据诊断分析服务器位于 PingCAP 内网,在中国境内。
数据访问权限做了严格的访问控制,只有经授权的 PingCAP 技术人员能够访问。
数据将在对应的技术支持 Case 关闭后90天内永久删除或匿名化处理。

## TiDB 集群数据采集范围
### Cluster 基础信息
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 集群基础信息,包括集群 ID | cluster.json | 每次收集默认采集 |
| 集群详细信息 | meta.yaml|每次收集默认采集 |

### TiDB 诊断数据
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 日志 | tidb.log | --include=log|
| Error 日志 | meta.yaml| --include=log|
| 慢日志| tidb_stderr.log|--include=log |
en-jin19 marked this conversation as resolved.
Show resolved Hide resolved
| 配置文件 | tidb.toml|--include=config |
| 实时配置| config.json |--include=config |

### TiKV 诊断数据
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 日志 | tikv.log | --include=log|
| Error 日志 | tikv_stderr.log| --include=log|
| 配置文件 | tikv.toml|--include=config|
| 实时配置| config.json|--include=config |

### PD 诊断数据
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 日志 | pd.log | --include=log|
| Error 日志 |pd_stderr.log| --include=log|
| 配置文件 | pd.toml|--include=config|
| 实时配置| config.json|--include=config |
| tiup ctl pd -u http://${pd IP}:${PORT} store 输出 | store.json|--include=config|
| tiup ctl pd -u http://${pd IP}:${PORT} config placement-rules show 输出 |placement-rule.json|--include=config |

### TiFlash 诊断数据
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 日志 | tiflash.log | --include=log|
| Error 日志 |tiflash_stderr.log| --include=log|
| 配置文件 | tiflash-learner.toml, tiflash-preprocessed.toml, tiflash.toml| --include=config|
| 实时配置| config.json| --include=config |

### TiCDC 诊断数据
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 日志 | ticdc.log | --include=log|
| Error 日志 |ticdc_stderr.log| --include=log|
| 配置文件 | ticdc.toml| --include=config|
| 实时配置| config.json| --include=config |


### Prometheus 监控数据
|诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 所有的 Metrics 数据|XXXXX.json| --include=monitor |
| Alert 配置 |alerts.json| --include=monitor |

### TiDB 系统变量
|诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 获取 tidb 系统变量(默认不采集,采集需要额外提供 db 帐号) |mysql.tidb.csv| --include=db_vars|
| |global_variables.csv| --include=db_vars |


### 集群系统信息

|诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
|内核日志 |dmesg.log| --include=system |
| 基础的系统和硬件信息|insight.json| --include=system |
| 系统 /etc/security/limits.conf 中的内容|limits.conf| --include=system |
| 内核参数列表 |sysctl.conf| --include=system |
| 基础的系统和硬件信息|insight.json| --include=system |
qqqdan marked this conversation as resolved.
Show resolved Hide resolved
| socket 统计信息,ss 命令结果|ss.txt| --include=system |



## DM 集群数据采集范围

### Cluster 基础信息
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 集群基础信息,包括集群 ID | cluster.json | 每次收集默认采集 |
| 集群详细信息 | meta.yaml|每次收集默认采集 |

### dm-master 诊断数据
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 日志 | dm-master.log| --include=log|
| Error 日志 | dm-master_stderr.log| --include=log|
| 配置文件 | dm-master.toml | --include=config|

### dm-worker 诊断数据
| 诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 日志| dm-worker.log|--include=log |
| Error 日志 | dm-worker_stderr.log| --include=log|
| 配置文件 | dm-work.toml | --include=config|

### Prometheus 监控数据
|诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
| 所有的 Metrics 数据|XXXXX.json| --include=monitor |
| Alert 配置 |alerts.json| --include=monitor |

### 集群系统信息

|诊断数据类型 | 输出文文件 | Clinic 采集参数 |
| :------ | :------ |:-------- |
|内核日志 |dmesg.log| --include=system |
| 基础的系统和硬件信息|insight.json| --include=system |
| 系统 /etc/security/limits.conf 中的内容|limits.conf| --include=system |
| 内核参数列表 |sysctl.conf| --include=system |
| 基础的系统和硬件信息|insight.json| --include=system |
| socket 统计信息,ss 命令结果|ss.txt| --include=system |
Loading