Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v7.1.6: ticdc: add description for cdc behaviour change (#17363) #17478

Merged
merged 11 commits into from
Nov 21, 2024
Merged

v7.1.6: ticdc: add description for cdc behaviour change (#17363) #17478

Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
e0ea4a6
This is an automated cherry-pick of #17363
lidezhu May 30, 2024
1328977
Discard changes to releases/release-8.1.0.md
qiancai May 30, 2024
11eeef9
resolve conflicts
qiancai May 30, 2024
42a7b17
Update ticdc/ticdc-behavior-change.md
qiancai Jun 4, 2024
64e6642
thresholdTs -> thresholdTS
qiancai Jun 5, 2024
46ceb8e
Apply suggestions from code review
qiancai Jun 13, 2024
90526c7
Discard changes to ticdc/ticdc-behavior-change.md
qiancai Nov 18, 2024
329b0cf
Merge branch 'release-7.1' into pr/17478
qiancai Nov 18, 2024
cf530fe
Merge branch 'cherry-pick-17363-to-release-7.1' of https://github.com…
qiancai Nov 18, 2024
f3fa698
Update ticdc-split-update-behavior.md
qiancai Nov 18, 2024
83e5067
Update ticdc-split-update-behavior.md
qiancai Nov 18, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions ticdc/ticdc-split-update-behavior.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ aliases: ['/zh/tidb/dev/ticdc-behavior-change']

## MySQL Sink 拆分 `UPDATE` 事件行为说明

从 v6.5.10 开始，当使用 MySQL Sink 时，TiCDC 的任意节点每次收到某张表的同步任务请求并开始向下游同步数据之前，会从 PD 获取当前的时间戳 `thresholdTS`，并根据时间戳的值决定是否拆分对应表的 `UPDATE` 事件：
从 v6.5.10 和 v7.1.6 开始，当使用 MySQL Sink 时，TiCDC 的任意节点每次收到某张表的同步任务请求并开始向下游同步数据之前，会从 PD 获取当前的时间戳 `thresholdTS`，并根据时间戳的值决定是否拆分对应表的 `UPDATE` 事件：

- 对于含有单条或多条 `UPDATE` 变更的事务，如果该事务的 `commitTS` 小于 `thresholdTS`，在写入 Sorter 模块之前 TiCDC 会将每条 `UPDATE` 事件拆分为 `DELETE` 和 `INSERT` 两条事件。
- 对于事务的 `commitTS` 大于或等于 `thresholdTS` 的 `UPDATE` 事件，TiCDC 不会对其进行拆分。详情见 GitHub issue [#10918](https://github.com/pingcap/tiflow/issues/10918)。
Expand Down Expand Up @@ -135,4 +135,4 @@ COMMIT;
| v7.1.1 | Canal/Open | ✗ | ✓ |  |
| v7.1.1 | CSV/Avro | ✗ | ✗ | 拆分但是不排序, 详见 [#9086](https://github.com/pingcap/tiflow/issues/9658) |
| v7.1.2 ~ v7.1.5 | 所有协议 | ✓ | ✗ |  |
| \>= v7.1.6（待发布）| 所有协议 | ✓ (默认值：`output-raw-change-event = false`) | ✓ (可选配置项：`output-raw-change-event = true`) | |
| \>= v7.1.6 | 所有协议 | ✓ (默认值：`output-raw-change-event = false`) | ✓ (可选配置项：`output-raw-change-event = true`) | |
Loading