fix: sync task still running after DataNode has stopped

[jaime0815]

issue: #38319
pr: #38377

[mergify]

@jaime0815 E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@jaime0815 E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@jaime0815 E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[mergify]

@jaime0815 E2e jenkins job failed, comment /run-cpu-e2e can trigger the job again.

[codecov]

Codecov Report

Attention: Patch coverage is 62.22222% with 17 lines in your changes missing coverage. Please review.

Project coverage is 83.36%. Comparing base (1da4ac4) to head (5aa663c).
Report is 12 commits behind head on 2.4.

Files with missing lines	Patch %	Lines
internal/datanode/writebuffer/write_buffer.go	33.33%	4 Missing and 2 partials ⚠️
internal/datanode/importv2/task_import.go	20.00%	3 Missing and 1 partial ⚠️
internal/datanode/importv2/task_l0_import.go	20.00%	3 Missing and 1 partial ⚠️
internal/datanode/data_node.go	40.00%	2 Missing and 1 partial ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##              2.4   #38441      +/-   ##
==========================================
+ Coverage   79.50%   83.36%   +3.85%     
==========================================
  Files        1077      809     -268     
  Lines      169330   142904   -26426     
==========================================
- Hits       134633   119127   -15506     
+ Misses      30234    19295   -10939     
- Partials     4463     4482      +19     

Files with missing lines	Coverage Δ
internal/datanode/syncmgr/sync_manager.go	79.74% <100.00%> (+1.66%)	⬆️
pkg/util/conc/pool.go	88.57% <100.00%> (+0.69%)	⬆️
pkg/util/paramtable/component_param.go	98.38% <100.00%> (+<0.01%)	⬆️
internal/datanode/data_node.go	81.27% <40.00%> (-0.71%)	⬇️
internal/datanode/importv2/task_import.go	80.89% <20.00%> (-2.12%)	⬇️
internal/datanode/importv2/task_l0_import.go	68.75% <20.00%> (-1.97%)	⬇️
internal/datanode/writebuffer/write_buffer.go	75.66% <33.33%> (-0.98%)	⬇️

... and 309 files with indirect coverage changes

[congqixia]

/lgtm

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia, jaime0815

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• configs/OWNERS [congqixia]
• internal/datanode/OWNERS [congqixia]
• pkg/util/OWNERS [congqixia]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[jaime0815]

/hold