chore: Upgrade spark to 4.0.0-preview1

[advancedxy]

Which issue does this PR close?

Closes #525

Rationale for this change

Reduce CI time and for local testing with spark 4.0.

What changes are included in this PR?

How are these changes tested?

[advancedxy]

@kazuyukitanimura would you mind take a look at this.

[kazuyukitanimura]

LGTM pending CI

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 34.32%. Comparing base (7ab37eb) to head (7dde3de).
Report is 1 commits behind head on main.

Additional details and impacted files

@@             Coverage Diff              @@
##               main     #526      +/-   ##
============================================
+ Coverage     34.23%   34.32%   +0.09%     
- Complexity      803      807       +4     
============================================
  Files           105      105              
  Lines         38483    38483              
  Branches       8560     8562       +2     
============================================
+ Hits          13173    13209      +36     
+ Misses        22555    22522      -33     
+ Partials       2755     2752       -3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.