feat: Add COMET_SHUFFLE_MODE config to control Comet shuffle mode #1180

Job	Run time
ubuntu-latest/java 8-spark-3.4-scala-2.12/rust	2s
macos-14(Silicon)/java 8-spark-3.4-scala-2.12/rust	1s
ubuntu-latest/java 8-spark-3.2-scala-2.12/java	7s
ubuntu-latest/java 8-spark-3.4-scala-2.13/rust	3s
macos-14(Silicon)/java 8-spark-3.4-scala-2.13/rust	1s
macos-14(Silicon)/java 8-spark-3.2-scala-2.12/java	3s
ubuntu-latest/java 8-spark-3.4-scala-2.12/java	2s
macos-14(Silicon)/java 8-spark-3.4-scala-2.12/java	1s
macos-14(Silicon)/java 17-spark-3.3-scala-2.12/java	2s
ubuntu-latest/java 8-spark-3.4-scala-2.13/java	2s
macos-14(Silicon)/java 17-spark-3.3-scala-2.13/java	2s
macos-14(Silicon)/java 8-spark-3.4-scala-2.13/java	2s
ubuntu-latest/java 17-spark-3.4-scala-2.12/rust	3s
ubuntu-latest/java 17-spark-3.4-scala-2.13/rust	2s
macos-14(Silicon)/java 17-spark-3.4-scala-2.12/rust	2s
ubuntu-latest/java 8-spark-3.3-scala-2.12/java	3s
ubuntu-latest/java 17-spark-3.4-scala-2.12/java	2s
${{ matrix.os }}/java ${{ matrix.java_version }}-spark-${{ matrix.spark-version }}-scala-${{ matrix.scala-version }}/${{ matrix.test-target }}	0s
ubuntu-latest/java 8-spark-3.3-scala-2.13/java	2s
ubuntu-latest/java 17-spark-3.4-scala-2.13/java	3s
ubuntu-latest/java 11-spark-3.3-scala-2.12/java	3s
ubuntu-latest/java 11-spark-3.3-scala-2.13/java	2s
macos-14(Silicon)/java 17-spark-3.4-scala-2.13/rust	1s
ubuntu-latest/java 17-spark-3.3-scala-2.12/java	1s
macos-14(Silicon)/java 17-spark-3.4-scala-2.12/java	1s
ubuntu-latest/java 17-spark-3.3-scala-2.13/java	2s
macos-14(Silicon)/java 17-spark-3.4-scala-2.13/java	1s
	56s

Provide feedback