Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Eliminate nullness errors from a bit of the FlinkRunner #32925

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Eliminate nullness errors from a bit of the FlinkRunner

e4ed7eb
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Draft

Eliminate nullness errors from a bit of the FlinkRunner #32925

Eliminate nullness errors from a bit of the FlinkRunner
e4ed7eb
Select commit
Loading
Failed to load commit list.
GitHub Actions / Test Results succeeded Dec 6, 2024 in 0s

All 163 tests pass, 5 skipped in 33m 16s

  506 files  +  280    506 suites  +280   33m 16s ⏱️ + 22m 57s
  168 tests  - 1 420    163 ✅  - 1 415   5 💤  -  5  0 ❌ ±0 
1 848 runs  +  256  1 793 ✅ +  211  55 💤 +45  0 ❌ ±0 

Results for commit e4ed7eb. ± Comparison against earlier commit a58f05d.

Annotations

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Test Results

5 skipped tests found

There are 5 skipped tests, see "Raw output" for the full list of skipped tests.
Raw output
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testStreamingPipelineCanceledState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testStreamingPipelineFailedState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testStreamingPipelineRunningState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testStreamingPipelineTimeoutState
org.apache.beam.runners.spark.structuredstreaming.translation.streaming.SimpleSourceTest ‑ testUnboundedSource

Check notice on line 0 in .github

See this annotation in the file changed.

@github-actions github-actions / Test Results

168 tests found

There are 168 tests, see "Raw output" for the full list of tests.
Raw output
org.apache.beam.runners.spark.CacheTest ‑ cacheCandidatesUpdaterTest
org.apache.beam.runners.spark.CacheTest ‑ shouldCacheTest
org.apache.beam.runners.spark.GlobalWatermarkHolderTest ‑ testLowHighWatermarksAdvance
org.apache.beam.runners.spark.GlobalWatermarkHolderTest ‑ testMultiSource
org.apache.beam.runners.spark.GlobalWatermarkHolderTest ‑ testSynchronizedTimeMonotonic
org.apache.beam.runners.spark.ProvidedSparkContextTest ‑ testAWithProvidedContext
org.apache.beam.runners.spark.ProvidedSparkContextTest ‑ testBWithStoppedProvidedContext
org.apache.beam.runners.spark.ProvidedSparkContextTest ‑ testCWithNullContext
org.apache.beam.runners.spark.SparkPipelineOptionsTest ‑ testCheckpointDirDefaultValue
org.apache.beam.runners.spark.SparkPipelineStateTest ‑ testBatchPipelineCanceledState
org.apache.beam.runners.spark.SparkPipelineStateTest ‑ testBatchPipelineFailedState
org.apache.beam.runners.spark.SparkPipelineStateTest ‑ testBatchPipelineRunningState
org.apache.beam.runners.spark.SparkPipelineStateTest ‑ testBatchPipelineWaitTimeout
org.apache.beam.runners.spark.SparkPipelineStateTest ‑ testStreamingPipelineCanceledState
org.apache.beam.runners.spark.SparkPipelineStateTest ‑ testStreamingPipelineFailedState
org.apache.beam.runners.spark.SparkPipelineStateTest ‑ testStreamingPipelineRunningState
org.apache.beam.runners.spark.SparkPipelineStateTest ‑ testStreamingPipelineWaitTimeout
org.apache.beam.runners.spark.SparkRunnerDebuggerTest ‑ debugBatchPipeline
org.apache.beam.runners.spark.SparkRunnerDebuggerTest ‑ debugBatchPipelineWithContextfulTransform
org.apache.beam.runners.spark.SparkRunnerDebuggerTest ‑ debugStreamingPipeline
org.apache.beam.runners.spark.SparkRunnerRegistrarTest ‑ testOptions
org.apache.beam.runners.spark.SparkRunnerRegistrarTest ‑ testRunners
org.apache.beam.runners.spark.SparkRunnerRegistrarTest ‑ testServiceLoaderForOptions
org.apache.beam.runners.spark.SparkRunnerRegistrarTest ‑ testServiceLoaderForRunner
org.apache.beam.runners.spark.aggregators.metrics.sink.SparkMetricsSinkTest ‑ testInBatchMode
org.apache.beam.runners.spark.aggregators.metrics.sink.SparkMetricsSinkTest ‑ testInStreamingMode
org.apache.beam.runners.spark.coders.SparkRunnerKryoRegistratorTest$WithKryoSerializer ‑ testKryoRegistration
org.apache.beam.runners.spark.coders.SparkRunnerKryoRegistratorTest$WithoutKryoSerializer ‑ testDefaultSerializerNotCallingKryo
org.apache.beam.runners.spark.io.AvroPipelineTest ‑ testGeneric
org.apache.beam.runners.spark.io.NumShardsTest ‑ testText
org.apache.beam.runners.spark.io.ReaderToIteratorAdapterTest ‑ testHasNextIdempotencyCombo
org.apache.beam.runners.spark.io.ReaderToIteratorAdapterTest ‑ testNextWhenDrainedThrows
org.apache.beam.runners.spark.io.ReaderToIteratorAdapterTest ‑ testReaderIsClosedAfterDrainage
org.apache.beam.runners.spark.metrics.SparkBeamMetricTest ‑ testRenderName
org.apache.beam.runners.spark.metrics.SparkBeamMetricTest ‑ testRenderNameWithPrefix
org.apache.beam.runners.spark.metrics.SparkMetricsPusherTest ‑ testInBatchMode
org.apache.beam.runners.spark.metrics.SparkMetricsPusherTest ‑ testInStreamingMode
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testBag
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testBagIsEmpty
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testBagWithBadCoderEquality
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testCombiningIsEmpty
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testCombiningValue
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMap
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMapReadable
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMergeBagIntoNewNamespace
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMergeBagIntoSource
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMergeCombiningValueIntoNewNamespace
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMergeCombiningValueIntoSource
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMergeCombiningWithContextValueIntoNewNamespace
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMergeCombiningWithContextValueIntoSource
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMergeSetIntoNewNamespace
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testMergeSetIntoSource
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testSet
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testSetIsEmpty
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testSetReadable
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testValue
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testWatermarkEarliestState
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testWatermarkEndOfWindowState
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testWatermarkLatestState
org.apache.beam.runners.spark.stateful.SparkStateInternalsTest ‑ testWatermarkStateIsEmpty
org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingRunnerRegistrarTest ‑ testOptions
org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingRunnerRegistrarTest ‑ testRunners
org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingRunnerRegistrarTest ‑ testServiceLoaderForOptions
org.apache.beam.runners.spark.structuredstreaming.SparkStructuredStreamingRunnerRegistrarTest ‑ testServiceLoaderForRunner
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testBatchPipelineCanceledState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testBatchPipelineFailedState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testBatchPipelineRunningState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testBatchPipelineTimeoutState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testStreamingPipelineCanceledState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testStreamingPipelineFailedState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testStreamingPipelineRunningState
org.apache.beam.runners.spark.structuredstreaming.StructuredStreamingPipelineStateTest ‑ testStreamingPipelineTimeoutState
org.apache.beam.runners.spark.structuredstreaming.aggregators.metrics.sink.SparkMetricsSinkTest ‑ testInBatchMode
org.apache.beam.runners.spark.structuredstreaming.metrics.SparkBeamMetricTest ‑ testRenderName
org.apache.beam.runners.spark.structuredstreaming.metrics.SparkBeamMetricTest ‑ testRenderNameWithPrefix
org.apache.beam.runners.spark.structuredstreaming.translation.batch.AggregatorsTest$MergingWindowedAggregatorTest ‑ testMerge
org.apache.beam.runners.spark.structuredstreaming.translation.batch.AggregatorsTest$MergingWindowedAggregatorTest ‑ testReduce
org.apache.beam.runners.spark.structuredstreaming.translation.batch.AggregatorsTest$NonMergingWindowedAggregatorTest ‑ testMerge
org.apache.beam.runners.spark.structuredstreaming.translation.batch.AggregatorsTest$NonMergingWindowedAggregatorTest ‑ testReduce
org.apache.beam.runners.spark.structuredstreaming.translation.batch.AggregatorsTest$SessionsAggregatorTest ‑ testMerge
org.apache.beam.runners.spark.structuredstreaming.translation.batch.AggregatorsTest$SessionsAggregatorTest ‑ testReduce
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombineGloballyTest ‑ testBinaryCombineWithSlidingWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombineGloballyTest ‑ testCombineGlobally
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombineGloballyTest ‑ testCombineGloballyPreservesWindowing
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombineGloballyTest ‑ testCombineGloballyWithMergingWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombineGloballyTest ‑ testCombineGloballyWithSlidingWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombineGloballyTest ‑ testCountGloballyWithSlidingWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombineGroupedValuesTest ‑ testCombineGroupedValues
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombinePerKeyTest ‑ testCombineByKeyWithMergingWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombinePerKeyTest ‑ testCombinePerKey
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombinePerKeyTest ‑ testCombinePerKeyPreservesWindowing
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombinePerKeyTest ‑ testCombinePerKeyWithSlidingWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombinePerKeyTest ‑ testCountPerElementWithSlidingWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.CombinePerKeyTest ‑ testDistinctViaCombinePerKey
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ComplexSourceTest ‑ testBoundedSource
org.apache.beam.runners.spark.structuredstreaming.translation.batch.FlattenTest ‑ testFlatten
org.apache.beam.runners.spark.structuredstreaming.translation.batch.GroupByKeyTest ‑ testGroupByKey
org.apache.beam.runners.spark.structuredstreaming.translation.batch.GroupByKeyTest ‑ testGroupByKeyExplodesMultipleWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.GroupByKeyTest ‑ testGroupByKeyPreservesWindowing
org.apache.beam.runners.spark.structuredstreaming.translation.batch.GroupByKeyTest ‑ testGroupByKeyWithMergingWindows
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ParDoTest ‑ testPardo
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ParDoTest ‑ testPardoWithOutputTagsCachedDataset
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ParDoTest ‑ testPardoWithOutputTagsCachedRDD
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ParDoTest ‑ testPardoWithUnusedOutputTags
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ParDoTest ‑ testSideInputAsList
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ParDoTest ‑ testSideInputAsMap
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ParDoTest ‑ testSideInputAsSingleton
org.apache.beam.runners.spark.structuredstreaming.translation.batch.ParDoTest ‑ testTwoPardoInRow
org.apache.beam.runners.spark.structuredstreaming.translation.batch.SimpleSourceTest ‑ testBoundedSource
org.apache.beam.runners.spark.structuredstreaming.translation.batch.WindowAssignTest ‑ testWindowAssign
org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions.SideInputValuesTest ‑ globalSideInputValues
org.apache.beam.runners.spark.structuredstreaming.translation.batch.functions.SideInputValuesTest ‑ windowedSideInputValues
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testBeamBinaryEncoder
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testBeamEncoderMappings
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testBeamEncoderOfPrivateType
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testBeamWindowedValueEncoderMappings
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testCollectionEncoder
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testEncoderForKVCoder
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testHashMapEncoder
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testMapEncoder
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testOneOffEncoder
org.apache.beam.runners.spark.structuredstreaming.translation.helpers.EncoderHelpersTest ‑ testTreeMapEncoder
org.apache.beam.runners.spark.structuredstreaming.translation.streaming.SimpleSourceTest ‑ testUnboundedSource
org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctionsTest ‑ testGbkIteratorValuesCannotBeReiterated
org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctionsTest ‑ testGroupByKeyInGlobalWindowWithPartitioner
org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctionsTest ‑ testGroupByKeyInGlobalWindowWithoutPartitioner
org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctionsTest ‑ testGroupByKeyIterator
org.apache.beam.runners.spark.translation.GroupNonMergingWindowsFunctionsTest ‑ testGroupByKeyIteratorOnNonGlobalWindows
org.apache.beam.runners.spark.translation.SparkCombineFnTest ‑ testGlobalCombineFn
org.apache.beam.runners.spark.translation.SparkCombineFnTest ‑ testGlobalWindowCombineFn
org.apache.beam.runners.spark.translation.SparkCombineFnTest ‑ testGlobalWindowMergeAccumulatorsWithEarliestCombiner
org.apache.beam.runners.spark.translation.SparkCombineFnTest ‑ testSessionCombineFn
org.apache.beam.runners.spark.translation.SparkCombineFnTest ‑ testSlidingCombineFnExplode
org.apache.beam.runners.spark.translation.SparkCombineFnTest ‑ testSlidingCombineFnNonMerging
org.apache.beam.runners.spark.translation.SparkExecutableStageFunctionTest ‑ expectedInputsAreSent
org.apache.beam.runners.spark.translation.SparkExecutableStageFunctionTest ‑ outputsAreTaggedCorrectly
org.apache.beam.runners.spark.translation.SparkExecutableStageFunctionTest ‑ sdkErrorsSurfaceOnClose
org.apache.beam.runners.spark.translation.SparkExecutableStageFunctionTest ‑ testNoCallOnEmptyInputIterator
org.apache.beam.runners.spark.translation.SparkExecutableStageFunctionTest ‑ testStageBundleClosed
org.apache.beam.runners.spark.translation.SparkInputDataProcessorTest ‑ testBoundedProcessBlocksOnMaxInputsUntilTheyAreConsumed
org.apache.beam.runners.spark.translation.SparkInputDataProcessorTest ‑ testBoundedProcessLifecycle
org.apache.beam.runners.spark.translation.SparkInputDataProcessorTest ‑ testBoundedProcessWorksWithEmptyInput
org.apache.beam.runners.spark.translation.SparkInputDataProcessorTest ‑ testUnboundedProcessLifecycle
org.apache.beam.runners.spark.translation.SparkInputDataProcessorTest ‑ testUnboundedProcessWorksWithEmptyInput
org.apache.beam.runners.spark.translation.SparkInputDataProcessorTest ‑ testUnboundedProcessWritesAllInputsAndNotBlock
org.apache.beam.runners.spark.translation.TransformTranslatorTest ‑ testIteratorFlatten
org.apache.beam.runners.spark.translation.TransformTranslatorTest ‑ testMultipleOutputPardoHaveFilter
org.apache.beam.runners.spark.translation.TransformTranslatorTest ‑ testSingleOutputParDoHasNoFilter
org.apache.beam.runners.spark.translation.TransformTranslatorTest ‑ testSplitBySameKey
org.apache.beam.runners.spark.translation.ValueAndCoderLazySerializableTest ‑ serializableAccumulatorKryoTest
org.apache.beam.runners.spark.translation.ValueAndCoderLazySerializableTest ‑ serializableAccumulatorSerializationTest
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testAdvanceWatermarkEqualToPositiveInfinityThrows
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testAdvanceWatermarkNonMonotonicThrows
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testDiscardingMode
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testElementAtPositiveInfinityThrows
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testElementsAtAlmostPositiveInfinity
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testFirstElementLate
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testFlattenedWithWatermarkHold
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testInStreamingModeCountByKey
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testLateDataAccumulating
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testMultiOutputParDo
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testMultipleStreams
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest ‑ testParDoCallsSetupAndTeardown
org.apache.beam.runners.spark.translation.streaming.ResumeFromCheckpointStreamingTest ‑ testWithResume
org.apache.beam.runners.spark.translation.streaming.SparkCoGroupByKeyStreamingTest ‑ testInStreamingMode
org.apache.beam.runners.spark.translation.streaming.StreamingSourceMetricsTest ‑ testUnboundedSourceMetrics
org.apache.beam.runners.spark.translation.streaming.TrackStreamingSourcesTest ‑ testTrackFlattened
org.apache.beam.runners.spark.translation.streaming.TrackStreamingSourcesTest ‑ testTrackSingle