You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When doing iterative computing, I found the lineage on IndexedRDDs cannot be cut through checkpointing. It is because the newRDD returned by doCheckpoint() is a CheckpointRDD.
I'm presently using IndexedRDD as a Spark package. Is there any way other than checkpoint (through public API) that I can use to cut the lineage? Thank you! Any suggestion is appreciated...
The text was updated successfully, but these errors were encountered:
Hi,
When doing iterative computing, I found the lineage on IndexedRDDs cannot be cut through checkpointing. It is because the newRDD returned by doCheckpoint() is a CheckpointRDD.
I'm presently using IndexedRDD as a Spark package. Is there any way other than checkpoint (through public API) that I can use to cut the lineage? Thank you! Any suggestion is appreciated...
The text was updated successfully, but these errors were encountered: