Checkpointing on Spark Node failures -


i have developed spark streaming application (which has internal sates well) check pointing , fault-tolerant..this working on when exit application , re-reun it...so every thing (states..) loads well,

i wonder why in case of cluster miss, should work or not? because guess spark save checkpoints pointers memory location...

yes should work, after cluster up, state regained.


Comments