Reusing PVC

[cgpoh]

What question do you want to ask?

• ✋ I have searched the open/closed issues and my issue is not listed.

When my Spark job fails, I need it to restart from a saved checkpoint stored in my PV. Does the Spark Operator support reusing PVC? Currently, whenever I uninstall my Spark job, the associated PVC is also deleted. Are there any options to enable the Spark job to reuse the PVC and resume from the checkpoint?

As a workaround, I set the RestartPolicy to Never. When a job fails, I manually remove the resourceVersion and uid keys from the PV's claimRef section and then redeploy the Spark job. It would be great if this process could be automated.

Additional context

No response

Have the same question?

Give it a 👍 We prioritize the question with most 👍