You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When I do df..write.format("tfrecords").option('writeLocality','local').save(path) or df..write.format("tfrecords").save(path) the file is not getting created on the main Driver node. I dont see the folder as well. I am unable to overwrite as that mode is not working. I am unable to delete those files as they are in worker node. Is there a simple API that can delete the files created through this spark job
The text was updated successfully, but these errors were encountered:
When I do
df..write.format("tfrecords").option('writeLocality','local').save(path)
ordf..write.format("tfrecords").save(path)
the file is not getting created on the main Driver node. I dont see the folder as well. I am unable to overwrite as that mode is not working. I am unable to delete those files as they are in worker node. Is there a simple API that can delete the files created through this spark jobThe text was updated successfully, but these errors were encountered: