Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

K8s: Spark ContainsUdf fails because of WKTReader and JtsShapeFactory serialization issue #329

Open
muttcg opened this issue Nov 28, 2023 · 0 comments
Open

K8s: Spark ContainsUdf fails because of WKTReader and JtsShapeFactory serialization issue #329

muttcg opened this issue Nov 28, 2023 · 0 comments

Comments

@muttcg
Copy link
Member

muttcg commented Nov 28, 2023

WKTReader and JtsShapeFactory are not serializable and cannot be created outside the call method. Initializing these classes within the call method may(or not) potentially impact performance. Extending or wrapping them into serializable classes did not work, and neither did Spark broadcasting or wrapping with broadcasting features
muttcg added a commit that referenced this issue Nov 28, 2023
@muttcg
#329 Link comment
dcd307e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@muttcg