You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I connect to EMR 7.1 from sagemaker using spark connect, this would be more straight-forward if both were using the same version of python AL2023 has default support for 3.9 and 3.11 but not 3.10 which is what sagemaker distribution is on, could we update the image to 3.11
Use case description
Spark Connect UDFs are not possible
Alternatives
I could install 3.10 manually using bootstraps, but this is slows down node start up time
Additional context
No response
The text was updated successfully, but these errors were encountered:
🚀 The feature, motivation and pitch
I connect to EMR 7.1 from sagemaker using spark connect, this would be more straight-forward if both were using the same version of python AL2023 has default support for 3.9 and 3.11 but not 3.10 which is what sagemaker distribution is on, could we update the image to 3.11
Use case description
Spark Connect UDFs are not possible
Alternatives
I could install 3.10 manually using bootstraps, but this is slows down node start up time
Additional context
No response
The text was updated successfully, but these errors were encountered: