Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Patch release 3.2.5 #3653

Merged
merged 10 commits into from
Dec 6, 2023
Merged

Patch release 3.2.5 #3653

merged 10 commits into from
Dec 6, 2023

Conversation

karol-kokoszka
Copy link
Collaborator

@karol-kokoszka karol-kokoszka commented Dec 6, 2023

karol-kokoszka and others added 9 commits December 6, 2023 10:33
This change makes it easier to introduce changes to repair parallelism,
like bypassing 1 job per 1 node rule.
Similar to scylladb/scylladb#16222 ,we need to
make sure our docker image is updated to latest for all OS packages

Fixes: #3646
Currently, SM disables transfer pruning (MaxCompletedTransfers = -1) because it needs complete upload statistics. This is the main reason for memory leak detected in issue #3298. With this change, transfers can be purged while preserving total upload statistics exposed at the core/aggregated endpoint.
Recent changes in used rclone fork changed upload statistics aggregation. Total upload statistics are now available at core/aggregated endpoint.
Uploading much more files than the MaxBacklog forces rclone to keep references to uploaded objects even when there is no need for it. This partially results in memory leak detected in #3298.
SM 3.2 changed repair param validation so that scheduling and running repair of a single node cluster is treated as an error. Although this is acceptable in terms of real users, the ability to schedule/run repair on a simple single node cluster is useful for tests and some experiments.

Fixes #3649
@karol-kokoszka karol-kokoszka merged commit 69dbb76 into branch-3.2 Dec 6, 2023
41 checks passed
@karol-kokoszka karol-kokoszka deleted the patch_release_3.2.5 branch December 6, 2023 11:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants