Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow the specification of a write window for retention policies #25424

Open
davidby-influx opened this issue Oct 3, 2024 · 0 comments
Open
Assignees
Labels
1.x area/data ingestion Issues related to any type of data ingestion/acquisition area/influxql Issues related to InfluxQL query language area/retention policies

Comments

@davidby-influx
Copy link
Contributor

Customer operating "shared" clusters frequently run into issues where a user will attempt to write data in to the cluster and the time is skewed either deeply into the future or significantly into the past.

Clean-up of this "bad data" is then problematic, time consuming, etc.

Add FutureWriteLimit and PastWriteLimit to retention policies. Points which are outside of now() + FutureWriteLimit or now() - PastWriteLimit will be rejected on write with a PartialWriteError.

The default will be zero for both values, which behaves as the current product.

There will be corresponding work for Enterprise and InfluxQL.

@davidby-influx davidby-influx added area/retention policies area/influxql Issues related to InfluxQL query language 1.x area/data ingestion Issues related to any type of data ingestion/acquisition labels Oct 3, 2024
@davidby-influx davidby-influx self-assigned this Oct 3, 2024
davidby-influx added a commit that referenced this issue Oct 3, 2024
Add FutureWriteLimit and PastWriteLimit to retention
policies. Points which are outside of
now() + FutureWriteLimit
or
now() - PastWriteLimit
will be rejected on write with a PartialWriteError.

closes #25424
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
1.x area/data ingestion Issues related to any type of data ingestion/acquisition area/influxql Issues related to InfluxQL query language area/retention policies
Projects
None yet
Development

No branches or pull requests

1 participant