v0.11

What's Changed

• Improved stability for analysing large streams (>1000 shards)

  • Number of shards processed concurrently is decided based on the number of CPUs available in host. Default behaviour can also be overridden via a newly introduced argument -max-workers
  • Partition key analysis uses count-min-sketch algorithm to predict hot keys (experimental). Partition key analysis is turned off by default to and can be enabled via -aggregate-keys option.

• Ability to specify time windows using seconds

  khs -stream test -from "2023-03-28 09:00:00" -to "2023-03-28 09:00:10"
  

• Output file size is reduced (should be in the range of 10-50KB for a stream with 2500 shards)

• Output the metrics of successfully analysed shards even when there are some failed shards

• Fix: Correctly display time range in command output

Full Changelog: v0.10...v0.11