Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve Pulsar AWS deployment (terraform + ansible) #415

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Commits on Jun 29, 2024

  1. Replace terraform-inventory plugin and add support for spot instances

    Co-authored-by: toziegler
    
    Replace the outdated terrafrom-inventory plugin with the Ansible
    Provider and the Terraform Ansible-Collection
    Add a new variable to deploy instances as AWS spot instances
    melhindi committed Jun 29, 2024
    Configuration menu
    Copy the full SHA
    61faaaa View commit details
    Browse the repository at this point in the history

Commits on Jul 3, 2024

  1. Replace hard coded storage devices with ansible discovery

    Co-authored-by: toziegler
    When deploying AWS instances, with every re-boot the label of NVMe
    devices changes. E.g., `/dev/nvme1n1`, `/dev/nvme0n1`
    Hence, hard-coding the disk labels leads to failed deployments when,
    e.g., `/dev/nvme1n1` is used as boot disk.
    By discovering storage devices with ansible we can dynamically select
    available storage devices for pulsar/bookkeeper
    melhindi committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    fa8be97 View commit details
    Browse the repository at this point in the history
  2. Prevent uploading benchmark code multiple times

    Co-authored-by: toziegler
    When network connectivity is slow, uploading the benchmark code to nodes
    via ansible takes long and is not required if the step has been
    performed before. By splitting the copy and rename step and using
    `creates` we can prevent multiple (slow) uploads.
    melhindi committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    90b15dc View commit details
    Browse the repository at this point in the history
  3. Make on-demand instances default

    Co-authored-by: toziegler
    
    For long running benchmarks on-demand instances is a more meaningful
    default value
    melhindi committed Jul 3, 2024
    Configuration menu
    Copy the full SHA
    048eb22 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2024

  1. Configuration menu
    Copy the full SHA
    185da0c View commit details
    Browse the repository at this point in the history