Skip to content

A simple infrastructure for provisioning a cluster in AWS and deploying a dagster and postgres application

Notifications You must be signed in to change notification settings

data-max-hq/aws-iac-dagster-dbt-tf

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 

Repository files navigation

AWS Infrastructure with Terraform

Requirements

To run and use this project one must have:

  • An AWS account
  • Terraform installed
  • AWS CLI

From the AWS Console

Create:

  • Programmatic user
  • S3 Bucket

From the projects terminal

Authenticate

aws configure

Add the access key and the secret access key that you downloaded when the user was created.

Configure the backend

In the versions.tf file, set the default value of the bucket variable to the bucket name you created above.

Provision the infrastructure

terraform init
terraform get
terraform apply

Fill the secrets in Secret Manager with accurate values, then rerun terraform apply.

Configure kubectl

To retrieve the access credentials for the cluster and configure kubectl

(Replace region_code with the AWS cluster region and name_of_the_cluster witht your cluster name)

aws eks --region region_code update-kubeconfig \
    --name name_of_the_cluster

About

A simple infrastructure for provisioning a cluster in AWS and deploying a dagster and postgres application

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages