Redshift Integration Overview

This integration supports multiple clusters in a single account and region (filter-in / filter-out supported). It works by periodically unloading Redshift system-table contents into Pelanor’s S3 bucket, which Pelanor then reads using its IAM role.

The integration requires the master user and password to unload certain system tables and views.
These credentials must be stored in an AWS Secrets Manager secret in the same account and region and tagged as:

Tag keyTag value
Redshiftcluster ARN

If your cluster was created with Secrets Manager credentials, the secret and tags are already correct.

Read each step carefully. If you hit issues, see the troubleshooting section or contact Pelanor Support.

Modules included:

  • redshift-account-onboarding
  • redshift-cluster-onboarding

Each module contains its own README.md with usage details.

This integration is network-agnostic — it schedules, authenticates, and runs queries via the cloud backbone.
If you use restrictive IAM/SCP policies, you may need to update them.
Each scheduled query emits an EventBridge event routed to a CloudWatch Logs group prefixed with /pelanor/aws/events/redshift/.


Setup the Terraform Module

1

Create tfvars

Create a file like production.tfvars and replace <bucketname> with the bucket used by Pelanor’s AWS integration.

2

Run Terraform

From your root module directory, run terraform apply.
Make sure your AWS provider is set to the correct region and account.

3

Confirm plan and apply

Review the plan and type yes to apply.

For help with provider setup, see the AWS Provider docs.


Select Appropriate Bucket

Use the correct bucket name based on your AWS region:

AWS RegionBucket name
us-east-1pelanor-redshift-us-east-1
eu-west-1pelanor-redshift-eu-west-1
ap-southeast-2pelanor-redshift-ap-southeast-2

Choosing the correct bucket is essential — double-check your AWS account region before proceeding.

If your region isn’t listed, contact Pelanor Support.


Directory Structure

examples/
  redshift/
    backend.tf
    main.tf
    README.md
    variables.tf
modules/
  redshift-account-onboarding/
    aws_context.tf
    main.tf
    outputs.tf
    README.md
    variables.tf
    versions.tf
  redshift-cluster-onboarding/
    aws_context.tf
    cluster_discovery.tf
    event_logging.tf
    main.tf
    outputs.tf
    README.md
    sql/
      segmented.sql.tftpl
      unsegmented.sql.tftpl
    variables.tf
    versions.tf