03 - Deploy Supporting Charms

This part of the tutorial focuses on deploying supporting charms that Airbyte requires for metadata storage, workflow orchestration, and object storage.

Requirement

Charm

Purpose

Database

postgresql-k8s

Stores metadata, job configurations, and sync history

Workflow Engine

temporal-k8s

Manages task queues and workflow execution

Admin UI

temporal-admin-k8s

Manages Temporal namespaces and admin tasks

Object Storage

minio or S3 Integrator

Stores sync logs, state, and artifacts

Note: Either MinIO or S3 Integrator can be used; not both.

Deploy PostgreSQL

juju deploy postgresql-k8s --channel 14/stable --trust
juju status --watch 2s

Note: Deployment may take ~10 minutes. Expect active status for all units once complete.

Deploy MinIO

juju deploy minio --channel ckf-1.10/stable
juju status --watch 2s

Note: Deployment completes when all units are active.

Deploy Temporal

juju deploy temporal-k8s --config num-history-shards=4  # This value can be set to 1024 or 2048 for a production deployment
juju deploy temporal-admin-k8s
juju status --watch 2s

Note: Temporal requires num-history-shards to be a power of 2.

Ignore temporary blocked messages; they will be resolved once relations are added in the next step.

See next: Deploy Charmed Airbyte