AutoGrowVolumes not working #4319
Description
Overview
repo disk did not auto expand, was at 99% note the PgCluster CRD and logs are after I patched from 128Gi to 256Gi
Environment
Please provide the following details:
- Platform: Kubernetes
- Platform Version: (e.g.
1.20.3,4.7.0) - PGO Image Tag: ubi8-5.7.0-0
- Postgres Version 15
- Storage: AWS EBS
apiVersion: postgres-operator.crunchydata.com/v1beta1
kind: PostgresCluster
metadata:
annotations:
helm.sh/resource-policy: keep
meta.helm.sh/release-name: unsupervised
meta.helm.sh/release-namespace: default
postgres-operator.crunchydata.com/pgbackrest-backup: Wed Oct 8 00:29:33 CDT 2025
creationTimestamp: "2025-10-05T12:26:16Z"
finalizers:
- postgres-operator.crunchydata.com/finalizer
generation: 4
labels:
app.kubernetes.io/managed-by: Helm
name: unsupervised-rails-postgres
namespace: default
resourceVersion: "1536987684"
uid: 04306f88-7738-47c5-a0e7-03d7163cff6c
spec:
backups:
pgbackrest:
global:
repo1-retention-full: "30"
repo1-retention-full-type: time
manual:
options:
- --type=full
repoName: repo1
repos:
- name: repo1
schedules:
full: 0 0 * * 6
incremental: 45 0 * * 1,2,3,4,5,0
volume:
volumeClaimSpec:
accessModes:
- ReadWriteOnce
resources:
limits:
storage: 1Ti
requests:
storage: 256Gi
storageClassName: gp3-encrypted
instances:
- affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: unsupervised.com/component
operator: In
values:
- database
topologyKey: kubernetes.io/hostname
dataVolumeClaimSpec:
accessModes:
- ReadWriteOnce
resources:
limits:
storage: 1Ti
requests:
storage: 128Gi
storageClassName: gp3-encrypted
metadata:
labels:
unsupervised.com/component: database
name: primary
replicas: 1
resources:
limits:
cpu: "2"
memory: 8Gi
requests:
cpu: "1"
memory: 4Gi
tolerations:
- key: unsupervised.com/component
operator: Equal
value: database
- affinity:
podAntiAffinity:
requiredDuringSchedulingIgnoredDuringExecution:
- labelSelector:
matchExpressions:
- key: unsupervised.com/component
operator: In
values:
- database
topologyKey: kubernetes.io/hostname
dataVolumeClaimSpec:
accessModes:
- ReadWriteOnce
resources:
limits:
storage: 1Ti
requests:
storage: 128Gi
storageClassName: gp3-encrypted
metadata:
labels:
unsupervised.com/component: database
name: blue
replicas: 1
resources:
limits:
cpu: "2"
memory: 8Gi
requests:
cpu: "1"
memory: 4Gi
tolerations:
- key: unsupervised.com/component
operator: Equal
value: database
monitoring:
pgmonitor:
exporter: {}
patroni:
dynamicConfiguration:
postgresql:
parameters:
checkpoint_completion_target: 0.9
default_statistics_target: 100
effective_cache_size: 10752MB
effective_io_concurrency: 200
huge_pages: false
logging_collector: false
maintenance_work_mem: 896MB
max_connections: 1000
max_wal_size: 4GB
min_wal_size: 1GB
random_page_cost: 1.1
shared_buffers: 3584MB
wal_buffers: 16MB
work_mem: 9175kB
leaderLeaseDurationSeconds: 30
port: 8008
syncPeriodSeconds: 10
paused: false
port: 5432
postgresVersion: 15
users:
- databases:
- main
name: postgres
password:
type: AlphaNumeric
status:
conditions:
- lastTransitionTime: "2025-10-16T20:35:29Z"
message: pgBackRest dedicated repository host is ready
observedGeneration: 4
reason: RepoHostReady
status: "True"
type: PGBackRestRepoHostReady
- lastTransitionTime: "2025-10-05T12:26:45Z"
message: pgBackRest replica create repo is ready for backups
observedGeneration: 4
reason: StanzaCreated
status: "True"
type: PGBackRestReplicaRepoReady
- lastTransitionTime: "2025-10-05T12:29:48Z"
message: pgBackRest replica creation is now possible
observedGeneration: 4
reason: RepoBackupComplete
status: "True"
type: PGBackRestReplicaCreate
- lastTransitionTime: "2025-10-08T05:47:00Z"
message: Manual backup completed successfully
observedGeneration: 4
reason: ManualBackupComplete
status: "True"
type: PGBackRestManualBackupSuccessful
databaseRevision: 85cff5944f
instances:
- desiredPGDataVolume:
unsupervised-rails-postgres-blue-65zg: ""
name: blue
readyReplicas: 1
replicas: 1
updatedReplicas: 1
- desiredPGDataVolume:
unsupervised-rails-postgres-primary-f2kx: ""
name: primary
readyReplicas: 1
replicas: 1
updatedReplicas: 1
monitoring:
exporterConfiguration: 7d77dd69f7
observedGeneration: 4
patroni:
systemIdentifier: "7557713069205250153"
pgbackrest:
manualBackup:
completionTime: "2025-10-08T05:47:00Z"
finished: true
id: Wed Oct 8 00:29:33 CDT 2025
startTime: "2025-10-08T05:29:36Z"
succeeded: 1
repoHost:
apiVersion: apps/v1
kind: StatefulSet
ready: true
repos:
- bound: true
name: repo1
replicaCreateBackupComplete: true
stanzaCreated: true
volume: pvc-1ec8d970-ba44-46aa-bda8-f5d978542797
scheduledBackups:
- completionTime: "2025-10-11T00:29:13Z"
cronJobName: unsupervised-rails-postgres-repo1-full
repo: repo1
startTime: "2025-10-11T00:00:00Z"
succeeded: 1
type: full
- completionTime: "2025-10-18T00:18:38Z"
cronJobName: unsupervised-rails-postgres-repo1-full
repo: repo1
startTime: "2025-10-18T00:00:00Z"
succeeded: 1
type: full
- completionTime: "2025-10-15T00:52:55Z"
cronJobName: unsupervised-rails-postgres-repo1-incr
repo: repo1
startTime: "2025-10-15T00:45:00Z"
succeeded: 1
type: incr
- completionTime: "2025-10-16T01:03:44Z"
cronJobName: unsupervised-rails-postgres-repo1-incr
repo: repo1
startTime: "2025-10-16T00:45:00Z"
succeeded: 1
type: incr
- completionTime: "2025-10-17T00:53:50Z"
cronJobName: unsupervised-rails-postgres-repo1-incr
repo: repo1
startTime: "2025-10-17T00:45:00Z"
succeeded: 1
type: incr
proxy:
pgBouncer:
postgresRevision: 5c9966f6bc
usersRevision: 7977c5b9b6
Steps to Reproduce
REPRO
Create postgres cluster and fill up repo with backups.
EXPECTED
Repo disk should auto expand
ACTUAL
Disk does not auto expand.
Logs
Note I did manually up the disk via changing the psotgres cluster
time="2025-10-18T23:13:33Z" level=debug msg="debug flag set to true" version=5.7.0-0
time="2025-10-18T23:13:33Z" level=info msg="feature gates enabled" PGO_FEATURE_GATES="AutoGrowVolumes=true" version=5.7.0-0
time="2025-10-18T23:13:33Z" level=info msg="upgrade checking enabled" version=5.7.0-0
time="2025-10-18T23:13:33Z" level=info msg="starting controller runtime manager and will wait for signal to exit" version=5.7.0-0
time="2025-10-18T23:13:33Z" level=info msg="Starting metrics server" version=5.7.0-0
time="2025-10-18T23:13:33Z" level=info msg="Serving metrics server" bindAddress=":8080" secure=false version=5.7.0-0
I1018 23:13:33.912256 1 leaderelection.go:250] attempting to acquire leader lease unsupervised-singleton/cpk-leader-election-lease...
time="2025-10-18T23:13:33Z" level=info msg="starting server" addr="[::]:8081" name="health probe" version=5.7.0-0
I1018 23:13:52.462539 1 leaderelection.go:260] successfully acquired lease unsupervised-singleton/cpk-leader-election-lease
time="2025-10-18T23:13:52Z" level=debug msg="pgoperator-5865b66fc5-lzpqn_26e7f781-844d-4015-bbb0-ee531bf7cbd1 became leader" object="{Lease unsupervised-singleton cpk-leader-election-lease bfbfc2cd-0fe3-4d9b-a317-239c1987266a coordination.k8s.io/v1 1536985234 }" reason=LeaderElection type=Normal version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgupgrade controllerGroup=postgres-operator.crunchydata.com controllerKind=PGUpgrade source="kind source: *v1beta1.PGUpgrade" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgupgrade controllerGroup=postgres-operator.crunchydata.com controllerKind=PGUpgrade source="kind source: *v1.Job" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgupgrade controllerGroup=postgres-operator.crunchydata.com controllerKind=PGUpgrade source="kind source: *v1beta1.PostgresCluster" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting Controller" controller=pgupgrade controllerGroup=postgres-operator.crunchydata.com controllerKind=PGUpgrade version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=crunchybridgecluster controllerGroup=postgres-operator.crunchydata.com controllerKind=CrunchyBridgeCluster source="kind source: *v1beta1.CrunchyBridgeCluster" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=crunchybridgecluster controllerGroup=postgres-operator.crunchydata.com controllerKind=CrunchyBridgeCluster source="kind source: *v1.Secret" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1beta1.PostgresCluster" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.ConfigMap" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.Endpoints" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.PersistentVolumeClaim" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.Secret" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.Service" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.ServiceAccount" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.Deployment" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.StatefulSet" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.Job" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.Role" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.RoleBinding" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.CronJob" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.PodDisruptionBudget" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.Pod" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster source="kind source: *v1.StatefulSet" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting Controller" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin source="kind source: *v1beta1.PGAdmin" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=crunchybridgecluster controllerGroup=postgres-operator.crunchydata.com controllerKind=CrunchyBridgeCluster source="kind source: *v1.Secret" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=crunchybridgecluster controllerGroup=postgres-operator.crunchydata.com controllerKind=CrunchyBridgeCluster source="every 5m0s" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin source="kind source: *v1.ConfigMap" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin source="kind source: *v1.PersistentVolumeClaim" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin source="kind source: *v1.Secret" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin source="kind source: *v1.StatefulSet" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin source="kind source: *v1.Service" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin source="kind source: *v1beta1.PostgresCluster" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting EventSource" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin source="kind source: *v1.Secret" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting Controller" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting Controller" controller=crunchybridgecluster controllerGroup=postgres-operator.crunchydata.com controllerKind=CrunchyBridgeCluster version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="Starting workers" controller=pgadmin controllerGroup=postgres-operator.crunchydata.com controllerKind=PGAdmin version=5.7.0-0 worker count=1
time="2025-10-18T23:13:52Z" level=info msg="Starting workers" controller=pgupgrade controllerGroup=postgres-operator.crunchydata.com controllerKind=PGUpgrade version=5.7.0-0 worker count=1
time="2025-10-18T23:13:52Z" level=info msg="Starting workers" controller=crunchybridgecluster controllerGroup=postgres-operator.crunchydata.com controllerKind=CrunchyBridgeCluster version=5.7.0-0 worker count=1
time="2025-10-18T23:13:52Z" level=info msg="Starting workers" controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster version=5.7.0-0 worker count=2
time="2025-10-18T23:13:52Z" level=info msg="spec.SessionAffinity is ignored for headless services" version=5.7.0-0
time="2025-10-18T23:13:52Z" level=info msg="v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice" version=5.7.0-0
time="2025-10-18T23:13:53Z" level=info msg="{\"pgo_versions\":[{\"tag\":\"v5.8.3\"},{\"tag\":\"v5.8.2\"},{\"tag\":\"v5.8.1\"},{\"tag\":\"v5.8.0\"},{\"tag\":\"v5.7.7\"},{\"tag\":\"v5.7.6\"},{\"tag\":\"v5.7.5\"},{\"tag\":\"v5.7.4\"},{\"tag\":\"v5.7.3\"},{\"tag\":\"v5.7.2\"},{\"tag\":\"v5.7.1\"},{\"tag\":\"v5.7.0\"},{\"tag\":\"v5.6.9\"},{\"tag\":\"v5.6.8\"},{\"tag\":\"v5.6.7\"},{\"tag\":\"v5.6.6\"},{\"tag\":\"v5.6.5\"},{\"tag\":\"v5.6.4\"},{\"tag\":\"v5.6.3\"},{\"tag\":\"v5.6.2\"}]}" X-Crunchy-Client-Metadata="{\"bridge_clusters_total\":0,\"build_source\":\"developer\",\"deployment_id\":\"deb33e9f-7bdb-43f6-91b7-12ea57ba8e16\",\"feature_gates_enabled\":\"AutoGrowVolumes=true\",\"is_open_shift\":false,\"kubernetes_env\":\"v1.34.1-eks-d96d92f\",\"pgo_clusters_total\":3,\"pgo_installer\":\"helm\",\"pgo_installer_origin\":\"developer-registry-oci\",\"pgo_version\":\"5.7.0-0\",\"registration_token\":\"\"}" version=5.7.0-0
time="2025-10-18T23:13:53Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=19110595-f636-4e7f-9a26-af91c5414158 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:13:53Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-shared-usecase-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-shared-usecase-postgres namespace=default reconcileID=17ea6066-26f5-483d-93db-2061a142e1f7 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:13:53Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=19110595-f636-4e7f-9a26-af91c5414158 version=5.7.0-0
time="2025-10-18T23:13:53Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=19110595-f636-4e7f-9a26-af91c5414158 version=5.7.0-0
time="2025-10-18T23:13:53Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-shared-usecase-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-shared-usecase-postgres-diet-jl8m name=unsupervised-shared-usecase-postgres namespace=default reconcileID=17ea6066-26f5-483d-93db-2061a142e1f7 version=5.7.0-0
time="2025-10-18T23:13:53Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-shared-usecase-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=diet name=unsupervised-shared-usecase-postgres namespace=default reconcileID=17ea6066-26f5-483d-93db-2061a142e1f7 version=5.7.0-0
time="2025-10-18T23:13:53Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=19110595-f636-4e7f-9a26-af91c5414158 version=5.7.0-0
time="2025-10-18T23:13:53Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=19110595-f636-4e7f-9a26-af91c5414158 version=5.7.0-0
time="2025-10-18T23:13:54Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-shared-usecase-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-shared-usecase-postgres namespace=default reconcileID=17ea6066-26f5-483d-93db-2061a142e1f7 version=5.7.0-0
time="2025-10-18T23:13:54Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=19110595-f636-4e7f-9a26-af91c5414158 version=5.7.0-0
time="2025-10-18T23:13:54Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=0eaa73ff-c29b-430a-ab6c-547c25118528 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:13:54Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=0eaa73ff-c29b-430a-ab6c-547c25118528 version=5.7.0-0
time="2025-10-18T23:13:54Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=0eaa73ff-c29b-430a-ab6c-547c25118528 version=5.7.0-0
time="2025-10-18T23:13:54Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-shared-usecase-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-shared-usecase-postgres namespace=default reconcileID=1ab7cd39-d3ed-4301-87b2-d4fc863b3918 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:13:55Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=0eaa73ff-c29b-430a-ab6c-547c25118528 version=5.7.0-0
time="2025-10-18T23:13:55Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=0eaa73ff-c29b-430a-ab6c-547c25118528 version=5.7.0-0
time="2025-10-18T23:13:55Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-shared-usecase-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-shared-usecase-postgres-diet-jl8m name=unsupervised-shared-usecase-postgres namespace=default reconcileID=1ab7cd39-d3ed-4301-87b2-d4fc863b3918 version=5.7.0-0
time="2025-10-18T23:13:55Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-shared-usecase-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=diet name=unsupervised-shared-usecase-postgres namespace=default reconcileID=1ab7cd39-d3ed-4301-87b2-d4fc863b3918 version=5.7.0-0
time="2025-10-18T23:13:55Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=0eaa73ff-c29b-430a-ab6c-547c25118528 version=5.7.0-0
time="2025-10-18T23:13:55Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-shared-usecase-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-shared-usecase-postgres namespace=default reconcileID=1ab7cd39-d3ed-4301-87b2-d4fc863b3918 version=5.7.0-0
time="2025-10-18T23:19:16Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=0b056843-bb6c-415e-a1d9-c61e79537824 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:19:17Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=0b056843-bb6c-415e-a1d9-c61e79537824 version=5.7.0-0
time="2025-10-18T23:19:17Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=0b056843-bb6c-415e-a1d9-c61e79537824 version=5.7.0-0
time="2025-10-18T23:19:17Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=0b056843-bb6c-415e-a1d9-c61e79537824 version=5.7.0-0
time="2025-10-18T23:19:17Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=0b056843-bb6c-415e-a1d9-c61e79537824 version=5.7.0-0
time="2025-10-18T23:19:17Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=0b056843-bb6c-415e-a1d9-c61e79537824 version=5.7.0-0
time="2025-10-18T23:19:17Z" level=debug msg="patched cluster status" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=0b056843-bb6c-415e-a1d9-c61e79537824 version=5.7.0-0
time="2025-10-18T23:19:18Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=aadf35b7-7ab6-40de-acbf-21e5e06892dd stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:19:18Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=aadf35b7-7ab6-40de-acbf-21e5e06892dd version=5.7.0-0
time="2025-10-18T23:19:18Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=aadf35b7-7ab6-40de-acbf-21e5e06892dd version=5.7.0-0
time="2025-10-18T23:19:18Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=aadf35b7-7ab6-40de-acbf-21e5e06892dd version=5.7.0-0
time="2025-10-18T23:19:18Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=aadf35b7-7ab6-40de-acbf-21e5e06892dd version=5.7.0-0
time="2025-10-18T23:19:18Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=aadf35b7-7ab6-40de-acbf-21e5e06892dd version=5.7.0-0
time="2025-10-18T23:19:18Z" level=debug msg="patched cluster status" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=aadf35b7-7ab6-40de-acbf-21e5e06892dd version=5.7.0-0
time="2025-10-18T23:19:19Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=30d12127-ab4e-452f-b1dd-5d903b48a5a0 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:19:19Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=30d12127-ab4e-452f-b1dd-5d903b48a5a0 version=5.7.0-0
time="2025-10-18T23:19:19Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=30d12127-ab4e-452f-b1dd-5d903b48a5a0 version=5.7.0-0
time="2025-10-18T23:19:19Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=30d12127-ab4e-452f-b1dd-5d903b48a5a0 version=5.7.0-0
time="2025-10-18T23:19:19Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=30d12127-ab4e-452f-b1dd-5d903b48a5a0 version=5.7.0-0
time="2025-10-18T23:19:20Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=30d12127-ab4e-452f-b1dd-5d903b48a5a0 version=5.7.0-0
time="2025-10-18T23:19:20Z" level=debug msg="patched cluster status" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=30d12127-ab4e-452f-b1dd-5d903b48a5a0 version=5.7.0-0
time="2025-10-18T23:19:21Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=560c0b5a-5b34-4139-8229-44ad08edab67 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:19:21Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=560c0b5a-5b34-4139-8229-44ad08edab67 version=5.7.0-0
time="2025-10-18T23:19:21Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=560c0b5a-5b34-4139-8229-44ad08edab67 version=5.7.0-0
time="2025-10-18T23:19:21Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=560c0b5a-5b34-4139-8229-44ad08edab67 version=5.7.0-0
time="2025-10-18T23:19:21Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=560c0b5a-5b34-4139-8229-44ad08edab67 version=5.7.0-0
time="2025-10-18T23:19:21Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=560c0b5a-5b34-4139-8229-44ad08edab67 version=5.7.0-0
time="2025-10-18T23:19:23Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=c1f6e810-11aa-49b2-aa63-53aa5e4d2791 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:19:23Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=c1f6e810-11aa-49b2-aa63-53aa5e4d2791 version=5.7.0-0
time="2025-10-18T23:19:23Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=c1f6e810-11aa-49b2-aa63-53aa5e4d2791 version=5.7.0-0
time="2025-10-18T23:19:24Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=c1f6e810-11aa-49b2-aa63-53aa5e4d2791 version=5.7.0-0
time="2025-10-18T23:19:24Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=c1f6e810-11aa-49b2-aa63-53aa5e4d2791 version=5.7.0-0
time="2025-10-18T23:19:24Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=c1f6e810-11aa-49b2-aa63-53aa5e4d2791 version=5.7.0-0
time="2025-10-18T23:20:09Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=128996fc-0336-47e6-b96a-4bbde82d2ef3 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:20:09Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=128996fc-0336-47e6-b96a-4bbde82d2ef3 version=5.7.0-0
time="2025-10-18T23:20:09Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=128996fc-0336-47e6-b96a-4bbde82d2ef3 version=5.7.0-0
time="2025-10-18T23:20:09Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=128996fc-0336-47e6-b96a-4bbde82d2ef3 version=5.7.0-0
time="2025-10-18T23:20:09Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=128996fc-0336-47e6-b96a-4bbde82d2ef3 version=5.7.0-0
time="2025-10-18T23:20:09Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=128996fc-0336-47e6-b96a-4bbde82d2ef3 version=5.7.0-0
time="2025-10-18T23:20:10Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=e9c680e3-1ea5-42a8-9743-e9d83318f4e5 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:20:10Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=e9c680e3-1ea5-42a8-9743-e9d83318f4e5 version=5.7.0-0
time="2025-10-18T23:20:10Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=e9c680e3-1ea5-42a8-9743-e9d83318f4e5 version=5.7.0-0
time="2025-10-18T23:20:10Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=e9c680e3-1ea5-42a8-9743-e9d83318f4e5 version=5.7.0-0
time="2025-10-18T23:20:10Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=e9c680e3-1ea5-42a8-9743-e9d83318f4e5 version=5.7.0-0
time="2025-10-18T23:20:10Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=e9c680e3-1ea5-42a8-9743-e9d83318f4e5 version=5.7.0-0
time="2025-10-18T23:20:10Z" level=debug msg="patched cluster status" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=e9c680e3-1ea5-42a8-9743-e9d83318f4e5 version=5.7.0-0
time="2025-10-18T23:20:11Z" level=debug msg="replaced configuration" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=c0c00df9-e686-4296-b106-3d9d38491752 stderr= stdout="Not changed\n" version=5.7.0-0
time="2025-10-18T23:20:11Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-primary-f2kx name=unsupervised-rails-postgres namespace=default reconcileID=c0c00df9-e686-4296-b106-3d9d38491752 version=5.7.0-0
time="2025-10-18T23:20:11Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=primary name=unsupervised-rails-postgres namespace=default reconcileID=c0c00df9-e686-4296-b106-3d9d38491752 version=5.7.0-0
time="2025-10-18T23:20:11Z" level=debug msg="reconciled instance" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance=unsupervised-rails-postgres-blue-65zg name=unsupervised-rails-postgres namespace=default reconcileID=c0c00df9-e686-4296-b106-3d9d38491752 version=5.7.0-0
time="2025-10-18T23:20:11Z" level=debug msg="reconciled instance set" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster instance-set=blue name=unsupervised-rails-postgres namespace=default reconcileID=c0c00df9-e686-4296-b106-3d9d38491752 version=5.7.0-0
time="2025-10-18T23:20:11Z" level=debug msg="reconciled cluster" PostgresCluster=default/unsupervised-rails-postgres controller=postgrescluster controllerGroup=postgres-operator.crunchydata.com controllerKind=PostgresCluster name=unsupervised-rails-postgres namespace=default reconcileID=c0c00df9-e686-4296-b106-3d9d38491752 version=5.7.0-0
Additional Information
Please provide any additional information that may be helpful.