Kubernetesetcd

Spinnaker Operator secret accumulation causes Kubernetes control plane crash

critical
Resource ContentionUpdated Nov 20, 2025(via Exa)
How to detect:

Armory Spinnaker Operator creates secrets on every reconciliation cycle when spinsvc manifest is malformed, causing secrets to cumulatively build up in etcd database over time until Kubernetes control plane becomes overloaded and crashes. The buildup provides no indication aside from performance degradation. Particularly affects environments with many secrets and accounts.

Recommended action:

Check secret count in etcd using kubectl get --raw=/metrics | grep 'etcd_object_counts{resource="secrets"}'. Monitor for malformed CRDs triggering reconciliation loops. Set up monitoring for secret accumulation trends in large environments. Clean up accumulated secrets. Update Spinnaker Operator to patched version addressing GitHub issue #215.