Kubernetes controller manager crash with Elasticsearch in air-gapped environment

img IX mining rig inside white and gray room

Problem Description In a private, air‑gapped Kubernetes cluster the kube-controller-manager pod repeatedly enters CrashLoopBackOff. The crash is triggered when the Elastic Cloud on Kubernetes (ECK) operator attempts to deploy Elasticsearch for log aggregation. Typical log excerpts are: 2026-06-05T12:34:56Z panic: x509: certificate signed by unknown authority goroutine 1 [running]: k8s.io/kubernetes/cmd/kube-controller-manager/app.run(0x0, 0x0, 0x0, 0x0, 0x0, 0x0) /go/src/k8s.io/kubernetes/cmd/kube-controller-manager/app.go:345 … Read more

Kafka container crash loop on premises with low CPU

a black and white photo of a mountain

Problem In an on‑premises data‑pipeline node that hosts a Kafka broker container, the pod repeatedly enters a CrashLoopBackOff state. The container exits after a few seconds, the orchestrator restarts it, and the cycle continues. The environment is a bare‑metal server with 4 vCPU and 8 GiB RAM, shared with other AI‑training services. The symptom manifests as: Kafka … Read more

ChromaDB container crash loop on-premises OOM error

photo of computer cables

Problem – ChromaDB Container Crash Loop on‑Premises OOM Error Deployments of ChromaDB on shared on‑premises servers often encounter a crash loop where the Docker container is repeatedly killed and restarted. Typical symptoms include: Docker daemon reports OOMKilled for the container. Health‑check failures such as HTTP 500 Internal Server Error from the /healthz endpoint. Docker logs … Read more

Pinecone controller manager crash during multi-region replication

tilt-shift photography of tree

Problem Description The controller manager pods in a multi‑region Pinecone deployment are crashing during synchronous index replication. Symptoms observed across us-east-1, eu-west-1 and ap-southeast-2 include: Pod restarts with exit code 137 (OOM kill) in the Kubernetes events. Log entries such as: 2024-05-28T14:12:03Z controller_manager: out of memory 2024-05-28T14:12:04Z replication sync failed: connection reset by peer 2024-05-28T14:12:05Z … Read more