connection-failure

Jenkins CI job connection timeout to Haystack API server

by
brown round grass on green grass field during daytime

Problem During the execution of integration tests on a Jenkins build agent, the CI job fails with a connection timeout when trying to reach the Haystack API server. In some runs the logs also show DNS resolution failures. The failure aborts the test suite and marks the build as unstable. [2026-10-13 02:14:37] INFO – Starting … Read more

vLLM API server connection timeout after rolling deployment in Kubernetes

by
The text JEV VS LLM* written in black dots on a glass window

Problem After a rolling deployment of the vLLM inference service in a Kubernetes cluster, client applications began receiving connection timeout, connection refused, and HTTP 502 Bad Gateway responses when calling the vLLM API endpoint. The issue appears only after the deployment finishes; the service was reachable before the rollout. Root Cause The timeout originated from … Read more

Gemini RAG pipeline connection timeout to vector store after autoscaling

by
A person holding a cell phone in their hand

Problem: Gemini RAG pipeline cannot connect to the vector store after autoscaling The Gemini Retrieval‑Augmented Generation (RAG) pipeline is deployed on a managed cloud service that scales compute instances automatically. After a scale‑out event, the pipeline consistently fails to retrieve documents from the configured managed vector store. The failure manifests as connection timeouts and, intermittently, … Read more

Weaviate connection timeout during nightly RAG ingestion pipeline

by
Rows of black server racks with white logos in a data center

Problem – Nightly RAG Ingestion Fails with Weaviate Connection Timeouts The automated Retrieval‑Augmented Generation (RAG) pipeline runs every night to ingest fresh documents, generate embeddings, and store them in a Weaviate vector store. Since the last deployment, the pipeline aborts during the store_vectors step with repeated connection timeout errors and occasional authentication failures. No new … Read more

AWS EC2 inference service connection timeout to RAG vector store

by
Race car with cartoon graphics and aws logo

Problem Description The inference service deployed on an AWS EC2 instance (private subnet) cannot establish a TCP connection to the remote RAG vector store (Milvus, Pinecone, or Qdrant). Every request to retrieve relevant documents ends with a timeout, causing the entire inference pipeline to fail. Typical log excerpts: 2024-09-10T12:34:56.123Z ERROR langchain.vectorstores.milvus: connect ETIMEDOUT 172.31.45.23:443 2024-09-10T12:34:57.001Z … Read more

Inference API timeout connecting to PostgreSQL after firewall rule update

by
Server rack with blinking green lights

Problem Description The inference API service, built with FastAPI and using psycopg2/SQLAlchemy to query a PostgreSQL instance, started returning HTTP 504 timeouts after a recent firewall rule change. The API logs contain repeated connection errors such as: 2026-08-31 14:02:13,842 ERROR inference.api.handlers – could not connect to server: Connection timed out (0.00s) Is the server running … Read more

RAG vector store connection timeout during rolling update of Meta LLaMA

by
cable network

Problem Description During a rolling update of a production Meta LLaMA RAG service, the retrieval‑augmented generation pipeline intermittently fails to retrieve embeddings. The failure manifests as: grpc deadline exceeded: context deadline exceeded while attempting to query vector store VectorStoreError: connection refused – unable to establish TCP connection to Faiss endpoint TimeoutError: failed to retrieve embeddings … Read more

Hugging Face streamer connection timeout during token generation

by
Transformer robot

Problem – Intermittent Streamer Time‑outs During Token Generation When a FastAPI gateway proxies a request to a GPU‑hosted TextGenerationPipeline with streamer=True, the client receives a socket hang‑up or ReadTimeoutError after the first token (or sometimes before any token is emitted). The failure is reproducible under concurrent load and manifests as: ReadTimeoutError: Server timed out while … Read more

ONNX Runtime connection timeout in Docker container

by
a close up of a web page on a computer

Problem Description When running inference inside an ONNX Runtime Docker container the following error is observed: ONNXRuntimeException: Unable to download model from URL https://example.com/model.onnx – Connection timed out or, when using the Remote Execution Provider: grpc call failed: deadline exceeded – RemoteExecutionProvider initialization failed Typical impact includes: Model loading hangs for the configured timeout (default … Read more

Docker API server refuses connection from data pipeline

by
red and blue cargo ship on sea during daytime

Problem Description The data‑pipeline service, defined in a docker‑compose.yml file, attempts to call the API server at http://api:5000/api during ingestion. The call consistently fails with either a timeout or a connection‑refused error, causing the pipeline to abort. Typical log excerpts: pipeline | 2026-06-12T08:14:32Z ERROR: dial tcp 172.18.0.3:5000: connect: connection refused pipeline | 2026-06-12T08:14:32Z ERROR: Get … Read more