connection-failure

Hugging Face streamer connection timeout during token generation

by
Transformer robot

Problem – Intermittent Streamer Time‑outs During Token Generation When a FastAPI gateway proxies a request to a GPU‑hosted TextGenerationPipeline with streamer=True, the client receives a socket hang‑up or ReadTimeoutError after the first token (or sometimes before any token is emitted). The failure is reproducible under concurrent load and manifests as: ReadTimeoutError: Server timed out while … Read more

ONNX Runtime connection timeout in Docker container

by
a close up of a web page on a computer

Problem Description When running inference inside an ONNX Runtime Docker container the following error is observed: ONNXRuntimeException: Unable to download model from URL https://example.com/model.onnx – Connection timed out or, when using the Remote Execution Provider: grpc call failed: deadline exceeded – RemoteExecutionProvider initialization failed Typical impact includes: Model loading hangs for the configured timeout (default … Read more

Docker API server refuses connection from data pipeline

by
red and blue cargo ship on sea during daytime

Problem Description The data‑pipeline service, defined in a docker‑compose.yml file, attempts to call the API server at http://api:5000/api during ingestion. The call consistently fails with either a timeout or a connection‑refused error, causing the pipeline to abort. Typical log excerpts: pipeline | 2026-06-12T08:14:32Z ERROR: dial tcp 172.18.0.3:5000: connect: connection refused pipeline | 2026-06-12T08:14:32Z ERROR: Get … Read more

Qwen connection timeout after 30 seconds in staging environment

by
black sedan parked beside tree during daytime

Qwen Connection Timeout After 30 seconds in Staging Environment Problem Description During staged load‑testing with k6, every Qwen API request aborts after exactly 30 seconds. The failure manifests as: ETIMEDOUT: ETIMEDOUT: connection timed out after 30000ms in application logs. HTTP 504: Load balancer returns 504 Gateway Timeout when the upstream Qwen service does not reply within 30 s. SDK … Read more