llamaindex

LlamaIndex controller manager crash during model evaluation

by
a close-up of a server room

Problem Description The LlamaIndex controller manager process crashes with a segmentation fault (SIGSEGV) when an automated evaluation script attempts to load a custom‑trained language model. The failure occurs inside a Docker container used for local development and stops the entire evaluation pipeline. Typical log excerpt (Docker container stdout): 2026-06-29 14:12:03,212 INFO controller_manager – Starting model … Read more

LlamaIndex inference queue backlog during A/B testing

by
photo of computer cables

Problem – Inference Queue Backlog During A/B Testing During a recent high‑traffic A/B test two LlamaIndex variants (A and B) were deployed side‑by‑side in a Kubernetes cluster. Users of the test variant experienced: Latency spikes from ~200 ms to >30 s. HTTP 503 responses with the log line Inference queue full: max_queue_size reached. Increasing numbers of “Worker … Read more

LlamaIndex training loop rejected by admission controller Kubernetes

by
a rack of servers in a server room

Problem Description The LlamaIndex training loop fails to start in a Kubernetes‑based ML platform. The pod creation request is rejected by the llamaindex-validation admission webhook. Typical error output from kubectl describe pod looks like: Error from server (BadRequest): admission webhook “llamaindex-validation” denied the request: unauthorized access to secret “llama-index-config” Other observed rejections include: “pod llamaindex-trainer-7f9c9d … Read more

LlamaIndex token limit exceeded during model evaluation

by
photo of computer cables

Problem – Token Limit Exceeded During Model Evaluation with LlamaIndex When running automated evaluation of a large document corpus through LlamaIndex, the evaluation script aborts with errors such as: openai.error.InvalidRequestError: This model’s maximum context length is 4096 tokens ValueError: Prompt exceeds max_input_size (got 5273 tokens, max allowed 4096) RuntimeError: Token limit exceeded while building prompt … Read more