anthropic

RAG prompt template rendering error in Anthropic Claude on AWS

by
a rack of servers in a server room

Problem – RAG Prompt Template Rendering Errors in Anthropic Claude (Hybrid AWS/On‑Prem) Observed symptoms Claude API returns TemplateRenderError: missing variable ‘documents’ or TemplateRenderError: missing variable ‘context’. Prompt payloads sent to the API contain malformed JSON – placeholders such as {{documents}} remain unsubstituted. Occasional InvalidPromptError: prompt exceeds max token limit when retrieved documents are concatenated without … Read more

Kubernetes scheduler pod placement failure after autoscaling

by
a rack of servers in a server room

Problem Description The Claude inference service experiences a cascade of pending pods during traffic spikes. Typical symptoms observed in the kubectl get pods -n claude-prod output are: NAME READY STATUS RESTARTS AGE claude-infer-7f9c9d8c9f-abcde 0/1 Pending 0 2m30s claude-infer-7f9c9d8c9f-fghij 0/1 Pending 0 2m30s … Relevant scheduler events (extracted from kubectl describe pod <pod>) contain the following … Read more