LlamaIndex token limit exceeded during model evaluation
Problem – Token Limit Exceeded During Model Evaluation with LlamaIndex When running automated evaluation of a large document corpus through LlamaIndex, the evaluation script aborts with errors such as: openai.error.InvalidRequestError: This model’s maximum context length is 4096 tokens ValueError: Prompt exceeds max_input_size (got 5273 tokens, max allowed 4096) RuntimeError: Token limit exceeded while building prompt … Read more