Strategies to Cut Costs of LLMs in Data-Intensive RAG Applications

How we cut token usage significantly in an F1 telemetry analyzer by rethinking what goes into the context window — and when. When building RAG applications on top of structured data (databases, APIs, telemetry), the naive approach is to dump everything into the context and let the LLM figure it out.