Building a DIY Knowledge Base Beats Firecrawl's Cost for AI Projects

Firecrawl is a great tool. I want to say that upfront, because what I'm about to describe isn't really Firecrawl's fault. It's just not what it was built for. I was using it as the data layer behind an AI agent, and the costs kept climbing for a simple reason: every time my agent needed fresh contex