An eval is just a test that returns a value

apte is an async-first test framework for Python where your unit tests and your LLM evals run in the same engine, with the same fixtures. The whole design follows from one idea. An eval is just a test that returns a value. A unit test asserts and passes or fails. An eval returns an output, scores it

Related Stories

📰

X3DH and Double Ratchet: Cracking Secure Chat in the Cloud

Creating Sandbox to Make Developer Growth Visible and Recognized

📰

Creating a Robust RAG Pipeline Using LlamaIndex and Pinecone

📰

Quickly Extract Knowledge from Any Documentation Site with a RAG in 5 Minutes