Evalite - an Early Preview
An early preview of Evalite, a local-first, TypeScript-native tool for testing LLM-powered apps, based on Vitest.
Matt Pocock
On this page
It feels crazy to me that there's no TypeScript-native, local-first tool for testing LLM-powered apps.
I want a simple test runner that can:
- Run my evals on a watch script
- Show me a UI for viewing traces, scores, inputs and outputs
- Not need me to sign up for an API key
So, I'm building one.
It's based on Vitest, and it's called Evalite.
Here's an early preview.
Don't know what evals are? Learn about them here.