Lightweight eval harness for agent outputs — contains/regex/length/JSON-path assertions and suite pass rates.
Part of Talocode. Hosted at /v1/evallane/*.
| npm | npm install @talocode/evallane |
| CLI | evallane |
| Cloud | https://api.talocode.site/v1/evallane/* |
| Auth | TALOCODE_API_KEY |
| Repo | https://github.com/talocode/evallane |
| License | MIT |
You cannot improve agents without measurement. EvalLane runs deterministic suites so regressions are visible.
npm install @talocode/evallane
# PyPI later: pip install talocode-evallaneimport { runSuite, scoreOutput } from "@talocode/evallane"
const r = runSuite({ cases: [{ name: "greet", output: "hello", assertions: [{ type: "contains", value: "hello" }] }] })| Project | Role |
|---|---|
| RetryLane | Tool retries & circuit breakers |
| PromptLane | Prompt versioning & feedback |
| EvalLane | Assertion eval suites |
| PolicyLane | Allow/deny + redaction |
| VerifyLane | Deterministic code verification |
| TraceLane | Agent run tracing |
| HandoffLane | Schema handoffs |
| StyleLane | Constitution packs |
| SearchLane | Agent web search |
| StackLane | Cloud keys & credits |
More: github.com/talocode · docs.talocode.site
MIT © Talocode