Judgment Labs (judgeval)
Open-source agent behavior monitoring and evaluation library feeding agent post-training (RL/SFT).
| Category | Evals & Testing |
| Open source | Yes |
| Self-hostable | Yes |
| Pricing model | freemium |
| Pricing notes | Open-source library plus hosted platform |
| Framework integrations | — |
| Funding / ownership | — |
| GitHub stars | 1,036 |
| Maintenance | active (commit 2026-06-12) |
| License (GitHub) | Apache-2.0 |
| Open issues | 18 |
| Maturity signal | 86/100 (Mature) — computed from public GitHub signals, see methodology |
Pricing/feature source: https://github.com/JudgmentLabs/judgeval
Maturity signal is computed from public GitHub data only. How it is calculated.
Frequently asked questions
Is Judgment Labs (judgeval) open source?
Yes. Licensed under Apache-2.0.
Can I self-host Judgment Labs (judgeval)?
Yes — Judgment Labs (judgeval) can run in your own infrastructure.
How much does Judgment Labs (judgeval) cost?
Freemium. Open-source library plus hosted platform