Deepchecks
Continuous validation suite from the ML-testing world extended to LLM apps, scoring outputs across versions from dev to production.
| Category | Evals & Testing |
| Open source | Yes |
| Self-hostable | Yes |
| Pricing model | freemium |
| Pricing notes | OSS package free; LLM evaluation SaaS with free + paid tiers |
| Framework integrations | openai-sdk, langchain |
| Funding / ownership | $14M seed (2022) |
| GitHub stars | 4,023 |
| Maintenance | slow (2025-12-28) |
| License (GitHub) | not detected |
| Open issues | 263 |
| Maturity signal | 63/100 (Established) — computed from public GitHub signals, see methodology |
Pricing/feature source: https://www.deepchecks.com/pricing/
Maturity signal is computed from public GitHub data only. How it is calculated.
Frequently asked questions
Is Deepchecks open source?
Yes.
Can I self-host Deepchecks?
Yes — Deepchecks can run in your own infrastructure.
How much does Deepchecks cost?
Freemium. OSS package free; LLM evaluation SaaS with free + paid tiers