Langfuse
Open source LLM engineering platform (observability, evals, prompt management)
Self-hosted (Free) / Cloud Tier Open Source
#ai #llm #observability #open-source
Comparison · Braintrust
Best Braintrust alternatives
Braintrust is the AI evaluation target all three tools on this page are listed against, and one of the three is marked open source. Langfuse is an open source LLM engineering platform covering observability, evals, and prompt management, listed as self-hosted free with a cloud tier, LangSmith is for debugging, testing, evaluating, and monitoring LLM applications, listed with a free tier, and Arize Phoenix is for tracing, evaluating, and debugging LLM applications with OpenTelemetry-native observability, listed as self-hosted free but not marked open source in the data. Compare on whether you want a fully open-source platform, a hosted evaluation tool, or OpenTelemetry-native tracing.
3 tools · 1 open-source · Prices and open-source status are as listed in the DevAlt directory.
LangSmith
Debugging, testing, evaluating, and monitoring LLM applications
Free Tier Proprietary
#llm #monitoring #ai #testing
Arize Phoenix
Trace, evaluate, and debug LLM applications with OpenTelemetry-native observability
Self-hosted (Free) Proprietary
#ai #llm #observability #evaluation