Langfuse
Open source LLM engineering platform (observability, evals, prompt management)
Self-hosted (Free) / Cloud Tier Open Source
#ai #llm #observability #open-source
Category · AI & LLM
AI & LLM Tools & Alternatives
AI & LLM is a broad category in the data, with 11 tools and 5 marked open source, spanning LLM engineering, model serving, and agent infrastructure rather than one product type. Langfuse is an open source LLM engineering platform covering observability, evals, and prompt management, OpenRouter is a unified API for LLMs, and Ollama is for getting up and running with large language models locally. The rest of the set includes debugging and evaluation tools, serverless GPU functions for Python, model serving at production scale, sandboxed environments for AI agents, and turning websites into structured data for AI apps, so start from the tagline that matches your LLM task, not from the category label alone. Arize Phoenix, added here, is for tracing, evaluating, and debugging LLM applications with OpenTelemetry-native observability, listed as self-hosted free but not marked open source in the data, and Opik is open-source LLM evaluation and observability for AI agents, also listed as self-hosted free.
11 tools · 5 open-source · Prices and open-source status are as listed in the DevAlt directory.
OpenRouter
Unified API for LLMs — route to Claude, GPT-4, Llama, and more
Pay-as-you-go Proprietary
#ai #llm #routing #api
Ollama
Get up and running with large language models locally
Open Source (Free) Open Source
#ai #local llm #llama3
LangSmith
Debugging, testing, evaluating, and monitoring LLM applications
Free Tier Proprietary
#llm #monitoring #ai #testing
Braintrust
Enterprise-grade evaluations and data infrastructure for AI
Free tier available Proprietary
#ai #evaluation #llm
Modal
Fast serverless cloud functions with GPU support for Python
Free Tier ($30/mo credits) Proprietary
#python #gpu #serverless #ai
Baseten
Deploy and serve machine learning models at production scale
Usage-based Proprietary
#ml #inference #gpu #ai
E2B
Secure sandboxed cloud environments for AI agents
Free Tier available Open Source
#sandbox #ai agents #code execution
Firecrawl
Turn websites into clean markdown or structured data for AI apps
Free Tier (500 credits) Open Source
#scraping #markdown #llm #data
Arize Phoenix
Trace, evaluate, and debug LLM applications with OpenTelemetry-native observability
Self-hosted (Free) Proprietary
#ai #llm #observability #evaluation
Opik
Open-source LLM evaluation and observability for AI agents
Self-hosted (Free) Open Source
#ai #llm #evaluation #observability