Free open source alternative app list about topic "evaluation" :

LangWatch

Key features Simulation-based testing for AI agents and LLM applications. Evaluation tools for LLM applications. Observability for AI agents and LLM applications. Open-source platform licensed under Apache-2.0. Self-hostable via Docker. Platforms: Linux, macOS, Windows Links Official website: langwatch.ai Source code: github.com/langwatch/langwatch Pricing: Free and open-source under Apache-2.0, with self-hosting via Docker.

FreeWindowsmacOSLinux

Langfuse

Key features Open-source LLM engineering platform for AI-powered applications. Tracing and observability tools to debug and analyze LLM requests. Monitoring capabilities for production LLM-based products. Built-in evaluation features to assess and improve model performance. Prompt management to organize, version, and maintain prompts. Platforms: Linux, macOS, Windows Links Official website Source code repository Pricing Free. The entire platform is open source under the MIT license and free to self-host with no feature restrictions.

FreeWindowsmacOSLinux

Laminar

Key features Open-source, AI-powered platform designed for engineering LLM products. Comprehensive LLM tracing to monitor and debug application behavior. Evaluation tools for assessing model performance and reliability. Prompt management features to organize and version prompts. Free to self-host with the full feature set, including tracing, evaluation, and prompt management. Available on Linux, macOS, and Windows. Platforms: Linux, macOS, Windows. Links Official website: https://www.lmnr.ai Source code: https://github.com/lmnr-ai/laminar Pricing: Free — the open-source platform is free to self-host with full features, including LLM tracing, evaluation, and prompt management.

FreeWindowsmacOSLinux

Arize Phoenix

Key features Open-source LLM tracing and evaluation platform for AI applications. Monitor, debug, and optimize LLM workflows with built-in observability. Self-hosted deployment for full control over tracing and evaluation data. Supports experimentation with LLM tracing and evaluation using the Phoenix library. Designed for machine-learning and AI observability use cases. Platforms Windows, macOS, Linux Links Official website Source code repository Pricing Free. The free plan includes self-hosted LLM tracing, evaluation, and experimentation with the open-source Phoenix library.

FreeWindowsmacOSLinux

Agenta

Key features Build, evaluate, and improve AI agents and LLM applications in a single collaborative platform. Manage prompts with versioning and organization tools for LLM workflows. Run evaluations to test and compare AI agent and LLM outputs. Gain observability into LLM application behavior and performance. Support LLMOps practices for teams developing with large language models. Platforms Windows, macOS, Linux Links Official website: https://agenta.ai Source code: https://github.com/Agenta-AI/agenta Pricing Free. Free and open-source self-hosted platform under Apache-2.0 license.

FreeWindowsmacOSLinux

Editor's Picks for Free Open-Source Software: