Key features

• Open-source LLM engineering platform for AI-powered applications.
• Tracing and observability tools to debug and analyze LLM requests.
• Monitoring capabilities for production LLM-based products.
• Built-in evaluation features to assess and improve model performance.
• Prompt management to organize, version, and maintain prompts.

Platforms: Linux, macOS, Windows

Links

• Official website
• Source code repository

Pricing

Free. The entire platform is open source under the MIT license and free to self-host with no feature restrictions.