Free open source alternative app list about topic "llm" :

Open WebUI

Key features Self-hosted AI chat interface that you can run on your own hardware, keeping conversations and data under your control. Works with both local models (for example via Ollama) and remote LLM providers from a single web UI. Extensible, community-driven project designed to be customized and adapted to different workflows. Multi-model support, letting you switch between different language models without leaving the app. Browser-based chat experience that requires no client installation beyond a modern web browser. Platforms: Windows, macOS, Linux. Links Official website Source code Pricing: Fully free and open source under the MIT license; self-hostable Docker image with no paid tier.

FreeWindowsmacOSLinux

Fullmoon

Key features Native macOS and iOS application built specifically for Apple platforms. Chat interface designed for interacting with large language models. Runs conversations locally on-device, keeping data private. Focused on privacy by avoiding cloud-based processing. Tailored experience on both Mac and iPhone/iPad. Platforms: macOS, iOS Links Official website Pricing: Free to download; closed-source proprietary app.

FreemacOSiOS

FastGPT

Key features Open-source platform for building AI-powered knowledge bases and question-answering systems Uses Retrieval-Augmented Generation (RAG) to combine large language models with custom data sources Supports knowledge ingestion, indexing, and natural-language querying Vector search capabilities for retrieving relevant context from documents Chatbot workflow tools for creating conversational AI agents Flexible integration with various LLM providers Platforms: Linux, macOS, Windows Links Official Website Source Code Pricing: Free — self-hosted, free and open-source under the MIT license.

FreeWindowsmacOSLinux

Browser Use

Key features Enables AI agents to autonomously control and automate any web browser Supports LLM-driven browser tasks including navigation, form filling, and web scraping Provides a scalable framework for orchestrating complex browser interactions Built on Playwright for reliable cross-browser automation Distributed as a Python library for easy integration into AI workflows Open-source under the MIT license, allowing flexible self-hosting and customization Platforms: Windows, macOS, Linux Links Official Website Source Code Pricing Free and open-source under the MIT license; self-hosted Python library for AI browser automation.

FreeWindowsmacOSLinux

AnythingLLM

Key features Chat with your own documents using retrieval-augmented generation (RAG) and any supported LLM Desktop application with a single, unified interface for chatting, embedding, and managing vector storage Full support for local models, enabling fully offline and private use Works with a wide range of LLM providers, letting you swap models without changing your workflow Open source under the MIT license, giving you transparency and control over your data Platforms: Windows, macOS, Linux Links Official website Source code Pricing Fully free and open source under the MIT license, with optional paid cloud hosting tiers.

FreeWindowsmacOSLinux

OpenLLMetry

Key features Open-source observability tool designed specifically for LLM applications. Provides tracing, metrics, and performance monitoring to help debug and optimize AI workflows. Self-hosted LLM observability with full telemetry capabilities. Licensed under Apache-2.0, enabling free use and modification. Platforms: Windows, macOS, Linux Links Official website: https://www.traceloop.com/openllmetry Source code: https://github.com/openllmetry/openllmetry Pricing: Free. OpenLLMetry is free and open-source under the Apache-2.0 license, offering self-hosted LLM observability with tracing and monitoring capabilities.

FreeWindowsmacOSLinux

OpenLIT

Key features Open-source observability platform purpose-built for LLM applications. Combines monitoring, debugging, and analytics in one integrated tool. Native OpenTelemetry support for standardized telemetry collection. Self-hosted deployment with no usage limits. Licensed under Apache-2.0, so it's free to use and extend. A free, open-source alternative to commercial tools like LangSmith. Platforms Linux, macOS, Windows. Links Official website: https://openlit.ai Source code: https://github.com/openlit/openlit Pricing Free and open-source under Apache-2.0, self-hosted with no usage limits.

FreeWindowsmacOSLinux

Open-Notebook

Key features Free and open-source AI-powered research notebook. Privacy-first: runs locally on your own machine. Chat with PDFs, documents, and notes to gather insights. Bring your preferred LLM provider: Ollama, OpenAI-compatible APIs, or other providers. Self-host locally for full control over your data. Platforms: Windows, macOS, Linux Links Official website: https://open-notebook.vercel.app Source code: https://github.com/SiddharthMaheshwari/Open-Notebook Pricing: Free — completely free and open-source; self-host locally and connect to Ollama, OpenAI-compatible APIs, or other providers.

FreeWindowsmacOSLinux

Ollama

Key features Run open-source large language models locally on your own machine. Provides a simple API and CLI for interacting with models. Offers a private and free alternative to cloud-based LLM services. Supported on Windows, macOS, and Linux. Platforms: Windows, macOS, Linux Links Official website: https://ollama.com Source code: https://github.com/ollama/ollama Pricing Free. Fully free and open-source under the MIT license; download and run any supported open-source LLM locally without restrictions.

FreeWindowsmacOSLinux

LocalAI

Key features Self-hosted AI runtime covering text, voice, vision, and agent capabilities. OpenAI-compatible API, making it a practical free alternative to the OpenAI API. Runs LLMs and other AI models locally, keeping data on your own hardware and off external services. Works across Windows, macOS, Linux, and Raspberry Pi OS. Fully open source under the MIT license — no usage limits or API fees. Platforms: Windows, macOS, Linux, Raspberry Pi OS Links Official website: https://localai.io Source code: https://github.com/mudler/LocalAI Pricing Free. Completely free and open source under the MIT license; self-host all AI features without usage limits or API fees.

FreeWindowsmacOSLinuxRaspberry Pi OS

llama.cpp

llama.cpp is a free, open-source alternative to OpenAI . Key features Lightweight C++ implementation for running large language models locally. Supports a wide range of hardware backends. Quantized inference for efficient performance. Platforms: Windows, macOS, Linux Links Official website Source code Pricing: Free — fully open-source under the MIT license, free to use, modify, and distribute.

FreeWindowsmacOSLinux

Latitude

Key features End-to-end tracing for LLM applications and AI agents in production. Monitoring and analytics tools built specifically for LLM observability. Self-hosted, open-source platform with full control over your data. Designed for AI-agent workloads, covering request-level visibility and debugging. Platforms: Linux, macOS, Windows. Links Official Website Source Code Pricing: Free. Open-source self-hosted observability for AI agents, including full tracing and analytics.

FreeWindowsmacOSLinux

LangWatch

Key features Simulation-based testing for AI agents and LLM applications. Evaluation tools for LLM applications. Observability for AI agents and LLM applications. Open-source platform licensed under Apache-2.0. Self-hostable via Docker. Platforms: Linux, macOS, Windows Links Official website: langwatch.ai Source code: github.com/langwatch/langwatch Pricing: Free and open-source under Apache-2.0, with self-hosting via Docker.

FreeWindowsmacOSLinux

Langfuse

Key features Open-source LLM engineering platform for AI-powered applications. Tracing and observability tools to debug and analyze LLM requests. Monitoring capabilities for production LLM-based products. Built-in evaluation features to assess and improve model performance. Prompt management to organize, version, and maintain prompts. Platforms: Linux, macOS, Windows Links Official website Source code repository Pricing Free. The entire platform is open source under the MIT license and free to self-host with no feature restrictions.

FreeWindowsmacOSLinux

Laminar

Key features Open-source, AI-powered platform designed for engineering LLM products. Comprehensive LLM tracing to monitor and debug application behavior. Evaluation tools for assessing model performance and reliability. Prompt management features to organize and version prompts. Free to self-host with the full feature set, including tracing, evaluation, and prompt management. Available on Linux, macOS, and Windows. Platforms: Linux, macOS, Windows. Links Official website: https://www.lmnr.ai Source code: https://github.com/lmnr-ai/laminar Pricing: Free — the open-source platform is free to self-host with full features, including LLM tracing, evaluation, and prompt management.

FreeWindowsmacOSLinux

Helicone

Key features Open-source LLM observability and monitoring platform built for AI applications. Tracks LLM requests to help developers understand usage patterns and behavior. Monitors costs associated with AI application usage. Measures latency and performance for model calls. Evaluates quality metrics to assess model outputs and application reliability. Platforms: Linux Links: Official website · Source code Pricing: Free self-hosted open-source license (Apache-2.0) with full observability features; cloud managed service available with a free tier.

FreeLinux

GPT4All

Key features Run local large language models directly on your own device, enabling fully private and offline AI chat without relying on cloud services. Keep all conversations and data on your hardware — nothing is uploaded, protecting your privacy. Free and open-source desktop application released under the permissive MIT license. No usage limits; all models execute locally on your own hardware. Cross-platform desktop support for Windows, macOS, and Linux. Platforms: Windows, macOS, Linux Links Official website: https://gpt4all.io Source code repository: https://github.com/nomic-ai/gpt4all Pricing Free. GPT4All is completely free and open-source (MIT) with no usage limits; all models run locally on your hardware. It serves as a private, offline alternative to cloud-based AI chat tools such as ChatGPT.

FreeWindowsmacOSLinux

prompts.chat

prompts.chat The world's largest open-source prompt library for AI Works with ChatGPT, Claude, Gemini, Llama, Mistral, and more formerly known as Awesome ChatGPT Prompts 🌐 Browse Prompts • 📖 Read the Book • 📄 View on GitHub • 🚀 Self-Host 🏆 Featured in Forbes · 🎓 Referenced by Harvard , Columbia · 📄 40+ academic citations · ❤️ Most liked dataset on Hugging Face ⭐ 143k+ GitHub stars · 🏅 GitHub Staff Pick · 🚀 First prompt library (Dec 2022) Loved by AI pioneers: Greg Brockman (OpenAI Co-Founder) · Wojciech Zaremba (OpenAI Co-Founder) · Clement Delangue (Hugging Face CEO) · Thomas Dohmke (Former GitHub CEO) What is this? A curated collection of prompts for AI chat models. Originally created for ChatGPT, these prompts work great with any modern AI assistant. Browse Prompts Data Formats prompts.chat prompts.csv PROMPTS.md Hugging Face Dataset Want to contribute? Add prompts at prompts.chat/prompts/new — they sync here automatically. 📖 The Interactive Book of Prompting Learn prompt engineering with our free, interactive guide — 25+ chapters covering everything from basics to advanced techniques like chain-of-thought reasoning, few-shot learning, and AI agents. Start Reading → (Source: https://github.com/f/prompts.chat/tree/main/src/content/book ) 🎮 Prompting for Kids An interactive, game-based adventure to teach children (ages 8-14) how to communicate with AI through fun puzzles and stories. Start Playing → 🚀 Self-Hosting Deploy your own private prompt library with custom branding, themes, and authentication. Quick Start: npx prompts.chat new my-prompt-library cd my-prompt-library Manual Setup: git clone https://github.com/f/prompts.chat.git cd prompts.chat npm install && npm run setup The setup wizard configures branding, theme, authentication (GitHub/Google/Azure AD), and features. Recommended database: prompts.chat uses PostgreSQL. For a hosted database, we recommend Neon . Sponsored by 📖 Full Self-Hosting Guide • 🐳 Docker Guide 🔌 Integrations CLI npx prompts.chat Claude Code Plugin /plugin marketplace add f/prompts.chat /plugin install [email protected] 📖 Plugin Documentation MCP Server Use prompts.chat as an MCP server in your AI tools. Remote (recommended): { "mcpServers" : { "prompts.chat" : { "url" : " https://prompts.chat/api/mcp " } } } Local: { "mcpServers" : { "prompts.chat" : { "command" : " npx " , "args" : [ " -y " , " prompts.chat " , " mcp " ] } } } 📖 MCP Documentation 💖 Sponsors Built with Windsurf and Devin Become a Sponsor → 👥 Contributors 📜 License This project is dual-licensed: Source code and site-authored content is licensed under the MIT License , including the interactive book content in src/content/book . Prompt content and data (prompts.csv, PROMPTS.md, user-submitted prompts) is dedicated to the public domain under CC0 1.0 Universal . See LICENSE for details.

FreeWindowsmacOSLinux

Portkey AI Gateway

Key features Routes API requests to 180+ LLM providers through a unified gateway. Observes request traffic with built-in observability for monitoring and debugging. Secures requests with configurable guardrails. Improves reliability with automatic retries. Supports fallbacks between providers for seamless failover. Platforms: Windows, macOS, Linux Links Official website: https://portkey.ai Source code: https://github.com/Portkey-AI/gateway Pricing Free and open-source under the MIT License.

FreeWindowsmacOSLinux

LobeChat

Key features Open-source, modern AI chat interface for managing, building, and running AI agent teams. Works across multiple LLM providers, letting you switch or combine models in one place. Supports self-hosting for full control over your data and deployment. Extensible via plugins to add custom tools and capabilities. Rich feature set covering chat organization, agent management, and team workflows. Platforms: Windows, macOS, Linux Links Official website: https://lobehub.com/ Source code: https://github.com/lobehub/lobe-chat Pricing Free and fully open-source under Apache-2.0. You can self-host it or use the public demo.

FreeWindowsmacOSLinux

Editor's Picks for Free Open-Source Software: