Latest free open-source software collection:

OpenLLMetry

Key features Open-source observability tool designed specifically for LLM applications. Provides tracing, metrics, and performance monitoring to help debug and optimize AI workflows. Self-hosted LLM observability with full telemetry capabilities. Licensed under Apache-2.0, enabling free use and modification. Platforms: Windows, macOS, Linux Links Official website: https://www.traceloop.com/openllmetry Source code: https://github.com/openllmetry/openllmetry Pricing: Free. OpenLLMetry is free and open-source under the Apache-2.0 license, offering self-hosted LLM observability with tracing and monitoring capabilities.

FreeWindowsmacOSLinux

OpenLIT

Key features Open-source observability platform purpose-built for LLM applications. Combines monitoring, debugging, and analytics in one integrated tool. Native OpenTelemetry support for standardized telemetry collection. Self-hosted deployment with no usage limits. Licensed under Apache-2.0, so it's free to use and extend. A free, open-source alternative to commercial tools like LangSmith. Platforms Linux, macOS, Windows. Links Official website: https://openlit.ai Source code: https://github.com/openlit/openlit Pricing Free and open-source under Apache-2.0, self-hosted with no usage limits.

FreeWindowsmacOSLinux

Open-Notebook

Key features Free and open-source AI-powered research notebook. Privacy-first: runs locally on your own machine. Chat with PDFs, documents, and notes to gather insights. Bring your preferred LLM provider: Ollama, OpenAI-compatible APIs, or other providers. Self-host locally for full control over your data. Platforms: Windows, macOS, Linux Links Official website: https://open-notebook.vercel.app Source code: https://github.com/SiddharthMaheshwari/Open-Notebook Pricing: Free — completely free and open-source; self-host locally and connect to Ollama, OpenAI-compatible APIs, or other providers.

FreeWindowsmacOSLinux

Ollama

Key features Run open-source large language models locally on your own machine. Provides a simple API and CLI for interacting with models. Offers a private and free alternative to cloud-based LLM services. Supported on Windows, macOS, and Linux. Platforms: Windows, macOS, Linux Links Official website: https://ollama.com Source code: https://github.com/ollama/ollama Pricing Free. Fully free and open-source under the MIT license; download and run any supported open-source LLM locally without restrictions.

FreeWindowsmacOSLinux

LocalAI

Key features Self-hosted AI runtime covering text, voice, vision, and agent capabilities. OpenAI-compatible API, making it a practical free alternative to the OpenAI API. Runs LLMs and other AI models locally, keeping data on your own hardware and off external services. Works across Windows, macOS, Linux, and Raspberry Pi OS. Fully open source under the MIT license — no usage limits or API fees. Platforms: Windows, macOS, Linux, Raspberry Pi OS Links Official website: https://localai.io Source code: https://github.com/mudler/LocalAI Pricing Free. Completely free and open source under the MIT license; self-host all AI features without usage limits or API fees.

FreeWindowsmacOSLinuxRaspberry Pi OS

llama.cpp

llama.cpp is a free, open-source alternative to OpenAI . Key features Lightweight C++ implementation for running large language models locally. Supports a wide range of hardware backends. Quantized inference for efficient performance. Platforms: Windows, macOS, Linux Links Official website Source code Pricing: Free — fully open-source under the MIT license, free to use, modify, and distribute.

FreeWindowsmacOSLinux

Latitude

Key features End-to-end tracing for LLM applications and AI agents in production. Monitoring and analytics tools built specifically for LLM observability. Self-hosted, open-source platform with full control over your data. Designed for AI-agent workloads, covering request-level visibility and debugging. Platforms: Linux, macOS, Windows. Links Official Website Source Code Pricing: Free. Open-source self-hosted observability for AI agents, including full tracing and analytics.

FreeWindowsmacOSLinux

LangWatch

Key features Simulation-based testing for AI agents and LLM applications. Evaluation tools for LLM applications. Observability for AI agents and LLM applications. Open-source platform licensed under Apache-2.0. Self-hostable via Docker. Platforms: Linux, macOS, Windows Links Official website: langwatch.ai Source code: github.com/langwatch/langwatch Pricing: Free and open-source under Apache-2.0, with self-hosting via Docker.

FreeWindowsmacOSLinux

Langfuse

Key features Open-source LLM engineering platform for AI-powered applications. Tracing and observability tools to debug and analyze LLM requests. Monitoring capabilities for production LLM-based products. Built-in evaluation features to assess and improve model performance. Prompt management to organize, version, and maintain prompts. Platforms: Linux, macOS, Windows Links Official website Source code repository Pricing Free. The entire platform is open source under the MIT license and free to self-host with no feature restrictions.

FreeWindowsmacOSLinux

Laminar

Key features Open-source, AI-powered platform designed for engineering LLM products. Comprehensive LLM tracing to monitor and debug application behavior. Evaluation tools for assessing model performance and reliability. Prompt management features to organize and version prompts. Free to self-host with the full feature set, including tracing, evaluation, and prompt management. Available on Linux, macOS, and Windows. Platforms: Linux, macOS, Windows. Links Official website: https://www.lmnr.ai Source code: https://github.com/lmnr-ai/laminar Pricing: Free — the open-source platform is free to self-host with full features, including LLM tracing, evaluation, and prompt management.

FreeWindowsmacOSLinux

Helicone

Key features Open-source LLM observability and monitoring platform built for AI applications. Tracks LLM requests to help developers understand usage patterns and behavior. Monitors costs associated with AI application usage. Measures latency and performance for model calls. Evaluates quality metrics to assess model outputs and application reliability. Platforms: Linux Links: Official website · Source code Pricing: Free self-hosted open-source license (Apache-2.0) with full observability features; cloud managed service available with a free tier.

FreeLinux

GPT4All

Key features Run local large language models directly on your own device, enabling fully private and offline AI chat without relying on cloud services. Keep all conversations and data on your hardware — nothing is uploaded, protecting your privacy. Free and open-source desktop application released under the permissive MIT license. No usage limits; all models execute locally on your own hardware. Cross-platform desktop support for Windows, macOS, and Linux. Platforms: Windows, macOS, Linux Links Official website: https://gpt4all.io Source code repository: https://github.com/nomic-ai/gpt4all Pricing Free. GPT4All is completely free and open-source (MIT) with no usage limits; all models run locally on your hardware. It serves as a private, offline alternative to cloud-based AI chat tools such as ChatGPT.

FreeWindowsmacOSLinux

dstack

Key features Open-source GPU orchestration tool for distributed AI and ML workloads. Runs workloads seamlessly across cloud providers, Kubernetes clusters, and on-premises infrastructure. Simplifies resource management and scheduling for GPU-intensive tasks. Built for MLOps workflows with automation and infrastructure abstraction. Platforms: Windows, macOS, Linux Links Official website: https://dstack.ai Source code: https://github.com/dstackai/dstack Pricing: Free. Open-source under Apache-2.0; self-hosted with no usage limits.

FreeWindowsmacOSLinux

prompts.chat

prompts.chat The world's largest open-source prompt library for AI Works with ChatGPT, Claude, Gemini, Llama, Mistral, and more formerly known as Awesome ChatGPT Prompts 🌐 Browse Prompts • 📖 Read the Book • 📄 View on GitHub • 🚀 Self-Host 🏆 Featured in Forbes · 🎓 Referenced by Harvard , Columbia · 📄 40+ academic citations · ❤️ Most liked dataset on Hugging Face ⭐ 143k+ GitHub stars · 🏅 GitHub Staff Pick · 🚀 First prompt library (Dec 2022) Loved by AI pioneers: Greg Brockman (OpenAI Co-Founder) · Wojciech Zaremba (OpenAI Co-Founder) · Clement Delangue (Hugging Face CEO) · Thomas Dohmke (Former GitHub CEO) What is this? A curated collection of prompts for AI chat models. Originally created for ChatGPT, these prompts work great with any modern AI assistant. Browse Prompts Data Formats prompts.chat prompts.csv PROMPTS.md Hugging Face Dataset Want to contribute? Add prompts at prompts.chat/prompts/new — they sync here automatically. 📖 The Interactive Book of Prompting Learn prompt engineering with our free, interactive guide — 25+ chapters covering everything from basics to advanced techniques like chain-of-thought reasoning, few-shot learning, and AI agents. Start Reading → (Source: https://github.com/f/prompts.chat/tree/main/src/content/book ) 🎮 Prompting for Kids An interactive, game-based adventure to teach children (ages 8-14) how to communicate with AI through fun puzzles and stories. Start Playing → 🚀 Self-Hosting Deploy your own private prompt library with custom branding, themes, and authentication. Quick Start: npx prompts.chat new my-prompt-library cd my-prompt-library Manual Setup: git clone https://github.com/f/prompts.chat.git cd prompts.chat npm install && npm run setup The setup wizard configures branding, theme, authentication (GitHub/Google/Azure AD), and features. Recommended database: prompts.chat uses PostgreSQL. For a hosted database, we recommend Neon . Sponsored by 📖 Full Self-Hosting Guide • 🐳 Docker Guide 🔌 Integrations CLI npx prompts.chat Claude Code Plugin /plugin marketplace add f/prompts.chat /plugin install [email protected] 📖 Plugin Documentation MCP Server Use prompts.chat as an MCP server in your AI tools. Remote (recommended): { "mcpServers" : { "prompts.chat" : { "url" : " https://prompts.chat/api/mcp " } } } Local: { "mcpServers" : { "prompts.chat" : { "command" : " npx " , "args" : [ " -y " , " prompts.chat " , " mcp " ] } } } 📖 MCP Documentation 💖 Sponsors Built with Windsurf and Devin Become a Sponsor → 👥 Contributors 📜 License This project is dual-licensed: Source code and site-authored content is licensed under the MIT License , including the interactive book content in src/content/book . Prompt content and data (prompts.csv, PROMPTS.md, user-submitted prompts) is dedicated to the public domain under CC0 1.0 Universal . See LICENSE for details.

FreeWindowsmacOSLinux

Tiledesk

Key features Open-source no-code platform for building AI agents and automating customer support. Combines live chat, helpdesk, and chatbot functionality in a single solution. Drag-and-drop visual builder for creating conversational flows without code. Offers self-hosted and cloud deployment options. Platforms Linux, macOS, Windows Links Official website: https://www.tiledesk.com/ Source code: https://github.com/Tiledesk/tiledesk Pricing Freemium. Free self-hosted version under GPL-3.0 with unlimited users and conversations, plus a free cloud tier with basic features.

FreemiumWindowsmacOSLinux

Portkey AI Gateway

Key features Routes API requests to 180+ LLM providers through a unified gateway. Observes request traffic with built-in observability for monitoring and debugging. Secures requests with configurable guardrails. Improves reliability with automatic retries. Supports fallbacks between providers for seamless failover. Platforms: Windows, macOS, Linux Links Official website: https://portkey.ai Source code: https://github.com/Portkey-AI/gateway Pricing Free and open-source under the MIT License.

FreeWindowsmacOSLinux

Paperclip

Key features Org chart for AI agent teams Budget management for AI agent operations Governance controls for AI agent teams Links Project website Pricing Free

FreeWindowsmacOSLinux

Mem0

Key features Provides a persistent memory layer designed for AI agents and applications. Enables storing, retrieving, and managing user memories across multiple sessions. Supports semantic memory capabilities to help agents recall relevant context over time. Offers self-hostable open-source infrastructure for developer use. Platforms: Windows, macOS, Linux Links Official website: mem0.ai Source code: github.com/mem0ai/mem0 Pricing: Completely free and open-source under Apache-2.0; self-host and use without any licensing costs.

FreeWindowsmacOSLinux

LobeChat

Key features Open-source, modern AI chat interface for managing, building, and running AI agent teams. Works across multiple LLM providers, letting you switch or combine models in one place. Supports self-hosting for full control over your data and deployment. Extensible via plugins to add custom tools and capabilities. Rich feature set covering chat organization, agent management, and team workflows. Platforms: Windows, macOS, Linux Links Official website: https://lobehub.com/ Source code: https://github.com/lobehub/lobe-chat Pricing Free and fully open-source under Apache-2.0. You can self-host it or use the public demo.

FreeWindowsmacOSLinux

LiveKit

Key features Full-stack platform for building real-time voice, video, and AI agent applications. Built on WebRTC technology for low-latency browser and native communication. SFU-based architecture for scalable real-time media routing. Client SDKs for Windows, macOS, Linux, Android, and iOS. Open-source core server and SDKs under the Apache-2.0 license. Self-hostable alternative to proprietary real-time communication services like Twilio. Platforms: Windows, macOS, Linux, Android, iOS Links Official website: https://livekit.io Source code: https://github.com/livekit/livekit Pricing Free. The core LiveKit server and SDKs are open source under Apache-2.0, allowing self-hosting and unrestricted use.

FreeWindowsmacOSLinuxAndroidiOS

Find free open source alternatives of following paid software:

LLM Evaluation & Observability

LLM Evaluation & Observability is a tool for evaluating and tracking AI model behavior.

Observability

Observability is a set of tools for monitoring and diagnosing system health via telemetry.

GPU Orchestration

GPU Orchestration is a platform for managing, scheduling, and allocating GPU resources across clusters.

Prompt Library

Customer Support

Customer Support is a helpdesk platform for managing customer inquiries and support tickets.

Real-time Communication

Real-time Communication is a service for live messaging, voice, and video.

Workflow Automation

Workflow automation is a tool that connects apps and automates repetitive tasks.

LLM Observability

LLM observability provides monitoring, tracing, and evaluation for LLM apps.

LLMOps

LLMOps is a platform for managing and monitoring large language models in production.

AI Copilot Builder

AI Copilot Builder is a platform for creating and managing AI copilots.

Maltego

Maltego is a graphical tool for link analysis and data mining used in OSINT investigations.

AI Coding Assistant Optimization

AI Coding Assistant Optimization fine-tunes AI coding assistants for better suggestions.

LangSmith

LangSmith is a platform for debugging, testing, evaluating, and monitoring LLM applications.

AI Developer Tools

AI Developer Tools is a suite for building, testing, and deploying AI applications.

Open Source Alternatives

A directory for individuals and businesses to discover software tools for various needs.

Video Production

Video Production is a video editing suite for creating polished, professional videos.

AI Development

AI Development is a platform for building, training, and deploying artificial intelligence models.

People Search

People Search is a tool for finding and viewing public information about individuals.

AI Development Platforms

AI development platforms provide tools and infrastructure for building, training, and deploying machine learning models.

VMware

VMware is a virtualization platform for IT teams to manage servers and workloads.