Free open source alternative app list about topic "inference" :

Ollama

Key features Run open-source large language models locally on your own machine. Provides a simple API and CLI for interacting with models. Offers a private and free alternative to cloud-based LLM services. Supported on Windows, macOS, and Linux. Platforms: Windows, macOS, Linux Links Official website: https://ollama.com Source code: https://github.com/ollama/ollama Pricing Free. Fully free and open-source under the MIT license; download and run any supported open-source LLM locally without restrictions.

FreeWindowsmacOSLinux

LocalAI

Key features Self-hosted AI runtime covering text, voice, vision, and agent capabilities. OpenAI-compatible API, making it a practical free alternative to the OpenAI API. Runs LLMs and other AI models locally, keeping data on your own hardware and off external services. Works across Windows, macOS, Linux, and Raspberry Pi OS. Fully open source under the MIT license — no usage limits or API fees. Platforms: Windows, macOS, Linux, Raspberry Pi OS Links Official website: https://localai.io Source code: https://github.com/mudler/LocalAI Pricing Free. Completely free and open source under the MIT license; self-host all AI features without usage limits or API fees.

FreeWindowsmacOSLinuxRaspberry Pi OS

llama.cpp

llama.cpp is a free, open-source alternative to OpenAI . Key features Lightweight C++ implementation for running large language models locally. Supports a wide range of hardware backends. Quantized inference for efficient performance. Platforms: Windows, macOS, Linux Links Official website Source code Pricing: Free — fully open-source under the MIT license, free to use, modify, and distribute.

FreeWindowsmacOSLinux

Editor's Picks for Free Open-Source Software: