llama.cpp

Ollama is an open-source platform for running large language models locally. It allows users to easily set up and run various AI models on their own hardware, providing a self-hosted alternative to cloud-based AI chat services.

LocalAI is an open-source project that allows users to run AI models locally. It supports various language models and aims to be a drop-in replacement for OpenAI API, making it easy to integrate with existing applications.

LMStudio is a GUI-based application for running and fine-tuning large language models on local hardware. It provides an easy-to-use interface for interacting with various open-source models.

Also known as oobabooga's text generation web UI, this is a gradio web UI for running large language models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA. It offers a user-friendly interface for interacting with various models locally.

GPT4All is an ecosystem of open-source large language models that can run locally on consumer-grade hardware. It includes a chatbot, an API, and various pre-trained models, making it easy for users to deploy AI assistants on their personal devices without relying on cloud services.