LMStudio

Ollama is an open-source platform for running large language models locally. It allows users to easily set up and run various AI models on their own hardware, providing a self-hosted alternative to cloud-based AI chat services.

LocalAI is an open-source project that allows users to run AI models locally. It supports various language models and aims to be a drop-in replacement for OpenAI API, making it easy to integrate with existing applications.

Also known as oobabooga's text generation web UI, this is a gradio web UI for running large language models like LLaMA, llama.cpp, GPT-J, Pythia, OPT, and GALACTICA. It offers a user-friendly interface for interacting with various models locally.

llama.cpp is a popular C/C++ port of Facebook's LLaMA model, optimized for CPU usage. It allows users to run LLaMA and other large language models on consumer hardware, making it highly accessible for personal use and experimentation.

GPT4All is an ecosystem of open-source large language models that can run locally on consumer-grade hardware. It includes a chatbot, an API, and various pre-trained models, making it easy for users to deploy AI assistants on their personal devices without relying on cloud services.