Self hosted ai

Blog posts tagged “Self-Hosted AI”


Self-Host OmniRoute: A Free AI Gateway for 500+ Models and 290+ Providers

OmniRoute AI Gateway Self-Hosted AI

OmniRoute is a free MIT-licensed AI gateway you run yourself: one OpenAI-compatible endpoint in front of 290+ providers and 500+ models. We ran it in Docker, got 99 models resolving with zero configuration, tested combos, compression, MCP, and the CLI, then shared the whole thing over a public HTTPS URL with Pinggy. Facts rechecked against v3.8.51 (October 2026).

Best Open Source Self-Hosted Text-to-Speech Models in 2026

Text to Speech Self-Hosted AI Kokoro TTS

A guide to the best open-weight text-to-speech models you can self-host in 2026, ranked by Artificial Analysis Speech Arena Elo. Compare Breeze TTS 2, Fish Audio S2 Pro, Step Audio EditX, Voxtral TTS, Qwen3-TTS, VoxCPM2, GLM-TTS, Higgs Audio V3, Kokoro 82M and Chatterbox on quality, licensing, hardware and deployment.

Self hosting a 744B param LLM with only 25 GB RAM

GLM-5.2 Local LLM Mixture of Experts

A single-file C engine called Colibrì streams GLM-5.2's 744B mixture-of-experts weights off an NVMe drive to run the full model on 25 GB of RAM at 0.05-2 tokens/second. Here's how it works, what Hacker News made of it, and how to check on a queued run from your phone with Pinggy.

Picking the Right Hardware to Run LLMs Locally in 2026

Local LLM Self-Hosted AI Apple Silicon

A practical hardware guide for self-hosting LLMs in 2026. Compare consumer GPUs, Apple Silicon, enterprise cards, and pre-built AI workstations. Find the right setup for 7B to 405B models at every budget.

Best Open Source LLMs for Coding to Self-Host in 2026

Open Source LLM Self-Hosted AI Local LLM

The best open-weight coding LLMs you can self-host as of October 2026, from MiMo-V2.6-Pro and GLM-5.3 down to Qwen3.8-27B on one GPU, with current benchmark scores, licenses and the hardware each one needs.

Best Open-Source Alternatives to ChatGPT in 2026

Open Source AI Self-Hosted AI Local LLM

Discover the best open-source alternatives to ChatGPT in 2026. Compare Open WebUI, Jan, GPT4All, LibreChat, LobeChat, AnythingLLM, and more self-hosted AI chat platforms you can run locally with full privacy.

How to Self-Host Any LLM – Step by Step Guide

Self-Hosted AI Ollama Open WebUI

Complete guide to self-hosting large language models locally using Ollama and Open WebUI with Docker. Learn to run AI models privately with full control over your data.