AIAny
AI Infra2022
Icon for item

Self Hosting Guide

A continuously-updated, categorized self-hosting guide that catalogs tools, deployment notes and resources for containers, networking, home automation and running LLMs/chatbots locally; provided as a long, structured README with links and quick setup tips.

Introduction

Self-hosting has grown from a hobbyist niche into a practical privacy- and control-first alternative to many SaaS offerings — this repository is a single, curated index of the tooling and how-tos you need to run services yourself. It collects recommendations, Docker/Kubernetes guidance, networking/VPN tips, Home Assistant and Raspberry Pi notes, and a dedicated section on running large language models and related tooling locally.

What Sets It Apart
  • Breadth and organization: covers core self-hosting domains (containers, CI/CD, networking, storage, backups, home automation, media servers) in a single, navigable README so you can find complementary tools and deployment approaches without hunting multiple sources.
  • Practical deployment focus: links to Docker Compose examples, images, and quick commands (and platform-specific notes like Pi/Unraid/pfSense/OpenWRT) that speed up getting a service running.
  • LLM and AI-relevant content: includes curated links and projects for running LLMs locally, chat UIs, and related infrastructure (LocalAI, llama.cpp, web UIs), so it’s useful for teams that want on-prem or private model deployments.
  • Community-driven and maintained: large star/contributor surface means many suggestions and periodic updates; acts more like a living bibliography than a packaged distribution.
Who it's for & tradeoffs

Great fit if you want full control over services and data, are comfortable with Docker/VMs/routers, and prefer curated recommendations over opinionated installers. Not ideal if you want a one-click, fully-maintained hosted product: many entries point to community projects that require manual configuration and ongoing maintenance. Expect to handle updates, backups, and security hardening yourself.

Where it fits

Use this guide as a discovery and reference hub — it complements curated app lists (e.g., awesome-selfhosted) and official project docs by grouping related tooling and deployment notes in one place. It is not a turnkey appliance; for production-critical deployments you should pair its references with tested deployment pipelines and monitoring/backup systems.

Information

  • Websitegithub.com
  • Authorsmikeroyal
  • Published date2022/02/06

Categories

More Items

GitHub
AI Infra2026

Compresses tool outputs, logs, files and RAG chunks locally before they reach the LLM to reduce token usage while caching originals for on-demand retrieval. Provides proxy/library/wrap modes, JSON- and code-aware compressors, and reversible compression.

GitHub
AI Infra2026

Provides a self‑hosted OpenAI‑compatible gateway that exposes one API endpoint to route requests to 40+ model providers, issue revocable virtual keys, enforce budgets before spend, and record usage.

GitHub
AI Coding2023

A statically typed, parallel programming language that prevents AI-introduced bugs by making correctness claims (laws) require machine-checked proofs. Compiles to native code and targets CPU/GPU parallelism with a fast proof checker.