AIAny
AI Infra2022
Icon for item

Self Hosting Guide

A continuously-updated, categorized self-hosting guide that catalogs tools, deployment notes and resources for containers, networking, home automation and running LLMs/chatbots locally; provided as a long, structured README with links and quick setup tips.

Introduction

Self-hosting has grown from a hobbyist niche into a practical privacy- and control-first alternative to many SaaS offerings — this repository is a single, curated index of the tooling and how-tos you need to run services yourself. It collects recommendations, Docker/Kubernetes guidance, networking/VPN tips, Home Assistant and Raspberry Pi notes, and a dedicated section on running large language models and related tooling locally.

What Sets It Apart
  • Breadth and organization: covers core self-hosting domains (containers, CI/CD, networking, storage, backups, home automation, media servers) in a single, navigable README so you can find complementary tools and deployment approaches without hunting multiple sources.
  • Practical deployment focus: links to Docker Compose examples, images, and quick commands (and platform-specific notes like Pi/Unraid/pfSense/OpenWRT) that speed up getting a service running.
  • LLM and AI-relevant content: includes curated links and projects for running LLMs locally, chat UIs, and related infrastructure (LocalAI, llama.cpp, web UIs), so it’s useful for teams that want on-prem or private model deployments.
  • Community-driven and maintained: large star/contributor surface means many suggestions and periodic updates; acts more like a living bibliography than a packaged distribution.
Who it's for & tradeoffs

Great fit if you want full control over services and data, are comfortable with Docker/VMs/routers, and prefer curated recommendations over opinionated installers. Not ideal if you want a one-click, fully-maintained hosted product: many entries point to community projects that require manual configuration and ongoing maintenance. Expect to handle updates, backups, and security hardening yourself.

Where it fits

Use this guide as a discovery and reference hub — it complements curated app lists (e.g., awesome-selfhosted) and official project docs by grouping related tooling and deployment notes in one place. It is not a turnkey appliance; for production-critical deployments you should pair its references with tested deployment pipelines and monitoring/backup systems.

Information

  • Websitegithub.com
  • Authorsmikeroyal
  • Published date2022/02/06

Categories

More Items

Enables RL post-training with million-token prompts under a fixed GPU budget by evaluating shared prompt state without autograd, retaining only minimal model state, and replaying short response branches; instantiated as GRPO and demonstrated on Qwen3.6-27B and GLM-5.2 up to multi-million token execution.

GitHub
AI Infra2026

Defines OpenTelemetry semantic conventions for generative AI telemetry — spans, metrics, and events for GenAI clients, the Model Context Protocol (MCP), and provider-specific integrations. Includes YAML models, human-readable docs, and reference implementations to standardize observability across GenAI deployments.

GitHub
AI Infra2024

Provides a lightweight build platform for HIP and ROCm that supports building ROCm, PyTorch, and JAX from source, multi-architecture nightly releases, and integrated CI/CD and developer tooling for Linux and Windows.