AIAny
AI Infra2022
Icon for item

Self Hosting Guide

A continuously-updated, categorized self-hosting guide that catalogs tools, deployment notes and resources for containers, networking, home automation and running LLMs/chatbots locally; provided as a long, structured README with links and quick setup tips.

Introduction

Self-hosting has grown from a hobbyist niche into a practical privacy- and control-first alternative to many SaaS offerings — this repository is a single, curated index of the tooling and how-tos you need to run services yourself. It collects recommendations, Docker/Kubernetes guidance, networking/VPN tips, Home Assistant and Raspberry Pi notes, and a dedicated section on running large language models and related tooling locally.

What Sets It Apart
  • Breadth and organization: covers core self-hosting domains (containers, CI/CD, networking, storage, backups, home automation, media servers) in a single, navigable README so you can find complementary tools and deployment approaches without hunting multiple sources.
  • Practical deployment focus: links to Docker Compose examples, images, and quick commands (and platform-specific notes like Pi/Unraid/pfSense/OpenWRT) that speed up getting a service running.
  • LLM and AI-relevant content: includes curated links and projects for running LLMs locally, chat UIs, and related infrastructure (LocalAI, llama.cpp, web UIs), so it’s useful for teams that want on-prem or private model deployments.
  • Community-driven and maintained: large star/contributor surface means many suggestions and periodic updates; acts more like a living bibliography than a packaged distribution.
Who it's for & tradeoffs

Great fit if you want full control over services and data, are comfortable with Docker/VMs/routers, and prefer curated recommendations over opinionated installers. Not ideal if you want a one-click, fully-maintained hosted product: many entries point to community projects that require manual configuration and ongoing maintenance. Expect to handle updates, backups, and security hardening yourself.

Where it fits

Use this guide as a discovery and reference hub — it complements curated app lists (e.g., awesome-selfhosted) and official project docs by grouping related tooling and deployment notes in one place. It is not a turnkey appliance; for production-critical deployments you should pair its references with tested deployment pipelines and monitoring/backup systems.

Information

  • Websitegithub.com
  • Authorsmikeroyal
  • Published date2022/02/06

Categories

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.