AIAny
AI Infra2021
Icon for item

SkyPilot

Runs, manages, and scales AI workloads across 20+ clouds, Kubernetes, Slurm, and on-prem from one YAML or Python spec. Auto-provisions GPUs/TPUs, fails over across regions and providers when capacity is short, and routes jobs to the cheapest option.

Introduction

GPU scarcity turned "which cloud" into a daily scramble: the cheapest A100s might be on Lambda today, GCP tomorrow, and your own Kubernetes cluster when both run dry. SkyPilot's bet is that the job spec should outlive the infrastructure — you describe what to run once, and it decides where, provisioning across 20+ clouds, Slurm, and Kubernetes and failing over automatically when a region runs out of capacity.

What Sets It Apart
  • Write once, run on any infra. A single YAML or Python spec maps onto AWS, GCP, Azure, OCI, RunPod, Lambda, Nebius, and on-prem clusters, so you stop maintaining a separate launch script per provider.
  • Spot jobs that babysit themselves. Managed jobs checkpoint and re-provision preempted spot instances on their own, turning cheap-but-fragile capacity into something you can actually train on overnight.
  • A scheduler that optimizes for price and availability together. At launch it compares real-time cost and GPU availability across regions and providers and picks the cheapest option that actually has the hardware, instead of dying on a quota wall.
  • One control plane for messy fleets. Infra teams get a single place to enforce scheduling, quotas, and automatic teardown across otherwise heterogeneous compute.
Great Fit / Look Elsewhere

Great fit if you train or batch-infer across more than one cloud, chase spot capacity to cut cost, or want workloads portable enough that you're never locked into one vendor's console. Look elsewhere if you live entirely inside a single managed platform like SageMaker or Vertex and value its native integrations over portability, or if your whole world is one fixed on-prem box — then SkyPilot's orchestration layer is overhead you won't use.

Information

  • Websitegithub.com
  • OrganizationsSky Computing Lab, UC Berkeley
  • Authorsskypilot-org, Sky Computing Lab (UC Berkeley)
  • Published date2021/08/11

More Items

GitHub
AI Infra2026

Compresses tool outputs, logs, files and RAG chunks locally before they reach the LLM to reduce token usage while caching originals for on-demand retrieval. Provides proxy/library/wrap modes, JSON- and code-aware compressors, and reversible compression.

GitHub
AI Infra2026

Provides a self‑hosted OpenAI‑compatible gateway that exposes one API endpoint to route requests to 40+ model providers, issue revocable virtual keys, enforce budgets before spend, and record usage.

GitHub
AI Coding2023

A statically typed, parallel programming language that prevents AI-introduced bugs by making correctness claims (laws) require machine-checked proofs. Compiles to native code and targets CPU/GPU parallelism with a fast proof checker.