AIAny
AI Infra2021
Icon for item

SkyPilot

Runs, manages, and scales AI workloads across 20+ clouds, Kubernetes, Slurm, and on-prem from one YAML or Python spec. Auto-provisions GPUs/TPUs, fails over across regions and providers when capacity is short, and routes jobs to the cheapest option.

Introduction

GPU scarcity turned "which cloud" into a daily scramble: the cheapest A100s might be on Lambda today, GCP tomorrow, and your own Kubernetes cluster when both run dry. SkyPilot's bet is that the job spec should outlive the infrastructure — you describe what to run once, and it decides where, provisioning across 20+ clouds, Slurm, and Kubernetes and failing over automatically when a region runs out of capacity.

What Sets It Apart
  • Write once, run on any infra. A single YAML or Python spec maps onto AWS, GCP, Azure, OCI, RunPod, Lambda, Nebius, and on-prem clusters, so you stop maintaining a separate launch script per provider.
  • Spot jobs that babysit themselves. Managed jobs checkpoint and re-provision preempted spot instances on their own, turning cheap-but-fragile capacity into something you can actually train on overnight.
  • A scheduler that optimizes for price and availability together. At launch it compares real-time cost and GPU availability across regions and providers and picks the cheapest option that actually has the hardware, instead of dying on a quota wall.
  • One control plane for messy fleets. Infra teams get a single place to enforce scheduling, quotas, and automatic teardown across otherwise heterogeneous compute.
Great Fit / Look Elsewhere

Great fit if you train or batch-infer across more than one cloud, chase spot capacity to cut cost, or want workloads portable enough that you're never locked into one vendor's console. Look elsewhere if you live entirely inside a single managed platform like SageMaker or Vertex and value its native integrations over portability, or if your whole world is one fixed on-prem box — then SkyPilot's orchestration layer is overhead you won't use.

Information

  • Websitegithub.com
  • OrganizationsSky Computing Lab, UC Berkeley
  • Authorsskypilot-org, Sky Computing Lab (UC Berkeley)
  • Published date2021/08/11

More Items

Enables RL post-training with million-token prompts under a fixed GPU budget by evaluating shared prompt state without autograd, retaining only minimal model state, and replaying short response branches; instantiated as GRPO and demonstrated on Qwen3.6-27B and GLM-5.2 up to multi-million token execution.

GitHub
AI Infra2026

Defines OpenTelemetry semantic conventions for generative AI telemetry — spans, metrics, and events for GenAI clients, the Model Context Protocol (MCP), and provider-specific integrations. Includes YAML models, human-readable docs, and reference implementations to standardize observability across GenAI deployments.

GitHub
AI Infra2024

Provides a lightweight build platform for HIP and ROCm that supports building ROCm, PyTorch, and JAX from source, multi-architecture nightly releases, and integrated CI/CD and developer tooling for Linux and Windows.