LogoAIAny
Icon for item

Flyte

A Kubernetes-native workflow engine (originally at Lyft, now LF AI & Data) that provides strongly-typed, versioned data/ML pipelines at scale.

Introduction

Overview

Flyte is an open-source, cloud-native platform that manages data, analytics and ML workflows with automatic lineage, caching and reproducibility.

Key Capabilities
  • Python and Java SDKs with type-checked tasks
  • Declarative DAG execution on Kubernetes
  • Automatic data versioning & lineage tracking
  • Task-level caching and memoization
  • Plugins for Spark, Ray, Hive, BigQuery, Sagemaker, etc.

Information

  • Websiteflyte.org
  • AuthorsLyft, Flyte Community
  • Published date2020/01/07

Categories