Argo Workflows
Kubernetes-native workflow orchestration engine for running parallel jobs, ML pipelines, and CI/CD workflows at scale.
✨ Key Features
- ✓ Container-based: Each step runs in a container
- ✓ CRDs: Workflow and WorkflowTemplate resources
- ✓ Native scaling: Leverages K8s scheduling
- ✓ Resource management: CPU, memory, GPU allocation
- ✓ DAGs: Directed acyclic graph workflows
- ✓ Steps: Sequential and parallel steps
- ✓ Loops: Iterate over items or parameters
- ✓ Conditionals: Branch based on results
- ✓ Artifacts: Pass data between steps via S3, GCS, Minio
- ✓ Parameters: Input/output parameter passing
- ✓ Retry strategies: Configurable failure handling
- ✓ Suspend/Resume: Manual intervention points
- ✓ Argo Events: Event-driven workflow triggers
- ✓ Argo CD: GitOps continuous delivery
- ✓ Kubeflow: ML pipeline integration
- ✓ Prometheus: Metrics and monitoring
📁 More Orchestration Tools
Apache Airflow
The industry-standard workflow orchestration platform
Dagster
Cloud-native orchestration platform for data pipelines
dbt Cloud
Flyte