Open sourceActive

Prefect

Open-source Python orchestration engine for production-grade data pipelines with minimal friction.

Open source page ↗

Field note

What it does

Turns Python functions into production-grade data pipelines with automatic state tracking, failure handling, and real-time monitoring. Supports pure Python workflows without DSLs or complex configs.

Capabilities

Available capabilities

Event-DrivenModern UIDynamic RuntimeHuman-in-the-loop approvalConcurrency controlFlexible & Portable ExecutionObservabilityState & RecoveryPrefect Self-hostedPrefect CloudPythonic workflowsWorkflow InfrastructureResume Flow RunsRetriesEvent-Driven AutomationConfigurationAutomationsHigh Availability ScalingVisual WorkflowsSchedulingCustom ExtensibilityWorkflow OrchestrationDeploymentsInfrastructure ManagementConcurrency LimitsTask cachingAutomatic Task Retries

Tags

Tags

Data PipelineData engineeringOpen sourceOrchestrationPythonData pipelinesWorkflowworkflow orchestration

Ways to use it

Ways to use it

mcp

python / https://docs.prefect.io/v3/get-started

sdk

python / https://docs.prefect.io/v3/examples

sdk

python / https://docs.prefect.io/v3/examples

sdk

python / https://docs.prefect.io/v3/examples

sdk

python / https://docs.prefect.io/v3/get-started

sdk

python / prefect