diff --git a/knowledge base/prefect.md b/knowledge base/prefect.md new file mode 100644 index 0000000..bd3122c --- /dev/null +++ b/knowledge base/prefect.md @@ -0,0 +1,75 @@ +# Prefect + +Workflow orchestration framework for building data pipelines in Python. + +Workflow activity is tracked and can be monitored from a Prefect (self-hosted or cloud-managed). + +Allows building and scheduling workflows in pure Python, to then run them anywhere.
+Designed to handle retries, dependencies, branching logic, dynamic workflows, modern infrastructure, and data pipelines' +complexity.
+Handles automatic state tracking, failure handling, real-time monitoring, and more. + +1. [TL;DR](#tldr) +1. [Further readings](#further-readings) + 1. [Sources](#sources) + +## TL;DR + +
+ Setup + +```sh +# Install. +docker pull 'prefecthq/prefect:3-latest' +pip install --upgrade 'prefect' + +# Check installation. +prefect version +``` + +
+ +
+ Usage + +```sh +# Start. +prefect server start +docker run -d -p '4200:4200' 'prefecthq/prefect:3-latest' -- prefect server start --host '0.0.0.0' +``` + +
+ + + +## Further readings + +- [Website] +- [Codebase] + +### Sources + +- [Documentation] + + + + + + + +[codebase]: https://github.com/PrefectHQ/Prefect +[documentation]: https://docs.prefect.io/v3/get-started/index +[website]: https://www.prefect.io/ + +