--- title: "Orchestrate ETL pipelines with Data Platform workflows" description: "Workflows are basically your orchestrated ETL and data processing pipelines on the Platform" url: https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/dpe-workflows lang: de lastUpdated: 2026-09-14 --- > For AI agents: the complete documentation index is available at https://docs.ovhcloud.com/de/llms.txt, the full documentation bundle is available at https://docs.ovhcloud.com/de/llms-full.txt. # Orchestrate ETL pipelines with Data Platform workflows ## Objective Workflows are basically your orchestrated ETL and data processing pipelines on the Platform. A workflow is an organizational structure in the Data Processing Engine which represents **a sequence of [actions](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/landing-page-dpe-actions.md)** which can be: - Run manually or through an API call - Scheduled to run at a given time (CRON) When **creating workflows**, you can organize actions into stages to customize the processing of your data, as stages are run sequentially and actions in parallel. Each time a workflow is launched, you can **monitor the execution of a workflow** by reviewing the logs. ## Create a workflow The Platform offers a simple point-and-click interface to orchestrate your actions into scheduled workflows. The creation of the workflow has 2 main steps: - **Stages**: Configure the workflow's successive stages, actions in the respective stages can be either added upon the creation of the workflow or later on. - **Preferences**: Users can define various parameters and information about the workflow ![Create a workflow — New workflow](/images/public-cloud/data-platform/product/dpe/workflows/picts/new-workflow.png) ### Stages Within a workflow, actions are organized in **sequential** stages. Within stages, actions are run in **parallel** (meaning they can run [in parallel on multiple instances](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/dpe-jobs-resources.md#scale-your-jobs-horizontally)) ![Stages — Organisation traitements](/images/public-cloud/data-platform/product/dpe/workflows/picts/organisation-traitements.png) If a workflow contains actions with multiple language versions, it will be executed with the **latest language version** it contains. You can override this behavior from the [workflow's preferences](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/dpe-workflows.md#preferences) :::warning At the moment, a single workflow **cannot** contain both [PySpark actions](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/dpe-actions-custom-pyspark.md) and normal actions. ::: :::info A workflow must contain **at least one action** before it can be started. Empty workflows cannot be run. ::: ### Preferences The preferences tab allows the user to give the workflow a name, a description and tags; and to define several [execution parameters](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/dpe-jobs-preferences.md). ![Preferences — Workflow preferences](/images/public-cloud/data-platform/product/dpe/workflows/picts/workflow-preferences.png) :::info **What does the "Auto Flushall" do?** The platform stores the output of the queries in cache (in other words they are "pre-computed") for better performance when using an application. By running the "Flush all" the queries are re-run and the data in the app refreshed. It is therefore activated by default & usually adds an additional 5-10s of processing time to your workflow. For complex successive data processing workflows, you might want to deactivate it and run it only once at the end as a separate workflow. ::: ### Advanced mode You can also go under the hood by using our integrated IDE in the Advanced mode: the **advanced** tab is available to further customize your workflow using the JSON config files. [Learn how to configure a workflow using the Advanced mode](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/dpe-workflows-advanced-mode.md) ## Manage workflows In the workflows screen, you can quickly see which workflows are being run, have successfully ran or have encountered errors during their execution. By hovering on the _More_ icon (i.e. "...") on each line of a workflow, you can also easily: - **Delete** a workflow - **Edit** an existing workflow - **Run** a workflow - **Inspect the logs** of a workflow ![Manage workflows — Crud workflow](/images/public-cloud/data-platform/product/dpe/workflows/picts/crud_workflow.png) When the number of workflows increases, you can organise the view using _Folders_ or look for a specific workflow using the search bar on the top right of the screen. To add workflows into folders, simply drag & drop a workflow inside a given folder. ![Manage workflows — Workflow basic actions](/images/public-cloud/data-platform/product/dpe/workflows/picts/workflow-basic-actions.png) ## Monitor a workflow ### Logs To monitor a workflow's progress, it is possible to open its logs by clicking on the **Console icon**. This will open the [Control Center Logs Explorer](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/control-center-logs-explorer.md) in a new window. Note that in the [preferences](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/dpe-workflows.md#preferences) of a workflow, you can define a level of information available in the logs (debug, info, notice, warning, error, critical). ![Logs — Etl log](/images/public-cloud/data-platform/product/dpe/workflows/picts/etl-log.png) ### Alerts Just like for actions, you can monitor the execution of a workflow by setting alerts on some key execution metrics (like job success, runtime, memory used, etc.). This will create an [alert](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/landing-page-control-center-alerting.md) in the [Control Center](https://docs.ovhcloud.com/de/guides/public-cloud/data-platform/landing-page-control-center.md). ![Alerts — Etl alert](/images/public-cloud/data-platform/product/dpe/workflows/picts/etl-alert.png) ## Go further If you need training or technical assistance to implement our solutions, contact your sales representative or click on [this link](https://www.ovhcloud.com/de/professional-services/) to get a quote and ask our Professional Services experts for a custom analysis of your project. Ask questions, give your feedback and interact directly with the team building the Data Platform on the dedicated [Discord channel](https://discord.gg/ovhcloud). If you need support with your OVHcloud services, create a request in our [Help Centre](https://help.ovhcloud.com/csm?id=csm_get_help). Join our [community of users](https://community.ovhcloud.com/).