--- title: "Load PySpark Action" description: "It is usually the first step in any data processing system, necessary before running any other processes on data coming from connected sources" url: https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/dpe-actions-load-pyspark lang: pl lastUpdated: 2026-09-14 --- > For AI agents: the complete documentation index is available at https://docs.ovhcloud.com/pl/llms.txt, the full documentation bundle is available at https://docs.ovhcloud.com/pl/llms-full.txt. # Load PySpark Action ## Objective The _Load PySpark_ action **extracts raw data from sources and inserts it into primary tables** in your data warehouse using [Apache Spark™](https://spark.apache.org/). It is usually the first step in any data processing system, necessary before running any other processes on data coming from connected sources. :::info In other terms, if you've [set-up a connector through the Connectors](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/landing-page-connectors-sources.md), the Project has the information to connect to the source as well as its metadata, but won't contain the actual data until it is actually loaded using the _Load PySpark_ action. ::: :::warning The _Load PySpark_ action is only compatible with the following source connectors: [MySQL](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/connectors-sources-mysql.md) , PostgreSQL, Snowflake, [Trino](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/connectors-sources-trino.md) , AWS S31 , [Microsoft Azure Blob Storage](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/connectors-sources-blob-storage.md) , [Data Platform Buckets](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/connectors-sources-dataplatform-buckets.md) , [File Upload](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/connectors-sources-upload-files.md) , and S3. ::: ## Configure a Load PySpark action To create a new _Load PySpark_ action, navigate to the _Actions_ tab of the Data Processing Engine (DPE), click on **New Action** and select the _Load PySpark_ action. ### Choose a source and destination To set-up the _Load PySpark_ action, start by selecting a **source** from the list that you have already set-up in the [Sources](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/landing-page-connectors-sources.md) tab of the Connectors. ![Choose a source and destination — Load pyspark select source](/images/public-cloud/data-platform/product/dpe/actions/load-pyspark/picts/load-pyspark-select-source.png) Then a **destination** table to send your data to. Similarly to the sources, the tables have to be configured ahead of time in the [Tables](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/lakehouse-manager-tables.md) tab of the Lakehouse Manager. Make sure you've [built](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/lakehouse-manager-manage-tables.md) your data model otherwise the tables won't be accessible by other components in the platform. ![Choose a source and destination — Load pyspark select destination](/images/public-cloud/data-platform/product/dpe/actions/load-pyspark/picts/load-pyspark-select-destination.png) ### Map attributes Once the source & destination have been selected, the system will **automatically map** the destination attributes of your destination table with the different columns that it has identified in the raw data source. ![Map attributes — Load pyspark blueprint rules](/images/public-cloud/data-platform/product/dpe/actions/load-pyspark/picts/load-pyspark-blueprint-rules.png) :::info On the picture below, you can see that the _date_ attribute has a a value of '1' beside the notepad icon. This indicates the number of **data validation rules, also called blueprint rules**, defined in the Connectors, that will be automatically applied when loading the data. [Blueprint rules](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/connectors-analyzer-blueprint-rules.md) allow users to quickly filter out invalid data like nulls / empty cells or reformat values such as date or currencies. ::: ![Map attributes — Load pyspark attribute select](/images/public-cloud/data-platform/product/dpe/actions/load-pyspark/picts/load-pyspark-attribute-select.png) Note that you might want to **insert raw text** directly inside your destination table. This might come in handy for instance when you want to count the number of data points or tag a certain source with a label that will be later used in an aggregate table. To do that, select _\< txt >_ which will set the source attribute to a raw text input field. ![Map attributes — Load pyspark attribute txt](/images/public-cloud/data-platform/product/dpe/actions/load-pyspark/picts/load-pyspark-attribute-txt.png) ### Configure the action's preferences Once you're satisfied with the mapping of your attributes, navigate to the [preferences tab to configure the action settings](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/dpe-jobs-preferences.md). ![Configure the action's preferences — Load pyspark settings](/images/public-cloud/data-platform/product/dpe/actions/load-pyspark/picts/load-pyspark-settings.png) When you are done editing your action, click on **Create** to validate the action. ## Advanced Mode If you need to access the JSON configuration file of the action, you can activate the Advanced mode by clicking on **Advanced** at the top of the page. [Use the Advanced mode of a Load action](https://docs.ovhcloud.com/pl/guides/public-cloud/data-platform/dpe-actions-load-advanced-mode.md) ## Go further If you need training or technical assistance to implement our solutions, contact your sales representative or click on [this link](https://www.ovhcloud.com/pl/professional-services/) to get a quote and ask our Professional Services experts for a custom analysis of your project. Ask questions, give your feedback and interact directly with the team building the Data Platform on the dedicated [Discord channel](https://discord.gg/ovhcloud). If you need support with your OVHcloud services, create a request in our [Help Centre](https://help.ovhcloud.com/csm?id=csm_get_help). Join our [community of users](https://community.ovhcloud.com/). 1 : S3 is a trademark of Amazon Technologies, Inc. OVHcloud's service is not sponsored by, endorsed by, or otherwise affiliated with Amazon Technologies, Inc.