DP-203 Data Engineering on Microsoft Azure

Nyt on aika päivittää Azure Data Engineering -osaaminen. Kaikki tärkeimmät tavat tallettaa, käsitellä ja analysoida Big Dataa Azuressa erityisesti Synapse Analyticsillä.

Tavoite

Opi hallitsemaan ja ylläpitämään datapalveluita Azure -ympäristössä.

Valmennuksen sisältö

Module 1: Get started with data engineering on Azure

Lessons

• Introduction to data engineering on Azure
• Introduction to Azure Data Lake Storage Gen2
• Introduction to Azure Synapse Analytics

Module 2: Build data analytics solutions using Azure Synapse serverless SQL pools

Lessons

• Use Azure Synapse serverless SQL pool to query files in a data lake
• Use Azure Synapse serverless SQL pools to transform data in a data lake
• Create a lake database in Azure Synapse Analytics
• Secure data and manage users in Azure Synapse serverless SQL pools

Module 3: Perform data engineering with Azure Synapse Apache Spark Pools

Lessons

• Analyze data with Apache Spark in Azure Synapse Analytics
• Transform data with Spark in Azure Synapse Analytics
• Use Delta Lake in Azure Synapse Analytics

Module 4: Work with Data Warehouses using Azure Synapse Analytics

Lessons

• Analyze data in a relational data warehouse
• Load data into a relational data warehouse
• Manage and monitor data warehouse activities in Azure Synapse Analytics
• Secure a data warehouse in Azure Synapse Analytics

Module 5: Transfer and transform data with Azure Synapse Analytics pipelines

Lessons

• Build a data pipeline in Azure Synapse Analytics
• Use Spark Notebooks in an Azure Synapse Pipeline

Module 6: Work with Hybrid Transactional and Analytical Processing Solutions using Azure Synapse Analytics

Lessons

• Plan hybrid transactional and analytical processing using Azure Synapse Analytics
• Implement Azure Synapse Link with Azure Cosmos DB
• Implement Azure Synapse Link for SQL

Module 7: Implement a Data Streaming Solution with Azure Stream Analytics

Lessons

• Get started with Azure Stream Analytics
• Ingest streaming data using Azure Stream Analytics and Azure Synapse Analytics
• Visualize real-time data with Azure Stream Analytics and Power BI

Module 9: Govern data across an enterprise

Lessons

• Introduction to Microsoft Purview
• Discover trusted data using Microsoft Purview
• Catalog data artifacts by using Microsoft Purview
• Manage Power BI assets by using Microsoft Purview
• Integrate Microsoft Purview and Azure Synapse Analytics

Module 10: Data engineering with Azure Databricks

Lessons

• Explore Azure Databricks
• Use Apache Spark in Azure Databricks
• Use Delta Lake in Azure Databricks
• Use SQL Warehouses in Azure Databricks
• Run Azure Databricks Notebooks with Azure Data Factory