Course Outline
1. Azure for the Data Engineer
- Explain the evolving data landscape
- Survey the services within the Azure Data Platform
- Identify the tasks performed by a Data Engineer
- Describe cloud use cases through a case study
- Explore the evolving data landscape
- Determine the services available on the Azure Data Platform
- Identify the key tasks undertaken by a Data Engineer
- Finalise data engineering deliverables
2. Working with Data Storage
- Select an appropriate data storage approach in Azure
- Create an Azure Storage Account
- Explain Azure Data Lake storage
- Upload data into Azure Data Lake
- Lab: Working with Data Storage
- Select an appropriate data storage approach in Azure
- Create a Storage Account
- Explain Data Lake Storage
- Upload data into Data Lake Store
3. Enabling Team-Based Data Science with Azure Databricks
- Explain Azure Databricks
- Work with Azure Databricks
- Read data using Azure Databricks
- Perform transformations with Azure Databricks
- Lab: Enabling Team-Based Data Science with Azure Databricks
- Explain Azure Databricks
- Work with Azure Databricks
- Read data using Azure Databricks
- Perform transformations with Azure Databricks
4. Building Globally Distributed Databases with Cosmos DB
- Create a scalable Azure Cosmos DB database
- Insert and query data in your Azure Cosmos DB database
- Build a .NET Core application for Cosmos DB in Visual Studio Code
- Distribute data globally using Azure Cosmos DB
- Lab: Building Globally Distributed Databases with Cosmos DB
- Create an Azure Cosmos DB
- Insert and query data in Azure Cosmos DB
- Build a .NET Core app for Azure Cosmos DB using VS Code
- Distribute data globally with Azure Cosmos DB
5. Working with Relational Data Stores in the Cloud
- Use Azure SQL Database
- Describe Azure SQL Data Warehouse
- Create and query an Azure SQL Data Warehouse
- Use PolyBase to load data into Azure SQL Data Warehouse
- Lab: Working with Relational Data Stores in the Cloud
- Use Azure SQL Database
- Describe Azure SQL Data Warehouse
- Create and query an Azure SQL Data Warehouse
- Use PolyBase to load data into Azure SQL Data Warehouse
6. Performing Real-Time Analytics with Stream Analytics
- Explain data streams and event processing
- Data ingestion with Event Hubs
- Processing data with Stream Analytics jobs
- Lab: Performing Real-Time Analytics with Stream Analytics
- Explain data streams and event processing
- Data ingestion with Event Hubs
- Processing data with Stream Analytics jobs
7. Orchestrating Data Movement with Azure Data Factory
- Explain how Azure Data Factory works
- Azure Data Factory components
- Azure Data Factory and Databricks integration
- Lab: Orchestrating Data Movement with Azure Data Factory
- Explain how Data Factory works
- Azure Data Factory components
- Azure Data Factory and Databricks integration
8. Securing Azure Data Platforms
- An introduction to security
- Key security components
- Securing Storage Accounts and Data Lake Storage
- Securing data stores
- Securing streaming data
- Lab: Securing Azure Data Platforms
- An introduction to security
- Key security components
- Securing Storage Accounts and Data Lake Storage
- Securing data stores
- Securing streaming data
9. Monitoring and Troubleshooting Data Storage and Processing
- Explain the available monitoring capabilities
- Troubleshoot common data storage issues
- Troubleshoot common data processing issues
- Manage disaster recovery
- Lab: Monitoring and Troubleshooting Data Storage and Processing
- Explain the available monitoring capabilities
- Troubleshoot common data storage issues
- Troubleshoot common data processing issues
- Manage disaster recovery
Requirements
- Experience with basic data analysis (e.g., Excel)
- A general understanding of cloud concepts (e.g., AWS)
Target Audience
- Database engineers
- Developers
Testimonials (2)
Doing Exercise
Joe Pang - Lands Department, Hong Kong
Course - QGIS for Geographic Information System
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.