Databricks Certified Data Engineer Professional Training

About Course

The Databricks Certified Data Engineer Professional certification validates skills in building and managing data engineering pipelines on the Databricks platform. It covers data ingestion, transformation, and storage using Apache Spark and Delta Lake technologies. Holders of this certification demonstrate proficiency in designing scalable data solutions, optimizing performance, and ensuring data reliability and security. This certification enhances career opportunities by confirming expertise in big data processing, real-time analytics, and cloud-based data engineering, supporting organizations in leveraging data-driven insights effectively across industries such as healthcare, finance, retail, and technology.

Course Content

Module 1- Introduction

Course Overview
Course Materials
Scenario Walkthrough

Module 2-Modeling Data Management Solutions

Module 3-Data Processing

Module 4-Improving Performance

Module 5-Databricks Tooling

Module 6-Security and Governance

Module 7-Testing and Deployment

Module 8-Monitoring and Logging

Module 9-Certification Overview

About Course

What Will You Learn?

Course Content

Module 1- Introduction

Course Overview

Course Materials

Scenario Walkthrough

Module 2-Modeling Data Management Solutions

Bronze Ingestion Patterns

Multiplex Bronze (Hands On)

Streaming from Multiplex Bronze (Hands On)

Quality Enforcement (Hands On)

Streaming Deduplication (Hands On)

Slowly Changing Dimensions

Type 2 SCD (Hands On)

Module 3-Data Processing

Change Data Capture

Processing CDC Feed (Hands On)

Delta lake CDF

CDF (Hands On)

Stream-Stream Joins (Hands On)

Stream-Static Join

Stream-Static Join (Hands On)

Materialized Gold Tables (Hands On)

Module 4-Improving Performance

Partitioning Delta Lake Tables

Partitioning (Hands On)

Delta Lake Transaction Log

Transaction Log (Hands On)

Auto Optimize

Module 5-Databricks Tooling

Databricks Jobs (Hands On)

Advanced Jobs Configurations (Hands On)

Troubleshooting Jobs failures (Hands On)

REST API (Hands On)

Databricks CLI (Hands On)

Module 6-Security and Governance

Propagating Deletes (Hands On)

Dynamic Views (Hands On)

Module 7-Testing and Deployment

Relative Imports (Hands On)

Data Pipeline Testing

Module 8-Monitoring and Logging

Managing Cluster

Module 9-Certification Overview

Certification Overview

Bonus Lecture