Data Engineer Professional & Data Analyst Associate

Databricks · Certification & Interview

Theory

After the Associate exam, two related certifications are common. The Databricks Certified Data Engineer Professional is the advanced data engineering exam. Its current guide covers production Python and SQL (bundles, UDFs, streaming, Lakeflow Jobs control flow, AUTO CDC for SCD 1 and 2), ingestion from message buses and CDC sources, VARIANT and AI functions, monitoring with system tables and event logs, cost and performance tuning, security (ABAC, PII, purging), governance, deployment with bundles and Git CI/CD, and data modelling. The Databricks Certified Data Analyst Associate targets SQL analysts: Databricks SQL and warehouses, Unity Catalog basics, importing data, analysing query performance, AI/BI dashboards, Genie Agents, data modelling (star schema, medallion) and securing data.

Why we use it

Choosing the right next certification signals your direction: the Professional proves you can design and run production pipelines, while the Analyst Associate proves you can turn lakehouse data into dashboards and self-service analytics.

When to use it

Go for Professional after real project experience (about a year is recommended) with streaming, CDC, CI/CD and tuning. Go for Data Analyst Associate if your role is SQL, BI and dashboards. Analytics engineers often take both Associate exams before the Professional.

How it works

  1. Associate passed or SQL/BI role
  2. Is your work mainly SQL, dashboards and BI? Yes: Data Analyst Associate. No: Next question.
  3. Do you run production pipelines with streaming, CDC and CI/CD? Yes: Data Engineer Professional. No: Get more project experience first.
  4. Download the current exam guide and map gaps
  5. Practise hands-on, then book the exam

Syntax

Data Engineer Professional: advanced pipelines, CDC, streaming, monitoring, optimisation, security, CI/CD, modelling
Data Analyst Associate: Databricks SQL, warehouses, dashboards, Genie Agents, query analysis, modelling, security
Check: databricks.com → Certification → exam guide PDFs (formats and versions change)

Example

-- Professional-style task: SCD 2 with AUTO CDC (you should write this from memory)
CREATE OR REFRESH STREAMING TABLE customers_history;
CREATE FLOW customers_scd2 AS AUTO CDC INTO customers_history
FROM stream(customers_cdc)
KEYS (customer_id)
SEQUENCE BY seq
COLUMNS * EXCEPT (op, seq)
STORED AS SCD TYPE 2;

-- Analyst-style task: dashboard dataset with a parameter
SELECT c.city, SUM(o.amount) AS sales
FROM main.sales.orders o
JOIN main.sales.customers c ON o.customer_id = c.customer_id
WHERE o.order_date BETWEEN :start_date AND :end_date
GROUP BY c.city
ORDER BY sales DESC;

Key points

Databricks topics

Databricks Fundamentals

Compute

Notebooks & Development

Apache Spark on Databricks

Delta Lake

Unity Catalog & Governance

Data Ingestion

Declarative Pipelines (Lakeflow)

Lakeflow Jobs

Databricks SQL & BI

Architecture, Performance & Cost

Machine Learning & AI

Certification & Interview

T
Tech Town
Log InSign Up Free
Home SQL Python DSA Power BI Snowflake Databricks Spark Gen AI Practice Problems Contest Blog

Master Databricks

The lakehouse platform from the ground up: Apache Spark, Delta Lake, Unity Catalog, Lakeflow pipelines and jobs, Databricks SQL and MLflow. Click any topic in the sidebar to open it right here.

{{ sectionCount }}
Sections
{{ topicCount }}
Topics
Free
Forever
Hands-on practice Practice SQL / Spark SQL Sharpen the SQL you use in Databricks SQL and Spark SQL: 150 query problems in a live editor with instant checking. Start practising →
Section {{ sec.num }}

{{ sec.label }}

Databricks  /  {{ current.sectionLabel }}  /  {{ current.name }}

{{ current.name }}

Theory

{{ current.def }}

Why we use it

{{ rich.why }}

When to use it

{{ rich.when }}

{{ sec.h }}

{{ sec.body }}

{{ sec.body }}

Diagram

{{ rich.dg.caption }}

{{ tb.title }}
{{ c.v }}
{{ rich.dg.op }}
➜
{{ rich.dg.output.title }}
{{ c.v }}
{{ nd.label }}
{{ nd.sub }}
{{ nd.label }}
{{ nd.sub }}
{{ rich.dg.left.title }}
{{ it }}
{{ rich.dg.right.title }}
{{ it }}
On screen — where to click

{{ rich.ui.title }}

{{ u.text }}
  1. {{ st.n }}{{ st.text }}
{{ rich.ui.title }}
{{ u.text }}
Flowchart — how it works
{{ nd.text }}
{{ nd.text }}
◇ {{ nd.text }}
Yes → {{ nd.yes }}
No → {{ nd.no }}
Syntax
{{ current.syntax }}
Example
{{ current.example }}
Want to run this yourself? Databricks needs a real workspace — there's no in-browser engine for it. Click Copy above, then paste it into a notebook or the SQL editor in Databricks Free Edition (free, no credit card) and run it on serverless compute.
Key Points — click to check off as you learn
  • {{ pt.mark }} {{ pt.text }}

Share this topic