Offer summary

Qualifications:

5+ years of experience in ETL development using Azure Databricks with Oracle and SQL Server., Strong understanding of ETL concepts and experience with Azure Data Factory (ADF) pipelines., Proficiency in Python programming and SQL, including CTEs and PL/SQL., Excellent communication and client-facing skills..

Key responsibilities:

Create and manage ETL jobs using Azure Databricks and ADF.

Develop reusable notebooks in Azure Databricks with functions and parameters.

Perform query performance tuning and troubleshooting.

Collaborate with clients to understand their data needs and provide solutions.

Job description

ETL Developer with Azure Databricks

Location: Remote – anywhere in US

Type: ongoing on W2

Key Skills & Requirements:

5+ years of experience in creating ETL jobs using Azure Databricks with Oracle and SQL Server as backend.
Strong understanding of ETL concepts including full load and incremental load using Databricks and Azure Data Factory (ADF) pipelines.
Experience in creating ETL pipelines with Azure Data Factory and sequencing Databricks jobs in ADF.
Experience in creating reusable notebooks in Azure Databricks, including the use of functions and parameters.
Proficiency in Python programming language.
Strong Oracle and SQL Server query experience, with knowledge of CTEs, ANSI SQL, and Oracle functions.
Experience with SQL set operators such as MINUS, EXCEPT, UNION, etc.
Proficiency in creating PL/SQL blocks, triggers, and indexes.
Experience in query performance tuning, including working with indexes and partitions.
Strong troubleshooting and defect resolution skills.
Excellent communication and client-facing skills.