Match score not available

Azure Databricks Engineer

Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

7+ years of experience in data engineering and analytics., Expertise in Azure Databricks, ADF, ADLS Gen 2, Synapse, and Python., Strong understanding of data architecture and management best practices., Excellent problem-solving skills and strong communication abilities..

Key responsabilities:

  • Lead the design and implementation of data solutions using Azure services.
  • Develop and optimize data pipelines using Azure Data Factory and Databricks.
  • Manage and maintain data storage solutions in Azure Data Lake Storage Gen 2.
  • Collaborate with cross-functional teams to define data requirements and ensure data integrity.

Numentica LLC logo
Numentica LLC SME https://www.numentica.com/
201 - 500 Employees
See all jobs

Job description

This is a remote position.

Job Description:

We are seeking an experienced Azure Databricks Engineer to join our team. The ideal candidate will have over seven years of experience in designing, implementing, and managing data solutions using Azure technologies. This role requires a strong background in Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS) Gen 2, Synapse Analytics, Spark SQL, Azure SQL and Python.

Key Responsibilities:

  • Lead the design and implementation of data solutions using Azure services.
  • Develop and optimize data pipelines using Azure Data Factory and Databricks.
  • Manage and maintain data storage solutions in Azure Data Lake Storage Gen 2.
  • Implement data models and analytics solutions using Azure Synapse Analytics.
  • Collaborate with cross-functional teams to define data requirements and ensure data integrity.
  • Provide technical leadership and mentorship to junior team members.
  • Stay up-to-date with the latest Azure technologies and best practices.

Qualifications:

  • 7+ years of experience in data engineering and analytics.
  • Expertise in Azure Databricks, ADF, ADLS Gen 2, Synapse, and Python.
  • Strong understanding of data architecture and data management best practices.
  • Excellent problem-solving skills and attention to detail.
  • Proven ability to lead and manage technical projects.
  • Strong communication and collaboration skills.
Must Have Qualifications:
  • Analyze and understand existing Spark SQL queries within Databricks notebooks and pipelines.
  • Translate complex Spark SQL logic into optimized and equivalent Azure SQL(T-sql) queries.
  • Strong proficiency in Spark SQL, Python, and T-SQL.

Preferred Qualifications:

  • Azure certifications (e.g., Azure Data Engineer, Azure Solutions Architect).
  • Experience with other data technologies and tools.


Requirements



Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Collaboration
  • Communication
  • Leadership
  • Detail Oriented
  • Problem Solving

Related jobs