Match score not available

Senior Data Engineer (DataBricks)

Remote: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

4+ years of experience as a Data Engineer, Strong programming skills in Python and SQL, Experience with Azure services and Databricks, Knowledge of Medallion Architecture or Multihop architecture..

Key responsabilities:

  • Design, develop, and maintain data pipelines and ETL processes
  • Automate data processing workflows using tools like Airflow
  • Optimize database performance and implement data structures
  • Implement data quality and governance processes.

SOFTETA logo
SOFTETA Information Technology & Services Scaleup https://www.softeta.com/
51 - 200 Employees
See all jobs

Job description

Softeta is looking for an experienced Data Engineer to join their growing team. As a Data Engineer, you will have the opportunity to work on cutting-edge data projects and contribute to the development of innovative data solutions.

You will be responsible for data processing for a modern platform created by a community of craftsmen that connects professionals in various fields with those who seek their services.

In this role, you will have to work with big data, data migration, and ELT creation.

Responsibilities:

  • Design, develop, and maintain data pipelines and ETL processes;
  • Data modeling, data cleansing;
  • Automating data processing workflows using tools such as Airflow or other workflow management tools;
  • Optimizing the performance of databases, including designing and implementing data structures and using indexes appropriately
  • Implement data quality and data governance processes.
  • Being a data advocate and helping unlock business value by using data.

Technologies - MS SQL, Azure Data Factory, Azure Data Lake Storage, Azure Databricks, Airflow, Python.

Requirements

  • 4+ years of experience as a Data Engineer;
  • Experience with Azure (Certifications are a Plus)
  • Experience with Databricks, Azure Data Lake, Data Factory and Apache Airflow
  • CI/CD or infrastructure as code
  • Architecture: knowledge of Medallion Architecture or Multihop architecture
  • Experience developing and administering ETL processes in the Cloud (Azure, AWS or GCP) environment;
  • Strong programming skills in Python and SQL;
  • Strong problem-solving and analytical skills.

Benefits

  • Diverse and technically challenging projects;
  • Remote workplace model;
  • Flexible schedule and Agile/SCRUM environment;
  • Technical equipment which you can choose.
  • Salary range - from 4000 EUR to 6000 EUR before taxes, from 30 EUR/h to 40 EUR/h for contractors.

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Industry :
Information Technology & Services
Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Analytical Thinking
  • Problem Solving

Data Engineer Related jobs