Offer summary

Qualifications:

Strong expertise in cloud platforms, specifically Azure., Proficiency in Python, SQL, and Apache Spark., Experience with scalable data architectures., Solid understanding of CI/CD practices..

Key responsabilities:

Design, develop, and optimize ETL/ELT pipelines.

Build and maintain scalable data architectures.

Job description

We are looking for an experienced Senior Data Engineer to join our team and play a critical role in designing and optimizing scalable data solutions.

The ideal candidate has extensive experience with cloud platforms, data processing frameworks, and ETL/ELT pipelines and is passionate about solving complex data challenges.

Responsibilities

Design, develop, and optimize ETL/ELT pipelines for seamless data integration and transformation
Build and maintain scalable data architectures to support analytics and business intelligence
Work with large-scale data processing frameworks to ensure efficient and secure data handling
Manage and process structured and unstructured data using various file formats
Develop robust pipelines and workflows for high-performance data solutions
Implement and maintain CI/CD pipelines to support efficient development and deployment
Collaborate with stakeholders to align technical solutions with business goals and requirements
Create datasets, reports, and dashboards to deliver actionable insights

Requirements

Strong expertise in cloud platforms, specifically Azure (e.g., Synapse, Data Factory, Databricks, Data Lake)
Proficiency in Python, SQL, and Apache Spark for data processing and pipeline development
Experience with scalable data architectures, including file formats such as Parquet, Delta, and JSON
Solid understanding of modern data processing frameworks and distributed systems
Practical experience with CI/CD practices and version control tools like Git
Excellent problem-solving skills and the ability to communicate technical concepts effectively

Nice to have

Knowledge of Azure Fabric components, including Lakehouse, Workspace, and SQL Endpoint
Experience in the development and management of Power BI datasets and reports
Familiarity with DAX for sophisticated data analysis

We offer

By choosing EPAM, you're getting a job at Great Place To Work-Certified™ in 2024, Glassdoor’s Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023.
Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.
You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.
We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.
At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

How We Hire

Here, we summarize the typical journey to finding a job within EPAM.
Apply and tell us about yourself!
Go through some standard interviews:
- General interview with a recruiter
- Technical interview with our technology experts
- Manager interview or Offer interview with a hiring manager
Get ready to join the team!
Not sure if you meet all the requirements? No problem. Let's talk anyway and find out more!
It takes 1 min of application to start the journey with us. Apply now!

Life at EPAM

We are a leading global provider of digital platform engineering and development services that has rapidly grown in Australia since 2013.
We adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. With a multinational talented team, we have been delivering innovative solutions for cloud migration, cyber security, digital transformation, etc.  
You will work in an open and friendly work environment where your professional skills and experience can stand out.

Required profile