Offer summary

Qualifications:

Bachelor's degree in Computer Science, Engineering, or a related field., 4+ years of experience with Big Data technologies and data integration processes., Strong knowledge of Microsoft Azure cloud platform and experience with Azure data services., Proficiency in SQL and experience with programming languages such as Python or Scala..

Key responsibilities:

Design, develop, and implement scalable data solutions on the Microsoft Azure platform.

Collaborate with cross-functional teams to gather and analyze data requirements.

Monitor data pipelines and troubleshoot issues to ensure smooth data flow.

Implement data quality measures and support data scientists and analysts with their data needs.

Job description

Design, develop, and implement scalable and reliable data solutions on the Microsoft Azure platform.
Collaborate with cross-functional teams to gather and analyze data requirements.
Design and implement data ingestion pipelines to collect data from various sources, ensuring data integrity and reliability.
Perform data integration and transformation activities, ensuring data quality and consistency.
Implement data storage and retrieval mechanisms, utilizing Azure services such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
Monitor data pipelines and troubleshoot issues to ensure smooth data flow and availability.
Implement data quality measures and data governance practices to ensure data accuracy, consistency, and privacy.
Collaborate with data scientists and analysts to support their data needs and enable data-driven insights.

Requirements

Bachelor's degree in Computer Science, Engineering, or a related field.
4+ years of experience with Big Data technologies
Migrating Data from Snowflake to Databricks
Exp with Databricks, Snowflake is must with Python scripting and SQL knowledge
Strong knowledge and experience with Microsoft Azure cloud platform.
Proficiency in SQL and experience with SQL-based database systems.
Experience with batch and data streaming.
Hands-on experience with Azure data services, such as Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
Experience using Azure Databricks in real-world scenarios is preferred.
Experience with data integration and ETL (Extract, Transform, Load) processes.
Strong analytical and problem-solving skills.
Good understanding of data engineering principles and best practices.
Experience with programming languages such as Python or Scala.
Relevant certifications in Azure data services or data engineering are a plus.