Data Engineer

Job Description :

We are looking for people who are self-motivated, responsive individuals who are passionate about data. You will build data solutions to address complex business questions. You’ll take data through its lifecycle, from the pipeline for data processing, data infrastructure, and create dataset data products. **

Core responsibilities** :

• Drive architectural plans and implementation for future data storage, ingestion, warehousing, reporting, and analytic solutions
• Design and Build ETL jobs to support Enterprise data warehouse
• Write Extract-Transform-Load (ETL) jobs using any standard tools
• Partner with business team(s) to understand the business requirements, understand the impact to existing systems and design and implement new data provisioning pipeline process for Finance/ External reporting domains.
• Monitor and troubleshoot operational or data issues in the data pipelines
• Keeps abreast of industry trends to provide valuable insights and innovative solutions for new and ongoing projects and enhancements

Qualifications :

• 7+ years of relevant work experience in data engineering or software engineering equivalent
• 3+ years of experience in implementing big data processing technology: AWS / Azure / GCP, Apache Spark, Python
• Proficiency in Glue, Lambda, S3, Athena, Redshift, Snowflake
• Experience writing and optimizing SQL queries in a business environment with large-scale, complex datasets
• Have a working knowledge of using higher abstraction ETL tooling (AWS Glue Studio, Talend, Informatica, etc.)
• Detailed knowledge of databases like Oracle / DB2 / SQL Server, data warehouse concepts and technical architecture, infrastructure components, ETL and reporting/analytic tools and environments
• Hands-on experience in cloud technologies (AWS /google cloud/Azure) related to Data Ingestion tool (both real time and batch based), CI/CD processes, Cloud architecture understanding, AWS, Big data implementation.

Preferred Skills :

• AWS certification or experience with cloud technologies
• Strong verbal and written communication skills
• Excellent organizational and prioritization skills
• Strong analytical and problem-solving skills