Senior Data Engineer

Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

5+ years of experience in the IT industry with a focus on Data Engineering., Strong hands-on experience with Oracle to PostgreSQL migrations., Proficient in Python and PySpark, with a solid understanding of data engineering concepts., Excellent written and verbal communication skills..

Key responsibilities:

  • Lead and execute data migration initiatives from Oracle to PostgreSQL.
  • Design, develop, and implement AWS DMS solutions for database migration.
  • Collaborate with cross-functional teams to understand data requirements and ensure smooth migration processes.
  • Troubleshoot migration issues and ensure data integrity and quality throughout the migration process.

ProArch logo
ProArch SME https://www.proarch.com
201 - 500 Employees
See all jobs

Job description

ProArch is seeking a highly skilled Data Engineer with 5+ years of experience in the IT industry, specializing in Data Engineering and Data Migration. The ideal candidate will have strong expertise in Oracle to PostgreSQL migration and be well-versed in AWS DMS (Database Migration Service). The role requires proficiency in Python and PySpark to work on various data migration projects and ensure seamless data transformations.

Key Responsibilities:

    • Lead and execute data migration initiatives, specifically from Oracle to PostgreSQL.
    • Design, develop, and implement AWS DMS solutions to migrate databases.
    • Collaborate with cross-functional teams to understand data requirements and ensure smooth migration processes.
    • Develop and optimize data pipelines using Python and PySpark.
    • Troubleshoot migration issues and implement corrective actions to ensure minimal disruptions during data transfer.
    • Ensure data integrity, accuracy, and quality throughout the migration process.
    • Create and maintain detailed documentation for migration processes, workflows, and data transformations.
    • Stay up to date with the latest technologies, best practices, and tools in data engineering and migration.

Requirements

    • 5+ years of experience in the IT Industry, with a focus on Data Engineering.
    • Strong hands-on experience with Oracle to PostgreSQL migrations.
    • Expertise in using AWS DMS (Database Migration Service) for seamless data migration.
    • Proficient in Python and PySpark, with a strong understanding of data engineering concepts and data pipeline development.
    • Solid understanding of database architecture, SQL, and data modeling.
    • Experience in troubleshooting, optimizing, and scaling data migration workflows.
    • Ability to work independently and in a team environment with strong problem-solving skills.
    • Excellent written and verbal communication skills.

Preferred Qualifications:

    • Experience with other AWS services such as AWS Lambda, S3, and Redshift is a plus.
    • Familiarity with other database migration tools and technologies.
    • Certifications in AWS or other relevant data engineering domains.

Benefits

NA

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Other Skills

  • Troubleshooting (Problem Solving)
  • Communication
  • Problem Solving

Data Engineer Related jobs