Data Engineer

Remote: 
Full Remote
Contract: 
Work from: 

Offer summary

Qualifications:

Hands-on experience with Python programming language is mandatory., Thorough understanding of AWS and experience with AWS Glue, Spark, and Airflow for data pipeline development., Strong SQL and PL/SQL skills with advanced data modeling capabilities., Experience with cloud-hosted databases like Redshift, Snowflake, and BigQuery is preferred..

Key responsibilities:

  • Design and develop data pipelines using AWS tools and Python.
  • Partner with solution architects to identify data inputs and perform quality checks.
  • Develop Data APIs using Python and frameworks like Flask or FastAPI.
  • Build and maintain integrations and ensure security and scalability of REST APIs.

Elfonze Technologies logo
Elfonze Technologies Scaleup https://www.elfonze.com/
201 - 500 Employees
See all jobs

Job description

This is a remote position.

Data Engineer

  • Hands-on Experience with programming languages such as Python mandatorily.
  • Thorough understanding of AWS from a data engineering and tools standpoint. Experience in another cloud is also beneficial.
  • Experience in AWS Glue, Spark, and Python with Airflow for designing and developing data pipelines. Expertise in Informatica Cloud is advantageous
  • Data Modeling: Advanced/Intermediate Data Modeling skills (Master/Ref/ODS/DW/DM) to enable Analytics on the Platform.
  • Traditional data warehousing and ETL skillset, including strong SQL and PL/SQL skills.
  • Experience with inbound and outbound integrations on the cloud platform
  • Design and development of Data APIs (Python, Flask/FastAPI) to expose data on the platform
  • Partner with SA to identify data inputs and related data sources, review sample data, identify gaps, and perform quality checks.
  • Experience loading and querying cloud-hosted databases like Redshift, Snowflake, and BigQuery.
  • Preferred - Knowledge of system-to-system integration, messaging/queuing, and managed file transfer.
  • Preferred - Building and maintaining REST APIs, ensuring security and scalability
  • Preferred - DevOps/DataOps: Experience with Infrastructure as Code, setting up CI/CD pipelines.
  • Preferred - Building real-time streaming data ingestion


Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Data Engineer Related jobs