Offer summary
Qualifications:
Over 3 years of experience in data engineering, Bachelor's degree in related field, Hands-on experience with Spark/Scala and SQL, Experience with Databricks and Airflow, Familiarity with CI/CD pipelines and Agile methodology.Key responsabilities:
- Ingest data from various source systems
- Manage ETL/ELT pipelines on Databricks
- Optimize data pipelines for speed and scalability
- Document ingestion flows and data catalogs
- Ensure compliance with security guidelines