Match score not available

Data Engineer

unlimited holidays

Remote:

Full Remote

Contract:

Full time

Experience:

Mid-level (2-5 years)

Work from:

United States

Offer summary

Qualifications:

Bachelor's or Master's degree in Computer Science, Data Science, or related field, 3+ years of experience in data engineering, Strong proficiency in SQL and big data processing frameworks, Experience with cloud platforms like AWS or Azure, Familiarity with version control systems and CI/CD practices.

Key responsabilities:

Design, develop, and maintain data pipelines for importing and cleaning data
Deploy and manage scalable data pipeline infrastructure
Collaborate with data science teams to ensure data consistency
Develop data quality checks and monitoring systems
Stay updated on trends in data engineering and big data processing

Acelab Architecture & Planning Startup https://www.acelabusa.com/

11 - 50 Employees

See more Acelab offers

Job description

We're seeking an experienced Data Engineer to design, develop, and maintain robust data pipelines and infrastructure for Acelab – B2B marketplace that connects architects and designers with building material manufacturers. This role will be crucial in managing our data ecosystem, implementing advanced analytics, and supporting our data science and engineering teams in delivering high-quality insights and products.

Key Responsibilities:

Design, develop, and maintain pipelines for importing and cleaning semi-structured data from various sources
Specify, deploy, and manage scalable and reliable data pipeline infrastructure
Design and implement database schemas to efficiently store and retrieve complex and sparse data
Collaborate closely with data science and engineering teams to reconcile datasets and ensure data consistency across systems
Develop and maintain data quality checks and monitoring systems
Optimize data storage and retrieval processes for improved performance and cost-effectiveness
Participate in code reviews and contribute to best practices for data engineering
Stay up-to-date with the latest trends and technologies in data engineering and big data processing

Requirements

Ideal fit would be someone with experience in data-intensive industries such as e-commerce (e.g., Wayfair, Amazon, Shopify) or similar high-volume data environments
Bachelor's or Master's degree in Computer Science, Data Science, or a related field
3+ years of experience in data engineering or a similar role
Strong proficiency in SQL, and at least one big data processing framework (e.g., Apache Spark, Hadoop)
Some experience with .NET Web API
Experience with cloud platforms (AWS, Azure, or GCP) and their data services
Solid understanding of data modeling, ETL processes, and data warehousing concepts
Familiarity with version control systems (e.g., Git) and CI/CD practices
Knowledge of data governance and security best practices
Strong problem-solving skills and attention to detail
Excellent communication skills and ability to work in a collaborative environment
Experience with Agile development methodologies