Offer summary

Qualifications:

1+ years of experience in Data Quality Engineering or related roles., Proficiency in SQL and Python programming languages., Familiarity with big data technologies like Hadoop and Spark., Experience with cloud platforms such as AWS, Azure, or GCP..

Key responsabilities:

Design and execute test plans for ETL processes and data pipelines.

Perform testing of data transformations and conduct data lineage audits.

Collaborate with data engineers to troubleshoot data quality issues.

Document testing procedures and stay updated on industry trends.

Job description

DTN is a global leader providing insights and analytics to our customers to feed, fuel, and protect the world. We help people make critical business decisions that impact the agriculture, oil and gas, trading, and weather industries.

It’s a difference you’ve likely felt without even knowing it. From the food on your plate to the gas in your car to the last flight you took, chances are a DTN customer made it possible. And that’s just for starters. That’s why we say, “When our customers prosper, we all win.”

Job Description:

We are seeking a detail-oriented Associate Data Quality Engineer to join our growing data team. In this role, you will be responsible for ensuring the quality, integrity, and reliability of our data engineering processes and outputs. You will work closely with data engineers, analysts, and other stakeholders to develop and implement quality assurance strategies for our data pipelines and systems.

Key Responsibilities:

Design, develop, and execute test plans for ETL processes, data pipelines, and data warehousing solutions

Perform thorough testing of data transformations, integrations, and migrations
Perform data lineage audits and ensuring applied updates reflect incoming data sources
Develop and maintain automated test suites for continuous integration and deployment
Conduct performance testing and optimization of data workflows
Collaborate with data engineers to troubleshoot and resolve data quality issues
Implement data validation checks and monitoring systems
Participate in code reviews and provide constructive feedback
Document testing procedures, results, and best practices
Stay current with industry trends and emerging technologies in data quality assurance

Required Qualifications:

1+ years of experience as a Data Quality Engineer, Quality Assurance, or a related role
Experience with SQL and Python programming
Experience with big data technologies such as Hadoop and Spark
Familiarity with cloud platforms (AWS, Azure, or GCP)
Experience with Docker and Kubernetes
Knowledge of data modeling and ETL processes
Experience with version control systems (e.g., Git)
Proficiency in Linux/Unix command-line operations

Preferred Skills and Experience:

Experience with data quality tools such as Great Expectations
Familiarity with workflow management tools like Apache Airflow and Argo Workflows
Experience with data transformation tools like dbt, PySpark, Jupyter, and SQL
Familiarity with CI/CD pipelines and practices
Experience with test automation frameworks (e.g., pytest)
Knowledge of data privacy and security best practices
Experience with Palantir Foundry

The targeted hiring base pay range for this position is between $56,250 and $75,000. DTN is a pay for performance organization, which means there is the opportunity to advance your compensation with performance over time. The actual base pay offered for this position will be dependent upon many factors, including but not limited to: prior work experience, training/education, transferable skills, business needs, internal equity and applicable laws. The targeted hiring base pay range is subject to change and may be modified in the future. This role may also be eligible for market competitive variable pay and benefits.

#LI-REMOTE
#LI- JW1

Why DTN?

OUR VISION: To be the independent, trusted source of insights to our customers who feed, protect, and fuel the world.

OUR MISSION: Empower our customers with intelligent and actionable insights that exceed their expectations and enable their success on a daily basis.

OUR VALUES: Customer-Focused, Forward-Thinking, People-Centric, Solution-Oriented

We have great benefits at DTN – apply today to find out more!

At DTN, we are an equal opportunity employer. Come join us as we help feed, fuel, and protect the world!