Pivotal Solutions is THE source for human capital in the IT workplace.Our strength is in the caliber of our people and the extent we go to to make certain the match between consultant and company is ideal:Each candidate, for project, contract/temp, contract-to-hire, or full-time assignment, is personally selected by a Pivotal Solutions Managing Partner.If within two weeks the employer is not 110% satisfied, we’ll remove the consultant from the job – no questions asked – and no monies will be due from the client for the consultant’s time.We double the industry guarantee for retained searches, providing every employer with the opportunity to be completely satisfied with a full time staff candidate by offering an unconditional guarantee period of 180 days.Our goal and our expertise is to be your partner in identifying the ideal candidate for your business needs.

Job description

This is a remote position.

Roles & Responsibilities

Strong verbal/written communication & facilitation skills. Ability to take a requirement document, work through any ambiguity and follow through to implementation independently
Strong analytical and problem-solving abilities
Strong work ethic, sense of ownership and a team player
Architect and design robust ETL processes using tools like Spark, Airflow, AWS Glue etc. to desired client specifications
Ability to analyze the data to identify the necessary pre-processing steps for the automated ETL processes
Solid understanding of SQL using databases like MS SQL Server, Redshift, etc.
Experience in Cloud Infrastructure (AWS, Azure, GCP)
Delivering the data pipeline with Quality and automated testing

Required Skills

Bachelor’s degree in computer science, information technology, or a related field.
Extensive knowledge of coding languages used to build data pipelines, such as Java, Scala, and/or Python
Experience with Databricks or Spark
Hands on experience building data pipelines in AWS using AWS Glue, Redshift, S3 buckets and other relevant technologies.
Proficiency in warehousing architecture techniques, including MOLAP, ROLAP, ODS, DM, and EDW.
Proven work experience as an ETL developer.
Experience using Source Code and Version Control systems like Git etc.
Strong project management skills.
Ability to analyze a company’s big-picture data needs.
Clear communication skills.
Ability to troubleshoot and solve complex technical problems.
Desire to continually keep up with advancements in data best practices