We are looking for a Data Engineer in India for our client in the Pharmaceutical Industry
Responsibilities:
The candidate will leverage Data Mesh and Medallion architecture principles within Azure Databricks and manage CI/CD processes in Azure DevOps to support data-driven decision-making in drug development and clinical trials.
Key Responsibilities:
Data Pipeline Design and Development:
- Design, construct, install, test, and maintain highly scalable data management systems using Azure Databricks following Data Mesh and Medallion architecture principles
- Ensure architectures support the needs of scientific and compliance-focused stakeholders.
- Integrate new data management technologies and software engineering tools into existing structures.
GxP Compliance:
- Implement and maintain data solutions and documentation in compliance with GxP guidelines critical for pharmaceutical applications.
- Collaborate with quality assurance teams to ensure data integrity and reliability for regulatory submissions.
CI/CD Pipeline Management:
- Develop and maintain scalable and efficient CI/CD pipelines in Azure DevOps to automate testing and deployment of data pipelines.
- Ensure continuous monitoring, testing, and performance tuning of all data management and processing systems.
Data Product Development:
- Build data products and services to support varied requirements from cross-functional teams including R&D, clinical operations, and regulatory affairs.
- Assist in translating data into usable insights and predictions to support strategic decisions.
Collaboration and Communication:
- Work closely with data scientists, business stakeholders, and IT teams to ensure solutions are robust, scalable, and aligned with business requirements.
- Document and communicate data architecture and engineering solutions clearly to both technical and non-technical stakeholders.
Qualifications:
Education & Certification:
- Bachelor’s or master's degree in computer science, Data Science, Bioinformatics, or a related field.
- Certification in Azure Databricks and/or Azure DevOps is highly advantageous.
Experience:
- Proven experience as a Data Engineer, preferably in the pharmaceuticals industry, with an understanding of GxP compliance requirements.
- Experience in building and optimizing ‘big data’ data pipelines, architectures, and data sets.
- Experience in Azure Databricks and Azure DevOps, with a deep understanding of Datamesh and Medallion architecture principles.
Skills:
- Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy.
- Adept at queries, report writing, and presenting findings.
- Excellent interpersonal and communication skills, capable of working in a cross-functional environment.
Way of working requirements
We expect that you adhere to the client's ways of working to ensure effective collaboration and productivity.
Minimum expectations include:
Following Agile Principles:
Engage actively in team events/meetings (e.g. Team Sync, Iteration Planning, Iteration Review, Retrospectives) as well as ART level events (e.g. Program Increment Planning, System Demos, and Inspect and Adapt workshops).
Accountability:
You are expected to take ownership of your – and your teams work, meet commitments, and be accountable for the quality and timeliness of deliverables.
Embrace Lean-Agile Mindset:
Focusing on delivering value, and being receptive to change, feedback, and learning (contribute to retrospectives, identify areas for improvement, and actively participate in implementing enhancements).
Be an active team member:
Actively engage in open and transparent communication, share your view, concerns, risks and blockers you think may prevent progress.
In Team meetings you:
Speak up – bring your suggestions and input forward and ask if you have questions,
Have your video on.
Start date: 13/05/2024
End date: 31/12/2024
Location: Offsite India
