Offer summary

Qualifications:

Strong experience with Azure cloud services and Databricks., Proficiency in Infrastructure as Code (IaC) using Terraform., Background in data engineering or architecture with a focus on Big Data and AI., Ability to mentor and lead a team of engineers effectively..

Key responsabilities:

Build and maintain a Data Platform in the Azure cloud for multiple Data teams.

Mentor and delegate tasks to a small team of engineers.

Evaluate and optimize costs for Databricks workloads.

Automate deployment and management of Databricks environments using Azure DevOps Pipelines.

Job description

About us

GetInData | Part of Xebia is a leading data company working for international Clients, delivering innovative projects related to Data, AI, Cloud, Analytics, ML/LLM, and GenAI. The company was founded in 2014 by data engineers and today brings together 120 Data & AI experts. Our Clients are both fast-growing scaleups and large corporations that are industry leaders. In 2022, we joined forces with Xebia Group to broaden our horizons and bring new international opportunities.

What about the projects we work with?
We run a variety of projects in which our sweepmasters can excel. Advanced Analytics, Data Platforms, Streaming Analytics Platforms, Machine Learning Models, Generative AI and more. We like working with top technologies and open-source solutions for Data & AI and ML/AI. In our portfolio, you can find Clients from many industries, e.g., media, e-commerce, retail, fintech, banking, and telcos, such as Truecaller, Spotify, ING, Acast, Volt, Play, and Allegro. You can read some customer stories here.

What else do we do besides working on projects?
We conduct many initiatives like Guilds and Labs and other knowledge-sharing initiatives. We build a community around Data & AI, thanks to our conference Big Data Technology Warsaw Summit, meetup Warsaw Data Tech Talks, Radio Data podcast, and DATA Pill newsletter.

Data & AI projects that we run and the company's philosophy of sharing knowledge and ideas in this field make GetInData | Part of Xebia not only a great place to work but also a place that provides you with a real opportunity to boost your career.

If you want to be up to date with the latest news from us, please follow up on our LinkedIn profile.

About role
A core part of our value proposition in projects we do is to bring the best expert knowledge in the applications of Big Data & AI. We mentor clients on what problems they can solve with modern technologies, how to architect and implement reliable solutions with the best engineering standards, and how to deliver them effectively. Being a solution architect is to be the ambassador of the company by setting technological direction, roadmap, architecture, and feasibility in multiple projects, especially at their earliest stages. The goal is to make sure our clients get the best possible solution to their real-world challenges and a path to get there.

Responsibilities

Building a Data Platform in the Azure cloud providing multiple Data teams with the ability to start and maintain projects in an automated fashion
Mentoring and delegating tasks to 2-3 engineers who will help in building the Data Platform
Evaluating and optimizing costs for Databricks workloads
Selecting and configuring clusters tailored to specific workload requirements
Integrating Databricks into the existing Azure network setup
Automating the deployment and management of Databricks environments using Azure DevOps Pipelines
Using Terraform as the primary Infrastructure as Code (IaC) tool for managing resources
Implementing secure data-sharing solutions within Databricks

Required profile