Offer summary

Qualifications:

Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree is highly desirable., Minimum of 5 years of experience in data engineering roles with a focus on real-time data analytics., Proficiency in programming languages such as Python, Spark, and SQL, along with experience in data streaming technologies like Kafka., Strong problem-solving skills and effective communication abilities in English..

Key responsibilities:

Design and implement scalable data pipelines for real-time data processing.

Develop and maintain data ingestion frameworks using technologies like Kafka and Clickhouse.

Collaborate with Machine Learning Engineers and Data Analysts to integrate data pipelines with AI/ML models.

Continuously monitor and optimize data pipelines for performance and reliability.

Job description

Senior Data Engineer

Beyond is a technology consultancy helping organizations thrive in a rapidly changing world.

We build, modernize, scale, and operationalize technology, creating Cloud and AI solutions to unlock productivity and drive growth for our customers.

Role Overview

Beyond is seeking a highly skilled and motivated Senior Data Engineer to join our team in Europe.

You will be part of a team of Machine Learning, MLOps, and Data Engineers, working on an exciting project to develop a real-time data analytics platform.

Responsibilities:

Data Pipeline Architecture: Design and implement scalable and efficient data pipelines to handle large volumes of real-time data
Data Ingestion and Processing: Develop and maintain robust data ingestion and processing frameworks using Kafka Connect, Kafka, and Clickhouse
Data Modeling and Storage: Design and implement appropriate data models and storage solutions to support real-time analytics and AI
Performance Optimization: Continuously monitor and optimize data pipelines for performance, scalability, and reliability
Collaboration: Work closely with Machine Learning Engineers and Data Analysts to ensure seamless integration of data pipelines with AI/ML models and visualisation tools

Required Skills and Experience:

Technologies:
Data Streaming: Kafka Connect, Kafka, Pulsar
Data Warehousing: Clickhouse, Snowflake, BigQuery, BigTable, Cassandra
AI & Analytics: Vertex AI, bicycle.ai, Cosmos.ai or similar tools
Data Visualization: Looker, Tableau, Power BI
Cloud Computing: Google Cloud Platform, AWS, Azure
Programming Languages & Frameworks: Python, Spark, Flink, Scala, SQL
Data Modeling: Dimensional modeling, data warehousing methodologies
Professional and Soft Skills:
Experience: Minimum of 5 years of experience in data engineering roles, with a strong focus on real-time data analytics
Communication Skills: High proficiency in English (both written and oral)
Agile Development: Familiarity with agile development methodologies, such as Scrum or Kanban, is helpful for working in a fast-paced, iterative environment
Education: Bachelor's degree in Computer Science, Engineering, or a related field. A Master's degree is highly desirable
Problem-Solving Skills: Strong capability in identifying issues and formulating effective solutions
Certifications: Relevant certifications in data engineering and cloud technologies are highly desirable

Having been named among Sunday Times Best 100 Companies, we believe culture plays a large role in what we offer as an organization. We actively promote diversity in all its forms across our Studios and we proudly, passionately, and proactively strive to create a culture of inclusivity and openness for all our employees.

Beyond is committed to welcoming everyone, regardless of gender identity, orientation, or expression. Our mission is to remove exclusivity and barriers and encourage new thinking and perceptions, in a space of belonging. It is not about race, gender, or age, it is about people. And without our people being their most creative and innovative selves, we are nothing.

Required profile