Match score not available

Data Engineer

Remote: 
Full Remote
Contract: 
Experience: 
Mid-level (2-5 years)
Work from: 

Offer summary

Qualifications:

University degree in Computer Science or related fields, 3-5 years of experience in Data Lake and Azure Big Data architecture, Advanced hands-on knowledge of SQL, TSQL, Python, pySpark, Hive, Experience with Azure infrastructure and relational databases design, Knowledge of DevOps Processes and data quality methods.

Key responsabilities:

  • Build and run Azure based Data Platform
  • Handle Terabytes of IoT data using Stream and Batch processing
  • Develop data models and maintain analytics applications collaboratively
  • Create scalable data pipelines in Microsoft Azure Cloud
  • Implement algorithms with data scientists using Hadoop ecosystem
Viessmann Research & Development Center logo
Viessmann Research & Development Center SME https://viessmann-kariera.pl/
201 - 500 Employees
See more Viessmann Research & Development Center offers

Job description

The Data Team at Viessmann works on building and deploying novel analytical algorithms based on the data from our IoT products. The person in this position will work on the full stack; from data pipelines and processing to creating user facing applications. The team is a Wrocław & Allendorf based unit of Viessmann.


Your responsibilities:

● Build and run Azure based Data Platform

● Handle multiple Terabytes of different domains data with focus on IoT data using Stream and Batch processing

● Craft and maintain world-class, high traffic analytical applications and services with a team of experienced data engineers and scientists

● Develop data models and process raw data at scale to make it available for analysis

● Build scalable data pipelines using state-of-the-art technologies in the Microsoft Azure Cloud

● Implement, run and deploy algorithms in cooperation with data scientists using the Hadoop ecosystem (e.g. Spark, Hive, HDFS) and the Microsoft Azure Stack


What we expect:

● Certification University degree in Computer Science or related fields of study (Mathematics, Physics)

● 3-5 Years of experience architecting and building Data Lake, Azure Big Data architecture, Enterprise Analytics Solutions, and optimizing 'big data' data pipelines, architectures and data sets.

● Advanced hands-on SQL, TSQL, Python, pySpark, Hive, HDFS (2+ of these) knowledge and experience working with relational databases for data querying and retrieval.

● Experience with Design and Architecture of Azure big data frameworks Azure Data Lake, Azure Data Factory, Azure Databricks, Azure ML, SQL Data Warehouse, HDInsights, Stream Analytics - or their Open Source counterparts: Kafka, Spark, Blob Storages. Experience with Design and Architecture of relational SQL and NoSQL databases

● Knowledge of DevOps Processes (including CI/CD) and infrastructure as a code fundamentals

● Profound knowledge of Data Quality issues and methods of dealing with them

● Fluent in English, German language will be considered as a plus


What we offer:

You choose your contract type (B2B & Employment contract available

Contract of employment

  • Private medical care
  • MyBenefit Cafeteria
  • Edenred Card
  • Multisport
  • Home office set up (monitor included)
  • Co-Funding for language courses
  • Glasses reimbursement

For everyone (B2B & Employment contract:

  • Hybrid work model
  • Flexible working time
  • Individual impact on the Viessmann products
  • Referral program
  • Knowledge sharing initiatives
  • Sport and gaming events & active groups
  • “Bike to work” addition
  • Integration events
  • Life insurance Generali

And if you decide to work from office,also:

  • Relax Zone
  • Playstation, ping-pong table

Required profile

Experience

Level of experience: Mid-level (2-5 years)
Spoken language(s):
EnglishEnglish
Check out the description to know which languages are mandatory.

Data Engineer Related jobs