Unlock Premium Benefits Today!
🚀 Elevate your career with priority access.
Stand out to top recruiters with Jobgether Priority Access:
  • ✅ Top Match: We help you identify job offers where you're a perfect fit.
  • ✅ Exclusive Referral Service: Connect directly with recruiters as a Jobgether Certified Premium User.
  • ✅ Personalized Feedback: Receive feedback and expert guidance on applications, and have your profile manually reviewed.
Go Premium

Bigdata_shailja

Remote: 
Full Remote
Contract: 
Full time
Work from: 
India

Offer summary

Qualifications:

Proficiency with Hadoop ecosystem technologies, including HDFS and Spark., Good knowledge of Big Data querying tools such as Hive and Impala., Experience with data ingestion using Spark for various file formats like JSON, CSV, and Parquet., Strong programming skills in Python and hands-on experience with Azure DataBricks, ADF, and Power BI..

Key responsibilities:

  • Provide Hadoop production support and implementation.
  • Translate complex functional and technical requirements into detailed design.
  • Load and process disparate data sets according to business needs.
  • Monitor data performance and maintain security and data privacy.

CodersBrain logo
CodersBrain SME https://www.codersbrain.com/
201 - 500 Employees
See all jobs

Job description

Big Data + Azure DataBricks

Primary Skills:

Proficiency with Hadoop ecosystem technologies - HDFS and Spark.

Good knowledge on Big Data querying tools-Hive and Impala

Working Knowledge of data ingestion using spark for supporting various file formats like JSON, CSV and parquet with its compression techniques.

Perform analysis of vast data stores and uncover insights

Experience in Shell Script

Data Engineer with hand on experience in execution of data project on Azure (Migration or build)

Azure Databricks, ADF and Power BI, Git, Azure Devops must have skill

Secondary Skills:

Strong programming skills in Python

Roles and Responsibilities:

Hadoop production support and implementation.

Translate complex functional and technical requirements into detailed design.

Loading from disparate data sets and processing the data as per business need

Organizing data into tables, performing transformations, performance tuning and simplifying complex queries with Py-spark.

Monitoring data performance and modifying infrastructure as needed

Maintain security and data privacy.

Propose best practices/standards.

Work on transformation roadmap - Hadoop stack to Azure Databricks

Required profile

Experience

Spoken language(s):
English
Check out the description to know which languages are mandatory.

Hard Skills

Azure DatabricksPython (Programming Language)Apache SparkApache HadoopApache ImpalaFile SystemsGit (Version Control System)Oracle AdfShell CommandsPower BIAzure DevOpsData CollectionApache Hive
Are you interested?

Related jobs

See more jobs