Company Name: VARITE India Private Limited
About The Client
Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth
About The Job
- We are seeking a highly skilled Big Data Architect with extensive experience in Apache Spark and a deep understanding of big data ecosystems.
- The ideal candidate will design, build, and manage large-scale distributed data processing systems, ensuring data pipelines are scalable, efficient, and maintainable.
- You will be responsible for architecting solutions that meet business needs while optimizing for performance and cost.
Essential Job Functions:
- Architect and Design end-to-end big data solutions that handle massive amounts of structured, semi-structured, and unstructured data.
- Lead the development and deployment of distributed data processing systems, particularly with Apache Spark and related big data technologies.
- Collaborate with stakeholders to understand data processing requirements, translating them into scalable data architecture and design.
- Optimize data processing workflows to improve performance, scalability, and cost-effectiveness.
- Ensure data security and governance by implementing best practices and complying with data privacy regulations.
- Integrate diverse data sources, including on-premise and cloud-based systems, into a unified data architecture.
- Mentor and guide junior engineers and data engineers on big data technologies and best practices.
- Stay up-to-date with the latest advancements in big data technologies, especially Spark, Hadoop, etc.
- Troubleshoot and resolve technical challenges in data processing and data pipeline failures.
Qualifications:
Exp - 12-18 Years
- Experience in big data architecture, design, and development.
- Hands-on experience with Apache Spark in a production environment, including Spark Core, Spark SQL, and Spark Streaming.
- Strong proficiency in distributed computing and parallel processing.
- Deep understanding of big data technologies, including Hadoop, HDFS, Kafka, Hive, HBase, and other tools in the big data ecosystem.
- Proficient in programming languages such as Scala, Python, or Java, particularly for Spark application development.
- Experience with data modeling, ETL pipelines, and data warehousing.
- Knowledge of database systems such as NoSQL (SOLR, Hbase, Redis) and SQL databases is added advantage
- Strong problem-solving and analytical skills with a focus on scalability and performance optimization.
- Familiarity with containerization tools like Docker and orchestration platforms such as Kubernetes is a plus.
How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India - VARITE.
Unlock Rewards: Refer Candidates and Earn.
If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.
Experience Level Bonus Referral: 0-2 years INR 5,000 2-6 years INR 7,500 6+ years INR 10,000
About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.
Equal Opportunity Employer
VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.
