Big Data Engineer (Apache Spark)

We are seeking an experienced Big Data Engineer with a strong proficiency in Apache Spark to join our team. The ideal candidate will have strong SQL skills, proficiency in programming languages such as Python, Scala or Java, and experience with cloud platforms and related data services.  

• Design, develop, and optimize scalable big data processing solutions using Apache Spark. 
  
• Build and maintain robust data pipelines to support advanced analytics and data-driven insights. 
  
• Collaborate closely with software engineers to understand data requirements and deliver efficient, scalable solutions. 
  
• Optimize Spark applications for performance, including tuning, scaling, and performance improvement strategies. 
  

• Implement data quality checks and ensure data integrity across large datasets. 
  

• Identify and resolve performance bottlenecks in Spark applications to enhance efficiency. 
  

• Ensure data security, compliance, and governance standards are met. 
  

 Qualifications: 

• 5+ years of experience in big data engineering roles. 
  
• Strong proficiency with Apache Spark (PySpark/Scala/Java) for large-scale data processing. 
  

• Solid understanding of distributed computing principles. 
  

• Proven experience in scaling, tuning, and optimizing Spark applications for performance improvement. 
  

• Nice to have experience with big data technologies like Hadoop, Hive, Kafka, HDFS, etc. 
  

• Proficiency in programming languages such as Python, Scala, or Java; knowledge of C# is a bonus. 
  

• Strong SQL skills for data querying and manipulation. 
  

• Experience with cloud platforms (AWS, GCP, Azure) and related data services. 
  

• Familiarity with CI/CD pipelines and version control systems (Git). 
  

Nice to Have: 

• Experience with real-time data processing and streaming technologies. 
  

• Knowledge of containerization and orchestration tools (Docker, Kubernetes). 
  

• Exposure to data lake architectures and modern data stack tools. 
  

• Strong problem-solving skills and attention to detail.  
  

About Innosphere:    

Founded in 1997, Innosphere provides technology staffing solutions to clients across North America. We have specialized in remote work for over 15 years. Our staffing solutions include fully managed development teams coupled with expert consulting, full-time hiring, and flexible staffing.   

Innosphere is a permanent remote company but we do have an office location in Guelph to provide employees opportunities to work intermittently in an office environment. We have collaborative space for meetings, lunches, and company events. Our employees have the freedom to choose where they prefer to work.   

Innosphere is committed to providing its employees with endless possibilities to learn new things and to work with the latest technologies.   
 

When we hire, we look for people who align with our core values:    

Remote First: Innosphere is a remote company but offers in-office workspace. Employee connections are fostered through shared experiences and events.   
Community Involvement: Innosphere strives to make a difference in the community through charity initiatives and volunteer opportunities.   
Employee Growth: Innosphere provides opportunities to work with new technologies and funds employee training. Our philosophy is to promote internally when possible. 

Life as an Innospherian - Who we are and how we work:    

• Work From Home  
  
• Flexible Work Schedule  
  

• Team Owned Deliverables   
  

• Charity Initiatives   
  

• Promote From Within   
  

Some other perks:    

• Generous Time Off 
  

• Above Average Benefits (Dental, Health, Vision, STD, LTD, AD&D, Life, Dependent Life)   
  

• Home Office Benefit Program  
  

• Yearly Professional Development Budget   
  

• Annual Fitness Benefit  
  

• Lunch & Learns and Virtual Events  
  

• Annual In-Person Celebrations   
  

• RRSP with Company Match   
  

• Volunteer Days  
  

• Sports Tickets for Blue Jays games  
  

• Birthday Club  
   
  

Innosphere welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process. Only applicants meeting the criteria outlined above will be contacted as part of the shortlisting process. All applicants are subject to a criminal, educational, and employment history background check. Must be currently residing in Canada and legally permitted to work in Canada. No phone calls please.