Senior Spark Engineer | Trainer/Code Reviewer For LLM Data Training

About the job

Experienced engineers are needed for AI Model Training in Coding Practices with expertise in Apache Spark. This crucial role is tailored for a Developer with the ability and enthusiasm to integrate advanced coding knowledge into the development of state-of-the-art AI models.

The Role: Combining Coding Expertise with AI Innovation

In this role, you will play a crucial role in guaranteeing the quality and efficiency of our AI training processes, ultimately contributing to the success of our projects. Your key responsibilities will encompass:

- Quality Control: Maintaining the Service Level Agreement (SLA) standards required by our customer contracts.

- Error and Hallucination Detection: Identifying inaccuracies or hallucinations in LLM responses based on reference documents.

- Spot Checking and QA: Conducting quality assessments of the LLM Data Training project items generated by other Engineers, including but not limited to reviewing the code quality, optimizing, or general responses about engineering processes and procedures in Apache Spark.

Your Profile: Apache Spark Engineer with a Vision for AI

We are looking for a professional who exhibits:

- 5+ years of experience with Apache Spark

- SQL + Python experience is mandatory

- Scala/Java is preferred

- Minimum B2 level of English language proficiency

- Analytical Excellence

- Attention to Detail: Commitment to precision and thoroughness in the training process.

- Ability to produce high-quality work with minimal or no supervision.

- Prior LLM experience preferred

- $20-80 hourly compensation