Senior QA Engineer

Purpose of Position

We are seeking a Senior QA Engineer with a passion for ensuring the quality and reliability of AI-driven solutions. You will focus on testing our advanced AI system, powered by large language models (LLMs), ensuring it meets high standards of performance, accuracy, and user experience. You will collaborate closely with developers, data scientists, and product managers in a fast-paced, innovative environment

Key Tasks & Responsibilities

• Creating test plan, test cases and documenting them.

• Develop and execute comprehensive test plans for AI and LLM-based applications.

• Design automated test scripts and frameworks to validate AI functionality, including model outputs, API integrations, and performance metrics.

• Conduct functional, regression, performance, and security testing of the AI solution.

• Identify, document, and track defects to resolution, ensuring continuous improvement in product quality.

• Collaborate with cross-functional teams to establish best practices for testing AI systems.

• Implement testing strategies for bias, fairness, and explainability in AI outputs.

• Provide feedback on system design to enhance testability and usability.

• Participate in the whole project lifecycle - from requirements gathering to releasing the product to the customers, operation and maintenance.

• Identify potential problems/bugs in an early stage of development using static analysis tools, code quality metrics, code reviews and peer programming.

• Ownership of bugs raised and help developers solve root cause.

• Carry risk assessments and do risk-based testing.

Skills & Expertise

Required:

• 5+ years of experience in software quality assurance, with 2+ years focused on AI/ML systems.

• Testing: Detailed understanding of the software testing pyramid.

• Experience in QA for AI/ML Systems: Strong background in testing machine learning or AI-based products, with a focus on understanding LLMs.

• Programming Proficiency: Expertise in Python or JavaScript for writing automated tests.

• Knowledge of Testing Tools: Hands-on experience with tools like Selenium, Postman, or Pytest.

• API Testing: Solid experience in testing RESTful APIs and working with JSON.

• Performance Testing: Ability to test and analyze system performance under varying conditions.

• Data Validation: Understanding of data quality, consistency, and preprocessing in AI pipelines.

• Attention to Detail: Ability to detect subtle anomalies in AI output.

• Problem-Solving: A proactive approach to identifying and resolving issues.

• Security: Comfortable about applying information security, able to design and implement solutions with mitigation against security threats

• Work style: They can work mostly autonomously, guided by project requirements.

Nice to have:

• Experience with LLMs: Familiarity with tools like OpenAI GPT, Hugging Face, or similar frameworks.

• DevOps Knowledge: Experience in CI/CD pipelines and containerization (Docker/Kubernetes).

• Cloud Platforms: Working knowledge of cloud environments like AWS, Azure, or GCP.

• Bias Testing: Skills in testing AI models for fairness, ethics, and bias.

• Visualization Tools: Familiarity with tools like Jupyter Notebooks for AI testing.

Our Offer

• Flexi-Week and Work-Life Balance: We prioritise your mental health and wellbeing, offering you a flexible four-day Flexi-Week at full pay and with no reduction to your annual holiday allowance. We also offer a variety of different paid special leaves.

• Remote Working Allowance: You will receive a monthly allowance to cover part of your running costs. In addition, we will support you in setting up your remote workspace appropriately.

• Flexi-Office: We offer an international culture and flexibility through our Flexi-Office and hybrid/remote work possibilities to work across Awin regions

• Meal Vouchers: You will be supported with a certain net sum to spend it on a variety of lunches.

• Health & Wellbeing: The insurance covers several types of health, vision and / or dental treatments for you and for up to one additional family member.

• Remote Working Furniture Package: After 3 months of employment, you will be eligible for a furniture package, which should enable you to set up a proper workplace at your remote working location

• Appreciation: Thank and reward colleagues by sending them a voucher through our peer-to-peer program.

Established in 2000, Awin is proud of our dynamic, social and inclusive culture.

Like all businesses, we’ve had to adapt and nurture our culture in a virtual environment. Our virtual ‘Life @ Awin’ hub brings our colleagues from across the globe together for various social activities.

Diversity & Inclusion are paramount to us, and we proudly pursue and hire diverse team members. We champion uniqueness and authenticity; this is who we are at our core. Our network of affiliate partnerships are diverse and transparent, as are the employees powering our vision to build the world’s leading open partner ecosystem. We welcome all backgrounds, identities, and experiences. If you need support at any point in the application or interview process, please let us know.

Apply now to begin the next stage of your career at a progressive company that supports both your professional and personal development.

#LI-RS1