وصف الوظيفة
Role Overview
RAK BANK is seeking an AI Quality Engineer (Assistant Manager – Automation and AI Engineer) to lead quality engineering and testing across AI, Generative AI, Conversational AI, Agentic AI, and Intelligent Automation initiatives.
Role Purpose
Lead end-to-end quality engineering for AI-powered solutions to ensure they are accurate, reliable, secure, explainable, and production-ready while driving automation excellence across the Digital & AI ecosystem.
Key Responsibilities
AI Testing Strategy & Frameworks
- Define AI testing strategies, evaluation frameworks, quality standards, and release-readiness criteria.
- Design and implement AI testing frameworks covering RAG evaluation, hallucination detection, AI safety, prompt validation, and model regression.
- Evaluate and benchmark Large Language Models (LLMs) for accuracy, safety, relevance, latency, groundedness, and cost.
Quality Engineering & Automation
- Lead end-to-end quality engineering for Generative AI, Conversational AI, Agentic AI, and intelligent automation solutions.
- Build and integrate automated testing solutions using Python, PyTest, Playwright, API automation, and CI/CD quality gates.
- Drive chatbot, virtual assistant, and copilot testing across multi-turn conversations, intent coverage, and English/Arabic user journeys.
Team Leadership & Collaboration
- Mentor QA and automation teams while partnering with Product, Engineering, and Data Science teams to embed quality throughout the AI development lifecycle.
Qualifications & Experience
- Bachelor's Degree plus 8–10 years of testing experience.
- At least 3 years supporting banking technology projects in a lead or SME capacity.
- Strong expertise in Generative AI, Conversational AI, Agentic AI testing, LLM evaluation, RAG frameworks, and AI quality assurance methodologies.
- Knowledge of banking regulations, UAE PDPL, and digital banking environments.
Skills & Competencies
Technical Skills
- Hands-on experience with Python, PyTest, Playwright, API automation, and UiPath Test Suite.
- Experience integrating automated testing and AI evaluation into Azure DevOps, Jenkins, GitLab, and modern CI/CD pipelines.
- Proficiency in test data management, synthetic data generation, performance testing, latency profiling, and AI observability.
- Strong understanding of Azure DevOps Test Plans and Jira.
AI & Security Expertise
- Knowledge of AI safety testing, prompt injection, jailbreak testing, hallucination detection, privacy controls, and guardrail validation.
- Understanding of modern AI concepts such as embeddings, vector databases, context windows, and orchestration frameworks.
Soft Skills
- Strong analytical, stakeholder management, and problem-solving capabilities.
- Mentoring and team leadership experience.
Additional Information
- Banking domain knowledge with awareness of data privacy, security, and regulatory compliance requirements is valued.
الراتبغير مُفصح عنه من صاحب العمل
آخر موعد—