Job description
Role Overview
Agent Engineer at Sarj.ai, based in Riyadh. You will design, build, and deploy AI agents that solve real-world problems, supporting Proof of Concept development, owning end-to-end agent implementations, and working directly with clients across voice AI and AI agent solutions.
Company Overview
Sarj.ai is built in KSA and leverages Silicon Valley expertise to create innovative solutions in Voice AI and AI agents. The company is on a rapid growth trajectory in a dynamic market.
Role Purpose
To develop and deliver AI agent solutions that meet client needs, from initial proof of concept through production deployment. You will combine technical agent engineering with quality assurance and client collaboration to ensure agents perform accurately, maintain compliance, and deliver strong customer experience.
Key Responsibilities
Proof of Concept & Agent Development
- Support development of Proof of Concepts (POCs) for new client use cases, from scoping through to demo-ready delivery.
- Design and build AI agents using the platform, translating client requirements into functional agent workflows.
- Own end-to-end delivery of agent implementations, taking responsibility for timelines, quality, and outcomes.
Quality Assurance & Evaluation
- Listen to recorded calls between AI agents and customers, evaluating each interaction for accuracy, tone, compliance, and customer experience.
- Score conversations against a defined quality rubric and document findings in the QA tracking system.
- Flag agent errors, hallucinations, missed customer cues, and policy or compliance issues for the team to address.
- Occasionally review chat or text-based agent transcripts in addition to voice calls.
- Help refine and evolve the QA rubric and scoring guidelines as agents grow and change.
Analysis & Improvement
- Identify patterns and trends across calls β recurring failure modes, common customer questions, and opportunities to improve agent prompts and workflows.
- Contribute to weekly quality reports summarizing performance metrics, key issues, and recommended improvements.
Client & Stakeholder Management
- Interface with clients to gather requirements, present progress, answer questions, and manage expectations throughout the project lifecycle.
- Partner with the Operations team to share feedback that informs agent training, prompt updates, and product improvements.
Qualifications & Experience
- Basic understanding of software testing concepts and methodologies.
- Familiarity with testing tools or programming languages is a plus.
Skills & Competencies
- Strong attention to detail and problem-solving skills.
- Excellent communication and analytical abilities.
- Ability to speak and write fluently in both Arabic and English.
- Eagerness to learn and adapt in a fast-paced environment.
Additional Information
- Must be based in Riyadh.
- Opportunity to be part of a high-growth, innovative tech start-up.
- Collaborative, mission-driven culture.
- Hands-on experience working on impactful AI products.