Arabic LLM AI Quality Analyst – Remote, $11/hr

About the role

We are looking for a detail‑oriented Arabic LLM AI Quality Analyst to join our remote team on a short‑term contract. You will help improve personalized AI responses by designing prompts, evaluating outputs, and ensuring proper use of personal data.

Key responsibilities

• Design multi‑turn conversational prompts that incorporate personal context.
• Evaluate AI responses for relevance, grounding, helpfulness, and correct use of personal data.
• Perform side‑by‑side (SxS) ranking of AI outputs and identify grounding errors or forced personalization.
• Write clear, structured rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations after review.

Required profile

• Fluent in Arabic (reading and writing).
• Strong experience in data annotation, AI quality evaluation, or content moderation.
• Analytical mindset with attention to detail and ability to assess nuanced AI responses.
• BS/BA degree or equivalent analytical experience.
• Excellent written communication and structured feedback skills.
• Self‑motivated, able to work independently with full‑time availability and a 4‑hour PST overlap.
• Reliable desktop/laptop and stable internet connection.

Required skills

• Arabic language proficiency.
• Data annotation and AI quality evaluation experience.
• Content moderation expertise.
• Analytical thinking and structured feedback.

What we offer

• Competitive hourly rate of $11.
• Remote work with flexible schedule.
• Opportunity to contribute to cutting‑edge AI personalization projects.