Data Annotator (Arabic) – Remote LLM AI Quality Analyst

About the role

We are looking for an Arabic‑speaking Data Annotator to join our AI quality team on a short‑term contract. You will help improve large language model responses by designing prompts, evaluating personalized outputs, and ensuring proper use of personal data.

Key responsibilities

• Design multi‑turn conversational prompts that incorporate personal context.
• Evaluate AI responses for relevance, grounding, helpfulness, and correct handling of personal data.
• Perform side‑by‑side comparisons and rank AI outputs.
• Identify grounding errors, weak inferences, and forced personalization.
• Write clear rationales referencing specific conversation turns.
• Extract and verify model debug information and data source usage.
• Maintain strict data hygiene by deleting evaluation conversations.

Required profile

• Fluent Arabic reading and writing skills.
• Strong experience in data annotation, AI quality evaluation, or content moderation.
• Analytical mindset with attention to detail.
• Ability to assess nuanced and ambiguous AI responses.
• BS/BA degree or equivalent analytical experience.
• Excellent written communication and structured feedback abilities.
• Self‑motivated, able to work independently in a remote setting.
• Reliable desktop/laptop with stable internet and full‑time availability (8 hours/day) including a 4‑hour PST overlap.

Required skills

• Arabic language proficiency.
• Data annotation and AI evaluation experience.

What we offer

• Short‑term (2 months) contract with 30‑40 hours/week.
• Remote work with flexible schedule.
• Hourly rate of $11 USD.