AI Policy Reviewer – Remote

About the role

The AI Policy Reviewer ensures that AI‑generated and user‑generated content complies with internal governance, regulatory standards, and responsible AI principles. Working remotely, you will act as a quality‑assurance checkpoint, safeguarding model integrity by identifying safety risks, bias, misinformation, and policy violations.

Key responsibilities

• Review and score AI responses against detailed policy rubrics, assessing safety, truthfulness, fairness, and alignment with community guidelines.
• Identify edge cases where the model misinterprets policy, making nuanced judgement calls on context, satire, or emerging risks.
• Analyze data to spot systematic flaws, bias, hallucinations, or policy gaps and report findings to Product and Engineering teams.
• Collaborate with Policy teams to test and refine evaluation rubrics and provide feedback on teachability of policies.
• Participate in adversarial testing (red‑team) to uncover vulnerabilities before launch.
• Work with Machine Learning Engineers to explain rating decisions and help adjust model behavior.
• Create high‑quality prompt‑response examples for “golden sets” used in training.

Required profile

• Minimum 3 years of professional experience in Trust & Safety Operations, Content Policy, Risk Analysis, or Legal/Compliance review.
• Deep understanding of content moderation principles (hate speech, harassment, misinformation, graphic violence).
• Strong analytical ability to deconstruct AI responses and detect logical flaws, hallucinations, or subtle biases.
• Excellent written communication skills to explain findings to engineers and policy experts.
• Emotional resilience and self‑care strategies for exposure to disturbing content.

Required skills

• Familiarity with large language model platforms (e.g., ChatGPT, Gemini).
• Proficiency with dashboard and analytics tools.
• Experience using spreadsheet software for data tracking.
• Knowledge of specialized content‑moderation review tools.