Senior AI Interaction Evaluator (Codex/Claude)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This contract position focuses on judging whether the model’s responses reflect the thinking of a strong engineer, rather than writing production code.

Key responsibilities

• Assess AI‑generated coding interactions end‑to‑end for usefulness, high‑level correctness, and alignment with expert engineering judgment.
• Rate the quality of explanations, reasoning, and overall interaction flow.
• Provide clear, opinionated feedback on what works, what feels off, and how trust is built or eroded.
• Help define standards for great AI‑assisted development experiences.

Required profile

• Staff or principal‑level engineer (or equivalent experience) with a strong sense of engineering taste.
• Hands‑on experience with TypeScript, JavaScript, or Python.
• Familiarity with AI‑assisted development tools such as OpenAI Codex, Claude Code, or Cursor.
• Comfortable making rigorous, subjective judgments and delivering direct feedback.

Required skills

• TypeScript
• JavaScript
• Python
• OpenAI Codex
• Claude Code
• Cursor (AI‑first IDE)

What we offer

• Contract rate up to $200 USD per hour (US/Canada), $150 USD (EU/Latam), $100 USD (other regions).
• Flexible 10–20 hours per week, remote work.
• Short‑term engagement through early May with possible extension.