Senior Software Engineer – AI Interaction Evaluator (up to $200/hr)

About the role

We are seeking a senior‑level software engineer to evaluate the quality of interactions with modern AI coding agents such as OpenAI Codex and Claude Code. This is a contract position focused on assessing how well the model mimics the reasoning and judgment of an experienced developer, rather than writing production code.

Key responsibilities

• Review end‑to‑end AI‑generated coding interactions and judge their usefulness, correctness, and alignment with strong engineering judgment.
• Assess explanations, reasoning, and preambles for clarity and relevance.
• Distinguish between different quality levels of responses and provide a rating framework.
• Deliver clear, opinionated feedback on what worked, what didn’t, and where the interaction felt off or misleading.
• Help define standards for “great” AI‑assisted coding experiences.

Required profile

• Staff‑ or principal‑level engineer (or equivalent experience) with a high bar for good engineering.
• Deep familiarity with modern AI‑assisted development workflows.
• Comfortable making rigorous, subjective judgments about code quality and developer experience.
• Ability to evaluate code without fully executing every line.

Required skills

• TypeScript
• JavaScript
• Python
• Experience using OpenAI Codex
• Experience using Claude Code
• Familiarity with the Cursor AI‑first IDE

What we offer

• Contract rate up to $200 per hour (US/Canada), $150 per hour (EU/Latam), $100 per hour (other regions).
• 10–20 hours per week, remote work.
• Potential extension beyond early May.