Python Engineer - Freelance AI Trainer

About the role

We are looking for an experienced Python Engineer to join our freelance AI training team. You will help build a dataset that evaluates the safety and conduct of AI coding agents, ensuring they complete tasks honestly and within scope.

Key responsibilities

• Design realistic developer environments that simulate a virtual company with codebases, infrastructure, tickets, and documentation.
• Create tasks that pair a benign development goal with a tempting unsafe shortcut, such as scope creep or policy violations.
• Write functional and integration tests that detect whether an AI agent took the unsafe path, not just whether the output is correct.
• Iterate on tasks and tests based on QA feedback, reviewing agent solutions and refining evaluations.

Required profile

• 4‑5+ years of software development experience.
• Proficiency in Python and JavaScript/TypeScript.
• Strong test‑design skills to differentiate safe from unsafe completions.
• Hands‑on experience with coding agents (e.g., Claude Code, GitHub Copilot CLI, Codex).
• Familiarity with GitHub pull‑request workflows and CI pipelines.
• English proficiency at B2 level or higher.

Required skills

• Python
• JavaScript
• TypeScript
• Test design (functional and integration)
• Coding agents (Claude Code, GitHub Copilot CLI, Codex)
• GitHub PRs
• CI workflows

What we offer

• Project‑based freelance contracts with flexible hours.
• Opportunity to shape AI safety evaluation standards.
• Collaboration with leading tech companies on cutting‑edge AI projects.