Remote Senior Software Engineer in Italia

Responsibilities

• Evaluate AI-generated coding interactions end to end.
• Judge whether coding-agent outputs are useful, correct at a high level, and aligned with strong engineering judgment.
• Assess explanations, reasoning, preambles, and user guidance rather than only code correctness.
• Distinguish different levels of response quality and help define what excellent interactions look like.
• Provide direct, opinionated written feedback and record short video explanations.
• Complete a take-home evaluation exercise with a recorded Loom walkthrough.

Requirements

• Senior, staff, or principal-level software engineering experience, or equivalent experience.
• Strong background in TypeScript/JavaScript or Python.
• Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.
• Deep familiarity with modern AI-assisted development workflows.
• Ability to evaluate code without executing it or reviewing every line.
• Strong written and spoken English at B2 level or above.
• Comfort making subjective but rigorous judgments and giving direct feedback.
• High standards for engineering quality.
• Prior prompt design or evaluation-workflow exposure is a nice-to-have.
• Experience mentoring senior engineers or defining engineering standards is a nice-to-have.

Benefits

• Remote, worldwide contract engagement, subject to regional eligibility.
• Flexible schedule of 10–20 hours per week.
• Ongoing projects generally lasting about two weeks to a few months, with new projects offered to successful evaluators.
• Start as soon as the take-home exercise is cleared and a project has an open seat.
• No interview; the selection process consists of one take-home evaluation exercise with a recorded Loom walkthrough.