Telecommute Member of Technical Staff, Coding Research — Digital Domain Advisor

Partner with SMR Talent Collective from anywhere in the US, UK, Canada, Australia, NZ, or Ireland as a remote Telecommute Member of Technical Staff, Coding Research — Digital Domain Advisor ($600,000 - $1,300,000/year). This specialist role focuses on evaluating AI model outputs, authoring domain-specific rubrics, and validating technical workflows involving LLMs, Coding Evaluation, AI Evaluation, ML Systems.

Project Responsibilities

• Working knowledge of large language models, coding agents, reinforcement learning, model evaluation, or related AI systems.
• Proven ability to build tooling, automate workflows, and improve technical processes through systematic experimentation.
• Strong analytical skills with the ability to investigate model behavior and derive insights from complex technical systems.
• Design and own evaluation frameworks for coding agents, including benchmark specifications, scoring methodologies, rubrics, and quality standards.
• Lead from initial concept through completion research initiatives focused on measuring and improving coding model performance across diverse software engineering tasks.
• Develop high-quality datasets, golden examples, and evaluation protocols that enable reliable assessment of frontier coding systems.
• Analyze model behavior and failure modes, identifying systematic weaknesses and translating findings into actionable improvements for training and evaluation.

Required Expertise

• Available Openings: 1 open position
• Core Competencies: LLMs, Coding Evaluation, AI Evaluation, ML Systems
• Excellent written and verbal communication skills, including the ability to clearly articulate technical findings to diverse audiences.
• Comfortable operating in fast-moving research environments with significant ambiguity and evolving priorities.
• Experience working on frontier AI systems, coding agents, or model evaluation research.
• Deep interest in understanding how data, evaluations, and feedback mechanisms influence model capabilities.
• Track record of independently driving ambiguous technical or research projects from conception to execution.

Rate Structure & Remote Benefits

• Compensation Rate: $600,000 - $1,300,000/year (contract specialist remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: LLMs, Coding Evaluation, AI Evaluation, ML Systems
• Hiring Agency: SMR Talent Collective

Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.