Remote Member of Technical Staff, Frontier AI (Full-Time Remote) — SMR Specialist Collective

Partner with SMR Talent Collective from anywhere in the US, UK, Canada, Australia, NZ, or Ireland as a remote Remote Member of Technical Staff, Frontier AI (Full-Time Remote) — SMR Specialist Collective ($600,000 - $2,000,000/year). This specialist role focuses on evaluating AI model outputs, authoring domain-specific rubrics, and validating technical workflows involving Research Signal Judgment, ML-Oriented Data Design, Ops-to-Research Translation, RL Environments.

Project Responsibilities

• Ability to translate messy, real-world system behavior into structured research and evaluation opportunities.
• Comfort operating in ambiguity, with a bias toward ownership and decisive action.
• Own research and evaluation initiatives from initial concept through completion: problem framing, data design, quality calibration, and signal validation.
• Design ML-oriented data systems, including task definitions, annotation schemas, rubrics, incentives, and pipelines optimized for downstream model performance.
• Analyze model and system failures to identify root causes, edge cases, and opportunities for improvement.
• Translate ambiguous, real-world behavior into structured evaluation frameworks and new data categories.
• Partner cross-functionally with researchers and domain experts to calibrate quality early and continuously raise the signal bar.

Required Expertise

• Available Openings: 1 open position
• Core Competencies: Research Signal Judgment, ML-Oriented Data Design, Ops-to-Research Translation, RL Environments
• Clear written and verbal communication, especially when explaining tradeoffs, limitations, and signal strength to technical and non-technical stakeholders.
• Proven ability to work directly with experts during project kickoff, calibration, and iteration.
• A systems-level mindset, with interest in improving from initial concept through completion model or agent performance rather than isolated components.
• Practical background using reinforcement learning environments, simulators, or feedback-driven training systems.
• Experience improving agentic systems or AI systems operating in real-world workflows.

Rate Structure & Remote Benefits

• Compensation Rate: $600,000 - $2,000,000/year (contract specialist remuneration)
• Work Arrangement: 100% Remote / Work From Home
• Eligible Remote Countries: United States, United Kingdom, Canada, Australia, New Zealand, Ireland, and South Africa
• Core Competencies: Research Signal Judgment, ML-Oriented Data Design, Ops-to-Research Translation, RL Environments
• Hiring Agency: SMR Talent Collective

Direct Application Process: Click the Apply button on this page to proceed directly to our partner application portal and submit your profile for immediate consideration.