Member of Technical Staff, Data Flywheel

🔒 Confidential Employer
Posted 12 October 2026
LOCATION
New York, NY; London; San Francisco, CA
TYPE
Full-time
LEVEL
Mid-Senior level
CATEGORY
Data & Analytics
Sponsorship confirmed in this job posting

SKILLS

Evaluation Design Data Curation Reinforcement Learning Reward Design LLM Training Software Engineering Pipeline Automation Machine Learning

FULL DESCRIPTION

Member of Technical Staff, Data Flywheel at [Employer hidden — sign up to reveal]

[Employer hidden — sign up to reveal] is a research lab making intelligence open and accessible for everyone to use, customize, and build on. The Data Flywheel team closes the gap between benchmark performance and useful performance in the real world. This is a hands-on technical role at the intersection of research and deployment.

Location: New York, NY; London; San Francisco, CA  |  Type: Full-time, On-site  |  Department: Research

What You’ll Do

  • Identify high-value data sources and partnership opportunities, deeply understand the underlying use cases, and translate them into representative evaluations
  • Bring new data sources online, from initial partner conversations and data scoping through quality validation and integration into production evaluation and training pipelines
  • Design and build evaluations, graders, and feedback loops that make priority real-world model behaviors measurable
  • Analyze model performance and failure modes, then translate insights into targeted datasets, reward signals, and training interventions
  • Develop human and synthetic data strategies for capabilities where existing data is insufficient
  • Build infrastructure and pipelines to ingest, inspect, version, and evaluate data reliably at scale
  • Collaborate closely with pre-training, post-training, applied, and partnership teams

What We’re Looking For

  • Degree (BS, MS, or PhD) in Computer Science, Machine Learning, or related discipline, or equivalent practical experience
  • Deep technical understanding of LLM training and evaluation, with hands-on experience in evaluation design, data curation, reinforcement learning, or reward design
  • Strong software engineering skills and experience building automated data/evaluation pipelines or large-scale ML systems
  • Track record of owning high-impact projects end to end, navigating ambiguity
  • Highly collaborative, action-oriented approach and excitement about defining how a new frontier lab measures and accelerates model progress
  • High agency and thrive in a fast-paced startup environment; bias for impact over process
  • Enjoy collaborating across research, engineering, operations, and product disciplines

What We Offer

Joining [Employer hidden — sign up to reveal] means building from the ground up as part of a talent-dense team. We want you to do the most impactful work of your career.

  • Top-tier compensation: Salary and equity structured to recognize and retain talent globally
  • Stock options: Everyone who joins and contributes to [Employer hidden — sign up to reveal]'s success gets to share in the upside
  • Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance
  • Meals: Lunch and dinner provided in the office daily
  • Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents
  • Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
  • Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways
  • Team building: Regular off-sites, happy hours, and team celebrations

Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations.

Our Mission

[Employer hidden — sign up to reveal] makes intelligence open and accessible for all. Visit [Employer hidden — sign up to reveal].ai to learn more.

Sign up free — access 45,000+ UK sponsor-licensed jobs