Member of Technical Staff, Evals & Post-Training Product

Fireworks AI is building the future of generative AI infrastructure, and they are seeking a Member of Technical Staff, Evals & Post-Training Product to help define how developers improve models on their platform. This role involves building products and workflows that connect evaluation and post-training processes, enabling teams to run evaluations at scale and enhance model quality.

Responsibilities:

• Build internal eval workflows: Design and scale evaluation tooling used by internal teams to measure model quality, compare model changes, and inform post-training decisions
• Own fine-tuning product experiences: Build and improve user-facing product workflows for post-training, including fine-tuning experiences across SFT, RFT, and related model-improvement capabilities
• Work closely with users: Partner with customers and internal stakeholders to understand evaluation and fine-tuning needs, support high-priority engagements, triage issues, and convert bespoke workflows into productized solutions