Evaluation and ML Systems Engineer, AI Safety and Security Engineering

NVIDIA is widely recognized as one of the most sought-after employers, with a focus on AI leadership and cybersecurity. They are seeking an Evaluation/ML-Systems Engineer to own the measurement of their AI Safety & Security Engineering program, ensuring that benchmarks and metrics are accurately defined and results are reproducible.

Responsibilities:

• Build the benchmarking and reproducibility systems we depend on
• Define the metrics and protocols we measure against
• Map every result to the code and runs that produced it
• Keep findings reviewable and conclusions traceable

Requirements:

• Bachelor's degree (or equivalent experience) with 5+ years in ML engineering or evaluation
• Designing benchmarks, metrics, and statistically sound comparisons for ML systems
• A careful, skeptical approach to metrics, baselines, and claims
• Solid Python engineering for shared infrastructure, including experiment tracking and data pipelines
• Exposure to evaluating security tooling or pipelines
• Experience measuring agent or LLM behavior
• Contributions to public benchmarks or evaluation frameworks