Call For Referral is seeking a Machine Learning Engineer to support the evaluation of advanced machine learning systems in collaboration with leading AI research initiatives. This role focuses on developing high-quality evaluation suites that measure AI performance on real-world machine learning engineering tasks.
Responsibilities:
- Design and develop detailed evaluation suites for machine learning engineering tasks
- Evaluate AI-generated solutions across model training, debugging, optimization, and experimentation workflows
- Analyze and document system behavior, performance characteristics, and limitations
- Contribute to the creation of benchmarks that reflect real-world ML engineering practices
- Maintain high standards of technical accuracy, clarity, and consistency in all deliverables
Requirements:
- 3+ years of experience in machine learning engineering or applied ML research
- Hands-on experience with model development, experimentation, and evaluation
- Strong ability to reason about ML system design choices and technical trade-offs
- Excellent written communication skills and high attention to technical detail
- Background in ML research in an industry or academic setting (strongly preferred)