Remote Senior Python Engineer – LLM Evaluation (US-based)

Turing is the world’s leading research accelerator for frontier AI labs, seeking a Senior Python Engineer for LLM Evaluation. The role involves creating datasets for training large language models, evaluating AI-generated code, and collaborating with researchers to enhance AI-driven coding solutions.

Responsibilities:

• Create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers
• Curate code examples, provide precise solutions, and make corrections — with a primary focus on Python across backend services, data pipelines, and ML infrastructure
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability
• Work with cross-functional teams to enhance enterprise-level AI-driven coding solutions
• Build agents and automated verification tools in Python that can verify the quality of code and identify error patterns
• Hypothesize on steps in the software engineering cycle (prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operational maintenance) and evaluate model capabilities on them
• Design verification mechanisms that can automatically verify a solution to a software engineering task