Member of Technical Staff (Applied AI Research)

Artificial Analysis is the leading independent AI benchmarking company, supporting labs, engineers, and enterprises in understanding AI capabilities. The Member of Technical Staff (Applied AI Research) will design and ship novel evaluation methodologies, build datasets, and evaluate AI models to shape industry understanding of AI progress.

Responsibilities:

• Design Frontier Evaluations: Conceive, build and ship novel evaluation methodologies that advance how AI capabilities are measured, and that stay ahead of what frontier models can do
• Build Evaluation Datasets and Infrastructure: Construct the datasets, harnesses and scoring systems behind our benchmarks, engineered for contamination resistance and repeatability at frontier scale
• Evaluate Every Major Model: Run our evaluation suite across frontier releases as they land, and own the integrity of the results the industry quotes
• Publish Influential Analysis: Produce the reports, indexes and data visualizations that shape how labs, enterprises and the broader industry understand AI progress
• Work with Frontier Labs on Pre-Release Models: Benchmark the leading labs’ systems, including pre-release and newly launched models, working directly with their research teams; our commercial team owns client relationships day to day, so your time stays on the science
• Become AI-Native: Embrace an AI-native workflow, using cutting-edge AI tools to generate leverage in a fast-changing industry and maintain our competitive edge in AI benchmarking