AI Benchmark Engineer – Native Language Specialist, Chinese Mandarin

Role Overview

• Design, build, and validate benchmarks for Terminal-Bench tasks.
• Create high-signal, high-quality tasks in your native language.
• Find failure points in AI processing in your native language.
• Support the development of robust solutions and write reliable verifier scripts.
• Analyze execution logs and calibrate task difficulty.
• Participate in a 4-layer quality control process alongside automated checks.

Requirements

• 5+ years of industry experience in software engineering.
• Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
• Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules.
• High English proficiency.
• Strong proficiency in Python, standard shell scripting, and data processing.
• Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
• Deep technical understanding of multilingual text processing pitfalls, including unicode normalization.

Tech Stack

• Python
• Shell Scripting

Benefits

• Your schedule, your rules.
• Get paid quickly and fairly.
• Work on projects that actually matter.
• Be part of something bigger.
• Grow without limits.
• Have fun doing what you love.