Key skills
PythonShell ScriptingShellAI
About this role
Role Overview
- Evaluating Coding Agents.
- Build realistic task environments using datasets and files in your native language.
- Finding failure points where AI does not work, in your native language.
- Support the development of robust solutions and write highly reliable verifier scripts.
- Analyze execution logs and calibrate task difficulty using standard run configurations.
- Participate in a rigorous, human quality control process alongside automated checks.
Requirements
- 5+ years of industry experience in software engineering.
- Proven track record at leading technology companies and/or graduation from top-tier engineering universities.
- Native or near-native fluency, with a deep understanding of its grammar, register, and phrasing rules. High English proficiency.
- Strong proficiency in Python, standard shell scripting, and data processing.
- Extensive experience with Terminal/CLI-based development workflows and a working familiarity with coding agents.
- Deep technical understanding of multilingual text processing pitfalls.
Tech Stack
- Python
- Shell Scripting
Benefits
- Your schedule, your rules.
- Get paid quickly and fairly.
- Work on projects that actually matter.
- Be part of something bigger.
- Grow without limits.
- Have fun doing what you love.