Project Manager

Modis is seeking a Project Manager for a contract job with a client. The role involves designing and analyzing evaluation frameworks for machine translation and quality evaluation models, ensuring high-quality datasets, and generating actionable insights through data analysis.

Responsibilities:

• Design, execute, and analyze evaluation frameworks for MT and QE models
• Ensure statistically sound evaluations and high-quality datasets
• Run evaluations to assess MT and QE performance and risk
• Connect linguistic quality frameworks with data analysis to generate actionable insights

Requirements:

• Bachelor's Degree
• Demonstrable experience in NLP/ML evaluations or localization analytics
• Knowledge of evaluation design and statistical analysis, including determining statistically significant sample sizes
• Experience benchmarking against human judgments and applying MT & QE evaluation metrics
• Skilled in analyzing evaluation results to ensure findings are reliable and actionable
• Proficiency with data analysis and visualization tools (e.g., Python, Tableau)
• Highly organized, analytical, detail-oriented, and methodical