MT/QE Evaluations Project Manager

The MT/QE Evaluations Project Manager will support the design, execution, and analysis of evaluation frameworks for MT (Machine Translation) and QE (Quality Estimation) models. This role focuses on ensuring statistically sound evaluations, high-quality datasets, and the generation of actionable insights. Responsibilities include running evaluations that assess MT and QE performance and risk, and connecting linguistic quality frameworks with data analysis.

This role requires strong data science, analytical, organizational, and communication skills.

• Demonstrable experience in NLP/ML evaluations or localization analytics.
• Knowledge of evaluation design and statistical analysis, including determining statistically significant sample sizes.
• Experience with benchmarking against human judgments and applying MT and QE evaluation metrics.
• Skilled in analyzing evaluation results and ensuring findings are reliable and actionable.
• Proficiency with data analysis and visualization tools (e.g., Python, Tableau).
• Highly organized, analytical, detail-oriented, and methodical.
• Strong communication skills - able to communicate effectively with both technical and business audiences.
• Ability to explain technical results in a clear and understandable manner.
• Strong eye for patterns, anomalies, and trends across large datasets.