This app evaluates MT engines by analyzing translations made by different MT engines’ and a human. MT Engine Evaluation app will identify an engine closest to human translation.
There are three metrics used for evaluation:
- BLEU
- hLEPOR
- WER
Once the MT Engine Evaluation app analyzes translations, you can choose the engine which is the most efficient for you.

- After installing the MT Engine Evaluation app, click Create.
- In the opened window, you can choose your source and target languages, MT engines you want to evaluate, and add files which MT engines and human translator will translate.
- Once you click Create, files will be automatically pre-translated, and a separate project will be created in your account.
- Open the reference file in the created project folder by clicking three dots on the app page or opening it from your Workspace.
- Human translator needs to translate the reference file.
- Once done, on the app page, click Report to download the evaluation report.
Crowdin is a platform that helps you manage and translate content into different languages. Integrate Crowdin with your repo, CMS, or other systems. Source content is always up to date for your translators, and translated content is returned automatically.
Learn More- —Crowdin Enterprise
Released on Jun 17, 2022
Updated on Feb 9, 2023
Published by Crowdin
Identifier:evaluation-app


