IWSLT10 | ||||
case+punc | BLEU | METEOR | WER | NIST |
Proposed (=PBMT+MOSES) | 0.5201 | 0.7916 | 0.3305 | 8.5812 |
MOSES | 0.5077 | 0.7808 | 0.3365 | 8.4804 |
SYSTRAN+MOSES | 0.5341 | 0.8001 | 0.3177 | 8.7090 |
JOSHUA | 0.4871 | 0.7648 | 0.3443 | 8.0456 |
SYSTRAN+JOSHUA | 0.5209 | 0.7892 | 0.3186 | 8.5260 |
MOSES(no tuning) | 0.4882 | 0.7700 | 0.3655 | 8.3291 |
SYSTRAN+MOSES(no tuning) | 0.5104 | 0.7909 | 0.3479 | 8.5575 |
PBMT+MOSES (no tuning) | 0.4991 | 0.7797 | 0.3600 | 8.4342 |
no_case+no_punc | BLEU | METEOR | WER | NIST |
Proposed (=PBMT+MOSES) | 0.4949 | 0.7606 | 0.3776 | 8.7709 |
MOSES | 0.4812 | 0.7488 | 0.3920 | 8.6752 |
SYSTRAN+MOSES | 0.5110 | 0.7707 | 0.3655 | 8.9056 |
JOSHUA | 0.4580 | 0.7292 | 0.4021 | 8.0676 |
SYSTRAN+JOSHUA | 0.4977 | 0.7604 | 0.3682 | 8.6502 |
MOSES (no tuning) | 0.4584 | 0.7351 | 0.4218 | 8.4744 |
SYSTRAN+MOSES(no tuning) | 0.4815 | 0.7610 | 0.3990 | 8.7320 |
PBMT+MOSES (no tuning) | 0.4711 | 0.7482 | 0.4110 | 8.6140 |
IWSLT09 | ||||
case+punc | BLEU | METEOR | WER | NIST |
Proposed (=PBMT+MOSES) | 0.5894 | 0.8173 | 0.2932 | 9.2554 |
MOSES | 0.5793 | 0.8079 | 0.3065 | 9.1049 |
SYSTRAN+MOSES | 0.5985 | 0.8268 | 0.2814 | 9.3422 |
JOSHUA | 0.5696 | 0.7940 | 0.3096 | 8.8269 |
SYSTRAN+JOSHUA | 0.5850 | 0.8112 | 0.2923 | 9.0368 |
MOSES (no tuning) | 0.5574 | 0.7940 | 0.3275 | 8.8250 |
SYSTRAN+MOSES (no tuning) | 0.5809 | 0.8132 | 0.3071 | 9.1918 |
PBMT+MOSES (no tuning) | 0.5670 | 0.8005 | 0.3235 | 9.0278 |
no_case+no_punc | BLEU | METEOR | WER | NIST |
Proposed (=PBMT+MOSES) | 0.5670 | 0.7844 | 0.3360 | 9.6467 |
MOSES | 0.5504 | 0.7748 | 0.3541 | 9.4419 |
SYSTRAN+MOSES | 0.5742 | 0.7965 | 0.3198 | 9.7262 |
JOSHUA | 0.5438 | 0.7592 | 0.3587 | 9.1024 |
SYSTRAN+JOSHUA | 0.5603 | 0.7805 | 0.3289 | 9.3301 |
MOSES(no tuning) | 0.5301 | 0.7607 | 0.3784 | 9.1431 |
SYSTRAN+MOSES(no tuning) | 0.5494 | 0.7830 | 0.3486 | 9.5210 |
PBMT+MOSES (no tuning) | 0.5381 | 0.7678 | 0.3684 | 9.3586 |