next up previous
Next: Discussion Up: Statistical Machine Translation without Previous: Decoder

Results of Statistical Machine Translation ( IWSLT 2008 Automatic Evaluation Scores)

Table 11 shows the summary of the results of our statistical machine translation evaluation for the BTEC-CE, Challenge-CE, and Challenge-CE tasks.

In this table, "primary" means the normal statistical machine translation and "contrast" means that we removed the long parallel sentences from the training parallel data. Also, ASR.1 means 1-BEST task, and CRR means TEXT task.

Table 4 shows examples of the evaluation results of our statistical machine translation for the BTEC-CE 1-BEST task . Table 5 shows examples of the evaluation results of our statistical machine translation for the BTEC-CE TEXT task. Table 6 shows examples of the evaluation results of our statistical machine translation for the Challenge-CE task for 1-BEST. Table 7 shows examples of the evaluation results of our statistical machine translation for the Challenge-CE task for TEXT. Table 8 shows examples of the evaluation results of our statistical machine translation for the Challenge-EC task for 1-BEST. Table 9 shows examples of the evaluation results of our statistical machine translation for the Challenge-EC task for TEXT.


Table 4: Outputs for BTEC-CE ASR.1
01 in 旅游 费用 包括 晚餐 吗
out Does it include dinner , the charge .
02 in 我 是 歌手
out I 歌手 .
03 in 怎样 才 能 到 那里 去 呢
out How about going to get there
04 in 请 叫 服务生 来
out 服务生 call , please .
05 in 这个 怎么样
out How about this
06 in 只要 按 这里 就 行
out Just press right here .
07 in 我 买 了 成 了
out I bought into .
08 in 请 再 拿 一 条 毛巾 来
out Bring a towel , please .
09 in 这个 菜 没有 点
out The food hasn't p .
10 in 死 于 日本 的 营销 人员 来说 关系 把 越 大 越 好 不过 关系网 或者 通过 别人 介绍 而 开设 的 工作 肯定 会 有 一 个 良好 的 开端
out I must be fine , but there is a large , the better leave as in Japan 来说 关系 or by the 开设 job 开端 recommend 关系网 someone else 死 marketing 人员


Table 5: Outputs for BTEC-CE CRR
01 in 旅游 费用 包括 晚餐 吗
out Does it include dinner , the charge .
02 in 我 是 歌手
out I 歌手 .
03 in 怎样 才 能 到 那里 去 呢
out How about going to get there
04 in 请 叫 服务生 来
out 服务生 call , please .
05 in 这个 怎么样
out How about this
06 in 只 按 这里 就 行 了
out Just press here just
07 in 我 买 了 成药
out I'll take 成药 .
08 in 请 再 拿 一 条 毛巾 来
out Bring a towel , please .
09 in 这个 菜 没有 点
out The food hasn't p .
10 in 对于 日本 的 营销 人员 来说 关系网 越 大 越 好 通过 关系网 或者 通过 别人 介绍 而 开始 的 工作 肯定 会 有 一 个 良好 的 开端
out And for Japan by the must be fine , 开端 recommend a large , the better leave as 关系网 or by the job someone else 关系网 marketing 人员 来说


Table 6: Outputs for Challenge-CE ASR.1
01 in 请 先 明信片
out postcard , please .
02 in 请问 邮局 在 哪儿
out Could you tell me the post office Where
03 in 请问 邮局 在 哪儿
out Could you tell me the post office Where
04 in 对不起 我 想 买 纪念 邮票
out Excuse me , but I'd like to buy a stamp
05 in 柜台 在 哪里
out Where is the counter
06 in 想 买 明信片
out I want to postcard
07 in 嗯 请 等 一下
out Wait a minute , uh , please .
08 in 邮局 怎么 走
out How do I get to the post office
09 in 最 近 的 邮局 怎么 走
out How do I get to the nearest post office
10 in 有 纪念 邮票 吗
out Do you have any commemorative stamps


Table 7: Outputs for Challenge-CE CRR
01 in 请 写 明信片
out Please write postcard
02 in 请问 邮局 在 哪儿
out Could you tell me the post office Where
03 in 请问 邮局 在 哪儿
out Could you tell me the post office Where
04 in 对不起 我 想 买 纪念 邮票
out Excuse me , but I'd like to buy a stamp
05 in 柜台 在 哪里
out Where is the counter
06 in 想 买 明信片
out I want to postcard
07 in 请 等 一下
out Wait a minute please .
08 in 邮局 怎么 走
out How do I get to the post office
09 in 最 近 的 邮局 怎么 走
out How do I get to the nearest post office
10 in 有 纪念 邮票 吗
out Do you have any commemorative stamps


Table 8: Outputs for Challenge-EC ASR.1
01 in do you or the yasaka-shrine and
out yasaka-shrine 和 和 吗 ?
02 in could you tell me where the osaka chinese
out 你 能 告诉 我 在 哪 大阪 的 。
03 in do or i can find the yasaka-shrine
out 我 能 找到 yasaka-shrine 还是 ?
04 in where is the yasaka-shrine
out yasaka-shrine 在 哪 ?
05 in well they're chips please
out 唔 他们 筹码 谢谢 。
06 in which way to kiyomizu-temple
out kiyomizu-temple 怎么 走 ?
07 in how can i get there
out 我 怎么 去 ?
08 in how long does it take to kiyomizu-temple
out kiyomizu-temple 要 花 多长 时间 ?
09 in here comes our boss now
out 我们 现在 在 这里 老板 来 。
10 in so far people seem quite receptive to talking to the machine of oh it's quite difficult ah because of the position of the microphone
out 哦 啊 。 很 难 的 人 说话 像 是 很 远 receptive 机器 的 position 的 microphone 因为 到 。


Table 9: Outputs for Challenge-EC CRR
01 in do you know where the yasaka shrine is
out 你 知道 yasaka shrine 在 哪 ?
02 in could you tell me where the yasaka shrine is
out 你 能 告诉 我 在 哪 yasaka shrine 吗 ?
03 in do you know where i can find the yasaka shrine
out 你 知道 我 在 哪 能 找到 yasaka shrine 。
04 in where is the yasaka shrine
out yasaka shrine 在 哪 ?
05 in world heritage please
out 世界 heritage 。
06 in which way to kiyomizu temple
out kiyomizu 寺庙 怎么 走 ?
07 in how can i get there
out 我 怎么 去 ?
08 in how long does it take to kiyomizu temple
out kiyomizu 寺庙 要 花 多长 时间 ?
09 in here comes the bus now
out 现在 巴士 来 了 。
10 in so far people seem quite receptive talking the machine although it's quite difficult because of the position of a microphone
out 很 难 说话 像 是 很 远 receptive 虽然 因为 这个 机器 。 position 的 microphone 的 人 。




We removed these long parallel sentence for training data. Our method was effective in the Challenge-EC task. However, this method was not so effective in the BTEC-CE and Challenge-CE tasks from these results.


next up previous
Next: Discussion Up: Statistical Machine Translation without Previous: Decoder
Jin'ichi Murakami 2008-10-28