next up previous contents
Next: NIST Up: ¼«Æ°É¾²Á Previous: ¼«Æ°É¾²Á   目次

BLEU

BLEU¤Ïµ¡³£ËÝÌõʬÌî¤Ë¤ª¤¤¤Æ¡¤°ìÈÌŪ¤Ë»ÈÍѤµ¤ì¤ë¼«Æ°É¾²Á¤Î¼êË¡¤Ç¤¢¤ë¡¥BLEU¤Ï¸ì½ç(4-gram)¤¬Àµ¤·¤¤¾ì¹ç¤Ë¹â¤¤¥¹¥³¥¢¤ò½Ð¤¹¡¥ BLEU¤Ï°Ê²¼¤Î¼°¤Ç·×»»¤µ¤ì¤ë¡¥
$\displaystyle BLEU_{score}$ $\textstyle =$ $\displaystyle BP \times exp \left( \sum_{n=1}^N \frac{1}{N} \log p_n \right)$ (6.1)
$\displaystyle p_n$ $\textstyle =$ $\displaystyle \frac{ \displaystyle\sum_{i} \mbox{½ÐÎÏʸ{\it i}¤ÈÀµ²òʸ{\it i}¤Ç...
...\it N}-gram¤Î¿ô}}
{\displaystyle\sum_{i}\mbox{½ÐÎÏʸ{\it i}¤Î{\it N}-gram¤Î¿ô}}$ (6.2)

¤³¤³¤Ç¡¤$P_{n}$¤Ï½ÐÎÏʸ¤ÈÀµ²òʸ¤ÎN-gram¤Î°ìÃ×Ψ¤òɽ¤·¤Æ¤¤¤ë¡¥ BLEU¤Ï¤³¤Î°ìÃ×Ψ¤ò1-gram¤«¤é4-gram¤Þ¤Ç·×»»¤·¡¤¤½¤Î´ö²¿Ê¿¶Ñ¤ò¤È¤ë¡¥ ¤Þ¤¿¡¤½ÐÎÏʸ¤¬Àµ²òʸ¤è¤êû¤¤¾ì¹ç¡¤`` $\displaystyle\sum_{i}$½ÐÎÏʸi¤ÎN-gram¤Î¿ô''¤¬¾®¤µ¤¯¤Ê¤ê¡¤ÉÔÅö¤Ë¥¹¥³¥¢¤¬¹â¤¯¤Ê¤ë²ÄǽÀ­¤¬¤¢¤ë¡¥ ¤½¤³¤Ç¡¤Àµ²òʸ¤è¤êû¤¤Ê¸¤ËÂФ¹¤ë¥Ú¥Ê¥ë¥Æ¥£¤È¤·¤Æ¡¤$BP$¤òÍѤ¤¤ë¡¥$BP$¤Î¾ò·ï¼°¤ò°Ê²¼¤Ë¼¨¤¹¡¥

$\displaystyle BP$ $\textstyle =$ $\displaystyle \left\{
\begin{array}{ll}
1 & (c>r)\\
e^{1- \frac{r}{c}} & (c\leq r) \\
\end{array} \right.$ (6.3)

¤³¤³¤Ç¡¤$c$¤Ï½ÐÎÏʸ¤Îñ¸ì¿ô¡¤$r$¤ÏÀµ²òʸ¤Îñ¸ì¿ô¤òɽ¤·¤Æ¤¤¤ë¡¥ ½ÐÎÏʸ¤¬Àµ²òʸ¤è¤êŤ¤¾ì¹ç¤Ï$BP=1$¤È¤Ê¤ê¡¤½ÐÎÏʸ¤¬Àµ²òʸ¤è¤êû¤¤¾ì¹ç¤Ï¡¤¤½¤Îû¤µ¤Ë±þ¤¸¤ÆBP¤¬¾®¤µ¤¯¤Ê¤ê¡¤BLEUÃͤ⾮¤µ¤¯¤Ê¤ë¡¥ BLEU¤Ï0¤«¤é1¤ÎÃͤò¥¹¥³¥¢¤È¤·¤Æ½ÐÎϤ·¡¤¥¹¥³¥¢¤ÎÃͤ¬¹â¤¤¤Û¤ÉËÝÌõÀºÅÙ¤¬¹â¤¤¤³¤È¤ò¼¨¤¹¡¥



2019-03-29