next up previous contents
Next: RIBES Up: ¼«Æ°É¾²Á Previous: NIST   目次

METEOR

METEOR¤ÏºÆ¸½Î¨$R$¤ÈŬ¹çΨ$P$¤Ë´ð¤Å¤¯FÃͤËÂФ·¤Æ¡¤Ã±¸ì¤ÎÈóϢ³À­¤ËÂФ¹¤ë¥Ú¥Ê¥ë¥Æ¥£´Ø¿ô$Pen$¤òÍøÍѤ·¤¿É¾²Á´ð½à¤Ç¤¢¤ë¡¥ METEOR¤Ï°Ê²¼¤Î¼°¤Ç·×»»¤µ¤ì¤ë¡¥
$\displaystyle METEOR_{score}$ $\textstyle =$ $\displaystyle F_{mean} \times (1-Pen)$ (6.6)
$\displaystyle F_{mean}$ $\textstyle =$ $\displaystyle \frac{P \times R}{\alpha \times P + (1-\alpha) \times R}$ (6.7)
$\displaystyle Pen$ $\textstyle =$ $\displaystyle \gamma \times (\frac{c}{m})^\beta$ (6.8)

¥Ú¥Ê¥ë¥Æ¥£´Ø¿ô$Pen$¤Ë¤ª¤¤¤Æ¡¤$m$¤Ï½ÐÎÏʸ¤ÈÀµ²òʸ¤Îñ¸ì¤Î°ìÃ×Ψ¤òɽ¤¹¡¥ ¤½¤·¤Æ¡¤$c$¤Ï°ìÃפ·¤¿Ã±¸ì¤òÂоݤˡ¤Àµ²òʸ¤È¸ì½ç¤¬Æ±¤¸¤â¤Î¤ò1¤Ä¤Î¤Þ¤È¤Þ¤ê¤È¤·¤ÆÅý¹ç¤·¤¿¾ì¹ç¤Î¡¤¤Þ¤È¤Þ¤ê¤Î¿ô¤òɽ¤¹¡¥ ¤½¤Î¤¿¤á¡¤½ÐÎÏʸ¤ÈÀµ²òʸ¤¬Æ±¤¸Ê¸¤Ç¤¢¤ë¤È¤­$c=1$¤È¤Ê¤ë¡¥ ¤Þ¤¿¡¤°ìÃ×Ψ¤Î·×»»¤Ë¤ª¤¤¤Æ¡¤WordNet¤Ë¤è¤ëÎàµÁ¸ì¤òÍѤ¤¤Æ¡¤»÷¤¿°ÕÌ£¤ò»ý¤Äñ¸ì¤ÏƱ°ì¤Ç¤¢¤ë¤ÈȽÃǤµ¤ì¤ë¡¥ METEOR¤Ïñ¸ì°À­(3¿Í¾Îñ¿ô¤Ê¤É)¤¬Àµ¤·¤¤¾ì¹ç¤Ë¡¤¹â¤¤¥¹¥³¥¢¤ò½Ð¤¹ÆÃÀ­¤ò»ý¤Ä¡¥$\alpha$¡¤$\beta$¡¤$\gamma$¤ÎÃͤϥѥé¥á¡¼¥¿¤Ç¤¢¤ë¡¥ METEOR¤Ï0¤«¤é1¤ÎÃͤò¥¹¥³¥¢¤È¤·¤Æ½ÐÎϤ·¡¤¥¹¥³¥¢¤ÎÃͤ¬¹â¤¤¤Û¤ÉËÝÌõÀºÅÙ¤¬¹â¤¤¤³¤È¤ò¼¨¤¹¡¥METEOR¤ÏÆüËܸ켭½ñ¤¬Â¸ºß¤·¤Ê¤¤¤¿¤á¡¤Ëܸ¦µæ¤Ç¤Ï½ÐÎÏʸ¤¬ÆüËܸìʸ¤Î±ÑÆüËÝÌõ¤Ç¤Ï»ÈÍѤ·¤Ê¤¤¡¥



2019-03-29