¤Ï¤¸¤á¤Ë

¸½ºßµ¡³£ËÝÌõ¤Î¿¤¯¤Î¸À¸ì¥â¥Ç¥ë¤Ë¤Ï$N$-gram¥â¥Ç¥ë¤¬»ÈÍѤµ¤ì¤Æ¤¤¤ë¡¥¤·¤«¤·¡¤$N$-gram¤ÏʬÌî°Í¸À­¤¬¤¢¤ê¡¤ÊÌʬÌî¤Î¸À¸ì¥Ç¡¼¥¿¤òÄɲ䷤ƤâËÝÌõÀºÅÙ¤¬¤¢¤Þ¤êÊѤï¤é¤Ê¤¤¤³¤È¤¬ÃΤé¤ì¤Æ¤¤¤ë[1]¡¥

¤½¤³¤ÇËܸ¦µæ¤Ç¤Ï¡¤$N$-gram¥â¥Ç¥ë¤ÎÂå¤ï¤ê¤Ë¸òº¹¥¨¥ó¥È¥í¥Ô¡¼¤Î³ÈÄ¥¤Ç¤¢¤ëHigh order Joint Probability¤ò»ÈÍѤ¹¤ë¼êË¡¤òÄó°Æ¤¹¤ë¡¥$N$-gram¤¬¶áÎ٤ξðÊó¤òÍøÍѤ·¤Æ¤¤¤ë¤Î¤ËÂФ·¡¤High order Joint Probability¤Ï±ó³Ö¤Î¾ðÊó¤òÍøÍѤǤ­¤ë¡¥¤·¤¿¤¬¤Ã¤Æ¡¤Ê¸Ë¡Åª¤Ê¾ðÊó¤òÍøÍѤǤ­¤ë¡¥¤½¤Î¤¿¤áʬÌî°Í¸À­¤¬¾¯¤Ê¤¯¡¤ÊÌʬÌî¤Î¸À¸ì¥Ç¡¼¥¿¤òÄɲ䷤ƤâËÝÌõÀºÅÙ¤¬¸þ¾å¤¹¤ë¤È¹Í¤¨¤ë¡¥µ¡³£ËÝÌõµ¡¤Ë¤ÏÁêÂÐŪ°ÕÌ£ÏÀ¤Ë´ð¤Å¤¯ÊÑ´¹¼çƳ·¿¥Ñ¥¿¡¼¥ó¥Ù¡¼¥¹Åý·×µ¡³£ËÝÌõ(TDPBSMT)¤òÍѤ¤¤ë¡¥¸À¸ì¥â¥Ç¥ë¤Ë¤ÏTri-gram¤ÈHigh order Joint Probability¤òÍѤ¤¤ë¡¥ÂÐÌõ³Ø½¬Ê¸¤È¥Æ¥¹¥Èʸ¤Ë¤Ï¡¤ÅŻҼ­½ñ¤«¤éÈ´¤­½Ð¤·¤¿Ê¸(¼­½ñʸ)¤Çñʸ¤òÍѤ¤¤ë¡¥Äɲåǡ¼¥¿¤Ë¤Ïwikipedia¤«¤éÈ´¤­½Ð¤·¤¿Ê¸(Wikipediaʸ)¤òÍѤ¤¤ë¡¥

¤½¤Î·ë²Ì¡¤¼«Æ°É¾²Á¤È¿Í¼êɾ²Á¤Î·ë²Ì¤è¤ê¡¤ÂÐÌõ³Ø½¬Ê¸¤È¤ÏÊÌʬÌî¤Î¥Ç¡¼¥¿¤òÄɲåǡ¼¥¿¤È¤·¤ÆÍѤ¤¤¿¾ì¹ç¡¤High order Joint Probability¤ÎÊý¤¬Tri-gram¤è¤ê¤âËÝÌõÀºÅÙ¤¬Îɤ¤¤³¤È¤¬³Îǧ¤Ç¤­¤¿¡¥¤Þ¤¿¡¤Äɲü¸³¤È¤·¤ÆÄɲåǡ¼¥¿¤òÍøÍѤ·¤Ê¤¤¼Â¸³¤È¡¤Äɲåǡ¼¥¿¤ËÂÐÌõ³Ø½¬Ê¸¤ÈƱ°ìʬÌî¤Î¥Ç¡¼¥¿¤òÄɲ乤ë¼Â¸³¤ò¹Ô¤Ã¤¿¡¥Äɲåǡ¼¥¿¤Ë¤Ï¼­½ñʸ¤«¤éÃê½Ð¤·¤¿Ê£Ê¸¤òÍѤ¤¤¿¡¥Äɲåǡ¼¥¿¤òÍøÍѤ·¤Ê¤¤¾ì¹ç¤ÈÄɲåǡ¼¥¿¤ËÂÐÌõ³Ø½¬Ê¸¤ÈƱ°ìʬÌî¤Î¥Ç¡¼¥¿¤òÄɲ乤ë¾ì¹ç¤Î¤É¤Á¤é¤Ë¤Ä¤¤¤Æ¤â¡¤High order Joint Probability¤ÎÊý¤¬Tri-gram¤è¤ê¤âËÝÌõÀºÅÙ¤¬Îɤ¤¤³¤È¤¬³Îǧ¤Ç¤­¤¿¡¥

ËÜÏÀʸ¤Î¹½À®¤Ï°Ê²¼¤ÎÄ̤ê¤Ç¤¢¤ë¡¥ ¤Þ¤º¡¤2¾Ï¤ÇÅý·×ËÝÌõ¥·¥¹¥Æ¥à¤Î³µÍפˤĤ¤¤Æ½Ò¤Ù¤ë¡¥ 3¾Ï¤Ç¤Ï¡¤½¾Íè¼êË¡¤Ë¤Ä¤¤¤Æ½Ò¤Ù¤ë¡¥ 4¾Ï¤Ç¤Ï¡¤Äó°Æ¼êË¡¤Ë¤Ä¤¤¤Æ½Ò¤Ù¤ë¡¥ 5¾Ï¤Ç¤Ï¡¤ÁêÂÐŪ°ÕÌ£ÏÀ¤Ë´ð¤Å¤¯ÊÑ´¹¼çƳ·¿¥Ñ¥¿¡¼¥ó¥Ù¡¼¥¹Åý·×µ¡³£ËÝÌõ(TDPBSMT)¤Ë¤Ä¤¤¤Æ½Ò¤Ù¤ë¡¥ 6¾Ï¤Ç¤Ï¡¤É¾²ÁÊýË¡¤Ë¤Ä¤¤¤Æ½Ò¤Ù¤ë¡¥ 7¾Ï¤Ç¤Ï¡¤¼Â¸³¤ËÍѤ¤¤ë¥Ç¡¼¥¿¤ä¥Ä¡¼¥ë¤È¤¤¤Ã¤¿¼Â¸³´Ä¶­¤Ë¤Ä¤¤¤Æ½Ò¤Ù¤ë¡¥ 8¾Ï¤Ç¤Ï¡¤¼Â¸³¤Î·ë²Ì¤ò¼¨¤¹¡¥9¾Ï¤Ç¤Ï¡¤Äɲü¸³¤Ë¤Ä¤¤¤Æ¼¨¤¹¡¥ ¤½¤·¤Æ¡¤10¾Ï¤Ç¹Í»¡¤ò¹Ô¤¤¡¤ ºÇ¸å¤Ë11¾Ï¤Ç·ëÏÀ¤ò½Ò¤Ù¡¤¤Þ¤È¤á¤ë¡¥