next up previous
Next: Results of Human Evaluation Up: Human evaluation Previous: Human evaluation

Evaluation Criteria

We organized the outputs into four categories according to the following evaluation criteria. Also, we converted unknown words into the ``romaji'' characters.

  1. Proposed Moses

    This refers to the case when the output of the proposed method was better than that of Moses. Example sentences are listed in Table 13.


    Table: Example of ``Proposed Moses''
    Input 私 は 彼女 に 結婚 を 申し込ん だ 。
    Proposed I made a proposal of marriage to her .
    Reference I proposed to her .
    Moses I He asked her for her hand .
    Input 彼女 は 5 人 の 子供 を 育て た。
    Proposed She brought up five children .
    Reference She has brought up five children .
    Moses She is five children .

  2. Proposed $ <$ Moses

    This is the case when the output of Moses was better than that of the proposed method. Example sentences are listed in Table 14.


    Table: Example of ``Proposed $ <$ Moses''
    Input 仕事 は 山場 に 入っ た 。
    Proposed work went into the labor-management .
    Reference Work has reached the critical point .
    Moses The work is appear to have entered the final stage .
    Input 農園 は 道路 に 接し て いる 。
    Proposed The farm is roads are .
    Reference The farm abuts on the road .
    Moses Farm adjoins the road .

  3. Proposed $ \approx$ Moses

    In this case, the output of the proposed method is the same quality as those by Moses. Example sentences are listed in Table 15.


    Table: Example of ``Proposed $ \approx$ Moses''
    Input 豊作 に なり そう だ 。
    Proposed It looks like rejoicing .
    Reference The harvest looks promising .
    Moses Hopes looks like .
    Input 彼 に よろしく お 伝え ください 。
    Proposed Please send him my best wishes .
    Reference Give him my good wishes .
    Moses Please give my best regards to him .

  4. Proposed $ =$ Moses

    This refers to when the output of the proposed method and the output of Moses were exactly the same. Examples of such sentences are listed in Table 16.


    Table: Example of ``Proposed $ =$ Moses''
    Input 彼 は 故郷 を 恋し がっ て いる 。
    Proposed He is homesick .
    Reference He is sick for home .
    Moses He is homesick .


next up previous
Next: Results of Human Evaluation Up: Human evaluation Previous: Human evaluation
Jin'ichi Murakami 2012-11-06