譁ー閨櫁ィ倅コ九�謗ィ螳夂イセ蠎ヲ縺ョ豈碑シ�→閠�ッ�

BERT縺ァ縺ョ謗ィ螳壼ョ滄ィ薙〒譁�俣邂�園縺ョ逶エ蜑搾シ檎峩蠕後�1譁�r逕ィ縺�※縺�k縺溘a�梧ッ碑シ�☆繧区怙螟ァ繧ィ繝ウ繝医Ο繝斐�豕輔→繧オ繝昴�繝医�繧ッ繝医Ν繝槭す繝ウ豕輔b蜷梧ァ倥↓逶エ蜑搾シ檎峩蠕�1譁�↓髢「縺吶k邏�諤ァ縺ョ謗ィ螳夂オ先棡(55#55��55#55+60#60��55#55+63#63)繧堤畑縺�※豈碑シ�☆繧具シ取眠閨櫁ィ倅コ九↓蟇セ縺励※縲娯�縲阪r蜷ォ繧€繝��繧ソ繧剃スソ逕ィ縺励◆BERT縺ョ謗ィ螳夂イセ蠎ヲ繧定。ィ4.29縺ォ遉コ縺呻シ取眠閨櫁ィ倅コ九↓蟇セ縺励※�梧怙螟ァ繧ィ繝ウ繝医Ο繝斐�豕�(MEM)縺ィ繧オ繝昴�繝医�繧ッ繝医Ν繝槭す繝ウ豕�(SVM)縺ョ譁�俣謨ー10,000縺ョ謗ィ螳夂イセ蠎ヲ繧定。ィ4.30縺ォ遉コ縺呻シ�





Table 4.29: BERT縺ョ謗ィ螳夂イセ蠎ヲ
  BERT
豁」隗」邇� 0.7564
繝吶�繧ケ繝ゥ繧、繝ウ 0.6743





Table 4.30: MEM縺ィSVM縺ョ謗ィ螳夂イセ蠎ヲ
  MEM SVM
55#55 0.6905 0.6651
55#55+60#60 0.6919 0.6684
55#55+63#63 0.6935 0.6679
55#55+65#65 0.7430 0.7134
58#58 0.6959 0.6737
58#58+65#65 0.7644 0.7424
59#59 0.6956 0.6788
59#59+65#65 0.7628 0.7474
繝吶�繧ケ繝ゥ繧、繝ウ 0.6743

3縺、縺ョ謇区ウ輔�謗ィ螳夂イセ蠎ヲ繧呈ッ碑シ�☆繧九→�梧�繧峨°縺ォBERT縺悟━繧後※縺�k縺薙→縺悟�縺九k�惹サ悶�2縺、縺ョ謇区ウ輔〒縺ッ��+60#60��+63#63縺ィ縺励※邏�諤ァ繧定ソス蜉�縺吶k縺薙→縺ァ蟆代@邊セ蠎ヲ縺ョ蜷台ク翫�隕九i繧後k縺鯉シ沓ERT縺ォ豈斐∋繧後�菴弱>�弱し繝昴�繝医�繧ッ繝医Ν繝槭す繝ウ豕輔�謗ィ螳夂イセ蠎ヲ縺ォ閾ウ縺」縺ヲ縺ッ�瑚。ィ4.30縺ョ邏�諤ァ縺ァ縺ッ繝吶�繧ケ繝ゥ繧、繝ウ謇区ウ輔�豁」隗」邇�r蜈ィ縺ヲ荳句屓縺」縺ヲ縺�k��

4.2.2遽€縺ョ10蝗槭�BERT縺ョ螳滄ィ難シ瑚。ィ4.30縺ョ邨先棡繧偵b縺ィ縺ォ�梧怏諢丞キョ繧呈、懷ョ壹@縺滂シ弱€勲EM(SVM)縺ッ豁」隗」縺ァ縺ゅk縺沓ERT縺ッ荳肴ュ」隗」縺ァ縺ゅ▲縺溷�蜑イ邂�園縲阪�謨ー縺ィ�後€勲EM(SVM)縺ッ豁」隗」縺ァ縺ゅk縺沓ERT縺ッ荳肴ュ」隗」縺ァ縺ゅ▲縺溷�蜑イ邂�園縲阪�謨ー縺ィ縲勲EM(SVM)縺ッ荳肴ュ」隗」縺ァ縺ゅk縺沓ERT縺ッ豁」隗」縺ァ縺ゅ▲縺溷�蜑イ邂�園縲阪�謨ー縺ョ蜷郁ィ域焚繧堤畑縺�シ御コ碁���蟶�↓蝓コ縺・縺乗怏諢乗ーエ貅�0.05縺ョ隨ヲ蜿キ讀懷ョ�(迚��讀懷ョ�)繧定。後▲縺滂シ撮ERT縺ィMEM縺ィ縺ョ譛画э蟾ョ讀懷ョ壹°繧牙セ励◆p蛟、繧定。ィ4.31縺ォ遉コ縺呻シ撮ERT縺ィSVM縺ィ縺ョ譛画э蟾ョ讀懷ョ壹°繧牙セ励◆p蛟、繧定。ィ4.32縺ォ遉コ縺呻シ撮ERT縺ョ豁」隗」邇��鬮倥>鬆�°繧我クヲ縺ケ縺滂シ�





Table 4.31: BERT縺ィMEM縺ョ譛画э蟾ョ(譁ー閨櫁ィ倅コ�)
BERT MEM
豁」隗」邇� 55#55 55#55+60#60 55#55+63#63 55#55+65#65
0.7600 9.78488572#72109#109 8.08656172#72110#110 1.86973572#72109#109 0.000333
0.7597 5.21921772#7277#77 1.55623672#72111#111 5.69557672#72112#112 0.000441
0.7592 3.31356372#72110#110 2.21809872#72109#109 5.64276772#72111#111 0.000530
0.7581 5.31483172#72109#109 2.61060172#72112#112 7.58733272#72113#113 0.001286
0.7569 8.74853172#72113#113 2.13814672#72107#107 3.68739372#72114#114 0.003028
0.7561 3.57611372#72115#115 8.62436372#72107#107 3.05849072#72116#116 0.004861
0.7547 1.90935672#72115#115 5.71866072#72107#107 1.71553972#72116#116 0.009505
0.7546 3.87649672#72115#115 2.46776772#72114#114 2.59515172#72116#116 0.010689
0.7527 4.50566572#72116#116 1.23668772#72117#117 1.86484272#72118#118 0.027248
0.7520 1.23470072#72117#117 3.58435872#72118#118 3.00426772#72119#119 0.039394





Table 4.32: BERT縺ィSVM縺ョ譛画э蟾ョ(譁ー閨櫁ィ倅コ�)
BERT SVM
豁」隗」邇� 55#55 55#55+60#60 55#55+63#63 55#55+65#65
0.7600 9.51797772#72120#120 3.69223872#7294#94 1.81481772#72121#121 1.11463272#72122#122
0.7597 9.02884872#72120#120 3.86806572#72123#123 6.40510272#7294#94 3.40228072#72122#122
0.7592 2.49674172#72124#124 7.34201472#7294#94 3.53963472#72121#121 2.55843172#72122#122
0.7581 3.93906772#72125#125 3.45368472#7293#93 7.00367172#72126#126 3.06274372#72103#103
0.7569 1.08702872#7293#93 6.63525572#72108#108 8.66106672#7278#78 5.87853872#72127#127
0.7561 2.64325172#72128#128 1.46682572#7285#85 1.63057672#7284#84 2.05683872#7299#99
0.7547 3.01168672#72128#128 1.13112672#7285#85 4.39218272#7284#84 8.35809572#7299#99
0.7546 5.39773772#7293#93 9.94626172#7284#84 2.73909172#72108#108 1.16955672#72102#102
0.7527 1.07530372#7285#85 5.59648972#7286#86 6.05693972#7295#95 2.63692372#72104#104
0.7520 1.01983672#7295#95 4.03371772#7287#87 4.71091572#7279#79 1.38074872#7298#98

陦ィ4.31�瑚。ィ4.32繧医j��10蝗櫁ゥヲ陦後@縺檻ERT縺ョ豁」隗」邇��MEM�郡VM縺ョ豁」隗」邇�↓蟇セ縺励※蜈ィ縺ヲ譛画э蟾ョ縺後≠縺」縺滂シ弱∪縺溯。ィ4.30繧医j�勲EM縺ィSVM縺ァ蜷後§邏�諤ァ繧堤畑縺�◆譎ゅ�豁」隗」邇��譛画э蟾ョ繧呈、懷ョ壹@縺滂シ弱€郡VM縺ッ豁」隗」縺ァ縺ゅk縺勲EM縺ッ荳肴ュ」隗」縺ァ縺ゅ▲縺溷�蜑イ邂�園縲阪�謨ー縺ィ�後€郡VM縺ッ豁」隗」縺ァ縺ゅk縺勲EM縺ッ荳肴ュ」隗」縺ァ縺ゅ▲縺溷�蜑イ邂�園縲阪�謨ー縺ィ縲郡VM縺ッ荳肴ュ」隗」縺ァ縺ゅk縺勲EM縺ッ豁」隗」縺ァ縺ゅ▲縺溷�蜑イ邂�園縲阪�謨ー縺ョ蜷郁ィ域焚繧堤畑縺�シ御コ碁���蟶�↓蝓コ縺・縺乗怏諢乗ーエ貅�0.05縺ョ隨ヲ蜿キ讀懷ョ�(迚��讀懷ョ�)繧定。後▲縺滂シ取怏諢丞キョ讀懷ョ壹°繧牙セ励◆p蛟、繧定。ィ4.33縺ォ遉コ縺呻シ�



Table 4.33: MEM縺ィSVM縺ョ譛画э蟾ョ(譁ー閨櫁ィ倅コ�)
SVM MEM
55#55 4.07904272#7299#99
55#55+60#60 2.10066372#72102#102
55#55+63#63 1.47895672#7299#99
55#55+65#65 2.84705972#72101#101
58#58 8.86636172#7299#99
58#58+65#65 7.65565172#72129#129
59#59 9.44274772#72130#130
59#59+65#65 8.20136372#72102#102


陦ィ4.33繧医j�勲EM縺ッSVM縺ォ蟇セ縺励※蜈ィ縺ヲ縺ョ邏�諤ァ縺ァ譛画э蟾ョ縺後≠縺」縺滂シ�