文献紹介:simple english wikipedia: a new text simplification task

17
William Coster and David Kauchak. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL-2011), pp.665-669, 2011. Presented by `% T

Upload: tomoyuki-kajiwara

Post on 06-Aug-2015

96 views

Category:

Science


0 download

TRANSCRIPT

Page 1: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

William Coster and David Kauchak. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics (ACL-2011), pp.665-669, 2011.

Presented by `%£T��

Page 2: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " ÃÕÄ,�Ô�±½Æµ

!  æÙàèÔ�"Á<R#¼Ñ

" ò;À�±½Æµ !  ��ÄæÙàèÂ<RÄæÙàèÆ8�ÜùêàÔ2�cÅas !  æÙàè<R#Ô��Ä��µÏ<RÄ��ÉÆz�Â{³Ñ !  ëöùáîùàz�ÞàæðÔ�¾À<R#

" �¶QϵÅľ½Æµ�!  <R#ºÒ½�!OÇ­ �!OÎÐÌw�nÅZGÅ<RÅľ½úBLEUû 2

Simple English Wikipedia: A New Text Simplification Task �

Page 3: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " æÙàè<R#ãàÚÆi±

! ÎÐ<RÄ�@ÂOa�ÔJ¿r�ÄOÔkH¼Ñ

" æÙàè<R#ÆCl

! 1¸Æ�|¶�l&~Ä���hÆas "  4ÃÌ­q��6y|­¡¢| "  3�mE|­}��¶±|­���¶±|

! b¯Ä���jãàÚÆ��j "  ���\­G*A ��­d_z�­�u�

3

æÙàè<R#ÂÇ�

Page 4: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " çùã¶Ä± ¬¥¬<R#ãàÚÂO-xãàÚÇ��nÅ À±Ñ

" O-xÆP5çùã ! 9º±

"  1,000 ā 3,000 O8

! 0LÅ��¶°Ñ "  O-xãàÚþ�� "  <R#ãàÚþV·L³­�ÈW³­K�­���

4

æÙàè<R#Æ���

Page 5: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

!

" O-xÆP5çùã ! 9º±

"  1,000 ā 3,000 O8

! 0LÅ��¶°Ñ "  O-xãàÚþ�� "  <R#ãàÚþV·L³­�ÈW³­K�­���

4

æÙàè<R#Æ���

English Wikipedia & Simple English Wikipedia

<R#çùãþ�;ÆOÂ<RÄO 2·±þ3,000 O8 ¥ 137,000 O8 0L��þ��ÆË ¥ �ÀÆ0L�

Page 6: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

!

��Æ8C�¹�

e�Æ8C�¹�

OÆ8C�¹�

5

<R#ÜùêàÆ�H�

Page 7: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " English Wikipedia ´ÎÈ Simple English Wikipedia ���ú2010= 5Yû

" ïÖô÷Û ! ãØèõ

" ë×õãô÷Û ! ��ÆËÆ��­àãì ! USD�fïùß­ñãïùß�

6

��Æ8C�¹�

10,588 8Æ��Ô8C�¹�

¤ ��­NormaløSimpleÂ+Èʼ®�

Page 8: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " $��ÖóØñ÷èãàÚÆ��opÅB²

! Regina Barzilay and Noemie Elhadad. 2003. Sentence alignment for monolingual comparable corpora. In Proceedings of EMNLP.

" e�þWikipediaÆV?F/µÏ(7Á·Ñ

" 8C�¹þTF-IDFÔl±½ÜÝØ÷  > !  SimpleÆe�¬¥¬NormalÆe�ú��0.5��û�

7

e�Æ8C�¹�

Page 9: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

!

8

OÆ8C�¹�

¦ SimpleOÔàÙåí § NormalOÔàÙåí ¨ ü¿ÆNormalOÂü¿ÆSimpleOÔ8C�¹Ñ © ü¿ÆNormalOÂý¿ÆSimpleOÔ8C�¹Ñ ª ý¿ÆNormalOÂü¿ÆSimpleOÔ8C�¹Ñ « ý¿ÆNormalOÂý¿ÆSimpleOÔ8C�¹Ñ�

¦ § ¨ © ª «

iþNormalO jþSimpleO�

sim(i,j): O£i ÂO j Æ  > TF-IDF­Cosine  >­0.5[gÇë×õãô÷Û�

skip_penalty = 0.0001�

Page 10: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

!

��Æ8C�¹£££££u 10,000 ��8�

e�Æ8C�¹¬u 75,000 e�8�

OÆ8C�¹££££££££u 137,000 O8�

9

<R#ÜùêàÆ�H�

Page 11: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " ó÷äðÅ 100 O8 "  2 Æ��|

"   >Æ�� 0.5 þt> 91%ú137,000 O8û "   >Æ�� 0.75þt> 98%ú 90,000 O8û�

10

8C�¹Æ���

Page 12: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " Simple ��Æe�Æ 65 % Ç8C�¹¶�ÓÒı�" �Æ Simple Oþ¬¬<. 40 O / �� " I�»½ Simple Oþ<. 14 O / ��

11

<R#ÜùêàÆ�\�

8C�¹M�� '�

SimpleOÔàÙåí� 27 %�NormalOÔàÙåí� 23 %�ü¿ÆNormalOÂü¿ÆSimpleOÔ8C�¹� 37 %�ü¿ÆNormalOÂý¿ÆSimpleOÔ8C�¹� 8 %�ý¿ÆNormalOÂý¿ÆSimpleOÔ8C�¹� 5 %�

Page 13: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " GIZA++ ÅÎÑ$�ÖóØñ÷è�

12

$�öîõÆ�\�

$�öîõÆM�� '�

V·L³þNormal Æ�¶ Simple Æ�Å0#¼Ñ 65 %�

�¬�¬þNormal Æ�¶f³Ñ 47 %�

�ÈW³þ�$�ÄÖóØñ÷è� 34 %�

v¬'¬þ�NÆ Normal Æ�¶ü¿Æ Simple Æ�ÅÊÂÊÑ� 31 %�

�¬ ¬þü¿Æ Normal Æ�¶�NÆ Simple Æ�Å�µÒÑ� 27 %�

Page 14: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! Normal� As Isolde arrives at his side, Tristan dies with her name on his lips.

Simple � As Isolde arrives at his side, Tristan dies while speaking her name.

Normal� Alfonso Perez Munoz, usually referred to as Alfonso, is a former Spanish footballer, in the striker position.

Simple � Alfonso Perez is a former Spanish football player.

Normal� Endemic types or species are especially likely to develop on islands because of their geographical isolation.

Simple � Endemic types are most likely to develop on islands because they are isolated.

13

<R#ÜùêàÆ��

Page 15: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! Normal� As Isolde arrives at his side, Tristan dies with her name on his lips.

Simple � As Isolde arrives at his side, Tristan dies while speaking her name.

Normal� Alfonso Perez Munoz, usually referred to as Alfonso, is a former Spanish footballer, in the striker position.

Simple � Alfonso Perez is a former Spanish football player.

Normal� Endemic types or species are especially likely to develop on islands because of their geographical isolation.

Simple � Endemic types are most likely to develop on islands because they are isolated.

13

<R#ÜùêàÆ��

V·L³�

���

���

V·L³ú� û�

V·L³úv'û�

V·L³ø�ÈW³�

Page 16: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " æÙàè<R#ãàÚ£ÿ£��z�ãàÚ " Mosesþëöùáîùàd_z�Þàæð

! <R#Üùêà�Æ 124,000 O8 !  Simple OµÏ�H»½ n-gram ��òçõ ! éØêùêóñùãÆ6yþ<R#Üùêà�Æ 500 O8

" æàèâåèþ<R#Üùêà�Æ 1,300 O8

14

æÙàè<R#ÅÎÑ <R#ÜùêàÆ���

Þàæð£Ā£��:>� BLEU� word - F1� SSA�

Baselineú<R#»Ä±û� 0.5937� 0.5967� 0.6179�Moses¬¤w�nÅZGÅ)�� 0.5987� 0.6076� 0.6224�Moses-Oracleú1000-bestû� 0.6317� 0.6661� 0.6550�

Page 17: 文献紹介:Simple English Wikipedia: A New Text Simplification Task

! " P5ÆÌÆÎÐ^�±Å2·ÄçùãâåèÔas

! English Wikipedia & Simple English Wikipedia !  137,000 O8ú8C�¹t> 91%û ! 1bÄ0LM�úV·L³­�ÈW³­K�­��û !  http://www.cs.middlebury.edu/~dkauchak/simplification/

" <R#ÜùêàÇæÙàè<R#ãàÚÅZl

! MosesÅÎÑ0L­BLEU�¶w�nÅZGÅ)� ! Moses-OracleÆv]þBLEU�ÇX2 0.033 )�

15

Simple English Wikipedia: A new simplification task �