c. lee giles, pennsylvania state...

20

Upload: others

Post on 24-Jan-2021

1 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

������������ ������������������������������! #" �$�%�'&�(�!)+*,�-��.,/�*, ��0&1���2.31�4���2��5631�7�8&9 ���:,;

<#=0>�?A@CBEDF>�G(HJILK�M�NPOQ>QKRI8BS=0>TN�U7VWNX=ZY#>[@C\8IM�IA]_^�`�GS@CB,VWa�>�@C=!ab@_NL=!c6d�=�\L>�=�@C@CB(>�=�\Je7@fa�g�=0>TaCNPOihj@C^!IABSGkM�VWlLm8npoAlAq

r�sAt%uwvyx�z7{-|�xT}0~7�SvA� |�{7�-vyv���uTxwvA�E� ��uwxwx$��{7�k}0�Et%vA� �s8�E�bu��S}0t���{7|�}0�b�E�bvLxTx��

rkvA�Pvy�6�7vL���0�!���L�W�8�

�������b�C W¡C�¢�£J¤p¥8¦¨§#©WªC©0«S¬�­4«�ª®¬p¯f°8«�¤p¥0ªC¤�ª_±³²[ª®§p§�´®µ�¶W£A¦Q¤p«,§F¤·ª®¤p«�¸�ªf±F¥A¦Q£A«S§�¹�º¼»8½�§·¾#­�¥A¦�±F¥J¦¨§#¬p«S©L¿

¬F«S§p«S£L¤(ªCÀA²Q«_ÀLÁJ¤p¥8«�Â$Â�º!¢pÃĹRÂi«S°A¬(ªC²�Â�«S¤�­-´f¬FÅƺ2¦Q£A¦Q¤p«k¢�¸�©A°A²Q§F«Ã�«�§p©0´f£A§F«E¾�ª®¬·±F¥A¦Q¤p«E±³¤p°A¬F«�¦Q§«EÇP°A¦QÈfª®²¨«�£y¤É¤p´�¤p¥A«�ÊL«(¶W£A¦Q¤F«$¸�«�¸�´f¬FÁ�§p«bÇf°8«S£L¤p¦�ªC²�¸�ªf±F¥A¦Q£A«S§�¹�Ë�½_½�§·¾É­�¥A¦�±F¥�ªC¬F«�¦Q¸k©A²Q«S¸,«S£L¤·ªÌ¿¤F¦¨´P£A§%´Cµ¼ÊL«bÍ7¬F°A¦ Î(£�ªC°A¤F´f¸�ªC¤·ª8Ï0ÐJ«�§p°A©A©0´f¬F¤7¤p¥8¦¨§-±(²�ªC¦Q¸ÑÀLÁ,ÊL¬·ªb­�¦Q£A¯�©Wª®¬·ªC²Q²Q«S²Q§%ÀW«�¤�­4«S«�£±(¦Q¬·±³°A¦Q¤¤F´f©0´f²Q´f¯P¦¨«�§4´®µ�§F«EÇP°A«S£L¤p¦�ª®²!¸ªP±F¥A¦Q£A«S§-°A§p«EÊÒ¤p´,¦Q¸�©A²Q«S¸k«S£L¤7º¼»8½�§�ª®£WÊk¤p¥A«�ªC¬(±F¥A¦Q¤p«E±(¤F°A¬p«�´Cµ7¤F¥A«Â�Â$º2¢pÃ�ÏLºA°8¬p¤p¥8«S¬�§p°A©8©W´P¬p¤-¦¨§-©A¬F´CÈy¦�ÊL«bÊ,ÀLÁ,§p¦Q¸,°A²�ªC¤F¦Q´f£�¬F«S§p°A²Q¤F§�¤p¥Wª®¤4§F¥A´C­Ó¤p¥Wª®¤Ôª�Â$Â�º!¢pÃÕªC¬Ö¿±F¥A¦Q¤p«b±(¤p°A¬F«�¦Q§Ôª®ÀA²Q«�¤p´�²Q«EªC¬F£�©0«S¬�µT«b±(¤p²QÁ_ª�²�ªC¬F¯f«�ÊX«(¶W£A¦Q¤p«�¸k«S¸�´P¬pÁ�¸ªP±p¥8¦¨£8«�¹R×fØ®ÙyÚ�§F¤·ª®¤p«S§(¾�­�¦Q¤p¥ÈP«S¬pÁ�µw«S­Ñ¤F¬·ªC¦Q£A¦Q£A¯,«³Û8ª®¸�©A²Q«S§bÏ�ÐJ«Üª®²Q§p´ÊX¦¨§(±(°A§F§�¤p¥A«�«(Ý�«E±(¤F§�¤F¥WªC¤�ÈfªC¬p¦�ª®¤p¦Q´f£A§�¦Q£_¤p¥A«�Â�Â$º2¢pꮬ·±F¥A¦Q¤p«E±³¤p°A¬F«�¥WªbÈf«�´P£¤F¥A«�±(²�ªC§F§$´Cµ%©A¬p´PÀA²Q«S¸�§-«Eª®§p¦Q²QÁ,²¨«bªC¬p£0ªCÀA²Q«�ÀLÁ�¤p¥8«�£8«S¤�­4´P¬pÅ�Ï

Þ·ß-à7áfâÓà7áPã�âÉä(åfæ(çéèyêPëpìîíbïfð�äSñ-ïPë·ð�ê8ç ä(êfïòRó ã!à6ô%ä(ð�ä³õ�ö�ëp÷,øwùfð�æwúîæ�ïPæ�äbèXûüöwúîùfë(ä(æ�íEù ó�ý èfþ�úÿìîä(ðpñ-ö�ä(ð�ä³õ�ö�ëp÷8ç ù��·ç ùfä(ëbç ë(í���Ró ã!à6ô%ä(ð�ä³õ�ö�ëp÷,øwùfð�æwúîæ�ïPæ�äbèXûüöwúîùfë(ä(æ�íEù ó�ý èf÷PíEö�ùPäSñ-ö�ä·ð�äSõ�ö�ëp÷8ç ù��(ç ùfä(ëbç ë(í��� ß-à7áfâÓà7áPã�âÉä(åfæ(çéèyþbë(íEæ�æ�ö�äFìÿì¨ñ-ïfë(ð�ê8ç ä(êfï�

Page 2: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

��� ����������� �������p=ÕGSg�@_=�@C`�BENPO$=�@CG���IAB� �OTNL=�\A`!NL\A@Ò>[=!c0`!abG³>[I8=ÕO¨>�GS@CBbNLGS`�BS@AU�>[=!c0`!abG³>[I8=�ILK"!!=0>[G�@�D(GENLG�@ÒNX`�GSIA]�NLGbN > DabIA]_]_IA=0O�H,GSg�I8`�\AgWG%ILK!NAD2GSg�@�c0IA]�NP>�=,ILK�BS@fab`�BSBS@C=0G7=�@CG���IAB� �NXBEaSg0>�GS@fabG�`�BS@fD$#QM�O�@C@CBS@C]�NL=!D�@CG�NPO&%�U � lAq8l('#îd-O�]�NL=7U � lAl � ')#+*-ILOQO N8a� %U � lAl � '�#-,#>QO[@fDj@CG�NPO&%�U � l8l/.0'1#32 NLGSBSI8`!D�NX=!c54�`�g�=7U � l8l/.0'&%76#I8��@C?A@CBPU4B�@Cnab@C=WG���IAB� 9#-,�>QO�@fD#@CG�NPO&%�U � lAlLm:'�g!NAD,D³g�I8�#=ÆG�g!NLG�N�BS@fD(GSB³> abG�@fcÆa�OTNAD�D,ILK�BS@fab`�BSBS@C=0G,=�@CGED,aCNL=ÓO�@fNLB�=N�D(`<;%a�OTNADSD#ILK$!!=0>�GS@_D(GENLGS@�NX`�GSIA]�NLGbNaCNyO¨O�@fc=!!=0>�GS@Cn�]_@C]_I8BSHZNL`�GSIA]�NLGEN<%>�p=6GSg0>TD�^!NL^2@CBfU?��@�D(g�I:�GSg!NLG>@BA�A�CD@BE/F�G$H/F�C:I�E/JLK-M�NLBEa�g0>[G�@fabGS`�BS@fD,aCNL=ÓBS@C^�BS@fD³@C=WG,NL=!c�O�@fNLBS= NJa�OTNADSD�ILK�NL`�G�IA]�NLGENüU!Y�@(N�BS`0>PO·=NL`�GSIA]�NXGEN<%Ñe�g�@fD³@ÆNL`�GSI8]�NLGENÓNAaCab@C^�GJD(GSB(>�=�\WD ILK�NLB�;0>�GSBENXBSHÕO�@C=�\AGSg7U";�`�G�g!Nf?8@ZD(GENLGS@fDÒGSg!NLG�NLB�@abIA]_^0O�@CGS@bO�H c0@CGS@CBS]�>�=�@fcQ;0HZNR!!=0>�GS@kO�@C=�\AGSg ILK�>�=�^�`�G�D(GSB(>�=�\WDS%UTÜD,D³`!aSgÓGSg�@fD(@�NL`�GSIA]�NLGEN_aCNL=V;!@>[] ^0O[@C] @C=WGS@fcW;0HÒN,a�OTNAD�D�ILK7D(@(XA`�@C=0G(>TNPO%]�NAa�g0>[=�@fDiGS@CBS]_@fcWY�A[Z"JL\^][A�_`A(aRE/F�M�_QH/bScd\eJ?ASf$g·Y�hQhÓD�i�%VAGSBS`!abGS`�BENyO¨O�H GSg�@fD(@ZY�hQhÓD�BS@fD(@C]R;0O�@ZG(>�]_@Cnpc0@bOTNPHÑ=�@C`�BbNPOÜ=�@CG���IAB� �DWg·e�Y�j�j�DBi�%Ñe�Y�j�j�Dk��@CB�@IAB(>�\L>�=!NPOQO�H�c0@�!!=�@fcl#P2 NP>m;2@bO4@CG�NPO&%�U � lAqAl0'pU7G�I�>[=!a�O�`!c0@�K�@C@fc8KRI8B���NLBEc6=�@CGED��j>[G�gn;!IAG�gÓ>�=�^�`�GG³>[] @Cnc0@bO NPH�D�NL=!cÆ>[=0GS@CBS=!NyO�G(>�]_@Cnpc0@bOTNPH Do%qp2>m A@Je�Y�j�j�DCU-Y�hQhÆD#]�N: 8@_=�IZc8>TD(G(>�=!abG(>�IA=r;!@CG���@C@C= GSg�@fD³@Gs��I�K�IABS]�D�ILK�G(>�]_@_c0@bOTNPH D�@b>�GSg�@CB(%U�p=ÓGSg�@kOQ>�GS@CBENLGS`�B�@t#32 NL=7U � lAlAo0'pU2N�e�Y�j�j >TD,NPOTD(I�BS@bKR@CB�BS@fc6GSINAD$NL=�j)j�u��·hvgsj�@C`�BbNPOwj�@CG���IAB� RuÉ>�=0>[G�@)�F]_^�`0OTD(@�h�@fD(^2IA=!D(@:iÔNXBEaSg0>�GS@fabG�`�BS@/%xu�I8B$a�O NXB(>�G·HR��@�c0@�!!=�@GSg�@_D(`<;¼a�OTNADSDy��g0>TaSg g!NAD�IA=0O�HÓG(>�]_@_c0@bO NPH�D�IA=ÓGSg�@k>�=�^�`�GED�NAD,NX=`�F=�^�`�GY�@bOTNPH`j#@C`�BENPOxj�@CG���IAB� g&�·Y�j�j�i�%

�p= GSg0>TD_^!NX^!@CB���@Óc8>TDSab`!DSD�GSg�@ZaCNL^!Nz;0>¨OQ>�G(H ILK1;2IAGSg GSg�@`j�j)u��(h NX=!cr�·Y�j�j NLBEa�g0>�GS@fabGS`�BS@fDKRIAB GSg�@JOTNL=�\A`!NX\A@�>�=!c0`!abG(>�IA=1GENADD w%r2 @7��>QOQO)!!=!c GSg!NLG_@C?8@C=ÑGSg�IA`�\8g�GSg�@`j�j)u��(h NX=!cr�·Y�j�jNLBEa�g0>[G�@fabGS`�BS@fD�NLBS@$;2IAGSg_aCNL^!N:;0O�@�ILK!BS@C^�B�@fD(@C=WG³>[=�\�GSg�@�DSNL] @�D(@CG-ILK0KR`�=!abG(>�IA=!D-G�g�@CBS@�> D-N�c8> D�ab@CBS=!N:;0O�@c8>|{7@CBS@C=!ab@�>�=JGSg�@b>�B�O�@fNLBS=0>�=�\�aCNL^!N:;0>QOQ>�GS@fDS%"�F=ZD(^0>�GS@,ILK4GSg�@#KpNAabG�GSg!NLG�GSg�@fD(@,=�@CG���IAB� _NLBEa�g0>�GS@fabGS`�BS@fDabIA=WGbNP>�=Z=�I�BS@fab`�BSBS@C=!ab@AU%GSg�@CHZaCNX=Æc0IqX8`0>�GS@R��@bOQO$NLG�>�=!c0`!abG(>�IA= IXKic0@�!!=0>�GS@_] @C]_IABSH�]�NAa�g0>�=�@fDCU¼ND(`<;¼a�OTNADSD#ILK�!!=0>�GS@D(GbNLGS@,]�NAa�g0>�=�@fDS%} ~��"���x�����R ����y�����������`�� ���������� ��"�$ �������p=ÑN�KR@C@fc0nwK�IAB���NLBbcÓ=�@C`�BENPO�=�@CG���IAB� %U7GSg�@J=�I�c0@fD�aCNL=�;2@JIABEc0@CBS@fcÕD(`!a�g�GSg!NLGkGSg�@_>�=�^�`�GEDÒGSIÆNL=0H=�I c0@k>�NLBS@kGSg�@�I8`�GS^�`�GED�ILK$=�I�c0@fD � U�.�U��0�(�bU2>�n � %,<�DF>�=�\JGSg0>TD#K�IABS]�`0OTNLG(>�IA=7U%GSg�@�NAabG(>�?yNXG(>�IA=6KR`�=!abnG(>�IA=6KRIAB,D(IA] @=�I�c0@k>�>�= N_]�`0O�G(>�nwOTNPHA@CB�^2@CBEab@C^�GSBSIA=9g·NÒK�@C@fc0nwKRIAB��jNXBEc6=�@CGs��IAB� q��g�I0D(@�=�I c0@fD,NLB�@^!@CBEab@C^�GSB�IA=!D�i�> Dj\L>�?A@C=7;0H�@(X8`!NLG(>�IA= � %

�(����� g �^�����D� �<� � � � � i g � i��g�@CBS@ �0� >TD,GSg�@kIA`�GS^�`�G,ILK$=�I�c0@k>pU � � � > D�G�g�@abIA=�=�@fabG(>�IA=ÕD(GSBS@C=�\AG�gJK�BSIA] =�I c0@�O�G�I�=�I�c0@k>ÖU

NL=!c_g >TD�GSg�@,D�X8`!NAD(g0>�=�\kKR`�=!abG(>�IA=�%���K�GSg�@CBS@�NLB�@�^ >�=�^�`�GED�GSIkGSg�@�=�@CG���IAB� %UAG�g�@C=�GSg�@U!!BED(G�^J=�I c0@fDNLBS@,`!D(@fc6NAD�>�=�^�`�G�`�=0>�GED �w >¡n¢

£ �(����¤<���g�@CBS@ ¤ � >TD#GSg�@ [¥^¦

=�@CG���IAB� Ò>[=�^�`�G0%T�=�j�j)u��(hrgsj#@C`�BENPO<j�@CG���IAB� )uÉ>�=0>�GS@"�p] ^�`0O D³@jhj@fD(^!IA=!D³@1#32 NL=7U � lAlAo0'&§LNPOTD(I� W=�I:��=�N8D7N�e�>[] @

Y�@bO NPH7j#@C`�BENPOxj�@CG���IAB� �IAB,e�Y�j�j�#¨p7NL=�\_@CG�NPO&%�U � lAlª©S'[i�>TD,DF>�]�>QO NXB,GSI N ]�`0O�G(>�nwO NPHA@CB,^2@CBEab@C^�GSBSI8=.

Page 3: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

t-2i iy t-3y

delay

tiy

t-1 yi

delaydelay

Inputs

Output

uÉ>�\A`�BS@ �ª« T�=7j�j�u��·h¬j�@CG���IAB� >[=ÓGSg!NXGÜNPOQO$abIA=�=�@fabG(>�IA=!D#K�@C@fc�KRIAB��jNXBEc�%�ejg�@c8>-{7@CBS@C=!ab@�>TD�G�g!NLG�>�=ÓGSg�@Rj)j�u��·h,U%G�g�@,>�=�^�`�GED�GSI�N=�I c0@

 abIA=!DF>TD(G,ILK$G�g�@�IA`�GS^�`�GbD�ILK$@fNLB(OQ>�@CB,=�I c0@fD�=�I8G�IA=0O�HÓc0`�B(>�=�\JGSg�@_ab`�BSBS@C=0G�G(>�]_@_D(G�@C^7­EU�;�`�G

c0`�B(>�=�\�D(IA]_@�=0`�]�;2@CBfU<®!U8ILK4^�BS@C?8>�IA`!D�G(>�]_@�D(GS@C^!D¯g&­�° � £ ­�°7. £ �(�S�^­�°7®<i�NAD>��@bO¨O&%$ejg�@ÜNAabG³>[?LNLG(>�IA=KR`�=!abG(>�IA=�KRI8B�=�I c0@ NLG�G(>�]_@±­�>�=ÆD³`!aSgÓN�=�@CG���I8B� �>TD�\L>�?A@C=V;WH�@(XA`!NXG(>�IA=`.<%

�¥� �²� g �^�L����� �

³�´��?µ �

¥ � ´� � � �D´ i g�.di��g�@CBS@ � � �D´ > D�GSg�@�abIA=�=�@fabG³>[I8=�D(G�BS@C=�\AGSgÓGSIJ=�I�c0@

 KRBSI8] GSg�@_IA`�GS^�`�G,IXKj=�I�c0@�¶ÓNLG,G(>�]_@q·�%j�IAG³> ab@kGSg!NLG�G�g�@,=W`�]R;!@CB�ILK$��@b>[\8gWGED�>[=!abB�@fNAD(@fDjO¨>�=�@fNLB³O[HV��>�GSgZG�g�@,=W`�]R;!@CB�ILK$c0@bOTNfH�DS%�e�g�@CBS@�NLB�@

=�I8�¸®±¹ � ��@b>�\Ag0GED#K�IAB,@C?A@CBSH6^!NP>�B�ILK�=�I c0@fDÜ>�= GSg�@_=�@CG���IAB� %U!I8=�@���@b>[\8gWG�K�IAB,@fNAa�g G(>�]_@�c0@bOTNPHD(GS@C^�%

e�g�@qj�j�u��·hÄ>TD,\A@C=�@CBENyO¨O�H >�]_^0O�@C]_@C=WG�@fc `!DF>�=�\ÓGENL^�^2@fc c0@bOTNPHÓOQ>�=�@fDS%7uüIAB,@fNAa�g =�I c0@ >�= G�g�@=�@CGs��IAB� ¼UAN�GENL^�^!@fc c0@bO NPH�OQ>�=�@�D(GSI8BS@fD-GSg�@�IA`�G�^�`�G$ILK%GSg�@�=�I�c0@Üc0`�B(>�=�\�GSg�@�^�B�@C?A>�IA`!D"®,G³>[] @ÜD(G�@C^!DS%e�g�@�I8`�GS^�`�G�ILK4N�=�I�c0@,NPO�IA=�\R��>�GSg�G�g�@�?LNPO�`�@fD�ILK7GSg�@,NADSD(I�a�>TNLGS@fc GENL^�^!@fc�c0@bOTNPH�OQ>[=�@fD�NLG�NPOQOÉc0@bOTNPH>[=0GS@CBS?LNPOTD�D³@CBS?A@�NAD�>�=�^�`�G�GSI�OTNLGS@CB#=�I c0@fDS%"uÉ>�\A`�BS@ � D³g�I8��D�NX=Z@�º!NL]_^0O�@�ILK�NL=`j�j)u��(h =�@CG���IAB� �%

e�g�@�O�@C=�\AGSg�IXK�GSg�@JGENL^�^2@fc�c0@bOTNfHÕOQ>�=�@fD�c0@CGS@CBS]�>�=�@fD�GSg�@JBbNL=�\A@JILK�>�=�^�`�G�g0>TD(GSIABSH GSIQ��g0>TaSgGSg�@Z=�@CG���IAB� >TDJD(@C=!DF>�G(>�?A@/% VL>�=!ab@AU�>�= GSg�@`j�j)u��(h NLBEa�g0>�GS@fabGS`�BS@AU#GSg�@Æc0@bOTNPH9DF>m»C@6>TDR!<º�@fc%U�G�g�@=�@CGs��IAB� ���>QOQO7=�IAG$;!@,N:;0O�@�GSIkBS@C^�BS@fD(@C=0G$]�NX^�^0>[=�\0D$��g0>Ta�g�BS@(X8`0>�BS@,N#O[I8=�\A@CB�>[=�^�`�G�g0>TD(GSIABSH/%�e7I,IA`�B W=�I:��O�@fc0\A@AUÉGSg�@CBS@_g!NAD�;2@C@C= =�I7��IAB� JIA= NAc�NL^�G(>�=�\ZG�g�@=0`�]R;!@CBkILKjc0@bOTNPH D®U�;�`�G,GS@fa�g�=0>eXA`�@fD�K�IABNAc�NL^�G(>�=�\�G�g�@�=0`�]R;!@CB�ILK%G(>�]_@�D(G�@C^!D�;!@CG���@C@C=�c0@bOTNfH�D-g!NP?A@";!@C@C=�c0@C?8@bO[I8^!@fcV#¨*-@fNLB(O�]�`�GSGS@CBfU � l8qAl0'pU#¨p2>�=Z@CG�NyO¼% U � lAl/.0'pU�#îY,NPH�NX=!cZY,NP?A@C=�^!I8BSGfU � lAlAoo'&%

o

Page 4: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

uuuuu t-6tt-1

Equivalent IDNN

t-1. . .t-4t

General NNFIR

. . . u

Pf ffQfQ P

P PQ Q

R Rt-4

t-5t-1

t-6t-2

tP

P

P

f (u ,..., u )

f (u ,..., u )

f (u ,..., u )

uÉ>�\A`�B�@�. « eÉBENL=!DFK�IABS]�>�=�\�NX=7j)j�u��·h >�=WGSI�NL=J@(XA`0>�?LNPO�@C=WG��(Y�j)j½ ~��"���x�����R ����y�����9�~¾��� �����$���� ��"�$ ������T =!NXGS`�BENPO$BS@fD³GSB(>TabG(>�IA=ÕILK�GSg�@_\A@C=�@CBENyO¯j�j)u��(h�GSIA^2ILO�IA\AH6>TDkGSg�@�a�OTNADSD�ILK)j)j�u��·h'NLBEa�g0>�GS@fabGS`�BS@fD��g0>TaSg�g!NP?A@Jc0@bOTNfH�D�IA=0O�HÕIA=�GSg�@ >�=�^�`�G�`�=0>�GEDS%¿2 @JaCNPOQO�GSg�@fD(@Q\eJzÀwÁd]�C/A0K|HªM8A�CnJ?A(ÁdFsHªKxJLA0][G$E/F�Â(fg&�·Y�j�j�DBi�%�T�=��(Y�j)j�aCNL=±;!@i>[] ^0O[@C] @C=WGS@fc±��>�GSg�N�D·>[=�\XO[@�GENX^�^!@fc�c0@bOTNPH�OQ>�=�@$K�IAB7@fN8aSg�>[=�^�`�G0%Ôd�NAa�gGENL^�^!@fc6c0@bOTNfH�OQ>�=�@_abIA=0GENP>�=!D�>�GED�>�=�^�`�GED#K�BSIA]'GSg�@k^�BS@C?A>�IA`!D�c�G(>�]_@�D(GS@C^!DS%$ejg�@fD(@�c0@bOTNfH8@fc�>�=�^�`�GEDKR@C@fc >�=0GSI NÓ=�IAB�]�NPO$K�@C@fcÕK�IAB���NLBbcÓ=�@CG���I8B� w%9N�@faCNL`!D(@JGSg�@JGENX^�^!@fc�c0@bOTNPH OQ>�=�@fDJNLBS@�@�{7@fabG(>�?A@bO�HD(@C^!NLBENLG�@�KRBSI8]�GSg�@,K�@C@fc�K�IAB���NLBbc_=�@CG���IAB� %U0GSBENP>�=0>�=�\�IXKÃ�(Y�j)j�D�>TD#@(XA`0>�?LNPO�@C=WG,GSI GSBENP>�=0>�=�\ NÒK�@C@fcKRIAB��jNXBEc_=�@CG���IAB� �%

VL>�=!ab@�GSg�@�a�OTNADSD-ILKL�(Y�j)j�DÉ>TD�N�D³`<;¼a�OTNADSDiILKwj)j�u��·h#DCUA@C?A@CB�H��·Y�j�jÕ>TD�NPOTD(I�NL=Rj)j�u��·h�%0MiO[@fNXB(O�HGSg�@C=7U0GSg�@�D(@CG�ILK%K�`�=!abG(>�IA=!D�abIA]_^�`�GEN:;0O�@�;WH�GSg�@�j�j)u��(h�D�]`!D³G�>�=!a�O�`!c0@�NPOQO�G�g�IWD(@�abIA] ^�`�GEN:;0O�@);0HGSg�@��·Y�j�j�Do%

�pG�>TD,O�@fDSD�>�=0GS`0>�G(>�?A@5;�`�G_NPOTD(IÓ@fNAD(HÓGSIÆD³g�I8� GSg!NLG,GSg�@JD(@CGkILK�KR`�=!abG(>�IA=!D abIA]_^�`�GEN:;0O�@�;WH NL=0H�·Y�j�j >�=!a�O[`!c0@fD NPOQO�GSg�IWD³@�abIA]_^�`�GENz;0O[@�;0H GSg�@_\A@C=�@CBbNPO¯j�j)u��(h'a�O N8DSD�#P2ÕNL=7U � lAl8o(' � %5uÉ>�\A`�[email protected]=!c�GSg�@c8>TDSab`!D�DF>�IA=7;2@bO[I:� ^�BS@fD(@C=0GED�N_abI8=!D(GSBS`!abG(>�IA=5�#g0> a�gZB�@fD(`0O�GED�>�=ZBS@C] Iy?8>�=�\�NPOQO4GSg�@�>�=0GS@CBS=!NPOc0@bO NPH�OQ>�=�@fDiKRB�IA] NL=qj�j)u��(h =�@CGs��IAB� NL=!c�B�@C^0O N8a�>[=�\�GSg�@C]Ä��>�GSgJNL=�>�=!abBS@fNAD(@fc =0`�]�;2@CB$ILK4c0@bOTNPH DIA=�GSg�@J=�@CG���IAB� Ó>�=�^�`�GEDCU�B�@fD(`0O�G(>�=�\ >�=9NX=r�·Y�j�j�=�@CG���IAB� n�#g0> a�g9abI8]_^�`�GS@fD�GSg�@ÓDSNL]_@�IA`�GS^�`�GKR`�=!abG(>�IA=�%

M$IA=!D·> c0@CB�NL=0H�=�I c0@�h >�=ZD(IA] @)j)j�u��·hy% h abIA] ^�`�GS@fD�N�K�`�=!abG(>�IA=JILK%>�GED�c8>[B�@fabG�>�=�^�`�GEDS%�VAIA] @ILK7GSg�@fD(@#>[=�^�`�GbD�abI8]_@�K�BSIA] GbNL^�^!@fc�c0@bOTNfHÒO¨>�=�@fD�NX=!c_D(IA]_@�NLBS@�GSg�@#>�]_]_@fc8>TNLGS@�IA`�GS^�`�GbD�ILK7@fNLB(OQ>�@CB=�I c0@fD�>�= G�g�@_=�@CG���I8B� w%�e�g�@�IA`�GS^�`�G�IXKj@fN8aSg @fNXB(OQ>[@CB�=�I�c0@_>�=ÕGSg�@�=�@CGs��IAB� ÆaCNL=n;2@q�#B(>�GSGS@C=�NADN KR`�=!abG(>�IA=ÓILK�GSg�@�=�@CG���IAB� �>�=�^�`�GEDkNLG�?yNLB(>�IA`!D,NX]_IA`�=0GED�IXK�c0@bO NPH/%Wgsu�I8BÜDF>�]_^0OQ>Ta�>�G(H ILK$=�IAGENXG(>�IA=7UÅÇÆ ä$ÈCùfí�É6í�Ê!ùPí�åPö�íCí�Ê�É7÷CúîëF÷�ë(í�Ëbä(ö�ð4æ�÷Pä�ëSõSð�ä�í�Ê!ð�÷fíbö�æ%úîùfåPïfæ-ð�æ�öwúîùfþbð�ÉÉ÷Cúîëp÷,êPí�ùfíbæ�Ìfìÿì!æ�÷Pä�êfäFì¨õ�Í�ÎfïSÏAä(ö�ð(ç%øTùæ�÷Cúîð-ë³õ�ð�äbèfúîæ�úîð4ùPíEæ7ëFìîäSõ�ö4æ�÷LõSæ7æ�÷Pä�øRâ ó-ó õ�ùfê ó-ó�Ð øRôJõ�ö�ëp÷®úîæ�ä·ë(æ�ïPö�ä·ð$õ�ö�ä�ä�ÑCïCú¨ËEõ³ìîä(ùCæ(ç

m

Page 5: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

>[=6GSg0>TD�c8>TDSab`!DSDF>�IA=Q��@���>QO¨O$NADSD³`�]_@�N�DF>�=�\LO�@�=�@CG���IAB� �>�=�^�`�G(%�e�g�@�NLBS\8`�]_@C=WG�>TD�@fNAD·>¨O�HJ@�º�GS@C=!DF>m;0O�@GSI�OTNLBS\A@CB,=0`�]R;!@CBED�ILK�>�=�^�`�GEDS%-in�ÖK#c�>TD,G�g�@=0`�]R;!@CBkILKjc0@bOTNPH D�I8= GSg�@�=�@CG���I8B� �>�=�^�`�G�GSg�@C= G�g�@KR`�=!abG(>�IA=�abIA]_^�`�GS@fc±;0HD(IA] @$@fNLB(OQ>�@CB$=�@CG���IAB� ,=�I�c0@AUÒ*-ULaCNL=R;!@Ó�#B(>�GSGS@C=N8D$Ô(Õ"g ¤

¥£ �(�0� £ ¤

¥ � ³ i�%Ôejg�@IA`�GS^�`�G�IXKjG�g�@q· ¥e¦ c0@bOTNPH ILK�GSg0>TD,=�I�c0@_>TDkGSg�@C=�Ô0Õ"g ¤

¥ � ´ £ �(�(� £ ¤¥ � ³ � ´ i�%��p= G�g�@�IAB³>[\X>[=!NyO�?A@CBED·>[I8=

ILKÜG�g�@J=�@CGs��IAB� �Ô0Õ"g ¤¥ � ´ £ �(�0� £ ¤

¥ � ³ � ´ i,>TD_abI8]_^�`�GS@fcr;0H�c0@bO NPH8>�=�\ GSg�@JI8`�GS^�`�G_ILK�=�I�c0@`*-U$;�`�GGSg�@�=�IAGbNLG(>�IA=J`!D(@fc�g�@CBS@k]�N: A@fD�>[G,a�O�@fNLB�GSg!NXG�GSg0>TD�K�`�=!abG(>�IA=ÓaCNL=ZNPOTD(I�;!@abI8]_^�`�GS@fc�;0HZNL^�^0O�HA>�=�\KR`�=!abG(>�IA=7Ô0Õ G�IN�c0@bOTNPHA@fcJD(@CG�ILK%>�=�^�`�GEDS%$�F=JGSg�@�=�@CG���IAB� %UAGSg0>TD�abIABSBS@fD³^!IA=!c�D�GSIk]�N: 8>[=�\_NL= @�ºüNAabGabIA^WH�ILKx*ÑNL=!cJNyO¨O-GSg�@,=�I c0@fD®U!c0@bOTNfH�D�NL=!c���@b>[\8gWGED�KR@C@fc8>�=�\ >[=0GSIq* NL=!cJDFOQ>Tc8>�=�\JGSg0>TD�D(`<;�=�@CG���IAB� c0I8�#=ÑGSg�@6>�=�^�`�GÆc0@bOTNPH�OQ>�=�@fDZD(IÕGSg!NLGJNPOQO�ILK,>�GED >�=�^�`�GEDJNLB�@Æc0@bOTNPHA@fc²;0Hr ÑG(>�]_@ D(GS@C^!Do% ejg0> DabIA=!D(GSBS`!abG³>[I8=7U�>�=Ó@�{7@fabGfU�BS@C^0OTNAab@fD�GSg�@�c0@bOTNPH�D�IA=JGSg�@�I8`�GS^�`�G�IXKÔ=�I�c0@�*l;0HZNAc�c8>�=�\�]_I8BS@c0@bOTNPH DIA=JGSg�@�=�@CG���IAB� Ò>[=�^�`�G0%

2 @�aCNL=6]�N: A@�N DF>�]�>QO NXB�GSBbNL=!DFK�IABS]�NLG³>[I8=�GSI�NPOQO4ILK�GSg�@�=�I�c0@fD"��g0>Ta�gZK�@C@fc�>�=0GSI_=�I�c0@h,UüGSgW`!DBS@C]_IL?A>�=�\JNPOQOÔB�@bO¨>TNL=!ab@�ILK�=�I�c0@Òh IA=ÓNL=WHJc8>�BS@fabG�>�=�^�`�GÜc0@bOTNPH�D�@�ºüab@C^�G#KRI8B�^!IWD�DF>m;0O[@�c8>[B�@fabG�>�=�^�`�Gc0@bO NPH�D�K�BSIA]'GSg�@,=�@CG���IAB� Ò>[=�^�`�GbDS%�ejg0> D#DSNL]_@�abIA=!D³GSBS`!abG(>�IA=ZaCNL=V;!@�NL^�^0OQ>�@fc6GSI�NL=0H_=�I�c0@,>�=ZG�g�@BS@fD(`0O�G(>�=�\�G�BENL=!DFK�IABS]_@fc�=�@CG���IAB� W��g0>TaSg5��>QOQO�@C?A@C=WG�`!NPOQO[HJB�@fD(`0O�G�>�=ZB�@C]_IL?yNPO7ILK$NPOQO7>�=WG�@CBS=!NPOÔc0@bOTNPH DKRBSI8]�GSg�@�=�@CG���IAB� �%4e�g�@Ój�j)u��(hÕ=�@CG���I8B� �>TD-GSgW`!D�a�g!NL=�\A@fc�>�=0GSIÜN#K�`�=!abG(>�IA=!NPOQO�H�@(XA`0>�?LNPO�@C=WG"�·Y�j�j=�@CGs��IAB� w%

�p=�GSg�@�=�@�º�GÔD³@fabG(>�IA=7U/��@�D³g�I8�ÕGSg!NLG-GSg�@"�·Y�j�jÕ=�@CG���IAB� �>TD�aCNL^!N:;0O�@�ILK¼B�@C^�BS@fD(@C=0G(>�=�\�N�D(`<;%a�OTNADSDILK�GSg�@tu�VÒhÓDS%Je�g�@ K�`�=!abG(>�IA=!NPO�@(X8`0>�?yNPO�@C=!ab@ÓILKÓ�·Y�j�j�D�NL=!c9j)j�u��·h#D��j>¨OQO�NPOQO�I:� `!DkGSI6@�º G�@C=!cGSg0>TD�BS@fD³`0O[G#GSI_GSg�@�j�j)u��(h�DS%

Ö �¸�Ó×�د ����y���������ÚÙv�> <ÛÜ�"�U�ÞÝ��"ßR���U�) ���Ø�×Qà ØÓ�����S���"�$á=~¾à à �$á�Ø���������`��â�

�p=1IABbc0@CB�GSIÕ`�=!c0@CBED(GbNL=!c GSg�@ÓBS@C^�BS@fD(@C=0GENLG(>�IA=!NyO�aCNL^!Nz;0>¨OQ>�G(>�@fDÓILK�G�g�@ãj�j�u��·h NLBEa�g0>�GS@fabGS`�BS@AUU��@c0@C?A@bO�IA^ÑNL=�NLBS\A`�]_@C=0G�;!N8D(@fcÕIA= GSg�@ZabI8=!ab@C^�GIXKÜD(@(X8`�@C=WG(>TNPO�]�N8aSg0>�=�@fDkK�BSIA]åä1p-V/��c0@fDF>�\A=�%QTD(@(XA`�@C=0G(>TNPO�]�NAa�g0>�=�@�>TDNX= >�]_^0O�@C]_@C=0GENLG(>�IA= ILK�N=!!=0>[G�@ZD(GENLGS@ ]�NAa�g0>[=�@Vgsu�VÒh¿i�>�=Ñc8>�\L>�GENPO�O�IA\L>TaNL=!c_c0@bOTNPH DU#¨4�IAg!NP?A>pU � ldæyq0'&%4ejg�@�D(@(X8`�@C=WG(>TNPO%]�NAa�g0>�=�@�K�IABS]�NyO¨>TD(] D³@C^!NLBENLGS@fD�abIA]R;0>�=!NLG(>�IA=!NPO�O�IA\L>TaKRBSI8] ]_@C] IABSHZ@bO�@C]_@C=0GEDS%±�p=ÕN�D(@(X8`�@C=0G(>TNPO�]�N8aSg0>�=�@k>�]_^0O�@C]_@C=WGbNLG(>�IA=ÕILK�NL=nu�VÒhÕU%GSg�@�]_@C]_IABSH@bO[@C] @C=WGED�abIA=0GENP>�= G�g�@�ab`�BSBS@C=0GD(GbNLGS@�ILK�GSg�@qu�VÒh9%-M$IA]R;0>�=!NLG(>�IA=!NyO$O�IA\L>Tak>TDk`!D(@fc GSIZc0@�!!=�@�G�g�@D(GENLGS@,G�BENL=!DF>�G(>�IA=!D�NX=!c�GSg�@�IA`�G�^�`�GED�ILKÔG�g�@�]�NAa�g0>�=�@/%

T�=qu�VÒh�>TD$DSNP>Tc GSI�;2@�ILK%>�=�^�`�GSn�IABEc0@CBÓ®�>QKî�>TD�GSg�@�O�@fNAD³G�>�=WG�@C\A@CB�D(`!aSg GSg!NLG$G�g�@�^�BS@fD(@C=0G�D(GbNLGS@ILK�GSg�@tu�VÒh+aCNX= NPOm��NfH�D�;2@ c0@CG�@CBS]�>�=�@fcÕ`�=0>eXA`�@bO�H KRBSI8] GSg�@� W=�I:��O�@fc0\A@�ILK�GSg�@�OTNAD³G�®6>�=�^�`�GEDS%VA`!aSgÑNL=çu�VÒhÕU���g�IWD(@ZD(GbNLGS@�c0@C^2@C=!c�D_IA=0O�HÕIA=ÑN=!<º @fcÕ=0`�]R;!@CB_IXK�BS@fab@C=0G�>�=�^�`�GED®U�>TD_aCNPOQO�@fcÑNC/A[Z"JL\^][A�aRA0a�EªF�M�aRH/bScÒ\^JLAyg·Y�hQh¿i�#¨4�IAg!NP?8>ÖU � ldæyq0U%M�g!NL^�GS@CB � ©z'&%

VL>�=!ab@�G�g�@�ab`�BSBS@C=0GD(GbNLGS@�ILKjNJY�hQh aCNL=n;2@ c0@CB(>�?A@fcÆKRBSI8] GSg�@_]_IWD³G,BS@fab@C=WGR®�>�=�^�`�GEDCU�NL=0HY�h`h�aCNL=�;!@�>�]_^0O�@C]_@C=0GS@fc�NAD�N,D(@(X8`�@C=WG(>TNPO!]�NAaSg0>�=�@Ó�#g�IWD(@�IA=0O�H�]_@C] IABSH�@bO�@C]_@C=0GED�NLBS@�GENL^�^2@fcc0@bO NPH�OQ>�=�@fD�IA=JGSg�@�>�=�^�`�G(%

�pGk>TD_NÓD(g�IAB�GÒD³GS@C^ K�BSIA] NÓD(@(X8`�@C=WG³> NyOj]�NAaSg0>�=�@�>[] ^0O[@C] @C=WGENXG(>�IA=�ILKÜNÓY�hQh+GSI NL=9�·Y�j�j>[] ^0O[@C] @C=WGENXG(>�IA=ÓILKiN Y�h`h9%<èL`!D(G#BS@C^0OTNAab@�GSg�@�abIA]R;0>�=!NLG(>�IA=!NPO7O�IA\X> aÜ>�=ZGSg�@�D(@(XA`�@C=0G(>TNPO4]�NAaSg0>�=�@��>�GSgZNkK�@C@fc KRIAB��jNXBEc_=�@C`�BbNPO4=�@CG���IAB� �%��ÖKÔG�g�@�>[=�^�`�GbD�NL=!c�I8`�GS^�`�GED�ILK$NL=5�·Y�j�j�NXBS@�abIA=!D(GSBbNP>�=�@fc

é

Page 6: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

Combinational

Logic

Finite Memory

(Delays)x t

u yt t

x t+1

uÉ>�\A`�BS@�o « T VA@(X8`�@C=WG(>TNPOxhÓNAa�g0>[=�@

NNet LogicCombinational Logic

Sequential Machine Input Delayed Neural Network

uÉ>�\A`�B�@,m « T�=WHJY�hQh aCNL=5;2@,>�]_^0O�@C]_@C=0GS@fcÓNAD�NL=5�(Y�j)jGSI � D�NL=!cV©AD>�·Y�j�j�D�>�]_^0O�@C]_@C=0G,@�º!NAabG(O�H�G�g�@�Y�h`hÓDS%�2 @,g!NP?A@�NyO[B�@fNAc0H D³@C@C=ZGSg!NLG�GSg�@�j�j�u��·hNL=!cR�·Y�j�j a�OTNADSD(@fD�NLBS@�K�`�=!abG(>�IA=!NPOQO�H�@(X8`0>�?yNPO�@C=0G(%�e�g0>TD->�]_^0OQ>�@fD�GSg!NLGxj�j)u��(h�Di>�]_^0O�@C]_@C=WG�Y�hQhÓDNAD"��@bOQO¼%

ê =�GSg�@�IAGSg�@CB-g!NL=!c%UP>QK7GSg�@�>�=�^�`�GED�NL=!ckIA`�GS^�`�GED-NLBS@�NPOQO�I:��@fckGSI�GEN: 8@$IA=kBS@fNPO�?yNPO�`�@fDCU8^�BSI/;0O�@C]�D=�IAG�B�@C^�BS@fD(@C=0GEN:;0O�@�;0HZNR!!=0>�GS@�D³GENLGS@�NL`�GSIA]�NXGEN_aCNL=V;!@�@�{7@fabG(>�?A@bO�HÆg!NX=!c8O[@fc�#P2 NL=7U � lAl8o('Ç%�VAG³>¨OQOpUGSg�@�!!=0>�GS@Jg0>TD(GSIABSHÕ]�NP>�=0GENP>�=�@fcr;0H GSg�@7j�j�u��·h�NLBbaSg0>�GS@fabGS`�B�@J^�BS@fa�O�`!c0@fD_GSg�@JB�@C^�BS@fD(@C=0GENLG(>�IA=�ILKD(IA]_@,BS@C\8`0O NXB�OTNL=�\A`!NX\A@fDS%Óu�I8B�@�ºüNX]_^0O�@AU!GSg�@�OTNL=�\8`!NL\A@ � ©dë�BS@(X8`0>�BS@fD�G�g!NLG�GSg�@�>[=0K�IABS]�NLG(>�IA=ZG�g!NLGN � g!NAD";!@C@C=ÓD(@C@C=ZG�I�;2@,]�NP>�=0GENP>�=�@fcZNAabB�IWDSD�N�^!I8GS@C=WG³> NyO¨O�H�>�=d!!=0>�GS@�=W`�]R;2@CB�ILKx©ADS%�e�g0>TDÓ 8>�=!cJILK>[=d!!=0>�GS@�g0>TD(GSI8BSH aCNX=�=�IAGÓ;!@k]�NP>�=0GENP>�=�@fc5;0H�G�g�@�GENL^�^2@fcZc0@bOTNPH_OQ>�=�@fD�ILK�GSg�@�j�j)u��(h�%

e�g�@��·Y�j�j�NXBEaSg0>�GS@fabG�`�BS@�>TD�Nk=!NLGS`�BENPO?!!G�K�IAB�GSg�@�^�B�I/;0O�@C]�ILK7>�=!c0`!a�>�=�\ZY�hQhÆDÔKRB�IA] O Nz;!@bO�@fc>[=�^�`�GÓD(GSB(>�=�\WDo%ì�p= GSg�@�KRIXO¨O�I:��>�=�\ÑD(@fabG(>�IA=7UU��@ÆD(`�^�^2IABSGJGSg0>TDJa�OTNP>�]Þ;WHÕO�@fNLB�=0>[=�\ N�.ª©LmWq D(GbNLGS@Y�h`hå��>�GSgZNX=5�·Y�j�j�%�p7NLGS@CBPUÒ��@�c8> D�ab`!DSD�G�g�@�;0> N8D�ILK�IAGSg�@CB#?yNLB(>TNLG³>[I8=!D�IA=JG�g�@�\A@C=�@CBENyO�j�j�u��·hNLBEa�g0>[G�@fabGS`�BS@/%

í

Page 7: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

î ït�"ØÓ���W�S��ðñØò×�ØU��ð)�å~óà à Û��� ��ô×S�� � �×���×���ð����N$@faCNX`!D(@�ILK�GSg�@�a�O�IWD(@kBS@bOTNLG(>�IA=!D(g0>�^Q;!@CG���@C@C=JGSg�@±�·Y�j�j�NLBbaSg0>�GS@fabGS`�B�@NL=!cJY�hQhÓDCU8>�G�>TD�^2IWDSDF>m;0O�@GSI_O�@fNLB�=ÆY�hQhÓD"��>�GSgÓ]�NL=0HZD(GENLG�@fD�`!DF>�=�\JGSg�@��(Y�j)j�NXBEaSg0>�GS@fabG�`�BS@/%Ó�F=ÆG�g0> D,D³@fabG(>�IA=7��@�^�B�@fD(@C=WGGSg�@,BS@fD(`0O�GED#ILK�O·`!D(G�D(`!aSgZNX=J@�º ^2@CB(>�]_@C=WG0%

e�g�@_]�NAaSg0>�=�@ O�@fNLBS=�@fc > D�N6Y�h`h�ILK�>�=�^�`�G�IABEc0@CB �ª� %��F=Ó>�GED�D(@(XA`�@C=0G(>TNPO�]�NAa�g0>[=�@ K�IABS]ZU�>[GabIABSBS@fD(^2IA=!c�D�GSI_G�g�@,O�IA\L>Ta�KR`�=!abG³>[I8=ÆIXK$@(XA`!NLG³>[I8= o�%Ó6�@CBS@kGSg�@_D(H0]�;2ILOöõ BS@C^�BS@fD³@C=WGED#GSg�@�>¨K�npNL=!c0nIA=0O�HWnw>QK$K�`�=!abG(>�IA=�%

� ´ �²¤ ´ ��� µ õ ¤ ´ ¤ ´ �L� ¤ ´ �L÷ ¹ ¤ ´ �L÷S¤ ´ �<ø ¹ ¤ ´ �L�(¤ ´ �L÷ g(odi

e�g�@�O[I8\L>TaJK�`�=!abG(>�IA=1N:;2Iy?8@5�jN8D_aSg�I0D(@C=1D(I GSg!NLGÒ>[GbD�]�>�=0>[]�NPOyu�VÒh BS@C^�BS@fD(@C=0GENLG(>�IA=l��IA`0OTcBS@(XA`0>�BS@�. ��� � ./©Lm0q_D(GENLG�@fDS%�2 @_c8> D�ab`!DSD,GSg�@_abIA=!c8>�G(>�IA=!D�=�@fab@fDSDSNLB�HJK�IAB�]Ò>[=0>�]�NyO¨>�G(HÓ>�=ÓGSg�@�=�@�º GD(@fabG(>�IA=7U�NL=!cÓ>�=�GSg�@JNL^�^2@C=!c8>|º�%�e�g�@JGSBENX=!DF>�G(>�IA=�c8>TNL\8BENL] KRI8BG�g�@�]�>�=0>�]�NPO�u�VÒh >TD�D(g�I:��= >�=!!\A`�BS@ é %

eÉI abBS@fNXGS@�GSBbNP>�=0>[=�\JNL=!c6GS@fD(G�D(@CGEDCU?��@�\A@C=�@CBENXGS@fcZNPOQO$D(GSB(>�=�\WD#ILK�O�@C=�\AGSg � GSI �/� U!mÒ©8lLm�>�= NPOQOÖUNL=!cÓOTN:;2@bO�@fc�GSg�@C]ò��>�GSgÑN � I8B�©Óc0@C^!@C=!c8>�=�\ÕIA=��#g�@CGSg�@CB�GSg�@ Y�hQhù��IA`0OTc�NAaCab@C^�G�IABkBS@�O·@fabGGSg�@C]7%lT GSB(>TNPOÜabIA=!D·> D³GS@fc�ILK�NÓBENX=!c0IA]�O�HÑaSg�I0D(@C=Ñ^2@CBEab@C=WGbNL\A@ZIXKÜGSg�@fD³@ÆD(GSB³>[=�\0D�IA=ç�#g0> a�gÑG�g�@=�@CGs��IAB� ���NAD�GSBENy>[=�@fc�G�I_GSg�@,@CBSBSI8B�abB(>�GS@CB(>�IA=Óc0@fDSabB(>m;!@fcV;!@bO�I:��%

e�g�@6=�@CGs��IAB� ÑNLBEa�g0>[G�@fabGS`�BS@ÆabI8=!DF>TD(GED�ILKNL=l�·Y�j�jú��>�GSg � © GENL^�^2@fc c0@bO NPH�D�IA=ÑG�g�@J>�=�^�`�G(%e�g�@Ó]`0O�G(>�nwOTNPHA@CBZ^2@CBEab@C^�GSBSI8=9^!NXBSGJILK�GSg�@ NLBEa�g0>�GS@fabGS`�BS@ abIA=0GENP>�=!DJD(@C?8@C=9g0>Tc�c0@C= =�I c0@fDJNX=!c9NDF>�=�\LO�@JIA`�GS^�`�G�=�I c0@/% d�NAa�g =�I c0@J`!D³@fD�G�g�@ D(GbNL=!c�NLBEcÕNAD(H0]_]_@CGSB³> a DF>�\A]_IL>TcÕ=�IA=0OQ>�=�@fNLB(>�G(H/%�uü`0O¨OabIA=�=�@fabG(>�IA=!DJNLBS@ZD³`�^�^0O¨>�@fc²;2@CG���@C@C= NPOQOÜc0@bOTNPH D=g�>�=!a�O�`!c8>[=�\ GSg�@Z`�=!c0@bOTNPHA@fc >�=�^�`�GSi_NL=!cÑNPOQO�G�g�@=�I c0@fD ILK�GSg�@Jg0>Tc�c0@C= OTNPHA@CB(%²p2>m A@S��>TD(@AU#GSg�@J=�@CG���I8B� �abI8=WGENy>[=!DÒK�`0O¨O,abIA=�=�@fabG(>�IA=!D�;!@CG���@C@C=ÑG�g�@g0> c�c0@C=6OTNPHA@CB�NL=!c�GSg�@,IA`�GS^�`�G0%

Y�`�B(>�=�\�GSBENP>�=0>�=�\7g(NL=!c�GS@fD(G(>�=�\<ibU<;!@bK�IABS@�>[=0GSBSI�c0`!abG(>�IA=ÓILK$N�=�@S��D(GSB(>�=�\!U�G�g�@�?yNyO[`�@fD#ILK�NPOQO4G�g�@c0@bO NPH�D"��@CBS@,D(@CG�GSI�©<% ê =0O¨>�=�@±;!NAa� ^�BSIA^!NL\WNXG(>�IA=`#éh�`�]_@bO�g!NLBSG�@CG�NPO&%�U � lAq í '���>�GSgJN�O�@fNLBS=0>�=�\�BbNLGS@ILK�©<%+. é NX=!c�] IA]_@C=0GS`�]�IXK�©<%¨. é ��NADÉ`!D(@fckK�IAB-GSBENP>�=0>�=�\L%$2 @b>�\Ag0G$c0@faCNPHq#¨4�B�IA\AgJNL=!c76#@CBSG�»AU � lAl/.0'��>�GSgÆNR��@b>�\Ag0G�c0@faCNPH�^!NXBENL]_@CGS@CB�ILKx©<%¨©ª©/© � ��NADj`!D(@fc�%

T D(@bO�@fabG(>�?A@J`�^%c�NLG(>�=�\ DSa�g�@C]_@5��NADkNL^�^0OQ>[@fc���g�@CBS@S;0Hn��@b>�\AgWGbD���@CBS@�`�^¼c�NXGS@fc >�=�NL=ÕIA=0OQ>�=�@KÖNAD³g0>[I8=7U<;�`�G�IA=0O�H�>QKÔG�g�@�N:;!D(ILO�`�GS@,@CBSB�IAB�IA=JGSg�@�ab`�B�BS@C=WG�GSBbNP>�=0>[=�\JDSNL] ^0O[@���NADj\ABS@fNLGS@CB�GSg!NX=t©<%+.<%e�g0>TD�@�{7@fabG(>�?A@bO�HÑD(^!@C@fc�D�`�^�G�g�@ NPO�\AI8B(>�GSg�]ñ;0H NP?AIL>Tc8>�=�\ \ABENAc8>�@C=0G_aCNPOTab`0O NXG(>�IA=!D�K�IAB_NL=0H D(GSB³>[=�\��g0>TaSgV��>QO¨O�BS@fD(`0O�G#>�=Z?A@CBSHJD(]�NyO¨O���@b>�\Ag0G�NAc0O(`!D(GS]_@C=0GEDS%

eÉBENP>�=0>�=�\`��NADkD(GSIA^�^2@fcn�#g�@C=�NPOQO�@�ºüNL] ^0O[@fD�>�=ÕGSg�@�G�BENP>�=0>�=�\ D³@CG�H8>[@bOTc0@fc NL= N:;!D(IXO[`�G�@�@CBSB�IABILK�O[@fD�D�G�g!NL=û©�%¨.<%��F= G�g0> Dk@�º�^!@CB(>�]_@C=0GfU�G�g0> D�O�@C?A@bO�ILK�NAaCab`�BEN8abH`��NAD�\A@C=�@CBENPOQO�H NAa�g0>�@C?A@fc >�=û.ª©/©@C^!I�aSg!D#IAB�K�@S��@CB(%$j�I_G�B(>TNPO4BS@(X8`0>�BS@fcJ]_I8BS@,GSg!NL=JmÒ©ª©/©k@C^!I�aSg!D#ILK�GSBENP>�=0>�=�\L%

uÉ>�\A`�BS@ í ^0O[I8GED�GSg�@ NP?A@CBENL\A@Za�OTNAD�DF>-!¼aCNLG(>�IA=1@CBSB�IAB�I8=9G�g�@ÆG�@fD(G(>�=�\�D³@CG�KRIAB�?yNXB(>�IA`!DJDF>m»C@fDJILKGSBENP>�=0>�=�\ D(@CGEDS%W2 @ aCNyO¨O�GSg0>TDk\A@C=�@CBENPOQ>m»fNLG(>�IA=Õ@CBSBSIAB±;!@faCNL`!D³@_>�G�B�@C^!IABSGbD,@CBSBSI8B�IA=0O�HÓIA= @�º!NL]_^0O�@fD=�IAG�D(@C@C= c0`�B(>�=�\ZGSBbNP>�=0>[=�\?%�uüIAB�^�`�B�^!IWD(@fD�ILK$GSg0>TD�\ABENX^�gÆG�g�@Òa�OTNAD�DF>-!¼aCNLG(>�IA=ÕILK$GSg�@�=�@CG���I8B� 5��NADabIA=!DF>Tc0@CBS@fcÓN � >¨K$G�g�@�=�@CG���IAB� �IA`�GS^�`�GÓ��NAD�\8BS@fNLGS@CB�G�g!NL=7©<% é U2NL=!cZN�©>¨K�IA`�GS^�`�GÓ��NAD�O[@fD�D�GSg!NX=

æ

Page 8: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

uÉ>�\A`�BS@ é�« eÉBENL=!D·>[G³>[I8=Æc8>TNL\ABENX]'KRI8B)./©LmWq�D(GbNLGS@�u�VÒhq

Page 9: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

10ü

20ü

30ü

Percent of total samples (4094) used in trainingý

0.0

0.2

0.4G

ener

aliz

atio

n E

rror

þ

Learning a Large FSM (2048 states)uÉ>�\A`�BS@ í<« ,�@C=�@CBENPOQ>m»fNLG(>�IA=ÓNAD�NkK�`�=!abG(>�IA=ZIXKÔGSBbNP>�=0>[=�\JD(@CG�D·>ÿ»C@kIA=JGSg�@�./©XmWq�D(GENLGS@�Y�hQh9%

IAB�@(X8`!NPO4G�It©<% é %�ejg�@CBS@bKRI8BS@AU¼NÒ?yNPO�`�@�ILKö©<% é IA=ZGSg�@k\ABENL^�g�>�=!c8> aCNXGS@fD,aSg!NX=!ab@^2@CB(K�IABS]�NL=!ab@/%�ejg�@?yNPO�`�@fD#^0O[I8GSGS@fc�g�@CBS@�NLB�@�Nf?8@CBENL\A@fc�NAabBSIWD�D�NyO¨O4D(G�B(>�=�\WD�>�=ZGSg�@,G�@fD(G�D(@CGfU�NL=!cJNAabBSI0DSD"./©kGSB(>TNPOTD�`!DF>�=�\c8>|{7@CBS@C=0G�BENL=!c0I8]�O�HÒa�g�IWD(@C=k>�=0>�G(>TNPOw��@b>�\Ag0G�^!NLBENL] @CGS@CBED-NL=!ckBENL=!c0IA]�O�H�aSg�IWD³@C=_GSBENP>�=0>�=�\�D(@CGEDo%Ôejg�@@CBSBSIAB�;!NLBbD�>�=!c8>TaCNLGS@�IA=�@_D(GENL=!c�NXBEcÓc0@C?A>TNLG(>�IA= IA=Ó@fNAaSg DF>Tc0@_IXK�GSg�@�]_@fNL= aCNPOTab`0OTNLGS@fcÕNAabBSI0DSD�G�g�@./©�GSB(>TNPOTDS%

�pG�>TDa�O�@fNLBkK�BSIA] GSg0>TD�!!\8`�BS@�G�g!NLG�GSg�@W�·Y�j�j >TDNz;0O[@�GSI�O[@fNXBS= G�g0> Dk^!NLB�G(>Tab`0O NXB�OTNLBS\A@�Y�hQhXA`0>�GS@�NAaCab`�BENLGS@bO�H�`!DF>�=�\�I8=0O[HJN_D(]�NPOQO4^!@CBEab@C=0GENL\8@,ILK4GSg�@,^2IAGS@C=0G(>TNPO7>�=�^�`�GÜD³GSB(>�=�\WDS%$6#I8��@C?A@CBPUWG�g�@O[I8\L>Ta,ILK4G�g�@ÜD(@(X8`�@C=0G(>TNPO4]�NAa�g0>�=�@,>�]_^0O�@C]_@C=0GENLG(>�IA=6ILK4GSg�@,Y�hQh >TD�NAabG�`!NPOQO[H7X8`0>�GS@�D(]�NyO¨O&§�=�I8GjNyO¨OILKÔG�g�@�>[=�^�`�GbDÓ��@CBS@,@C?A@C=6`!D(@fc��$�F=ZGSg0>TD�D(@C=!D(@,IA=�@�abIA`0OTc�>�=WG�@CBS^�BS@CG�GSg�@fD³@�BS@fD(`0O�GED#NAD";!@fD³GSnpaCNAD(@/%

� � ��� ~¾à à � ØÓ������ØÓ���S×��Þï5�"ØÓ����Øt×����� Ø�� �����`���pG�>TD#=�IAG�c8>� Jab`0O[G,G�I`�=!c0@CBbD(GENL=!c=��gWH�GSg�@��(Y�j)j >TD�N:;0O�@kGSIkO[@fNXBS=ÆN�OTNLBS\A@�Y�hQh >¨Kx��@,GSg0>�=< JILKGSg�@��(Y�j)j�NAD�N�D(@(XA`�@C=0G(>TNPO�]�NAa�g0>�=�@/%)uÉ>�BED(GfU O[@CG�`!D#O�IWIª ZNLG�GSg�@kGSBENL=!DF>�G(>�IA=Óc8>TNL\ABENL] ILK$N�Y�hQhNAD�>�]_^0O�@C]_@C=0GS@fcV;WHJN�D(@(XA`�@C=0G(>TNPO�]�NAa�g0>�=�@/%$�p=6GSg�@�D(@(X8`�@C=WG(>TNPO-]�NAa�g0>[=�@�>�]_^0O�@C]_@C=WGbNLG(>�IA=ÓILK4IA`�BY�h`hÕU0GSg�@�D(GbNLGS@�ILKÔG�g�@,]�NAa�g0>[=�@�>TD�@C=0G(>�BS@bO�HZc0@CGS@CBS]�>�=�@fcV;0H�GSg�@�abI8=WGS@C=0GED�ILK�GSg�@�>�=�^�`�G,GENL^�^2@fcc0@bO NPH�O¨>�=�@�NL=!ckGSg�@�ab`�BSBS@C=0G7>�=�^�`�G(%�e�g�@�GSBENL=!DF>�G(>�IA=_c8>TNL\ABbNL] >TD-@fDSD(@C=0G(>TNPOQO�HG�g!NLG7ILK!N�D³g0>¨K�G�BS@C\L>TD(G�@CB(%VA`!aSgÓN�GSBENL=!D·>[G³>[I8=Zc8> NX\ABENL]'>TD�aCNPOQO�@fcÆN c8>[B�@fabGS@fc5;0>�=!NLBSHZc0@(N�BS`0>PO(=Z\ABbNL^�gn#-,�IXO[I8]�;7U � l8q/.0'&%��������������������� �!�#"$�&%'�(�&)+*,�-��.�"�/����0*,"21�� 3'�54!"�.�687 e�g�@RC/\^FsA�b(][A�C:9o\eJ?H/F�MRC/A<;ÓF�Ád\ =SJ!>/F�H�ÀLcgpg�@C=!ab@bKRI8BSGSg�c0@(N�BS`0>PO(=_\ABENL^�g�i7IXK�c8>TNL]_@CGS@CBx®Ü>TD�GSg�@�\ABENX^�g��j>[G�gq. ³ =�I c0@fD�abIA=�=�@fabGS@fck>�=�N,D³^!@fa�>-!¼a

l

Page 10: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

000

001 011

111101010

100 110

uÉ>�\A`�BS@Ræ « ejg�@�Y�@(N$B�`0> O(=n,�BENL^�gJILK$Y#>TNL]_@CGS@CB�o^!NLGSGS@CBS=�%�d$N8aSg6=�I c0@�> D�=!NX]_@fc5��>�GSgÓN�`�=0>eXA`�@�D(GSB(>�=�\_ILKö®�©AD�NX=!c � DS%Ój#I�c0@:?A@ � @ ÷ @ ø �0�(�B@ ³DC> DÓabIA=�=�@fabG�@fc GSIÑ=�I�c0@E?F@ � @ ÷ �0�(�G@ ³ © C ��>�GSg�NL=�NLBEa6OTN:;2@bO�@fc ��>�GSg�Nç©�UkNL=!c1G�IÑ=�I�c0@H?@ � @ ÷ �0�(�B@ ³ � C �j>[G�gZNL=ZNLBEa#OTN:;2@bO[@fcã��>�GSgZN � %

e�g�@�G�BENL=!DF>�G(>�IA=�c8>TNL\8BENL] IXK�N�c0@(N�BS`0>PO(=�\8BENL^�g�>TD�abIA]_^0O�@CGS@bO�H�c0@CGS@CB�]�>�=�@fc�;0H_N�DF>�=�\LO�@#>[=0GS@C\A@CB^!NLBENL]_@CG�@CBfU�>�GEDJc8>TNL]_@CGS@CB(% e�g�@ c8> NX]_@CGS@CBZIXK�GSg�@ c0@(N$B�`0> O(=1\ABbNL^�g9NAD�D(I a�>TNLG�@fc²��>�GSg1N Y�hQh>[] ^0O[@C] @C=WGS@fcV��>�GSgJIÓc0@bOTNPH D�> D�IR¹ � %xuÉ>�\A`�BS@Ræ�D(g�I:��D�GSg�@�c0@(N�BS`0>PO(=Z\ABbNL^�g_K�IAB�NkGENX^�^!@fcZc0@bOTNPHO¨>�=�@R��>�GSgQ.c0@bOTNPH�DS%

T9c0@(N�BS`0>PO(=_\ABENX^�gÒc0@CG�@CBS]�>�=�@fD$N#GSBENL=!D·>[G³>[I8=Òc8>TNL\8BENL]7%$N�HNAD�DF>�\A=0>�=�\NAaCab@C^�G(>�=�\�NL=!cÒBS@�O·@fabG³>[=�\D(GENLGS@fD�GSIZG�g�@�=�I�c0@fDkILK�GSg�@�\8BENL^�g7U�N6=W`�]R;!@CB�ILK�Y�hQhÓD�aCNL=¿;!@J\A@C=�@CBENXGS@fc�%5�p=�G�g�@_^�BSI/;0O�@C]^�BS@fD(@C=0GS@fck>�=_GSg�@�^�BS@C?8>�IA`!D$D(@fabG³>[I8=7UAGSg�@�K�`�=!abG(>�IA=_G�g�@�=�@CG���IAB� ���NAD-B�@(XA`0>�BS@fc�G�I�O[@fNXBS=R�jN8D�aSg�IWD³@C=D(IZGSg!NXG�>[G±��IA`0OTcÓ]�NL^ I8=WGSIJNZc0@(N�BS`0>PO(= \8BENL^�g ILK�c8>TNL]_@CGS@CB �/� U4NX=!c NPOQO¯. ��� � ./©LmWqJD³GENLGS@fD�ILKGSg�@�c0@(N�BS`0>PO·=6\ABENL^�g5��IA`0OTc�;!@k=�@fab@fDSDSNLB�H�GSI�BS@C^�B�@fD(@C=WG#GSg�@�KR`�=!abG³>[I8=�%x�F=JIAGSg�@CBÓ��IABEc�D®UAGSg�@�./©XmWqD(GENLGS@�Y�hQh > Dj]�>�=0>[]�NPO&%

e�g�@ZabIA=!c8>�G(>�IA=l��g0>TaSg \A`!NLBENX=WGS@C@fDÒGSg�@J]�>�=0>�]�NPOQ>�G·H ILK�GSg0>TD�Y�hQh >TD�GSg!NLGÒKRIAB_NL=0HÕ^!NP>�B�ILK=�I c0@fDÜ>[= GSg�@_NADSD(I�a�>TNLGS@fcÓc0@(N�BS`0>PO·=Õ\ABENL^�gQ��g�I0D(@�=!NL]_@fD,NLBS@�>Tc0@C=WG(>TaCNPO�@�ºüab@C^�G�KRI8B�GSg�@ÒO[@bK�GS]_I0D(Gc8>[\X>[GPU!IA=�@,NL=!c�IA=0O�HJIA=�@,=�I�c0@,ILK4G�g0> D#^!NP>�B�>TD�NL=ZN8aCab@C^�G(>�=�\�D(GENLG�@/%Ôejg0> D�D(GENXGS@C]_@C=0G�>TD�^�B�@fD(@C=WG�@fcNAD�N�GSg�@CI8BS@C]'>�=ZGSg�@�NX^�^!@C=!c8>-º�U7NyO[I8=�\���>�GSg�>�GED#^�BSIWIXKD%

VL>�=!ab@�GSg�@CB�@�NLBS@ � ©kGENL^�^!@fc6c0@bOTNfH OQ>�=�@fD�NL=!cJN DF>�=�\LO�@ab`�BSBS@C=0G�>�=�^�`�GfU!G�g�@�NLBEa�g0>[G�@fabGS`�BS@,ILK4G�g�@�·Y�j�j > D-NPOTD(I�^�BS@fc0@CGS@CBS]Ò>[=�@fckGSI#>�]_^0O�@C]_@C=0G$N�c0@(N�BS`0>PO·=�\ABENX^�g�ILK!c8>TNL]_@CGS@CB �/� %-e�g�@�NLBbaSg0>�GS@fabGS`�B�@NL=!cÕGSg�@Z^�B�I/;0O�@C] GSIn;2@JO�@fNLBS=�@fc g!Nf?8@5;!@C@C=9a�g�IWD(@C=�G�I g!NP?A@�]�NLGEa�g0>[=�\ GSBENL=!DF>�G(>�IA= c8>TNL\ABENL]�DS%M$IA=!D(@(X8`�@C=WG³O[HAU2GSg�@��(Y�j)j�NLBbaSg0>�GS@fabGS`�B�@�c0IW@fD#=�IAG�g!NP?A@,GSI�O�@fNLBS=6GSg�@�D(GENXGS@�G�BENL=!DF>�G(>�IA=!D�NLG�NPOQO&%

�p=0>�G(>TNPOQ>m»b>�=�\9NPOQO�G�g�@Zc0@bO NPH�D_G�I`»C@CB�IWDR;!@bK�IABS@J@fN8aSg�^!NLG�GS@CBS=Õ>TD�^�BS@fD(@C=0GS@fc%U�NAD±��@Zc8>TcÕ>�=ÑG�g�@DF>�]`0OTNLG³>[I8=JILK4GSg�@�^�BS@C?8>[I8`!D�D³@fabG(>�IA=7U0>TD�@(XA`0>�?yNyO[@C=0G�GSI�!<º0>�=�\_GSg�@,D(GENLBSG�D(GENLG�@�ILK4GSg�@,Y�hQh GSI�G�g�@

� ©

Page 11: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

D(GENLGS@R��g�I0D(@_=!NL]_@Ò> DkNPOQOö»C@CBSI0DS%R�pG�> D�^!IWD�DF>m;0O[@JG�IZNPOQO[I:� GSg�@_=�@CG���IAB� ZG�I�O[@fNXBS= GSg�@�D³GENLBSG�D(GbNLGS@;WH�;!NAa� Wn�^�BSI8^!NL\WNLG(>�=�\_@CB�BSIAB�>�=WGSI GSg�@,GENL^�^2@fcZc0@bOTNPH�O¨>�=�@fDCU2GSg�@C=�>�=0>�G(>TNPOQ>m»b>T=�\ZGSg�@�c0@bOTNPH�DÓ��>�GSgJG�g�@NPO�GS@CBS@fc�?yNyO[`�@fDU;!@bK�IABS@,Nk=�@S�1^!NLGSG�@CBS=_>TD�^�B�@fD(@C=WG�@fc�%$�p=JGSg0>TD�^!NX^!@CBfU!NyO¨O7GSg�@,^�B�I/;0O�@C]�D�NLGSG�@C]_^�GS@fcaCNL=5;!@kBS@C^�BS@fD(@C=0GS@fc5;0HJN_Y�hQhú��>�GSgÓNR»C@CBSI�D(GbNLBSG�D(GENLG�@/%

d�?8@C=ZGSg�IA`�\8gÆ]�`!a�gZILK$G�g�@^�B�I/;0O�@C] BS@C^�BS@fD(@C=0GENLG(>�IA=6>TDU!<º�@fc7;0HJGSg�@R�·Y�j�j NXBEaSg0>�GS@fabG�`�BS@AU¼N]�NL^�^0>�=�\ÓK�BSIA] G�g�@ ab`�BSB�@C=WG_D(GENXGS@_GSI6GSg�@ abI8BSBS@fabG_NAaCab@C^�G(KfB�@�O·@fabG�IA`�GS^�`�Gk]�`!D(GR;!@ O[@fNXBS=�@fc�%Q�p=@fDSD(@C=!ab@AU0GSg�@�^�BSI/;0O�@C] ^�B�@fD(@C=WG�@fc�GSI�GSg�@�]�`0O�G(>�nwO NPHA@CB�=�@C`�BENPO!=�@CG���IAB� ,^2IABSG(>�IA=_IXK¼IA`�B$NLBbaSg0>�GS@fabGS`�B�@> D�GSg!NLG,ILK�O�@fNLBS=0>�=�\ÓGSg�@�O�IA\L>TakK�`�=!abG(>�IA=9��g0>TaSg ]�NL^!D�D(GbNLGS@�=W`�]R;2@CB,GSIJIA`�GS^�`�G(%�uüIAB,GSg�@�Y�hQh`!D(@fcÓ>�=ÕGSg0>TD,@�º�^!@CB(>�]_@C=0GfU-GSg�@ O�IA\L>TakK�`�=!abG(>�IA= >TD�NL^�^!NLB�@C=WG(O�H DF>�]_^0O�@�@C=�IA`�\AgÕGSg!NLG,GSg�@_=�@CG���IAB� g!NAD�OQ>�GSG(O�@�^�BSI/;0O�@C]�O�@fNLB�=0>[=�\ >�G�^2@CB(K�@fabG(O�H/%

j#IAG(>Tab@�G�g!NLGk>[Gk>TD_DF>�]_^0O�@JGSI�>�=!abBS@fNAD(@JGSg�@J=0`�]R;!@CB�ILKÜD³GENLGS@fDÜ>[=�G�g�@ Y�hQhù;0H aSg!NX=�\L>�=�\ NDF>�=�\LO�@_GS@CBS] ILK�G�g�@]�NL^�^0>�=�\�KR`�=!abG(>�IA=�%y�p=!D(GS@fN8cÓILK�O�@fNLBS=0>�=�\ZG�g�@�K�`�=!abG(>�IA=ÓILK$@(X8`!NLG(>�IA= o�NADU��@c8> c >�=ZGSg�@k^�BS@C?A>�IA`!D�D(@fabG(>�IA=7U���@�abI8`0O c�GSBENP>�=ZN�=�@CG���IAB� GSI�O�@fNLBS=6@(XA`!NLG³>[I8=JmL%

� ´ �²¤ ´ ��� µ õ ¤ ´ ¤ ´ �L� ¤ ´ �L÷ ¹ ¤ ´ �L÷S¤ ´ �<ø ¹ ¤ ´ �L�(¤ ´ �L÷ g(odi

� ´ �²¤ ´ ����� õ ¤ ´ ¤ ´ �L� ¤ ´ �L÷ ¹ ¤ ´ �L÷S¤ ´ �<ø ¹ ¤ ´ �L�(¤ ´ �L÷ gFm<ie�g0>TD�@(X8`!NLG(>�IA=k>TD->Tc0@C=0G(>TaCNPO7@�ºüab@C^�G�G�g!NLG->�G$BS@(X8`0>�BS@fD$NL=�@�º�GSBEN#>�=�^�`�G�c0@bOTNPHk>�=_GSg�@�=�@CG���IAB� �%7e7I

BS@C^�BS@fD(@C=0G�GSg0>TD�]�NAa�g0>�=�@,`!DF>�=�\�N�Y�h`h��j>¨OQO4B�@(XA`0>�BS@�Nk]�>�=0>�]�`�]�ILK4mÒ©8l í D(GbNLGS@fDCU8Gs�j> ab@�N8D$]�NL=WHNADkGSg�@�^�B�I/;0O�@C] ILK�GSg�@�OTNAD³GÒD³@fabG(>�IA=�%�VL>�=!ab@ZG�g�@�]�NX^�^0>[=�\ KR`�=!abG(>�IA=�g!N8D�@fD�D(@C=WG³> NyO¨O�H�GSg�@JDSNL] @KRIAB�] NAD�G�g�@�^�BSI/;0O�@C] ILK$GSg�@�@fNLB(OQ>�@CB�^�BSIª;0O[@C]6U���@R��IA`0OTc6@�º ^2@fabG�GSg�@±�·Y�j�j GSI�^2@CB(K�IABS] N:;!IA`�GNAD"��@bOQO4IA=JGSg0>TD#^�BSI/;0O�@C] N8D�>�G�c8>TcZI8=JGSg�@,@fNLB(OQ>�@CB,IA=�@/%$e�g0>TD�c0@C]_IA=!D(G�BENLGS@fD�GSg!NLG#GSg�@,=W`�]R;2@CB�ILKD(GENLGS@fDi>�=ZG�g�@Y�hQh >TD#=�IAG�N�\AI0I c�^�BS@fc8>TabGSI8B�ILK�GSg�@�c8>L ab`0O�G(HZILKÉO[@fNXBS=0>�=�\L%

M ït�"ØÓ���W�S��ðñØ �W��� t×��N ������ ��"�ù ��òØ ð��Ó�R�ö��Ø�×Q�����`��d$NLB(OQ>�@CB���@ÓD(g�I:��@fcÕGSg!NLG_GSg�@V�·Y�j�j NLBEa�g0>�GS@fabGS`�BS@ÓNL=!cÕGSg�@Z\8@C=�@CBENPO1j�j)u��(h NXBEaSg0>�GS@fabG�`�BS@ÆNLB�@KR`�=!abG(>�IA=!NyO¨O�HÓ@(X8`0>[?LNPO�@C=WG0%�e�g!NLG#GSg�@fD(@�G���I�NLBbaSg0>�GS@fabGS`�B�@fD�NLB�@�aCNL^!N:;0O�@�ILK¯F�ADÀwF�ASfSA(JL][\^JO>�GSg�@�DSNL] @a�O N8DSD�ILK-KR`�=!abG³>[I8=!D�c0I0@fD�=�IAG�>�]_^0O�HZGSg!NXG�G�g�@,Gs��I�NLBEa�g0>[G�@fabGS`�BS@fD�NLB�@,@(XA`!NPOQO�HZaCNL^!N:;0O�@kILK¯K-A�H/F�JL\^JO>GSg�@ÆDSNX]_@ZD(@CG�ILK�K�`�=!abG(>�IA=!DS% �p= GSg0>TD�NL=!c GSg�@JK�ILOQO�I:��>�=�\ÑD(@fabG(>�IA=!DCU"��@J^�BS@fD(@C=0G�IA`�B_>�=0GS`0>�G(>�IA=!DN:;!IA`�G���g!NLG� 8>[=!c�D�IXK,KR`�=!abG(>�IA=!D�@fN8aSg NLBEa�g0>[G�@fabGS`�BS@Ó]�NPH�;2@Ó\AIWI�cÑNXG_O�@fNLBS=0>�=�\L%¬2 @Ó^�BSIL?8>Tc0@D(`�^�^!IAB�G7K�IAB%GSg�@fD(@�abIA=:O·@fabG�`�BS@fD�;0H,BS`�=�=0>�=�\ÜDF>�]�`0OTNLG(>�IA=!DÉIA=abI8]_^!NLBEN:;0O�H0npDF>m»C@fc��(Y�j)j�NL=!c�j�j�u��·hNLBEa�g0>[G�@fabGS`�BS@fDS%

d$N8aSg_IXK¼GSg�@,NLBEa�g0>�GS@fabGS`�BS@fD���@#`!D(@�>�=�GSg�@�K�ILOQO�I8�j>[=�\_DF>�]�`0OTNLG(>�IA=!D�abIA=0GENP>�=!D$NkDF>�=�\LO�@�>�=�^�`�GjNX=!cND·>[=�\XO[@,I8`�GS^�`�G(%�e�g�@��·Y�j�j1NLBEa�g0>�GS@fabGS`�BS@,abIA=0GENP>�=!D�D(@C?A@C= >[=�^�`�G�c0@bO NPH�DCU�NL=!c Gs��Ikg0> c�c0@C=�OTNPHA@CBED@fNAaSgR��>�GSgkK�IA`�B�`�=0>�GEDS%$p2>m A@�G�g�@ö�(Y�j)j NLBEa�g0>�GS@fabGS`�BS@AULGSg�@Ój�j)u��(hÑNLBbaSg0>�GS@fabGS`�B�@jNyO D³I�abIA=WGbNP>�=!D7G���Ig0> c�c0@C= O NPHA@CBbDCU!G�g�IA`�\AgJ>�=ÓGSg�@�j�j)u��(h�NLBEa�g0>[G�@fabGS`�BS@AU2@fNAaSg6g0>Tc�c0@C= OTNPHA@CB�g!NAD�I8=0O[H6GSg�BS@C@k=�I c0@fDS%e�g�@1j�j�u��·h NLBEa�g0>�GS@fabGS`�BS@�abI8=WGENy>[=!DÔKRI8`�B�>�=�^�`�G�c0@bOTNPH D�NL=!c_G�g�BS@C@�c0@bOTNPH D�IA=_G�g�@�IA`�GS^�`�GEDiILK7@fNAa�g=�I c0@kILKÔG�g�@�!!BED(G�g0>Tc�c0@C=6OTNfH8@CB(%xuÉ>�\A`�BS@�qk>QOQO�`!D(GSBENXGS@fD�G�g�@,Gs��I_NLBEa�g0>�GS@fabGS`�BS@fDo%

�ª�

Page 12: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

NNFIR Architecture IDNN Architecture

uÉ>�\A`�BS@�q « T�BEa�g0>�GS@fabGS`�BS@fD�<�D(@fc >[=Ód�º�^!@CB(>�]_@C=0GEDj#IAGS@JGSg!NLGÒ>[= @fNAa�g9NXBEaSg0>�GS@fabG�`�BS@AU�GSg�@JIA`�GS^�`�G�=�I�c0@ÆabIA]_^�`�G�@fD�N KR`�=!abG³>[I8=ÑILK,GSg�@Æab`�B�BS@C=WG

>[=�^�`�GÓNPO�IA=�\ç�j>[G�g D³@C?A@C= >�=�^�`�GÆc0@bOTNPH Do%¸T#OTD(I!U�@fNAa�g NXBEaSg0>�GS@fabG�`�BS@ abIA=0GENP>�=!D K�IA`�B�OTNfH8@CBEDCU�NX=!cNL^�^�BSI0ºW>�]�NXGS@bO�HJGSg�@�DSNL]_@,=0`�]R;!@CB�IXKÃ��@b>�\Ag0GED�g é mk>�=ZG�g�@�j)j�u��·h,U%NL=!c é .>[=6GSg�@��·Y�j�jyi�%PRQGS T UWV�X�Y[Z\Y[]5X2U�^UWV�_�UW`badc�e[c$_�U�fgV�_�Z\hWikj\l�]�Z\hm_�U�X�fHcê `�B->[=0GS`0>�G(>�IA=�D³`�\A\A@fD(GEDÉGSg!NLG-GSg�@�\A@C=�@CBENPOLj)j�u��·h�NXBEaSg0>�GS@fabG�`�BS@�]�NPH�;!@";!@CGSG�@CB$NLG%O�@fNLBS=0>�=�\Y�hQh^�BSI/;0O�@C]�Di>�=q��g0>Ta�gJGSg�@�K�`�=!abG(>�IA=���g0>TaSg�]�NL^!D�D(GENXGS@�=W`�]R;!@CBbD$G�I�NAaCab@C^�G(>�=�\�NL=!c�B�@�O·@fabG(>�=�\_D(GENXGS@fDabIA=WGbNP>�=!D�GS@CBS]�DU��g0>TaSg BS@C^!@fNLG,NAabBSI0DSD�G³>[] @/%�e�g0>TD�>�=0GS`0>�G(>�IA= abIA]_@fDjK�BSIA] ?A>�@S��>�=�\Z@fN8aSgÓ=�I�c0@�>�=GSg�@�!!BED(G_g0>Tc�c0@C= O NPHA@CB ILKÜG�g�@7j)j�u��·h�NXBEaSg0>�GS@fabG�`�BS@ZNAD_c0@C?A@bO�IA^0>�=�\�N6K�@fNLGS`�BS@Zc0@CGS@fabG�IABR��g0>TaSgO[I0I/ �D�KRIAB_N6D(^!@fa�>-!¼aJ^!NXGSGS@CBS=Ó>�=Õ>�GED�>�=�^�`�G���>�=!c0I:��c0`�B(>�=�\ BS@fab@C=0GG³>[] @/%ÆY�`�B(>�=�\Ó^�BS@fD(@C=0GENLG³>[I8=ILK�N_D(GSB³>[=�\2U¼NkK�@fNLGS`�B�@�c0@CGS@fabGSIAB#>�=ÆG�g�@�!!BED(G�g0> c�c0@C=6OTNPHA@CB#> D�N:;0O�@�GSI�c0@CGS@fabG�GSg0>TD�DSNL]_@kBS@C^!@fNLG�@fc^!NLGSGS@CBS=6>�= NL=0HZG³>[] @���>�=!c0I:��%�pÉNLGS@CB�OTNPHA@CBED�aCNX= abI8]�;0>�=�@_G�g�@_IA`�GS^�`�GED�IXKjNPOQO$GSg�@fD(@±!!BED³G�O NPHA@CBKR@fNLG�`�BS@_c0@CGS@fabGSIABED,N8abBSIWDSD�N O�IA=�\A@CB��j>[=!c0I:��ILK�G(>�]_@R;!@faCNL`!D³@_GSg�@CHÓg!NP?A@NAaCab@fD�D,GSI�GSg�@�IA`�GS^�`�GEDILKÔG�g�@�KR@fNLG�`�BS@�c0@CGS@fabGSIABbD�NLG�N�=0`�]�;2@CB�IXKic0@bOTNPH Do%

eÉI�GS@fD³G�GSg0>TD�gWH0^!IAG�g�@fDF>TDCU���@BbNL=ÆNJD(@CB³>[@fD�IXK�DF>�]`0OTNLG³>[I8=!D���g0>Ta�g abIA=0GSBENAD(G#GSg�@�^!@CB(K�IABS]�NX=!ab@ILK�NL=n�·Y�j�j'=�@CG���IAB� V��>�GSg�NX=�j)j�u��·h =�@CG���IAB� �>[=ÕO�@fNLB�=0>[=�\ N6Y�h`h c0@�!!=�@fc9;0H N�]�NL^�^0>�=�\KR`�=!abG(>�IA=¿��>�GSgZBS@C^2@fNLGS@fc6GS@CBS]�DS%,e�g�@�]�NX^�^0>[=�\�KR`�=!abG³>[I8=ZK�IAB�GSg�@D³^!@fa�>-!¼a_^�B�I/;0O�@C]ú��@�aSg�I0D(@�GSIGS@fD(G�>TD#\L>�?A@C=�>�=Z@(X8`!NLG(>�IA= é %

� ´ �²¤ ´ �on õ ¤ ´ ¤ ´ �L÷ ¤ ´ �<ø ¹ ¤ ´ �L�(¤ ´ �<ø ¤ ´ �0p ¹ ¤ ´ �L÷(¤ ´ �0p ¤ ´ ��q ¹ ¤ ´ �<ø(¤ ´ ��q ¤ ´ �0r g é ie�g0>TD�K�`�=!abG(>�IA=�abIA=0GENP>�=!D�GSg�@�DSNX]_@�GS@CBS] K�IA`�B,G(>�]_@fD®U4D(g0>QK�GS@fcÓ>�= G³>[] @/%qu�I8B,GSg0>TD,BS@fNAD³IA=7U���@

aCNPOQOjG�g0> D�O�IA\L>TamsCD(H�D(GS@C]�NXG(>Ta(t<%Je�g�@_K�`�=!abG(>�IA=Õg!NAD�;2@C@C=ÑaSg�I0D(@C= G�IJ]_@C@CG�GSg�@�abIA=!c8>�G(>�IA=!D�IXKjG�g�@

� .

Page 13: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

GSg�@CIABS@C] ^�BS@fD(@C=0GS@fcÓ>�=ÕGSg�@�NL^�^2@C=!c8>-º�U>��g0>TaSgÕ\A`!NLBbNL=WG�@C@fD�GSg!NLG�. é/í D(GENLG�@fD�NLBS@ BS@(XA`0>�BS@fc >�= G�g�@]�>�=0>[]�NPO1u�VÒh BS@C^�BS@fD³@C=WGENXG(>�IA=�%Æejg�BSIA`�\AgÕBS`�=�=0>�=�\ ]�NL=0H DF>�]�`0O NXG(>�IA=!DCU>��@ g!Nf?8@q;2@C@C=ÑN:;0O�@JGSI!!=!c�NkD(@CG$ILK���@b>[\8gWGED���g0>TaSg�^�BSI�c0`!ab@fD�GSg0>TD�K�`�=!abG(>�IA=!NPO�;!@Cg!NP?8>[I8B$>�=�@fNAa�g_ILK7GSg�@�NLBbaSg0>�GS@fabGS`�B�@fDCU�D(I��@� 0=�I:�1GSg!NLG�GSg0>TDjKR`�=!abG³>[I8=J>TD�B�@C^�BS@fD(@C=0GEN:;0O�@�;0Hq;2IAGSgJGSg�@��(Y�j)j�NX=!c5j)j�u��·h NLBEa�g0>�GS@fabGS`�BS@fDS%

e�g�@_G�BENP>�=0>�=�\Z]_@CGSg�I�c `!D(@fc6K�IAB,GSg�@��(Y�j)j'=�@CG���IAB� V��NAD#>Tc0@C=WG(>TaCNPO�GSIZG�g�@�DF>�]�`0O NXG(>�IA= ^�B�@CnD(@C=WG�@fc_@fNLB³O¨>�@CB�@�º!ab@C^�G�GSBENP>�=0>�=�\R��NAD$D(G�IA^�^!@fcJNPK�GS@CBUæ8©/©/©�@C^2I a�g!D�@C?A@C= >QK4^!@CB(K�@fabG�^!@CB(K�IABS]�NL=!ab@�I8=GSg�@�G�BENP>�=0>�=�\ÒD³@CGx��NAD-=�IAG�NAaSg0>�@C?A@fc�%�e�g0>TD$@fNXB(O�H�D(GSIA^�^0>�=�\k>TD�=�@fab@fDSDSNLBSH�GSI�NP?AIL>Tck>�=d!!=0>�GS@,GSBENP>�=0>�=�\��g�@C=ÆN_D³`<;!IA^�G(>�]�NyO7O�I aCNPO-]�>�=0>[]�`�] g!NAD¯;!@C@C=ZB�@fNAaSg�@fc�%

eÉBENP>�=0>�=�\_K�IAB�GSg�@�j�j�u��·h NLBEa�g0>[G�@fabGS`�BS@,>TD�D·O¨>�\Ag0G(O�HZ] IABS@�abIA]_^0OQ>TaCNLGS@fc�%�d�B�BSIAB�KRB�IA]�GSg�@�!!=!NPOIA`�GS^�`�G�]�`!D(Gx;2@,^�BSIA^!NL\WNXGS@fcR;!NAa� Ò��NLBbc�D$NAabBSI0DSD�GSg�@#>�=WG�@CBS=!NPO¼GbNL^�^!@fcJc0@bOTNPH�OQ>�=�@fDS%�ejg0> D�>[=0?AILO�?A@fD^�BSIA^!NL\WNXG(>�=�\G�g�@�@CBSB�IAB�K�BSIA]'GSg�@U!!=!NPO7IA`�GS^�`�G";!NAa� _GSIk@fNAaSgJc0@bOTNPH_>�=JGSg�@#>�=WGS@CB�=!NPO7GENL^�^!@fcJc0@bOTNPHO¨>�=�@AU�G�g�@C= D(g0>QKRG³>[=�\ÓGSg�@�BS@fD(`0O�G(>�=�\Q;�`d{7@CB�ILK�@CBSBSIABbD�IA=�@ D³GS@C^n;!NAa� Ò��NLBbc�D#KRIAB,@fN8aSg @fNXB(OQ>[@CBk>�=�^�`�GD(GS@C^�%$2 g�@C=ÆNX=J@CBSBSIAB�?yNyO[`�@�BS@fN8aSg�@fD�G�g�@�;!@C\X>[=�=0>�=�\JILK�GSg�@�;�`d{7@CB�>�G,D(@CBS?A@fD�N8D�GSg�@,@CBSBSI8B$K�IAB�G�g�@=�I c0@Ó�#g0> a�g_c0B(>�?A@fD-GSg�@�NADSD³I a�>TNLGS@fc�c0@bOTNPH,OQ>�=�@/%�VA@C@�#P2ÕNL=7U � lAlAo0'0K�IABÔN�c0@CGENP>QO�@fc_c0@fDSabB³>[^�G³>[I8=�ILK!G�g�@\A@C=�@CBENPO$NPO�\AIAB(>�GSg�]V%�2 >[G�gÆG�g�@@�º!ab@C^�G(>�IA= IXK$GSg�@_c8>|{7@CBS@C=!ab@ ILK�GSg0>TD�]_I8BS@abIA] ^0O¨>TaCNLG�@fcÓGSBENP>�=0>�=�\]_@CGSg�I�c%U!NPOQOÔc0@CGENP>QOTD�ILK4G�g�@�j�j)u��(h GSBENP>�=0>�=�\���@CB�@�> c0@C=0G(>TaCNPO�GSI_GSg!NXG�IXKÔGSg�@��(Y�j)j G�BENP>�=0>�=�\L%

e�g�@�BS@fD(`0O�GED�IXK�GSg�@JDF>�]`0OTNLG³>[I8=9NLBS@�^�BS@fD(@C=0GS@fc >�=9!!\A`�BS@Jl<%n*ÔO[I8GSGS@fcÕ^!IX>[=0GED_NXBS@�G�g�@�]_@fNX=a�O N8DSDF>-!¼aCNLG(>�IA=J@CBSB�IAB�K�IAB$G�g�@Ó�·Y�j�j1NL=!c�j)j�u��·h NLBbaSg0>�GS@fabGS`�B�@fD$NP?A@CBENL\8@fc_NAabBSIWD�Dx./©�GSB³> NyO D�NLG�@fNAa�gGSBENP>�=0>�=�\�D(@CG�DF>m»C@/%$e�g�@,] @fNL=�^2@CB(K�IABS]�NL=!ab@�ILK4G�g�@1j�j)u��(h1NLBEa�g0>�GS@fabGS`�BS@�N8abBSIWDSDiGSg�@�@C=0G(>�BS@�ab`�BS?8@> D�DF>�\A=0>-!¼aCNL=0G(O�H�;2@CGSGS@CB$G�g!NL=_GSg!NLG�IXK¼GSg�@Ó�(Y�j)j NLBbaSg0>�GS@fabGS`�B�@ÜNAD�D³g�I8�#=�;WH_N�G���IAn[��NPH�NL=!NPO�H D·> D�ILK?yNLB(>TNL=!ab@RgÇT1j ê ä�T±i¯#éh�>Tab@AU � l8qAq0'�gBuwvyx{z�| ¦ � ©<�¨. æfmWl�U�u}vy~�zBz��\z � ©<�¨©/©ª.dæWU��±g � £ m é/í i � � © � �ÿmÒ.dæ0U¢ ? ©��¨©/© � i ÷ %�e�g0>TD�BS@fD(`0O�G_D(`�^�^!IAB�GED�IA`�B�g0H0^!IAGSg�@fD·> DkGSg!NXG,GSg�@_\A@C=�@CBENyOöj)j�u��·h NLBEa�g0>[G�@fabGS`�BS@ > D;!@CGSGS@CBJNLGkO�@fNLBS=0>�=�\ÑN Y�hQh ��g�IWD(@J]�NL^�^0>�=�\ K�`�=!abG(>�IA=1abIA=0GENP>�=!D�BS@C^2@fNLGS@fc�G�@CBS]�DS%çuüBSIA] G�g�@\ABENL^�g7U0GSg�@,D(@C^!NLBENXG(>�IA=_>TD�@fD³^!@fa�>TNPOQO�HJ^�BSIA=�IA`�=!ab@fc K�IAB�OTNLBS\A@�GSBENP>�=0>�=�\�D(@CG�DF>m»C@/%x6#I:��@C?A@CBfULK�IAB�?A@CBSHD(]�NPOQO4GSBbNP>�=0>[=�\JD(@CG�D·>ÿ»C@fD®U�>�G�NL^�^2@fNLBED�G�g!NLG�GSg�@,G���I_NLBEa�g0>[G�@fabGS`�BS@fD�^2@CB(KRI8BS] N:;2IA`�G�GSg�@�DSNL]_@/%PRQ�� T UWV�X�Y[Z\Y[]5V�YwUW���[V�j c$_�VW_�U������ �JZ-_'�wY�l�Y��(c$e[c$_'UWfHVW_�ZGhJj\l�]�Z\hJ_�UWX�fHce7I ^�B�Iy?8>Tc0@�KR`�B�GSg�@CB�@C?A>Tc0@C=!ab@AU"��@JBENL=�N DF>�]�>QOTNLB�DF>�]�`0OTNLG(>�IA= abIA=WG�BENAD(G(>�=�\ÓGSg�@J^2@CB(KRI8BS]�NL=!ab@JILKGSg�@�G���I�NLBEa�g0>�GS@fabGS`�BS@fDi>�=�O�@fNLBS=0>�=�\_N�Y�h`hó��g�IWD³@�]�NX^�^0>[=�\kK�`�=!abG(>�IA=Zc0I0@fD$=�I8G�abIA=0GENP>�=JabIA=WGbNP>�=BS@C^!@fNLG�@fc�GS@CBS]�D�;�`�G�g!N8D$G�g�@ÜDSNX]_@�=0`�]R;!@CB�ILKÃ. é/í D(GbNLGS@fDS%�2 @,aCNPOQO7GSg0>TD�O�IA\L>Ta,sÌ=�IA=�npD(H�D(GS@C]�NLG³> a(t;!@faCNL`!D(@Ò>[G�OTNAa� �D�BS@C^!@fNLG�@fcÓGS@CBS]�Do%Üejg�@]�NL^�^0>�=�\JK�`�=!abG(>�IA=6KRIAB,G�g0> D�^�B�I/;0O�@C] > D�\L>�?A@C=6>�= @(XA`!NXnG(>�IA= í %

� ´ ��¤ ´ ��n õ ¤ ´ ¤ ´ �L÷ ¤ ´ � ø ¹ ¤ ´ �L� ¤ ´ �&p ¤ ´ �0r ¹ ¤ ´ �<ø(¤ ´ �0p ¤ ´ �&r g í ie�g�@�NLBEa�g0>�GS@fabGS`�BS@fD�NX=!c�G�BENP>�=0>�=�\�]_@CGSg�I�c�D-`!D(@fc�>�=_GSg0>TD�DF>�]�`0OTNLG(>�IA=���@CBS@�>Tc0@C=WG³> aCNyO¼GSI�GSg�IWD(@�ILK�������B����� õ�ùfê �J����������� õ�ö�ä�æeÉ%í-úîùPêfä(åLä·ùPêfä(ùCæ�ä(ð�æwú¨��õSæ�ä(ð7í�ÊWæ�÷fä�ËEõ�öwú¨õSùPë(ä$í�Ê æ�÷Pä4êLõSæpõ®çy�-ùfä-ä(ð�æwú¨��õSæ�äbè �����B�����ö�äpìÿúîä(ð�íbù�æ�÷Pä$ùCï®ìÿì!÷SÍCåyíbæ�÷fä(ðwúîð(è0æ�÷yõ�æ7æ�÷fä(ö�ä-úîð-ùfí�äÇÏAä(ë·æÉí�Ê!æ�÷Pä$êCúPÏAä(ö�ä(ùfë(ä�úîù�õSö�ëF÷Cúîæ�ä(ë(æ�ïfö�ä(ð-íEù,æ�÷Pä�ä·ö�ö�íbö-öpõSæ�äbç��7÷PäíEæ�÷Pä·öÉä·ð�æwú¨��õ�æ�äbè ��� ��������� èCúîð%úîùPêfä(åLä(ùfêfä(ùCæ�í�Ê æ�÷®úîðÔõ�ð�ð�ï(��åPæwúîíEù8ç¼ø Ê æ�÷Pä�ùCïCìÿì�÷SÍCåLíEæ�÷Pä·ðwúîð-úîðÉæ�ö�ïfäbèfæ�÷fä(ù���èfæ�÷fä-öpõ�æwúîíÎyä(æ^É%ä·ä(ù�æ�÷fä(ð�ä�æ^ɼí�ä(ð�æwú¨�jõ�æ�ä(ð(èfúîðÉä��CåLä(ë(æ�ä(ê,æ�íxÎLä�ëFìîíEð�ä�æ�í�bç��4ð2úîæ7ð�æpõ�ùfêPð(èyíbïfö �7Ëbõ(ìîïPä�úîð���ïfëp÷�þbö�ä³õ�æ�ä(ö7æ�÷yõ�ùD�Eç�7÷fä�åfö�í�Îyõ�ÎCúÿìÿúîæ^Íí�Ê!þbä·æ�æwúîùPþÜõ�ù��nËEõ³ìîïfä�æ�÷Cúîð-ì¨õ�ö�þEäbè/É7÷Pä(ù,æ�÷fä$ùCï®ìÿì!÷SÍCåLíEæ�÷Pä·ðwúîðiúîð4æ�ö�ïPäbèLúîð4þ�ú¨ËEä(ù±ÎSÍ¢¡8ç�áÌúîùfë(ä�æ�÷Cúîðåfö�í�Îyõ�ÎCúÿìÿú¨æ^Í�úîð-ð[�jõ³ìÿì�è/É%ä$õSö�ä���ïPð�æwúPÌyä(ê�úîù,ö�ä^�Rä(ë(æwúîùfþ#æ�÷fä�ùCïCìÿì!÷SÍCåLíbæ�÷fä(ðwúîð(ç

� o

Page 14: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

20ü

40ü

60ü

Percent of total samples (510) used in trainingý

0.0

0.2

0.4G

ener

aliz

atio

n E

rror

þ

Logic with 4 Systematic Terms (256 states)£

2 Hidden Layer IDNN¤2 Hidden Layer NNFIR

uÉ>[\8`�BS@�l « ,�@C=�@CBbNPOQ>ÿ»fNXG(>�IA= ^2@CB(K�IABS]�NL=!ab@�ILK�N�\A@C=�@CBbNPOöj)j�u��·h NL=!c NL=Q�(Y�j)j IA= NJD(H�D(GS@C]�NXG(>Ta^�BSI/;0O�@C]GSg�@$^�BS@C?8>�IA`!D-DF>�]`0OTNLG³>[I8=�%$e�g�@$B�@fD(`0O�GED4NXBS@�^�BS@fD(@C=0GS@fc�>�=±!!\A`�BS@ � ©<%�6#@CBS@x��@$D(@C@�GSg!NLG7@C?8@C=�GSg�IA`�\8gGSg�@�^2@CB(K�IABS]�NL=!ab@ ILK�GSg�@�G���IJ=�@CG���IAB� �D#> Dk?A@CB�H D·>[]Ò>¨OTNLBPU�GSg�@��(Y�j)j'=�@CG���IAB� 6IA`�GS^2@CB(KRI8BS]�D,G�g�@j)j�u��·h =�@CG���IAB� �NLG�@C?A@CBSH_GS@fD³G�^2IL>�=WG0%$e�g�@�c8>-{7@CBS@C=!ab@,>TD�>�=!c0@C@fcZD·>[\8=0>|!¼aCNX=WG±g�u}vyx�z�| ¦ � ©<�¨© æ � æWUuwvy~-zBz¥�\z � ©<�¨©/© �0í U��±g � £ m é/í i � m é �-æ é o�U ¢ ?Ü©<�¨©ª© � i�%�e�g0>TD�D(`�\A\8@fD(GED#GSg!NLG,GSg�@R�·Y�j�j�=�@CG���IAB� g!NAD4N�DFOQ>�\Ag0G$NAc0?yNL=0GENL\8@$IL?A@CB-GSg�@öj�j)u��(hÕ=�@CG���I8B� �I8=�GSg�@fD(@" 8>�=!c�D-ILK!^�BSI/;0O�@C]�D���>�GSg�I8`�G�BS@C^!@fNLG�@fcGS@CBS]�DS%PRQ�¦ T UWV�X�Y[Z\Y[]��JZ\`[U§jGl�]¨ZGhm_�U�X2fHcT�=�IAG�g�@CB�gWH0^!I8GSg�@fDF>TD�>TD�G�g!NLG�GSg�@�j)j�u��·h NLBEa�g0>[G�@fabGS`�BS@�c0I0@fDÓ��@bOQO7IA=0O�H5��>�GSgJ]�NL^�^0>�=�\�K�`�=!abG(>�IA=!D>[=¿��g0>TaSg @fN8aSgÓGS@CBS] >TD,aCNL^!Nz;0O[@ ILKx!!GSG³>[=�\�>�= G�g�@�>�=�^�`�G���>�=!c0I:��ILKjN�DF>�=�\LO�@W!!BED(G�OTNPHA@CB�K�@fNLGS`�B�@c0@CGS@fabGSIAB(%W��K�G�g0> D�gWH0^!I8GSg�@fDF>TD�> DkGSB�`�@AU���@���IA`0OTc @�º�^!@fabGkGSg�@5j)j�u��·h NLBEa�g0>[G�@fabGS`�BS@�GSIJ^!@CB(K�IABS]^!I0IAB(O�H IA= N�^�B�I/;0O�@C] >�=9��g0>TaSg GSg�@_]�NL^�^0>�=�\6K�`�=!abG(>�IA= g!N8cQ��>Tc0@�B�@C^!@fNLGS@fc GS@CBS]�DS%W2 @_BENX= N!!=!NPOÔDF>�]�`0OTNLG(>�IA=ZI8=�O(`!D(G�D(`!a�gZNk^�BSI/;0O�@C]7%�e�g�@,]�NL^�^0>�=�\�K�`�=!abG(>�IA=�KRIAB�GSg0>TD�^�B�I/;0O�@C]�>TD�\L>�?A@C=�>�=@(XA`!NLG³>[I8=næÒ%

� ´ ��¤ ´ �0r õ ¤ ´ ¤ ´ �L÷ ¤ ´ � ø ¹ ¤ ´ �L�S¤ ´ � ø ¤ ´ �0p ¹ ¤ ´ �L÷S¤ ´ �0p ¤ ´ �oq g�æ/i2 @$c0@bO�@CGS@fckG���I$>�=�^�`�G�c0@bOTNfH�D�KRBSI8]1GSg�@xj�j)u��(h NLBbaSg0>�GS@fabGS`�B�@$`!D(@fcÜ>[=kGSg�@$@fNXB(OQ>[@CB-@�º�^!@CB(>�]_@C=0GED

NPO�IA=�\R��>�GSg�G�g�@�NADSD(I�a�>TNLGS@fc�abIA=�=�@fabG(>�IA=!D�GSIkGSg�@Ó!!BbD(G$g0>Tc�c0@C=�OTNPHA@CB(%�e�g0>TD�=!NLBSBSI:��>�=�\�IXK4GSg�@�>�=�^�`�G��>�=!c0I8����NADkc0IA=�@�G�IZ]�N: 8@ D(`�B�@_GSg!NLGk=�IÆG�@CBS] ILK�GSg�@�]�NL^�^0>�=�\ZK�`�=!abG(>�IA=r��IA`0OTcã!!G,>�=WG�IÆG�g�@� m

Page 15: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

20©

40©

60©

Percent of total samples (510) used in trainingª

0.0

0.2

0.4G

ener

aliz

atio

n E

rror

«

Logic with 3 Non-Systematic Terms (256 states)

2 Hidden Layer IDNN¬2 Hidden Layer NNFIR

uÉ>[\8`�BS@ � © « ,�@C=�@CBENPOQ>m»fNLG(>�IA=�^2@CB(K�IABS]�NL=!ab@�IXK N \A@C=�@CBENPOqj�j)u��(h NL=!c�NL=¬�·Y�j�j I8= NÑ=�I8=�nD(H D³GS@C]�NLG(>Ta�^�BSIª;0O[@C]>[=�^�`�GR��>�=!c0I:�'ILK�NL=0HÆIXKjG�g�@R!!BED(G�O NPHA@CB�KR@fNXGS`�BS@�c0@CGS@fabG�IABEDS%JeÉIJ>�=!D(`�BS@�GSg!NLG,GSg�@�=�@CG���IAB� Zg!N8cDF>�]`0O�GENX=�@CIA`!D�N8aCab@fDSD_G�IÓ>�=0KRIAB�]�NLG(>�IA=ÕK�BSIA] NX=�@C=WG(>�BS@ÓD(GSB(>�=�\ÕILK�O[@C=�\8GSg9D(@C?8@C=7U�GSg�@J]�N0º0>�]`�]O[@C=�\8GSgJILK4N�D(G�B(>�=�\�>�=JGSg�@#GSBENP>�=0>�=�\�D(@CGfUª��@ÜNAc�c0@fc IA=�@#>�=WGS@CB�=!NPO�c0@bOTNPH_K�IAB�@fNAaSgk!!BED(G�OTNfH8@CB$g0>Tc�c0@C=`�=0>[G0%�e�g�@�BS@fD(`0O�G(>�=�\ÆNXBEaSg0>�GS@fabG�`�BS@�g!NAc6G���I_>�=�^�`�G�c0@bOTNPH D®U2KRIA`�B#>�=WG�@CBS=!NPO�c0@bOTNPH D,NPK�GS@CB�@fNAa�g5!!BED(GO NPHA@CB#g0> c�c0@C=Ó`�=0>�GfU%NL=!cJN�GSI8GENPO7ILK é æ±��@b>�\Ag0GEDS%

VL>�]�>QOTNLB(O�HAUx��@�D³g�IABSGS@C=�@fc GSg�@ >[=�^�`�G�GENX^�^!@fcÕc0@bO NPHÓOQ>�=�@ZI8= GSg�@��·Y�j�j NXBEaSg0>�GS@fabG�`�BS@/% VL>�=!ab@GSg�@�@C=0G(>�BS@�]�NL^�^0>�=�\ÓK�`�=!abG(>�IA=�abIA=WGbNP>�=!D�I8=0O[H�D(@C?A@C=�abIA=0G(>�\A`�IA`!D�?yNLB(>TN:;0O�@fDCU�GSg�@�IAB(>�\L>�=!NPOÓ�·Y�j�jNLBEa�g0>[G�@fabGS`�BS@,abIA=WGbNP>�=�@fc�Ny!!=!NPO7c0@bO NPH�@bO�@C]_@C=WG�GSg!NXGx��IA`0OTc_=�@C?8@CBö;2@�`!D³@fc�%$e�g�@�BS@fD(`0O�G(>�=�\��·Y�j�jNLBEa�g0>[G�@fabGS`�BS@,g!NAc�DF>-º�>�=�^�`�G�c0@bOTNPH�DS%$2 @,NAc�c0@fcJN�DF>�=�\LO�@�=�I�c0@�>�=JGSg�@Ó!!BbD(G�g0> c�c0@C=�OTNfH8@CB�G�I�;�B(>�=�\GSg�@,GSIAGENyO�=0`�]R;!@CB�ILK���@b>�\Ag0GED�>�=ZGSg�@k=�@CG���I8B� _GSI é l<%

j#IAGS@_GSg!NXG@fN8aSgÕGS@CBS] >[=�G�g�@�]�NX^�^0>[=�\ KR`�=!abG(>�IA=ÑabIL?A@CBbD�N6BENL=�\A@ ILK�>�=�^�`�G�>�GS@C]�DkILK)�j> c0G�gKRIA`�BPUÒ�#g�@CBS@fNAD�GSg�@�!!BbD(G�O NPHA@CB#=�I c0@fD�IXK4GSg�@�j�j)u��(h�NLBbaSg0>�GS@fabGS`�B�@�D(@C@,IA=0O�H�G�g�BS@C@�>�=�^�`�G�>�GS@C]�D#NLGN�G(>�]_@/%$e�g0`!D�GSg�@�>�=�^�`�G)��>�=!c0I:�1ILK�GSg�@�j�j)u��(h�NXBEaSg0>�GS@fabG�`�BS@c0I0@fD�=�IAG�abIL?A@CB�NL=J@C=WG³>[B�@,GS@CBS]7%

uÉ>�\A`�BS@ �/� D³g�I8��D�GSg�@k^!@CB(K�IABS]�NL=!ab@�ILK$GSg�@�G���I�NLBbaSg0>�GS@fabGS`�B�@fD�IA=ZGSg0>TD�^�BSIª;0O[@C]V%Üejg�@�\ABENX^�gD(g�I:��D�GSg!NLG,GSg�@W�·Y�j�j =�@CG���IAB� Óc0IW@fDy;!@CGSG�@CB�GSg!NL=ÓGSg�@�j)j�u��·hâ��>�GSg D(]�NyO¨O�GSBENP>�=0>�=�\ÆD³@CGEDCU�;�`�GGSg�@qj�j)u��(h NXBEaSg0>�GS@fabG�`�BS@ c0I0@fD�;2@CGSGS@CB±��>�GSg OTNLB�\A@_GSBENy>[=0>�=�\ D(@CGEDo%�e�g�@�c8>-{7@CBS@C=!ab@5;2@CGs��@C@C= G�g�@Gs��I ab`�B�?A@fD >TD�=�IAGZDF>�\A=0>-!¼aCNL=0GQg�uwv x�z�| ¦ � ©<�¨©/© íªé U¢u}v ~-z�z��\z � ©<�¨©/©ª.Aq�U��±g � £ m é/í i � .<�éoLmWo�U¢� ©�� � . í ibU�;�`�G�GSg�@ >[=0GS@CBEN8abG(>�IA=r;!@CG���@C@C= G�g�@ NLBbaSg0>�GS@fabGS`�B�@�KÖNAabG�IABNL=!c GSg�@JGSBbNP>�=0>[=�\ D(@CG_DF>m»C@

KÖNAabG�IAB�> D�DF>�\A=0>-!¼aCNL=0G�gBuwvyx{z�| ¦�­¯® �L° ~ � ©<�¨©ª© é l�U¯�±g �/� £ m é/í i � .<� � o/©üU¢� ©<�¨© � æªi�%

j#IAGS@�GSg!NXG�G�g�@1j�j)u��(h1NLBEa�g0>�GS@fabGS`�BS@,c0I0@fD$=�I8G�^2@CB(K�IABS]�NAD>��@bO¨O%>�=�GSg0>TD�@�º ^2@CB(>�]_@C=0G�NADi>�Gjc8>Tc�0é

Page 16: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

20ü

40ü

60ü

Percent of total samples (254) used in trainingý

0.0

0.2

0.4G

ener

aliz

atio

n E

rror

þ

Logic with 3 Wide Terms (128 states)

2 Hidden Layer IDNN¤2 Hidden Layer NNFIR

uÉ>[\8`�BS@ �/�/« ,�@C=�@CBbNPOQ>ÿ»fNXG(>�IA=_^!@CB³KRIAB�]�NL=!ab@�ILK¼N#\A@C=�@CBENPOLj)j�u��·h�NX=!cNX=��(Y�j)jÕI8=ÒNU��>Tc0@�^�BSI/;0O�@C]>[=ÕGSg�@�@fNLB(OQ>�@CB�@�º ^2@CB(>�]_@C=0G���>�GSgÓK�IA`�BkBS@C^!@CG(>�G(>�?A@ GS@CBS]�D#>�=9��g0>TaSg G�g�@�>�=�^�`�G��j>[=!c0I:� ��NAD#OTNLBS\8@@C=�IA`�\Ag�GSI abIL?A@CB_NL=�@C=0G(>�BS@JGS@CBS]ùg[!!\A`�B�@Zldi�%n�ÖK1�j>[=!c0I:� D·>ÿ»C@Jg!N8cÕ=�I @�{7@fabGI8=�^!@CB(K�IABS]�NX=!ab@��@W��I8`0O c @�º ^2@fabG�GSg�@_^�B�I/;0O�@C] �j>[G�gÓKR@S��@CB,GS@CB�]�D,GSIJ^2@CB(K�IABS]ú;!@CG�GS@CB(%��F=!D(GS@fNAcã��@�D(@C@_^!I0IABS@CB^!@CB(K�IABS]�NX=!ab@,>�=ÓGSg�@�^�BSIª;0O[@C]ú�j>[G�gJK�@S��@CB#GS@CBS]�DS%�ejg0> Dj>TD�]_IWD(GjO¨>m A@bO�H c0`�@�G�I_GSg�@,KpNAabG�GSg!NLG�G�g�@DF>m»C@�ILK7N�GS@CBS] >TD$�j> c0@CB�GSg!NX=G�g�@)j)j�u��·h�>�=�^�`�Gö�j>[=!c0I:��%�e�g�@�c0@fabBS@C]_@C=0G�>�=_^!@CB³KRIAB�]�NL=!ab@�NPO�IA=�\��>�GSgZGSg�@�DF>�]�>QOTNLB(>�G(HJ>�=Z^2@CB(KRI8BS]�NL=!ab@kILK$GSg�@�j�j)u��(h�NL=!c5�(Y�j)j =�@CG���IAB� �D�IA=ZGSg0>TD#GENAD� >�]_^0OQ>�@fDGSg!NLG�GSg�@�j�j�u��·h NLBEa�g0>[G�@fabGS`�BS@�>TD�>�=!c0@C@fcÓD(@C=!DF>�G(>�?A@kGSI_GSg�@�>�=�^�`�G���>�=!c0I:�Ü��>Tc0GSg�%

± ²ì���R�"×S�������y���e�g0>TDÓ��IAB� JD(@CBS?8@fD�NAD�NkK�IL>QO�GSI�D(IA] @,^!IAGS@C=0G(>TNPO4]Ò> D�abIA=!ab@C^�G(>�IA=!D,abIA=!ab@CBS=0>�=�\�OTNL=�\A`!NX\A@�>�=!c0`!abG(>�IA=`!DF>�=�\_=�@C`�BENPO%=�@CGs��IAB� DS%�uÉ>�BED(GfUª��@�g!NP?A@�^�BS@fa�>TD(@bO�HJc0@�!!=�@fc�GSg�@,D(`<;¼a�OTNADSDjILK�!!=0>[G�@�D(GENLGS@�]�N8aSg0>�=�@fD��g0>TaSg aCNX=n;!@�>�=!c0`!ab@fc¿;WHÓGSg�@�j�j)u��(h NLBbaSg0>�GS@fabGS`�B�@/%_e�g0>TD�a�OTNADSD#>TD,G�g�@�c0@�!!=0>�GS@�] @C]_IABSHJ]�NXnaSg0>�=�@fDS%�2 @_g!NP?A@�D(g�I:��=Ó=�IAG�IA=0O�HÓGSg!NLGkGSg�@_=�@CG���IAB� ZNLBbaSg0>�GS@fabGS`�B�@_>TD�aCNX^!N:;0O�@�ILK�BS@C^�BS@fD(@C=0G(>�=�\GSg�@�OTNL=�\8`!NL\A@fD�>�=JGSg0>TD�a�OTNADSD®UÒ;�`�G�GSg!NXG¯j�j�u��·h�D�NXBS@ÜaCNX^!N:;0O�@,ILK7O�@fNLBS=0>�=�\�OTNL=�\A`!NX\A@fD�ILK4GSg0>TD�a�OTNADSD`!DF>�=�\�GSg�@,G�BENAc8>�G(>�IA=!NPO�;!N8a� �^�BSIA^!NL\0NLG(>�IA=�O�@fNLBS=0>�=�\JNPO�\AIAB(>�GSg�]7%

VA@fabIA=!c%U�G�g�@q��IAB� D(g�I:��D�GSg!NLG�D(IA]_@R!!=0>�GS@ZD³GENLGS@_]�NAaSg0>�=�@fD�aCNL=9;!@�O�@fNLBS=�@fcÕ`!D·>[=�\ N KR@C@fc0nKRIAB��jNXBEck=�@C`�BENPO!=�@CG���IAB� �%4e�g0>TD->TD�abIA=0GSBENLB�H,GSI,GSg�@�=�IAB�]�NPO!^�BENAabG³> ab@#ILK¼`!DF>�=�\�BS@fab`�BSB�@C=WG�=�@CG���IAB� �D>[=ÕGSg0>TD,B�ILO�@/%_e�g�@�a�OTNADSD�ILK�=�@CG���IAB� �D�O�@fNLB�=!N:;0O�@�`!DF>�=�\6GSg�@qj�j)u��(h NLBEa�g0>�GS@fabGS`�BS@Ò> D�=�IAG�OQ>�]�>�GS@fcGSIR!!=0>�GS@kO�@C=�\AGSg D(GSB(>�=�\WD®UL;�`�G#>�=!a�O[`!c0@fD�]�NAa�g0>�=�@fD���g�IWD(@kGSBENL=!DF>�G(>�IA=Óc8>TNL\ABENL]�D�g!NP?A@,O�I0IA^!DS%�ejg0> DabIA=WG�BENAc8>TabGED_N6=!NLGS`�BbNPO�>[=0GS`0>�G(>�IA=²��g0>Ta�gÑ@(X8`!NLGS@fD�O�IWIA^!DÒ>�=ÑGSg�@7u�VÒh GSBENL=!D·>[G³>[I8=Ñc8> NX\ABENL]ñ�j>[G�g

�0í

Page 17: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

BS@fab`�BSBS@C=0G�O�IWI8^!D�>�=ZG�g�@,=�@CGs��IAB� �NLBEa�g0>�GS@fabGS`�BS@/%e�g0>�BEc%U�G�g�@���I8B� _c0@C]_IA=!D(GSBbNLGS@fD�GSg!NLG�GSg�@,=0`�]R;!@CB�ILK�D(GENLGS@fDi>�=ÆNX=tu�VÒh >TD�=�IAG�=�@fab@fDSDSNXB(>QO[HZN

\AIWI�ck^�BS@fc8>TabGSIAB�ILK!GSg�@�O�@fNLBS=!Nz;0>¨OQ>�G(H�ILK!>�GED�NAaCab@C^�G�@fckOTNL=�\A`!NL\A@/%�2 @�NLB�@jNz;0O[@#GSI�O�@fNLB�=�N�./©LmWqXnpD(GENLGS@u�VÒh �j>[G�gZN_DF>�]_^0O�@kKR@C@fc0nwK�IAB���NLBEcJNXBEaSg0>�GS@fabG�`�BS@,`!DF>�=�\_K�@S�1GSBbNP>�=0>[=�\�@�º!NL]_^0O�@fDS%�e�g0>TD�>TD�^2IWDSDF>m;0O�@;!@faCNL`!D(@AU���@Æa�g�IWD(@ N OTNL=�\A`!NL\A@V��g0>TaSg aCNL=ç;2@ÆB�@C^�BS@fD(@C=0GS@fc >[= >[GbD�D(@(X8`�@C=0G(>TNPO�BS@C^�BS@fD(@C=0GENLG³>[I8=`!DF>�=�\ÒN,D³]�NPOQO�NL] IA`�=WG�IXK¼O�IA\X> a:%��p=_IA`�B�@�ºüNX]_^0O�@AUWG�g�@�DF>m»C@�ILK7GSg�@�O�IA\X> ajK�`�=!abG(>�IA=�NL^�^2@fNLBED�G�I�g!NP?A@]_IABS@k>�=¯³!`�@C=!ab@JGSg!NL=ÓGSg�@_=0`�]R;!@CBkILKjD(GbNLGS@fD#>�= c0@CGS@CBS]Ò>[=0>�=�\ÓGSg�@�c8>L ab`0O�G(HÓILK�G�g�@�OTNL=�\A`!NL\A@ GSI;!@,O�@fNLB�=�@fc�%

u�I8`�BSGSg7UÓ��@6>�=W?8@fD(G(>�\WNLGS@fc GSg�@Ó`�G(>QOQ>�G(H9IXK�>�=WG�@CBS=!NPOc0@bOTNPHÑOQ>�=�@fDZNX=!c KRI8`�=!cÑG�g�@C]+`!D(@bKR`0O,>�=c0@fNPOQ>[=�\R��>�GSgJN#OTNL=�\A`!NL\8@�\A@C=�@CBbNLGS@fckK�BSIA] abIA]R;0>�=0>�=�\±!<º @fc0nwO�@C=�\AGSg7UüBS@C^!@CG(>�G(>�?A@,abIA=!D(G³>[G�`�@C=WGEDo%�2 @NPOTD(IkKRIA`�=!c GSg�@)j�j�u��·h ^!@CB(K�IABS]�NL=!ab@�G�Ic0@C\ABEN8c0@)��g�@C=�GSg�IWD³@�abIA=!D(G(>�GS`�@C=0GED�@�º!ab@C@fc0@fc�GSg�@)�j> c0G�gILKÔG�g�@�>[=�^�`�G���>�=!c0I:��%

� à �S���(NñØ�×��s 0�µ´¬���"�)���N�����������������¶����IW·�¸�"$��1�6[¹òT�=7J<I�>/F�E/ÁoÀ�>TD$N,D³@CG�ILK4NPOQO!GSg�@).»º,=�I�c0@fD->�=JN,c0@(N$B�`0> O(=�\ABENL^�gR��g�IWD³@=!NL]_@fD,NLBS@_NPOQO->Tc0@C=WG(>TaCNPO�>�= GSg�@�B(>�\Ag0GS]_IWD(G�®R°�IÕc8>�\L>�GEDCU���g�@CBS@�®�>TD�GSg�@�=0`�]�;2@CB�ILK�c8>�\L>�GEDÜ>�= N=�I c0@k=!NL]_@/%¼��W½5½¶.¶¾A¿m@"@SE/F�A�H/bSc � IÀ>ªF�E/ÁSÀç\^J�]^cdA,>ªFsHBÀLc�Á)E/J?AqHªJLCQE/JLK-M5E/J?AqED@k]^cdA±À H/\^FRE�@qJLE0C/ASfR\eJ9]^cÒA>/F�E/ÁoÀã\ f1HªJ7H/b�b�ADÀw][\^JO>RfS][H/][A<ÁÃ]^cÒA0J7H/J?M�][G$E�JLE(CªASfdÁy@9H/JLC � ÁxG�cÒ\^bSc5H/F�A�C/\ fS][\eJ?b(]$aRA(aÂ9�A(F�f1E�@�H/JI�I�>/F�E/ÁoÀ�ÁÓH/F�ARC/\mfS][\^JO>/Ád\ f�cÒH¯9SK-AÄÃÅÆ"$�����ǹò2 @���>QO¨O�^�BSIL?A@,GSg0>TD";0H�>�=!c0`!abG(>�IA=ÓIA=JI�%*Æ.�È<�:%».�È<�yÉ�I � � ¹µ@_NL=!c � NLBS@�c8>TD(G(>�=!abG$] @C]�;2@CBED-ILK¼N � n�\ABSI8`�^�%4e�g�@�G���IÜD(GbNLGS@fD�>[=_N � n�\8BSIA`�^NLBS@�c8>TD(G(>�=�\A`0>TD(g!N:;0O�@�;WH�GSg�@k@C]_^�G(H D(G�B(>�=�\ DF>�=!ab@±;WHJGSg�@,^�B�@C]�>TD(@�IA=�@�>TD�NL=ÓNAaCab@C^�G(>�=�\JD(GENLGS@�NX=!cIA=�@�>TD�N�B�@�O·@fabG(>�=�\JD(GENLG�@/%Ê$��)81�%'���Ë�¨�¶Ìy�(�06�¹ e�g�@�>�=!c0`!abG(>�IA=�g0HW^2IAGSg�@fDF>TDÉ>TD7G�g!NLG4NPOQO�g�I$° � ipn�\ABSIA`�^!DÉNLBS@�c8>TD(G³>[=�\8`0> D³g!N:;0O�@/%¢@NL=!c � NLB�@�c8>TD(G(>�=!abG�]_@C]R;!@CBbD7ILK¼NX=,I2n�\ABSIA`�^�%���K�@�NL=!c � NLBS@$NyO D³I�]_@C]R;2@CBED7IXK¼D(IA]_@Ug�Ix° � iFn�\ABSIA`�^7UGSg�@C= GSg�@CHÓNLBS@c8>TD(G³>[=�\8`0> D³g!N:;0O�@ZNL=!cV��@_NLB�@Òc0I8=�@��j>[G�g GSg�@�^�BSI0ILK³U%D(IZNAD�D(`�]_@Â@ NL=!c � NXBS@�=�IAG]_@C]R;!@CBED�ILK4NL=0H�g�I�° � iFn�\ABSIA`�^�%-<�=!c0@CB�GSg�@fD(@,NADSD³`�]_^�G(>�IA=!DCU8GSg�@�B³>[\8gWGS] IWD(Gx®Ó°!IJc8>�\L>�GED�IXK�G�g�@b>[B=!NL]_@fD,NLBS@�>Tc0@C=WG(>TaCNPOpU�;�`�G,GSg�@k=�@�º G,B(>�\Ag0GS]_I0D(GÜc8>�\L>�G�>TD,=�I8G�gpI8B�GSg�@CHV��IA`0OTc7;2@�]_@C]R;!@CBED�ILK�NX=g�I$° � ipn�\ABSIA`�^�i�%4e�g�@�=!NL]_@fD�ILKy@�NL=!c � NLBS@AUPGSg�@CBS@bK�IABS@AUPILK�GSg�@�K�IABS]b?+@ � �0�(�G@ º �L� @ º @ º»Í � �(�(�B@ ³kCNL=!c�? � � �0�(� � º ��� @ º @ º»Í � �(�(�\@ ³ C BS@fD(^2@fabG(>�?A@bO�H/%�e�g�@k>�=�^�`�G_D(GSB(>�=�\!U�©üU���>QO¨O�GEN: A@�GSg�@C] B�@fD(^!@fabnG(>�?A@bO�H�>�=0GSID³GENLGS@fD�?5@ ÷ �0�(�B@ º �L� @ º @ ºÄÍ � �(�0��@ ³ © C NL=!c!? �8÷ �0�(� � º �L� @ º @ ºÄÍ � �0�(�B@ ³ © C �#g0> a�g�NLB�@c8> D³G(>�=!abG�]_@C]R;!@CBEDiILK4N�DF>�=�\LO�@Rg�I±° � ipn�\AB�IA`�^�%�N�H_GSg�@j>[=!c0`!abG³>[I8=JgWH0^!IAG�g�@fDF>TD�G���I,] @C]�;2@CBED�IXKÉNX=g�I5° � ipn�\AB�IA`�^ÆNLB�@Òc8>TD(G³>[=�\8`0> D³g!N:;0O�@/%�e�g�@CBS@bK�IABS@kGSg�@CBS@�@�º0> D³GED,D(IA]_@_D(G�B(>�=�\�Î G�g!NLGÜc8>TD(G³>[=�\8`0> D³g�@fDGSg�@C]7%$e�g�@�D³GSB(>�=�\t©ÄÎû��>QOQO�GSg�@C=Æc8>TD(G(>�=�\A`0>TD(gQ;2@CGs��@C@C=m@ZNL=!c � %Ï

� æ

Page 18: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

¼��W½5½¶.mÐH¿m@"@SE/F�A�H/bSc � IÀ>ªF�E/ÁSÀç\^J�]^cdA,>ªFsHBÀLc�Á)E/J?AqHªJLCQE/JLK-M5E/J?AqED@k]^cdA±À H/\^FRE�@qJLE0C/ASfR\eJ9]^cÒA>/F�E/ÁoÀ`\mf�H/J5H/b�b�A�Àw][\^JO>±fS][H/][A(Á$]^cÒA0J�@BE/F�A$Ñ(A0F�M¯À H/\^F)ED@1C/\ fS][\eJ?b(]�JLE(CªASf)\^J5]^cÒA >ªF�H�ÀLc�Áx]^cÒA±][G$E�JLE0C/ASfH/F�A�Cª\mfS][\eJ¯>/Ád\mf�cÒHO9oK-AÄÃÅÆ"$�����ǹñp�@CGÒ@JNX=!c � ;2@ÜNXB�;0>�GSBENLBSH�=�I�c0@fD�>�=�G�g�@�\ABbNL^�g�%�Y�@�!!=�@�Ó N8D�GSg�@�\ABS@fNLG�@fD(G�>�=0GS@C\A@CB�D(`!a�gGSg!NLG�GSg�@,=!NX]_@fD�ILK[@ZNL=!c � D(g!NLB�@�Ó B(>�\Ag0GS]_I0D(G�> c0@C=0G(>TaCNPO$c8>�\L>�GEDS%�e�g�@CBS@�NLBS@�.Ò^!IWDSD·>ÿ;0O�@_aCNAD(@fDo%ÔÆ.�È(�m¾�ÉÕÓ C ©0¹ VL>�=!ab@,GSg�@#=!NL]_@fD�IXK¨@�NL=!c � D(g!NXBS@�Ó_B(>�\Ag0GS]_IWD(G$c8>�\L>�GED®U&@�NL=!c � NLB�@�]_@C]R;!@CBEDILKiNtgs®�°mÓ�ipn�\AB�IA`�^�%�N�H�O�@C]_]�N � GSg�@C=7U�@ZNX=!c � NLBS@�c8>TD(G(>�=�\A`0>TD(g!N:;0O�@/%ÔÆ.�È(�gÐyÉÖÓ � ©0¹ VL>�=!ab@×Ó � ©üUØ@�NX=!c � g!NP?A@JNÓc8>TD(G(>�=!abG_B(>�\Ag0GS]_IWD³Gc8>�\L>�GEDk>�=�GSg�@b>�B_=!NL] @fDS%��K�GSg�@J=!NL] @JILKk@�>TDJ?Ù@ � @ ÷ @ ø �(�(�\@ ³ �L� @ ³§C U�GSg�@C=r��@5 W=�I:��G�g�@J=!NL]_@JILK � >TD ILK,GSg�@�KRI8BS]? �:�S�8÷S�0ø �0�(� � ³ �L� @ ³�C e�g�@#>[=�^�`�G�D(GSB(>�=�\�© ³ �L� ��>QO¨O7GENz A@Ú@ GSI�GSg�@�=�I c0@�=!NL]_@fc�?5@ ³ ©/©/©Ó�0�(�&© C UNL=!c � GSI�G�g�@�=�I�c0@�=!NL]_@fc�? @ ³ ©/©/©Ó�0�(�&© C %�e�g�@fD³@�G���I�c0@fD(G³>[=!NXG(>�IA=_=�I�c0@fD�D(g!NLBS@"®�° � B(>�\Ag0GS]_I0D(Gc8>[\X>[GbD�g(NPOQO¯©AD�i�NX=!cÓGSg�@CBS@bK�IABS@�NXBS@�>�= G�g�@�DSNL]_@ � n�\ABSIA`�^�%�N�HÆG�g�@_^�BS@C]�>TD(@�ILK�GSg0>TD�O�@C]_]�NüU4I8=�@ILK�GSg�@fD(@�=�I�c0@fDk>TD_NL=�NAaCab@C^�G(>�=�\ D(GENXGS@�NL=!cÕIA=�@ >TD_N6BS@�O(@fabG(>�=�\ D(GENLG�@/%Æe�g�@CB�@bKRIAB�@Û@�NL=!c � NLB�@c8> D³G(>�=�\A`0>TD(g!N:;0O�@�;0Ht© ³ ��� %Ü 7��O��"��W½Ý¾AÞ¾J?A�b�ASf�fSH/F�MRH/J?C�fSÁ{ßçb(\^A(JL]"b�E/JLCª\e][\^E/J±@BEªF�H/JQH:f�fB\L>/J?aRA(JL]>E�@�Hªb�b�A�Àw][\^JO>WfS][H/][ASf�][E]^cÒA5JLE0C/ASf�E�@qHQC/A<;ÓF�Ád\ =SJ¶>/F�H�À?cãED@qC/\^H/aRA(][A(F±®r][EQFsAofBÁdK-]Ó\^J�HQaR\eJ?\eaRH/K8à�áL_ô\ fq]^cÒHª]�@SE/F�A�H/bSc� IÀ>ªFsEªÁSÀ�\^Jr]^cÒA�>/F�H�ÀLc�Á�E/J?A5H/JLCnEªJLK-M7E/J?A5E�@q]^cÒAkÀ H/\^F�E�@5JLE0C/ASf�\eJ9]^cÒA:>ªF�E/ÁSÀ²\mfqHªJrH/b�b�A�À�][\eJ¯>fB][H/][A»ÃÅÆ"$�����ǹò2 @�!!BbD(GÜD³g�I8��G�g!NLG�>QK�GSg�@�\ABENL^�g�> D�]�>�=0>�]�NPOpU7GSg�@C=ÓIA=�@_NL=!c6IA=0O�H6IA=�@�ILK�GSg�@k^!NP>�B�ILK=�I c0@fD�>�=�@fNAa�g � n�\8BSIA`�^Ó>TD�NL=�NAaCab@C^�G(>�=�\ D(GENXGS@/%Je�g�@_KpNAabGkGSg!NLG�G�g�@�\ABbNL^�g >TDk]�>�=0>�]�NPO�>�]_^0OQ>�@fDGSg!NLG�@C?8@CBSH ^!NP>�B�ILK�=�I c0@fD�>�=�GSg�@_\8BENL^�g > D�c8>TD(G(>�=�\A`0>TD(g!Nz;0O[@/% VA^!@fa�>-!¼aCNPOQO�HWU�GSg�@ Gs��I6=�I c0@fD�>�=�N� n�\ABSIA`�^ NLB�@Òc8>TD(G³>[=�\8`0> D³g!N:;0O�@/%7N�H c0@�!!=0>�G(>�IA=7U�N � >�=�^�`�G�GEN: A@fD�G�g�@G���I�=�I c0@fDÜ>[=�N � n�\AB�IA`�^ÓGSIGSg�@�DSNL] @ÒD³GENLGS@AU7NL=!c�OQ>m A@S��>TD(@�K�IAB,N5©�>�=�^�`�G(%�u�I8B,GSg�@_G���I�=�I�c0@fD,GSI5;2@�c8>TD(G(>�=�\A`0>TD(g!N:;0O�@JGSg�@C=7UGSg�@CHZ]�`!D(G,^�BSI�c0`!ab@_NJc8>TD(G(>�=�\A`0>TD(g!N:;0O�@JIA`�GS^�`�G,I8=ÆG�g�@=0`0OQO�D(GSB(>�=�\L%ke�g�@CBS@bK�IABS@AU%IA=�@�=�I�c0@_]�`!D(G;!@NX=ZNAaCab@C^�G(>�=�\ D³GENLGS@�NL=!c�G�g�@,IAGSg�@CB�N�B�@�O·@fabG(>�=�\JD(GENLG�@/%

j#@�º G$��@�D(g�I:��GSg!NLGÉ>QK¼K�IAB-@fNAa�g � n�\ABSI8`�^,>�=�G�g�@�\8BENL^�g7ULIA=�@�NL=!c�I8=0O[H�IA=�@�ILK%GSg�@�^!NP>�B$ILK%=�I c0@fD>[=�GSg�@�\8BSIA`�^�>TD�NL=�NAaCab@C^�G³>[=�\_D(GbNLGS@AULGSg�@C=�GSg�@�\ABbNL^�g�>TD�]�>�=0>[]�NPO&%x�FG�K�ILOQO[I:��DÔKRB�IA] O�@C]_]�NR.�UAG�g!NLGKRIAB�@C?A@CBSH6^!NP>�B,ILKjc8>TD(G³>[=!abGk=�I c0@fD#>�= G�g�@\8BENL^�g7U%GSg�@�G���I_=�I c0@fDkNLBS@�c8> D³G(>�=�\A`0>TD(g!N:;0O�@/%�eÉIJ^�BSIL?A@]�>�=0>[]�NPOQ>[G(H9��@ÒNyO D³IZ=�@C@fcÓGSIZD³g�I8� GSg!NLG,@fNAa�gÓ=�I c0@ >�= GSg�@_\8BENL^�gÓ>TD,B�@fNAaSg!Nz;0O[@ K�BSIA] GSg�@_D(GENXBSG=�I c0@/%xN�H�GSg�@,c0@�!!=0>[G³>[I8=ZILKÔN�c0@(N�BS`0>PO(=J\ABENL^�g7U8>�G�>TD�a�O[@fNXB�GSg!NLG�GSg�@,D(GSB(>�=�\_abIABSB�@fD(^!IA=!c8>�=�\_G�IG�g�@=!NL]_@�ILK4N�=�I�c0@���>QO¨O4aCNL`!D³@ÜNkGSBENX=!DF>�G(>�IA=�G�I�GSg!NLG�=�I c0@#K�BSIA] NX=WH�=�I�c0@�>[=�GSg�@�\ABENL^�g�%�d�NAaSg =�I c0@>[= GSg�@�\ABENL^�g6>TD,GSg�@CB�@bKRIAB�@B�@fNAaSg!Nz;0O[@AU-NL=!c6@C?A@CBSH6^!NP>�B�ILK$=�I�c0@fD�>TD�c8>TD(G³>[=�\8`0> D³g!N:;0O�@/% ejg�@CBS@bKRI8BS@AUGSg�@�u�VÒh c0@�!!=�@fc7;0H�GSg0>TD�^�BSI�ab@fc0`�BS@�> Dj]�>�=0>[]�NPO&%�Ï

� q

Page 19: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

�â�"�0�ö���Ó�R�x�"�#QM�O�@C@CBS@C]�NL=!D#@CG�NPO&%�U � l8qAl:'�M�O�@C@CBS@C]�NX=!DCU�T�%�U�VA@CBS?yNX=�n(VWaSg�BS@b>m;2@CBfUÆYR% U_NL=!c�hÆaPMiO[@bOQOTNL=!c%U7è�%�p$%g � lAq8ldi�%¸uÉ>�=0>�GS@ D(GbNLGS@ NL`�GSIA]�NLGEN NL=!c DF>�]_^0O�@ BS@fab`�B�BS@C=WGJ=�@CG���IAB� �DS%ãâ�A(ÁdF�H/KåäxE/aUÀwÁd][H/][\^E/J!U� g·odi « odæ8.$æ�oAq � %#îY,NPH�NL=!cJY,NP?A@C=�^!I8BSGfU � lAlAoz'�Y,NfHAU�VL%¼NL=!c6Y,NP?A@C=�^!IAB�GfULh9%�g � l8lAodi�%�M�IA=WG³>[=0`�IA`!D(n�G³>[] @G�@C]_^!IABbNPO;!NAa� Wn�^�BSI8\WNL\WNLG³>[I8=���>�GSgÑN8c�NL^�G(>�?A@�G(>�]_@Zc0@bOTNfH�DS%+¿�ç�ç[ç�èLF�H/J<fSH/b0][\eE/J�f�E/J+â1A0ÁÒF�H/K�â�A(][G$E/F�Â(fCUm « oLm0q$æ o é m?%

#îd-O�]�NL=7U � lAl � ',d-O�]�NX=7U è�%Òp$%�g � lAl � i�%!Y#>TD(GSB(>m;�`�GS@fc�B�@C^�BS@fD(@C=0GENLG(>�IA=!DCU0DF>�]_^0O�@�B�@fab`�BSBS@C=0G�=�@CG���IAB� �DCUNL=!cJ\8BENL]_]�NXG(>TaCNPO�D(G�BS`!abGS`�BS@/%"_QH/bScd\eJ?AÆé�A�H/F�JL\^JO>AU�æ/gs.¯KLodi «m� l é æÒ./. í %

#-,�>QO�@fD�@CG�NPO&%�U � lAlXm/'�,#>QO[@fD®U%M)%Lp$% U 6#IABS=�@AU?N)%?,R%�U�NL=!c5p2>�=7U!e�%?g � l8lLm<i�%�p%@fNLBS=0>�=�\�N_a�OTNAD�D�ILK7OTNLBS\8@!!=0>�GS@�D(GENXGS@�]�NAa�g0>[=�@fDy��>�GSg N�BS@fab`�B�BS@C=WG,=�@C`�BbNPO$=�@CG���I8B� w%�eÉ@faSg�=0>TaCNPO�h�@C^!IAB�G�<)hV�&T�M�VAnpe�h�nlLmAnplLm�NX=!c�M�VAnpe�h�npo8o/.Aq�Uª�p=0G(>�GS`�GS@#KRIAB$T,c0?yNX=!ab@fcJM$I8]_^�`�GS@CB�VAG�`!c8>[@fD®U <#=0>�?A@CB(>�G(H_ILK�hÆNXBSHAOTNL=!c�%

#-,�>QO�@fD�@CG�NPO&%�U � lAlª.:'�,#>QO[@fD®UJM)%�p�%�U�VA`�=7U5,R%Æê�%�U�M$g�@C=7U�6±%�6�% U�p%@C@AUÂëR%kM)%�U_NL=!c M$g�@C=7U�YR%g � lAlª.di�%²6�>�\Ag�@CB�IABEc0@CB�BS@fab`�BSBS@C=0G�=�@CGs��IAB� D_NX=!c�\ABENX]_]�NLG(>TaCNPO#>[=0K�@CBS@C=!ab@/%ìâ�A(ÁdFsHªK�äxE/aUÀwÁªI][H/][\^E/J!U�m�g·odi « o8lAo$æWmÒ© é %#-,�ILO�IA]R;7U � lAqª.:'�,�ILO�IA]R;7U-VL%�g � lAqª.di�%�á?cÒ\ @B]�í"A�>ª\mfS][A(FkáwAdî(ÁdA(J?b�AofB%UT�@C\A@fNX=ã*�NXB� 7*�BS@fD�DCU�p7NL\A`�=!N6�>QOQOTDCU-MxTR%#¨4�IAg!NP?A>pU � ldæyq:'�4�IAg!NP?A>pU8ê�%�g � ldæLqdi�%åá�G$\e][bocÒ\eJ¯>7HªJLC!àx\^JL\^][AåÞ�ÁÒ][Eªa�Hª][H5è�cÒA�EªF�M:%�hÓa0,�BEN0��n&6j>QOQOÖU�p=!a:%�U?j�@S�ïë�IAB� %U<jë�U!D(@fabIA=!c�@fc8>�G(>�IA=�%#¨4�BSIA\AgZNX=!c56�@CBSG�»AU � lAl/.z'14�BSI8\Ag7U(TR%fNL=!c�6#@CBSG�»AU:è<%:g � lAl/.di�%ST�D·>[] ^0O[@"��@b>�\Ag0G4c0@faCNPHÜaCNL=�>�]_^�B�Iy?8@\A@C=�@CBENPOQ>m»fNLG(>�IA=�%>�p=9#¨h6IWI�c0H�@CG�NPO&%�U � l8l/.S'pUü^!NL\A@fD�l é ©$æ l é æd%

#¨p7NL=�\_@CG�NPO&%�U � lAlª©:'1pÉNL=�\!U�4R%�UL2ÕNP>m;!@bOpU�T�% U¼NL=!cV6�>�=0GSIA=7U�,�%�g � lAl/©di�%xT�G(>�]_@Cnpc0@bOTNPHZ=�@C`�BbNPOÔ=�@CG�n��IAB� �NLBbaSg0>�GS@fabGS`�B�@,K�IAB�> D³ILOTNLGS@fc5��IABbc�BS@fabIA\A=0>�G(>�IA=�%�â�A(ÁdF�H/K¨â1A0][G$E/F�Â0fÌU�odg � i « .AoÄæWmAmL%#¨p2>�=Z@CG�NyO¼% U � lAl/.z'1p2>�=7U�YR%�U0Y,NfH0g�I:{$U:è<%�UWNX=!c�p2>�\AIA]_@C=0>Tc0@fDCU?*�%dg � lAl/.di�%ÒT O�@fNLBS=0>�=�\_NPO�\AIAB³>[G�g�]�K�IABNAc�NL^�G(>�?A@�G(>�]_@Cnpc0@bOTNPH Di>�=ZN,G�@C]_^!IABbNPO¼=�@C`�BENyO¼=�@CG���IAB� �%¼eÉ@faSg�=0>TaCNPO�h�@C^!IAB�Gje#h9lª.Ln é l�U0VAH�D(GS@C]�Dh�@fD(@fNLBbaSg M$@C=WG�@CBfU�<�=0>�?A@CBED·>[G(HJILKxhÓNLBSH8OTNL=!c%U%M$ILOQO�@C\A@R*�NLB� %U hÓNLB�HAOTNL=!c�%

#¨h6IWI�c0H�@CG�NPO&%�U � lAlª.:'1h6I0I c0HAUdè<%WdU%�U/6�NL=!D(IA=7UüVL%Òè<%�U0NL=!c�p2>�^�^�]�NX=�=7U hy%Ò*�%�UA@fc8>�GSI8BED"g � lAl/.di�%0Þ�C:IÑ(H/J?b�Aof1\^J�â1A0ÁÒF�H/K¨¿�Jo@BE/F�aRH/][\^E/J�ðöF�E(b�ASf�fB\^JO>Dá�M0fB][A0a�f ñ×ðöF�E0b�A�A�Cª\eJ¯>:f�E�@�]^cÒA:ò�ó2ó�òmäxEªJS@SA(F�A(J?b�APUY�@C=W?8@CBfU%M$ILO�IABbNAc0IL%<h6IABS\WNL=54,NL`0K�]�NL=�=7*i`<;0O¨>TD(g�@CBbD « VWNL=7u�BbNL=!a�>TDSabI!UÉMxT�%

#¨*-@fNLB(O�]�`�GSGS@CBfU � l8qAl:'�*-@fNLB(O�]�`�GSGS@CBfU�N�%LTR%�g � lAq8ldi�%Óp%@fNLB�=0>[=�\ÓD(GENLG�@D(^!NAab@�GSBbN:O(@fabGSIAB(>�@fD�>�= BS@fab`�B�nBS@C=0G�=�@C`�BENPO4=�@CG���IAB� �DS%�â�A(ÁdFsHªK�äxE/aUÀwÁd][H/][\^E/J!U � gs.di « . í o$æ . í l<%

#¨*-ILOQOTNAa� %U � l8l � '�*-ILOQO N8a� %Uöè�%xN�%"g � lAl � i�% ejg�@�>[=!c0`!abG³>[I8=9IXKÜc0HW=!NX]�>TaCNPOÜB�@fabIA\A=0>m»C@CBEDS%²_QH/bScd\eJ?Aé�A�H/F�JL\^JO>8U<æ/g�.¯Kyodi « ./.dæ(æ . é .�%

#îh�>Tab@AU � lAqAq:',h�>Tab@AUxè<%�TR%$g � lAqAqdi�%k_`H/]^cÒA0aRH/][\eb�H/K8áw][H/][\ fB][\^bSf�H/J?C5Y�H/][HJÞ�J?H/K-M0fB\ fB%±N$B�IWI/ �DdKAM�ILO�@*�`<;0OQ>TD(g0>�=�\ M$I8]_^!NL=0HAU h6IA=0GS@CBS@CHAU2M�NyO¨>QK�IABS=0>TN<%

� l

Page 20: C. Lee Giles, Pennsylvania State Universityclgiles.ist.psu.edu/papers/DeBruijn.automata.learning... · 2007. 3. 4. · $ %'& ( !)+*,-.,/*, 0&12. 314 2 56317 8&9 :,;  ?A@CBEDF>

#îh�`�]_@bO�g!NLBSG�@CG�NPO&%�U � lAq í ',h�`�]_@bO�g!NLB�GfU�YR%�dU%�U�6�>�=0GSIA=7UR,R%�dÓ%�U,NL=!cv2Ñ>QOQOQ>TNL]�DCU�h�%)è�%�g � l8q í i�%p%@fNLBS=0>�=�\k>�=WG�@CBS=!NPO!BS@C^�BS@fD³@C=WGENXG(>�IA=!D$;0H�@CBSBSIAB�^�BSI8^!NL\WNLG(>�IA=�%��p=�h�`�] @bO[g!NXBSGfU�YR%AdÓ%ANL=!cWhÆaPMiO[@bO�nOTNL=!c%U$è<%�p$% U7@fc8>�GSIABED®U�ðöHªFsHªKeK-A(K�Y�\ fB][F�\À9oÁÒ][A�C�ðöF�E(b�ASf�fS\eJ¯>Oôkç[õ�ÀwK-E/F�H/][\eEªJ<f�\eJ9]^cÒA�_Q\eb0FsEzfB][F�ÁÒb0][ÁÒF�AE�@:ä>EÇ>/J?\e][\^E/J2UA?AILO�`�]_@ � U�aSg!NX^�GS@CB�q<%LhV�(eì*�BS@fD�DCU2M�NL]R;�B(>Tc0\A@AULhÓNADSDo%

#P2 NP>m;!@bO�@CG�NPO&%�U � l8qAl:'�2 NP>m;2@bOÖU�TR%�UÓ6�NL=!N:»fN0��N�U�ey%�UÓ6�>�=0GSIA=7Uy,�%�U�VAg0>m yNX=�I!U�4R%�U�NL=!c²p7NL=�\!UÓ4R%g � lAq8ldi�%)*ig�IA=�@C]_@�BS@fabIA\8=0>[G³>[I8=Æ`!D·>[=�\JG³>[] @dæ c0@bOTNfHÓ=�@C`�BENyOÔ=�@CG���IAB� �DS%�¿{ç[ç[çöèLFsHªJ<fSH/b(][\^E/J<f�E/JÞ�b�E/ÁªfS][\ebofÇÁ á/À<A�A�bScqHªJLC÷áw\L>/JLHªK�ðöF�E(b�ASf�fS\eJ¯>AUAodæ/g(odi « o/.8q$æ oAoLl<%

#P2 NL=7U � lAl8o:'�2 NL=7U-dÓ%�TR%$g � l8lAodi�%�e�>�]_@�D(@CB³>[@fDk^�BS@fc8>TabG(>�IA=9;0HÆ`!D·>[=�\ÓNZabIA=�=�@fabG³>[I8=0> D³G=�@CG���IAB� ��>�GSg >[=0GS@CBS=!NyOÉc0@bOTNPH O¨>�=�@fDS%��F=52 @b>�\A@C=!c%U<TR%�VL%�NL=!c=,�@CBED(g�@C=0K�@bOTc%ULj±%ÒTR%�U8@fc8>[G�IABEDCU�è�\^aRA�áwA0F�\^ASfðöF�A�C/\eb0][\eEªJyôÒà�EªFsA�b�H:fB][\^JO>R]^cdAåà�ÁÒ][ÁdF�A�HªJLC§ø�J?C/A(F�fB][HªJLC/\^JO>W]^cÒAåðöHzfB][%dT,c�c8> D³IA=72 @fD·O[@CH/%

#P2 NLGSB�IA`!D�NL=!c54�`�g�=7U � lAl/.:'�2 NXGSBSIA`!DCU�hy%�NL=!c²4�`�g�=7UR,R%Óg � lAl/.di�%²�p=!c0`!abG(>�IA= ILK�!!=0>�GS@ D(GbNLGS@OTNL=�\A`!NL\A@fD `!DF>�=�\ÑD(@fabIA=!c0n�I8BEc0@CB�B�@fab`�BSBS@C=0G_=�@CG���I8B� Do%ç�F=Ü#¨h6I0I c0H�@CG�NPO&%�U � lAlª.('FU�^!NL\A@fD_o/©8l$æo �(í %

.ª©