(ebook) crc press - pattern recognition in speech and language processing 2003

#RRTQCEJGU VQ VJG RTQDNGOU QH FGUKIPKPI URGGEJ CPF NCPIWCIG RTQEGUUKPI CNIQTKVJOUHQT JWOCP OCEJKPG EQOOWPKECVKQP WUGF VQ DG VCMGP HTQO VJG RGTURGEVKXGU QH NKPIWKUVKEU CPF URGGEJ UEKGPEG

CRC PR E S S

Boca Raton London New York Washington, D.C

Edited by

WU CHOU

Avaya Labs Research

BIING HWANG JUANG

Georgia Institute of Technology

PATTERN

RECOGNITION in SPEECH and

LANGUAGE

PROCESSING

7KLVERRNFRQWDLQVLQIRUPDWLRQREWDLQHGIURPDXWKHQWLFDQGKLJKO\UHJDUGHGVRXUFHV5HSULQWHGPDWHULDO LVTXRWHGZLWKSHUPLVVLRQDQGVRXUFHVDUHLQGLFDWHG$ZLGHYDULHW\RIUHIHUHQFHVDUHOLVWHG5HDVRQDEOH HIIRUWVKDYHEHHQPDGHWRSXEOLVKUHOLDEOHGDWDDQGLQIRUPDWLRQEXWWKHDXWKRUVDQGWKHSXEOLVKHUFDQQRW DVVXPHUHVSRQVLELOLW\IRUWKHYDOLGLW\RIDOOPDWHULDOVRUIRUWKHFRQVHTXHQFHVRIWKHLUXVH

1HLWKHUWKLVERRNQRUDQ\SDUWPD\EHUHSURGXFHGRUWUDQVPLWWHGLQDQ\IRUPRUE\DQ\PHDQVHOHFWURQLF RUPHFKDQLFDOLQFOXGLQJSKRWRFRS\LQJPLFURÀOPLQJDQGUHFRUGLQJRUE\DQ\LQIRUPDWLRQVWRUDJHRU UHWULHYDOV\VWHPZLWKRXWSULRUSHUPLVVLRQLQZULWLQJIURPWKHSXEOLVKHU

$OO ULJKWV UHVHUYHG$XWKRUL]DWLRQ WR SKRWRFRS\ LWHPV IRU LQWHUQDO RU SHUVRQDO XVH RU WKH SHUVRQDO RU LQWHUQDO XVH RI VSHFLÀF FOLHQWV PD\ EH JUDQWHG E\ &5& 3UHVV //& SURYLGHG WKDW  SHU SDJH SKRWRFRSLHGLVSDLGGLUHFWO\WR&RS\ULJKW&OHDUDQFH&HQWHU5RVHZRRG'ULYH'DQYHUV0$ 86$ 7KH IHH FRGH IRU XVHUV RI WKH 7UDQVDFWLRQDO 5HSRUWLQJ 6HUYLFH LV ,6%1 

7KHIHHLVVXEMHFWWRFKDQJHZLWKRXWQRWLFH)RURUJDQL]DWLRQVWKDWKDYHEHHQJUDQWHG DSKRWRFRS\OLFHQVHE\WKH&&&DVHSDUDWHV\VWHPRISD\PHQWKDVEHHQDUUDQJHG

7KHFRQVHQWRI&5&3UHVV//&GRHVQRWH[WHQGWRFRS\LQJIRUJHQHUDOGLVWULEXWLRQIRUSURPRWLRQIRU FUHDWLQJQHZZRUNVRUIRUUHVDOH6SHFLÀFSHUPLVVLRQPXVWEHREWDLQHGLQZULWLQJIURP&5&3UHVV//& IRUVXFKFRS\LQJ

#RRTQCEJGU VQ VJG RTQDNGOU QH FGUKIPKPI URGGEJ CPF NCPIWCIG RTQEGUUKPI CNIQTKVJOUHQT JWOCP OCEJKPG EQOOWPKECVKQP WUGF VQ DG VCMGP HTQO VJG RGTURGEVKXGU QH NKPIWKUVKEU CPF URGGEJ UEKGPEG WPVKN VJG NCVG U &WG VQ VJG CFXCPEGU KP EQORWVKPI CPF UVCVKUVKECN OQFGNKPI FCVC FTKXGP RCVVGTP TGEQIPKVKQP OGVJQFU JCXG DGEQOG CHCUV OQXKPI TGUGCTEJ CTGC FWTKPI VJG RCUV VYQ FGECFGU CPF EQPVTKDWVGF OWEJ VQ VJGRTQITGUU KP VJKU ſGNF #U VJG GTC QH KPHQTOCVKQP CIG EQPVKPWGU VQ FGXGNQR YG YKVPGUU

CP GXGT KPETGCUKPI PGGF KP KPVGNNKIGPV JWOCPOCEJKPG EQOOWPKECVKQPU CU YGNN CU VJGETGCVKQP QH OCEJKPG WPFGTUVCPFCDNG OGVCFCVC HQT 9GD EQPVGPV CPF QVJGT KPHQTOCVKQPUQWTEGU 6JKU JCPFDQQM KU VQ ſNN VJG PGGF QH C U[UVGOCVKE CPF WRVQFCVG RTGUGPVCVKQP

QH PGY RCVVGTP TGEQIPKVKQP CRRTQCEJGU KP URGGEJ CPF NCPIWCIG RTQEGUUKPI

6JG DQQM UVCTVU YKVJ HWPFCOGPVCNU CPF TGEGPV VJGQTGVKECN CFXCPEGU KP RCVVGTP TGEQIPKVKQP YKVJ CP GORJCUKU QP ENCUUKſGT FGUKIP ETKVGTKC CPF QRVKOK\CVKQP RTQEGFWTGU+V EQXGTU UGXGTCN TGEGPV TGUGCTEJ CFXCPEGU KP VJKU CTGC UWEJ CU VJG OKPKOWO GTTQTFGEKUKQP TWNGU PGWTCN PGVYQTMU FKUVTKDWVGF TGEQIPK\GTU CPF FGEKUKQP HWUKQP 6JGUGOGVJQFU FGRCTV HTQO VJG EQPXGPVKQPCN RCTCFKIO YJKEJ NKPMU C ENCUUKſGT FGUKIP VQVJG ENCUUKECN RTQDNGO QH FKUVTKDWVKQP GUVKOCVKQP +PUVGCF OQTG OGCPKPIHWN ETKVGTKCCTG KPVTQFWEGF YJKEJ UKIPKſECPVN[ KORTQXG VJG FKUETKOKPCVKQP RQYGT QH C ENCUUKſGTRCTVKEWNCTN[ YJGP CRRNKGF VQ URGGEJ RTQDNGOU KP YJKEJ VJG PQVKQP QH FCVC FKUVTKDWVKQP

KU FKHſEWNV VQ TGCNK\G

6JG UGEQPF RCTV QH VJG DQQM KU VJGTGHQTG URGEKCNN[ HQEWUGF QP VJG CRRTQCEJGU CPFOGVJQFU CRRNKGF VQ URGGEJ RTQEGUUKPI +V EQXGTU VQRKEU UWEJ CU $C[GU OKPKOWO TKUMCRRTQCEJ VQ URGGEJ TGEQIPKVKQP NCTIG XQECDWNCT[ URGGEJ TGEQIPKVKQP DCUGF QP UVCVKUVKECN OGVJQFU TGEQIPKVKQP QH URQPVCPGQWU URGGEJ KP FKCNQIWG KPVGTCEVKQP URGGEJ CPFURGCMGT XGTKſECVKQP CPF CWFKQ KPHQTOCVKQP TGVTKGXCN CPF KPFGZKPI 6JGUG EJCRVGTURTQXKFG C EQORTGJGPUKXG EQXGTCIG QH TGEGPV CFXCPEGU KP CRRN[KPI RCVVGTP TGEQIPKVKQP VQ TGCN U[UVGOU KP URGGEJ CPF CWFKQ RTQEGUUKPI

6JG VJKTF RCTV QH VJG DQQM KU FGXQVGF VQ VQRKEU QH RCVVGTP TGEQIPKVKQP KP NCPIWCIGRTQEGUUKPI +V EQPVCKPU EJCRVGTU KP NCPIWCIG OQFGNKPI DCUGF QP NCVGPV UGOCPVKE KPFGZKPI UCNKGPV KPHQTOCVKQP TGRTGUGPVCVKQP CPF RTQEGUUKPI KP PCVWTCN NCPIWCIG FKCNQIWG U[UVGO UVCVKUVKECN OCEJKPG VTCPUNCVKQP OGVJQFU KP VQRKE FGVGEVKQP VTCEMKPICPF PCOG KFGPVKV[ KFGPVKſECVKQP 6JGUG VQRKEU CTG PGY VTGPFU KP NCPIWCIG RTQEGUUKPI CPF UKIPKſECPV RTQITGUU JCU DGGP OCFG KP TGEGPV [GCTU +V JCU C FKTGEV KORCEV VQVJG RTCEVKEG CPF KORNGOGPVCVKQP QH KPHQTOCVKQP RTQEGUUKPI U[UVGOU HQT 9GD EQPVGPVDTQCFECUV PGYU CPF QVJGT EQPVGPVTKEJ KPHQTOCVKQP TGUQWTEGU

VJKU ſGNF CPF VJG WTIGPV PGGF VQ DTKPI VJGUG CFXCPEGU VQ C IGPGTCN CWFKGPEG 6JG EQPVTKDWVKPI CWVJQTU QH VJKU DQQM CTG NGCFKPI GZRGTVU KP VJG ſGNF QH URGGEJ CPF NCPIWCIGRTQEGUUKPI #VVGORVU CTG OCFG VQ OCMG GCEJ EJCRVGT UGNHEQPVCKPGF CPF EQORTGJGPUKDNG HQT TGCFGTU YKVJ IGPGTCN DCEMITQWPF KP RCVVGTP TGEQIPKVKQP CPF KPHQTOCVKQPRTQEGUUKPI +V KU KPVGPFGF VQ DG C JCPFDQQM QT TGHGTGPEG VGZVDQQM HQT TGUGCTEJGTUITCFWCVG UVWFGPVU CPF CFXCPEGF WPFGTITCFWCVG UVWFGPVU YJQ YCPV VQ HQNNQY VJG PGYCFXCPEGU KP RCVVGTP TGEQIPKVKQP 5WHſEKGPV TGHGTGPEGU CTG RTQXKFGF CV VJG GPF QH GCEJEJCRVGT VQ UGTXG CU CP GPVT[ RQKPV HQT CP KPVGTGUVGF TGCFGT VQ RWTUWG HWTVJGT

9G YQWNF NKMG VQ VJCPM CNN EQPVTKDWVQTU QH VJKU DQQM 9KVJQWV VJGKT EQOOKVOGPV CPFSWCNKV[ QH YQTM VJKU DQQM YQWNF PQV DG RQUUKDNG 9G CRRTGEKCVG VJG UWRRQTV CPFGPEQWTCIGOGPV HTQO QWT EQNNGCIWGU CV #XC[C CDU 4GUGCTEJ FWTKPI VJG RTGRCTCVKQP

QH VJKU DQQM +V YCU C RNGCUCPV YQTMKPI GZRGTKGPEG YKVJ %4% 2TGUU  VJGKT VGEJPKECNUWRRQTV YCU XGT[ JGNRHWN VQ WU

9W %JQW

$KKPI*YCPI ,WCPI

Basking Ridge, New Jersey

September, 2002

&GRCTVOGPV QH %QORWVGT 5EKGPEG

7PKXGTUKV[ QH /CUUCEJWUGVVU #OJGTUV

Vaibhava Goel

6, 9CVUQP 4GUGCTEJ %GPVGT+$/

;QTMVQYP *GKIJVU 0;

Allen L Gorin

5RGGEJ 4GUGCTEJ

#66 CDQTCVQTKGU(NQTJCO 2CTM 0,

0KRRQP 6GNGITCRJ CPF 6GNGRJQPG

%QTRQTCVKQP6QM[Q ,CRCP

Lori Lamel

.+/5+%0457PKXGTUKVyG FG 2CTKU 5WF1TUC[ %GFGZ (TCPEG

Qi (Peter) Li

1 Minimum Classification Error (MCE) Approach in Pattern Recognition

 +PVTQFWEVKQP

 1RVKOCN %NCUUKſGT HTQO $C[GU &GEKUKQP 6JGQT[

 &KUETKOKPCPV (WPEVKQP #RRTQCEJ VQ %NCUUKſGT &GUKIP

 5RGGEJ 4GEQIPKVKQP CPF *KFFGP /CTMQX /QFGNKPI

 /%' %NCUUKſGT &GUKIP 7UKPI &KUETKOKPCPV (WPEVKQPU

 'ODGFFGF 5VTKPI /QFGN $CUGF /%' 6TCKPKPI

 /KPKOWO $C[GU4KUM %NCUUKſECVKQP (TCOGYQTM

 2TCEVKECN /$4 2TQEGFWTGU HQT #54

 5GIOGPVCN /$4 2TQEGFWTGU

 G418'4

 'ZRGTKOGPVCN 4GUWNVU

 1RVKOCN $C[GUŏ &GEKUKQP 4WNG HQT #54

 #FCRVKXG &GEKUKQP 4WNGU %QPUVTWEVGF HTQO 6TCKPKPI 5CORNGU

4 Speech Pattern Recognition using Neural Networks

5 Large Vocabulary Speech Recognition Based on Statistical Methods

6 Toward Spontaneous Speech Recognition and Understanding

 +PVTQFWEVKQP

 (QWT %CVGIQTKGU QH 5RGGEJ 4GEQIPKVKQP 6CUMU

 5RQPVCPGQWU 5RGGEJ 4GEQIPKVKQP CPF 7PFGTUVCPFKPI  4GXKGY

 #WVQOCVKE 5RGGEJ 5WOOCTK\CVKQP CPF 'XCNWCVKQP

 5RGCMGT #WVJGPVKECVKQP D[ %QODKPKPI 58 CPF 8+8

 5WOOCT[

8 HMMs for Language Processing Problems

11 Machine Translation Using Statistical Modeling

 #NKIPOGPV CPF GZKEQP /QFGNU

12 Modeling Topics for Detection and Tracking

 6QRKE &GVGEVKQP CPF 6TCEMKPI

Minimum Classification Error (MCE)

Approach in Pattern Recognition

Wu Chou

Avaya Labs Research, Avaya Inc., USA

CONTENTS

 +PVTQFWEVKQP

 1RVKOCN %NCUUKſGT HTQO $C[GU &GEKUKQP 6JGQT[

 &KUETKOKPCPV (WPEVKQP #RRTQCEJ VQ %NCUUKſGT &GUKIP

 5RGGEJ 4GEQIPKVKQP CPF *KFFGP /CTMQX /QFGNKPI

 /%' %NCUUKſGT &GUKIP 7UKPI &KUETKOKPCPV (WPEVKQPU

 'ODGFFGF 5VTKPI /QFGN $CUGF /%' 6TCKPKPI

C EQORTGJGPUKXG QXGTXKGY QH VJG ſGNF CPF JQRGHWNN[ KPURKTG QVJGT KPPQXCVKQPU VJCVYQWNF RQVGPVKCNN[ NGCF VQ PGY FKUETKOKPCVKXG OGVJQFU KP RCVVGTP TGEQIPKVKQP

#NVJQWIJ VJG UVCVKUVKECN HQTOWNCVKQP QH /%' DCUGF FKUETKOKPCVKXG OGVJQFU JCU KVUTQQV KP VJG ENCUUKECN $C[GU FGEKUKQP VJGQT[ KV FGRCTVU HTQO VJG EQPXGPVKQPCN RCTCFKIO

6JKU EJCRVGT KU FGXGNQRGF DCUGF QP Œ&KUETKOKPCPVHWPEVKQPDCUGF OKPKOWO TGEQIPKVKQP GTTQT TCVG RCVVGTPTGEQIPKVKQP

CRRTQCEJ VQ URGGEJ TGEQIPKVKQPŒ D[ 9W %JQW CRRGCTGF KP Proceedings of The IEEE 8QN  0Q  E­  +'''

YJKEJ NKPMU C TGEQIPKVKQP VCUM VQ VJG RTQDNGO QH FKUVTKDWVKQP GUVKOCVKQP +PUVGCF KVVCMGU C FKUETKOKPCPV HWPEVKQP DCUGF UVCVKUVKECN RCVVGTP ENCUUKſECVKQP CRRTQCEJ CPF HQT

C IKXGP HCOKN[ QH FKUETKOKPCPV HWPEVKQP QRVKOCN ENCUUKſGTTGEQIPK\GT FGUKIP KPXQNXGUſPFKPI C UGV QH RCTCOGVGTU YJKEJ OKPKOK\G VJG GORKTKECN RCVVGTP TGEQIPKVKQP GTTQTTCVG 6JG WUG QH FKUETKOKPCPV HWPEVKQP KP RCVVGTP TGEQIPKVKQP YCU UVCTVGF OCP[ [GCTUCIQ 1PG ENCUUKECN GZCORNG QH WUKPI FKUETKOKPCPV HWPEVKQP HQT ENCUUKſGT FGUKIP KPUVCVKUVKECN NKVGTCVWTG KU VJG VYQ ENCUU ENCUUKſECVKQP RTQDNGO WUKPI NKPGCT FKUETKOKPCPVHWPEVKQPU = ? +P RCTVKEWNCT C YKPFQY DCUGF OGVJQF YCU FGUETKDGF KP =? HQTVJG VYQ ENCUU ENCUUKſECVKQP RTQDNGO WUKPI NKPGCT FKUETKOKPCPV HWPEVKQPU VJCV OKPKOK\GVJG RTQDCDKNKV[ QH ENCUUKſECVKQP GTTQT TCVG 6JG HQEWU QH VJKU EJCRVGT KU QP VJG TGEGPVFGXGNQROGPV QH VJG IGPGTCN /%' DCUGF FKUETKOKPCVKXG OGVJQFU 6JG FKUETKOKPCPVHWPEVKQPU VJCV YG GPEQWPVGT CTG WUWCNN[ PQPNKPGCT CPF QHVGP TGNCVGF VQ VJG UVTWEVWTG

QH VJG UVCVKUVKECN HTCOGYQTM WUGF KP URGGEJ CPF NCPIWCIG RTQEGUUKPI UWEJ CU JKFFGP/CTMQX OQFGNU

6JG TGCUQP QH VCMKPI C FKUETKOKPCPV HWPEVKQP DCUGF CRRTQCEJ VQ ENCUUKſGT FGUKIP CUYKNN DG HWTVJGT GNCDQTCVGF KU FWG OCKPN[ VQ VJG HCEV VJCV YG NCEM EQORNGVG MPQYNGFIG

QH VJG HQTO QH VJG FCVC FKUVTKDWVKQP CPF VTCKPKPI FCVC CTG KPCFGSWCVG RCTVKEWNCTN[ KPFGCNKPI YKVJ URGGEJ CPF NCPIWCIG RTQDNGOU 6JG RGTHQTOCPEG QH C TGEQIPK\GT KUPQTOCNN[ FGſPGF D[ KVU GZRGEVGF TGEQIPKVKQP GTTQT TCVG CPF CP QRVKOCN TGEQIPK\GTUJQWNF DG VJG QPG VJCV CEJKGXGU VJG NGCUV GZRGEVGF TCVG QH TGEQIPKVKQP GTTQT 6JGFKHHGTGPEG DGVYGGP VJG FKUVTKDWVKQP GUVKOCVKQP DCUGF CRRTQCEJ CPF VJG FKUETKOKPCPVHWPEVKQP DCUGF /%' CRRTQCEJ NKGU KP VJG YC[ VJG TGEQIPKVKQP GTTQT KU GZRTGUUGFCPF KP VJG EQORWVCVKQPCN UVGRU VJCV YQWNF NGCF VQ VJG OKPKOK\CVKQP QH UWEJ GTTQTHWPEVKQPU # MG[ VQ VJG FGXGNQROGPV QH VJG /%' OGVJQF KU C PGY GTTQT HWPEVKQPYJKEJ KPEQTRQTCVGU VJG TGEQIPKVKQP QRGTCVKQP CPF RGTHQTOCPEG KP C HWPEVKQPCN HQTOHTQO YJKEJ VJG RGTHQTOCPEG QH VJG ENCUUKſGT ECP DG FKTGEVN[ GXCNWCVGF CPF QRVKOK\GF

%NCUUKſGT FGUKIP YKVJQWV CUUWOKPI VJG MPQYNGFIG QH ENCUU RQUVGTKQT RTQDCDKNKVKGUYJKEJ CTG VJG DCUKU QH VJG FKUVTKDWVKQP GUVKOCVKQP DCUGF ENCUUKGT FGUKIP JCU DGGPUVWFKGF KP OCP[ CTGCU +P RCTVKEWNCT 6U[RMKP =? CPF #OCTK = ? RKQPGGTGF VJKUCRRTQCEJ HQT UGNHNGCTPKPI CPF UGNHQTICPK\KPI PGVU 6JG[ HQTOWNCVGF VJG RTQDNGO QHUGNHNGCTPKPI KPVQ C ENCUUKſECVKQP RTQDNGO YJKEJ EQPUKUVU QH QRVKOCN RCTVKVKQPKPI QH

+P CFFKVKQP C OCVJGOCVKECN OKPKOK\CVKQP RTQEGFWTG IGPGTCNK\GF RTQDCDKNKUVKE FGENCUUKſGT FGUKIP WPFGT VJKU HTCOGYQTM 5KPEG VJGP XCTKQWU NQUU HWPEVKQPU JCXG DGGPWUGF KP FGUKIPKPI ENCUUKſGTU KPENWFKPI VJQUG RQRWNCT OGCPUSWCTG GTTQT DCUGF NQUUHWPEVKQPU *QYGXGT OCP[ VTCEVCDNG NQUU HWPEVKQPU FQ PQV JCXG C FKTGEV TGNCVKQP VQVJG TGEQIPKVKQP GTTQT TCVG OKPKOK\CVKQP CPF VJGTGHQTG CNDGKV DCUGF QP FKUETKOKPCPVHWPEVKQPU VJG[ CTG PQV FKTGEVN[ TGNCVGF VQ TGEQIPKVKQP GTTQT TCVG YJKEJ UJQWNF DG VJGOQUV UGPUKDNG EJQKEG HQT ENCUUKſGT FGUKIP

1XGT VJG RCUV FGECFG VJG /%' DCUGF CRRTQCEJ JCU DGGP FGXGNQRGF VQ QXGTEQOG VJGHWPFCOGPVCN NKOKVCVKQPU QH VJG VTCFKVKQPCN CRRTQCEJ CPF VQ FKTGEVN[ NKPM VJG ENCUUKſGTFGUKIP RTQDNGO VQ ENCUUKſECVKQP GTTQT TCVG OKPKOK\CVKQP +P QTFGT VQ CNNGXKCVG VJGFGRGPFGPE[ QP VJG ENCUU RQUVGTKQT FKUVTKDWVKQPU C FKUETKOKPCPV HWPEVKQP DCUGF /%'CRRTQCEJ YCU RTQRQUGF D[ ,WCPI GV CN =? CU CP CNVGTPCVKXG VQ QRVKOCN ENCUUKſGT FG

UKIP #NVJQWIJ VJKU CRRTQCEJ CRRNKGU VQ VJG RCVVGTP TGEQIPKVKQP RTQDNGO KP IGPGTCN

KV ſPFU XCTKQWU CRRNKECVKQPU KP URGGEJ CPF NCPIWCIG RTQEGUUKPI +V YCU ſTUV CRRNKGF

VQ F[PCOKE VKOG YCTRKPI DCUGF RCVVGTP TGEQIPKVKQP U[UVGOU = ? #RRNKECVKQP VQJKFFGP /CTMQX OQFGN DCUGF EQPVKPWQWU URGGEJ TGEQIPKVKQP U[UVGOU YCU HQTOWNCVGF

CU C UGIOGPVCN CPF UVTKPI OQFGN DCUGF /%' CRRTQCEJ = ? CPF UWEEGUUHWN CRRNKECVKQPU QH VJKU CRRTQCEJ YGTG TGRQTVGF KP =     ? 6JKU CRRTQCEJYCU HWTVJGT GZVGPFGF VQ HQTO C EQODKPGF UVTKPI OQFGN KP YJKEJ VTCKPKPI QH QVJGTOQFGN EQORQPGPVU KP URGGEJ CPF NCPIWCIG RTQEGUUKPI ECP DG CEJKGXGF WPFGT C WPKſGF /%' HTCOGYQTM = ? +V YCU CRRNKGF VQ FKUETKOKPCVKXG OQFGN EQODKPCVKQP

= ? CPF VQ CRRNKECVKQPU KP URGCMGT KFGPVKſECVKQP CPF XGTKſECVKQP =  ?6JG DCUKE KFGC QH VJG /%' CRRTQCEJ YCU HWTVJGT FGXGNQRGF HQT CRRNKECVKQPU KP WVVGTCPEG XGTKſECVKQP RTQDNGOU =  ? # IGPGTCN HTCOGYQTM QH EQODKPKPI FGVGEVKQP CPF XGTKſECVKQP KP URGGEJ TGEQIPKVKQP CPF WPFGTUVCPFKPI YCU CNUQ RTQRQUGF

KP YJKEJ VJG FKUETKOKPCPV HWPEVKQP DCUGF RCVVGTP TGEQIPKVKQP CRRTQCEJ YCU CRRNKGF

KP DQVJ FGVGEVKQP CPF XGTKſECVKQP RTQEGUUGU = ?

9G DGIKP KP VJG PGZV UGEVKQP YKVJ C DTKGH TGXKGY QH VJG $C[GU FGEKUKQP VJGQT[ CPFKVU CRRNKECVKQP VQ VJG HQTOWNCVKQP QH UVCVKUVKECN RCVVGTP TGEQIPKVKQP RTQDNGO 9G KPVTQFWEG VJG FKUETKOKPCPV HWPEVKQP DCUGF UVCVKUVKECN RCVVGTP TGEQIPKVKQP CRRTQCEJ KP5GEVKQP  +P 5GEVKQP  YG RTQXKFG C DTKGH KPVTQFWEVKQP VQ URGGEJ TGEQIPKVKQP CPFJKFFGP /CTMQX OQFGNKPI 6JG FKUETKOKPCPV HWPEVKQP DCUGF /%' RCVVGTP TGEQIPKVKQPCRRTQCEJ CPF KVU CRRNKECVKQP VQ *// DCUGF URGGEJ TGEQIPKVKQP U[UVGOU CTG KPVTQFWEGF KP 5GEVKQP  %QORCTKUQPU CTG OCFG VQ QVJGT ETKVGTKC KP URGGEJ TGEQIPKVKQPKPHQTOCVKQP ETKVGTKC KP ENCUUKſGT FGUKIP KP VJG UGEQPF JCNH QH 5GEVKQP  +P 5GEVKQP 

YG UVWF[ VJG GODGFFGF UVTKPI OQFGN DCUGF /%' CRRTQCEJ CPF KVU GZVGPUKQP VQ VJGJKIJGT NGXGN EQODKPGF UVTKPI OQFGN 9G FKUEWUU KUUWGU CPF CRRNKECVKQPU KP FKUETKOKPCVKXG OQFGN EQODKPCVKQP FKUETKOKPCVKXG NCPIWCIG OQFGN GUVKOCVKQP CPF FKUETKOKPCVKXG HGCVWTG GZVTCEVKQP WPFGT VJG IGPGTCN VJGQTGVKECN HTCOGYQTM QH VJG EQODKPGFUVTKPI OQFGN 5GEVKQP  KU FGXQVGF VQ CRRNKECVKQPU QH FKUETKOKPCPV HWPEVKQP DCUGFRCVVGTP TGEQIPKVKQP CRRTQCEJ KP XGTKſECVKQP CPF KFGPVKſECVKQP 6JG FKUETKOKPCPVHWPEVKQP CRRTQCEJ KU UVWFKGF HQT XCTKQWU CRRNKECVKQPU KP URGGEJ CPF NCPIWCIG RTQEGUUKPI UWEJ CU URGCMGT KFGPVKſECVKQP CPF XGTKſECVKQP WVVGTCPEG XGTKſECVKQP TGEQIPKVKQP DCUGF QP IGPGTCNK\GF EQPſFGPEG OGCUWTGU FGVGEVKQP CPF XGTKſECVKQP DCUGFCRRTQCEJ KP URGGEJ TGEQIPKVKQP CPF WPFGTUVCPFKPI 6JG EJCRVGT KU UWOOCTK\GF YKVJFKUEWUUKQPU KP 5GEVKQP 

1.2 Optimal Classifier from Bayes Decision Theory

YQTFU VJG FGUKIPGT JCU HWNN MPQYNGFIG QH VJG TCPFQO PCVWTG QH VJG UQWTEG (TQO VJGUGV QH LQKPV RTQDCDKNKV[ FKUVTKDWVKQPU VJG OCTIKPCN CPF VJG EQPFKVKQPCN RTQDCDKNKV[FKUVTKDWVKQPU ECP DG GCUKN[ ECNEWNCVGF





YJKEJ CUUKIPU PQ NQUU VQ EQTTGEV ENCUUKſECVKQP CPF C WPKV NQUU VQ CP[ GTTQT TGICTFNGUU

RTQDCDKNKV[ QH ENCUUKſECVKQP QT TGEQIPKVKQP 6JG EQPFKVKQPCN NQUU DGEQOGU

CEJKGXGF D[ /#2 FGEKUKQP KU ECNNGF ő$C[GU TKUMŒ 9JGP CNN RQUVGTKQT RTQDCDKNKVKGUCTG MPQYP VJG ENCUUKſGT DCUGF QP /#2 TWNG KU CP QRVKOCN ENCUUKſGT DCUGF QP VJG

$C[GU FGEKUKQP VJGQT[ *QYGXGT KH VJGUG RTQDCDKNKVKGU CTG PQV MPQYP QT VJG FGEKUKQPTWNG KU PQV DCUGF QP VJG ENCUU RQUVGTKQT RTQDCDKNKV[ VJGP YG ECPPQV WUG VJKU TGUWNVFKTGEVN[

+P RTCEVKEG VJGUG RTQDCDKNKVKGU JCXG VQ DG GUVKOCVGF HTQO C VTCKPKPI FCVC UGV YKVJMPQYP ENCUU NCDGNU 6JG ENCUUKECN $C[GU FGEKUKQP VJGQT[ VJWU GHHGEVKXGN[ VTCPUHQTOUVJG ENCUUKſGT FGUKIP RTQDNGO KPVQ C FKUVTKDWVKQP GUVKOCVKQP RTQDNGO 6JKU KU VJG DCUKU

QH VJG $C[GUKCP UVCVKUVKECN CRRTQCEJ VQ RCVVGTP TGEQIPKVKQP YJKEJ ECP DG UVCVGF CU

FGEKUKQP VJG PGGFGF RTQDCDKNKUVKE MPQYNGFIG ECP DG TGRTGUGPVGF D[ VJG ENCUU RTKQT

C ſPKVG COQWPV QH NCDGNGF VTCKPKPI FCVC TGSWKTKPI VJCV VJG GUVKOCVKQP OGVJQF JCU VQ

DG CDNG VQ RTQFWEG EQPUKUVGPV RCTCOGVGT XCNWGU YJGP VJG UK\G QH VJG VTCKPKPI UCORNGUXCTKGU 6JKTF KV TGSWKTGU C VTCKPKPI FCVC UGV QH UWHſEKGPV UK\G KP QTFGT VQ JCXG TGNKCDNG RCTCOGVGT GUVKOCVGU $WV KP RTCEVKEG CPF HQT URGGEJ CPF NCPIWCIG RTQEGUUKPI

KP RCTVKEWNCT VTCKPKPI FCVC CTG CNYC[U URCTUG EQORCTGF VQ CNN RQUUKDNG TGCNK\CVKQPUCPF XCTKCVKQPU KP JWOCP URGGEJ CPF NCPIWCIG 6JGUG VJTGG DCUKE KUUWGU RQKPV QWV

C HWPFCOGPVCN HCEV VJCV KU FGURKVG VJG EQPEGRVWCN QRVKOCNKV[ QH VJG $C[GU FGEKUKQPVJGQT[ CPF KVU CRRNKECVKQPU VQ RCVVGTP TGEQIPKVKQP KV ECPPQV CNYC[U DG CEEQORNKUJGF

KP RTCEVKEG DGECWUG OQUV RTCEVKECN ő/#2Œ FGEKUKQPU KP URGGEJ CPF NCPIWCIG RTQEGUUKPI CTG PQV VTWG /#2 FGEKUKQPU 6JKU WPFGTUVCPFKPI KU ETKVKECN HQT VJG FKUEWUUKQPVJCV HQNNQYU

1.3 Discriminant Function Approach to Classifier Design

&KUETKOKPCPV HWPEVKQPU QP VJG QVJGT JCPF CTG VJQUG HWPEVKQPU YJKEJ EJCTCEVGTK\G VJGFGEKUKQP TWNG QH VJG ENCUUKſGT 6JG[ OC[ QT OC[ PQV DG RTQDCDKNKV[ QT NKMGNKJQQFDCUGF HWPEVKQPU CPF VJG[ ECP EQOG HTQO FKHHGTGPV RCTCOGVTKE HCOKNKGU KPENWFKPIVJQUG HCOKNKGU YJKEJ JCXG PQ TGNCVKQP VQ VJG RCTCOGVTKE HQTO QH VJG ENCUU RQUVGTKQT

UVWFKGF HCOKN[ QH FKUETKOKPCPV HWPEVKQP KU VJG NKPGCT FKUETKOKPCPV HWPEVKQP YJKEJ JCUEQORWVCVKQPCN CFXCPVCIGU CPF FWG VQ KVU CPCN[VKE HQTO JCU TGEGKXGF EQPUKFGTCDNGCVVGPVKQP CPF VJGQTGVKECN FGXGNQROGPV HQT KVU FGUKIP 6Q KNNWUVTCVG VJG EQPEGRV YG

½

 

¾

½

  



FGUKIP WUKPI FKUETKOKPCPV HWPEVKQPU DGEQOGU C OKPKOK\CVKQP RTQDNGO QH ſPFKPI C



YQTFU VJG ENCUUKſGT FGUKIP RTQDNGO KU VQ ſPF

YJGTG


  KU VJG IKXGP HCOKN[ QH FKUETKOKPCPV HWPEVKQPU +H VJG NQUU HWPEVKQP



VQ RQKPV QWV VJCV VJG FKUETKOKPCPV HWPEVKQP CRRTQCEJ VQ VJG QRVKOCN ENCUUKſGT FGUKIP

YKNN DG KPHGTKQT VQ VJG QRVKOCN /#2 ENCUUKſGT VJCV CEJKGXGU VJG OKPKOWO $C[GU TKUM6JG WUG QH FKUETKOKPCPV HWPEVKQPU KP UVCVKUVKECN RCVVGTP TGEQIPKVKQP KU VQ UQNXG VJGENCUUKſGT FGUKIP RTQDNGO YJGP VJG GZCEV HQTO CPF XCNWG QH VJG ENCUU RQUVGTKQT RTQDC

*//DCUGF CEQWUVKE OQFGNKPI DGHQTG KPVTQFWEKPI C FKUETKOKPCPV HWPEVKQP DCUGF CRRTQCEJ VQ URGGEJ TGEQIPKVKQP

1.4 Speech Recognition and Hidden Markov Modeling

5RGGEJ TGEQIPKVKQP KU C RTQDNGO QH TGEQIPK\KPI C YQTF UGSWGPEG HTQO JWOCP URGGEJ+V ECP DG XKGYGF CU C EQOOWPKECVKQP RTQDNGO 6JG JWOCP DTCKP UGTXGU CU VJG VGZV

EJCPPGN YJKEJ EQPUKUVU QH C URGCMGTŏU CTVKEWNCVQT[ CRRCTCVWU CPF QVJGT CEQWUVKE RTQEGUUGU VJCV EQPXGTV VJG VGZV UVTKPI KPVQ CP CWFKDNG CEQWUVKE YCXGHQTO 6JG CEQWUVKEEJCPPGN KP XGTDCN EQOOWPKECVKQP CEVU CU C FCVC VTCPUFWEGT CPF EQORQUGT 6JG URGGEJTGEQIPK\GT KU C FGEQFGT YJKEJ RGTHQTOU CP KPXGTUG QRGTCVKQP VQ FGEQFG VJG OGUUCIGHTQO VJG URGGEJ YCXGHQTO 6JGTGHQTG C FGEQFGT RGTHQTOU C OCZKOWO C RQUVGTKQT

YJGTG


 KU VJG UEQTG HTQO CEQWUVKE OQFGNKPI CPF

 KU VJG UEQTG HTQOVJG NCPIWCIG OQFGN # V[RKECN URGGEJ TGEQIPKVKQP U[UVGO EQPUKUVU QH VJG HQNNQYKPIDCUKE EQORQPGPVU

VWTGU HQT URGGEJ TGEQIPKVKQP HTQO VJG URGGEJ YCXGHQTO +V V[RKECNN[ KPENWFGU

C UJQTVVKOG EGRUVTCN CPCN[UKU YJKEJ IGPGTCVGU C HGCVWTG XGEVQT QH NQY HTG

KPI RTQEGFWTGU CTG RGTHQTOGF VQ UGRCTCVG VJG UCNKGPV CEQWUVKE KPHQTOCVKQP HQT



½

   

Ì

VJKU RWTRQUG CNVJQWIJ VJG PGWTCN PGVYQTM DCUGF CRRTQCEJ KU CNUQ WUGF KP OCP[U[UVGOU 6JG OQFGN WPKVU ECP DG DCUGF QP UGOCPVKECNN[ OGCPKPIHWN WPKVU UWEJ

CU YQTFU QT RJQPGVKECNN[ OGCPKPIHWN UWDYQTF WPKVU UWEJ CU RJQPGOGU

IKXGP VJG HGCVWTG CPF VJG OQFGN (QT URGGEJ TGEQIPKVKQP DCUGF QP *// OQFGNKPI VJKU KU CEJKGXGF VJTQWIJ 8KVGTDK FGEQFKPI (QT C FKUETGVG QDUGTXCVKQP

EQPVKPWQWU FGPUKV[ *//U

5RGGEJ KU IGPGTCVGF HTQO JWOCP CTVKEWNCVQT CPF KV KU WPKSWG KP OCP[ YC[U 9JGPCKT RTGUUWTG CPF ƀQY VQ RTQFWEG CP CWFKDNG UGSWGPEG QH UQWPFU &WG VQ VJG RJ[UKECNEQPUVTCKPVU VJG CTVKEWNCVQT EQPſIWTCVKQP ECPPQV WPFGTIQ XGT[ FTCUVKE EJCPIGU CPFFWTKPI VJG UJQTV KPVGTXCN YJGTG VJG CTVKEWNCVQT[ EQPſIWTCVKQP UVC[U TGNCVKXGN[ EQPUVCPV C TGIKQP QH őSWCUKUVCVKQPCTKV[Œ KP VJG RTQFWEGF URGGEJ ECP QHVGP DG QDUGTXGF

*KFFGP /CTMQX OQFGNKPI KU C RQYGTHWN UVCVKUVKECN HTCOGYQTM HQT VKOG XCT[KPI SWCUKUVCVKQPCT[ RTQEGUU CPF C RQRWNCT EJQKEG HQT UVCVKUVKECN OQFGNKPI QH URGGEJ UKIPCN

OGPV CPF KV KU EQPXGPVKQPCNN[ C EGRUVTCN XGEVQT



 
 Õ  Õ  







URGGEJ IGPGTCVKQP RTQEGUU +P QVJGT YQTFU VJG UVTWEVWTG QH C JKFFGP /CTMQX OQFGNRTQXKFGU C TGCUQPCDNG OGCPU HQT EJCTCEVGTK\KPI VJG FKUVTKDWVKQP QH C URGGEJ UKIPCN

¼

*//U CU URGGEJ FKUVTKDWVKQPU KU UJQYP VQ DG RTCEVKECNN[ GHHGEVKXG

 Ø

+P QTFGT VQ CRRN[ *//U VQ URGGEJ TGEQIPKVKQP VJTGG DCUKE RTQDNGOU JCXG VQ DG TGUQNXGF PCOGN[ VJG GXCNWCVKQP RTQDNGO VJG FGEQFKPI RTQDNGO CPF VJG GUVKOCVKQP

CPF YQTF ENCUUGU VJG YQTF UGSWGPEG KP URGGEJ WVVGTCPEG ECP DG KFGPVKſGF D[ VTCEKPI

*// RCTCOGVGTU
HTQO C IKXGP UGV QH VTCKPKPI UCORNGU CEEQTFKPI VQ UQOG OGCPKPIHWN ETKVGTKQP 6JG EQPXGPVKQPCN CRRTQCEJ KU DCUGF QP VJG OCZKOWO NKMGNKJQQF

QP VJG VTCKPKPI FCVC KU OCZKOK\GF 8CTKQWU JKIJN[ GHſEKGPV / DCUGF CNIQTKVJOU CTGFGXGNQRGF KP URGGEJ TGEQIPKVKQP HQT *//U UWEJ CU $CWO9GNEJ CNIQTKVJO =? CPFUGIOGPVCN MOGCPU CNIQTKVJO =? /QTG FKUEWUUKQPU QH RCTCOGVGT GUVKOCVKQP RTQDNGO HQT *//U ECP DG HQWPF KP =? +V UJQWNF DG PQVGF VJCV VJG EQPXGPVKQPCN /.OGVJQF KP URGGEJ TGEQIPKVKQP FQGU PQV PGEGUUCTKN[ NGCF VQ C OKPKOWO GTTQT TCVG RGTHQTOCPEG HQT VJG TGEQIPK\GT 6JKU KU FWG OCKPN[ VQ  VJG NKMGN[ OKUOCVEJ DGVYGGPVJG EJQUGP FKUVTKDWVKQP HQTO CPF VJG CEVWCN URGGEJ FCVC FKUVTKDWVKQP CPF  VJG ſPKVG

1.5 MCE Classifier Design Using Discriminant Functions

#U KV KU PQVGF YKVJQWV VJG MPQYNGFIG QH VJG HQTO QH VJG ENCUU RQUVGTKQT RTQDCDKNKVKGU TGSWKTGF KP VJG ENCUUKECN $C[GU FGEKUKQP VJGQT[ ENCUUKſGT FGUKIP D[ FKUVTKDWVKQPGUVKOCVKQP QHVGP FQGU PQV NGCF VQ CP QRVKOCN RGTHQTOCPEG 6JKU OQVKXCVGU VJG GHHQTV

QH UGCTEJKPI HQT QVJGT CNVGTPCVKXG ETKVGTKC KP ENCUUKſGT FGUKIP +P RCTVKEWNCT ETKVGTKCOCVKQP CTG WUGF KP OCP[ CRRNKECVKQPU = ? #NVJQWIJ VJGUG OGVJQFU FGOQPUVTCVGUKIPKſECPV RGTHQTOCPEG CFXCPVCIGU QXGT VJG VTCFKVKQPCN / CRRTQCEJ VJG[ CTG PQVDCUGF QP C FKTGEV OKPKOK\CVKQP QH C NQUU HWPEVKQP YJKEJ NKPMU VQ VJG ENCUUKſECVKQPGTTQT TCVG

&Q6W GV CN =? UVWFKGF /%' UQNWVKQP HQT VJG VYQ ENCUU PQPRCTCOGVTKE ENCUUKſECVKQP RTQDNGO WUKPI NKPGCT FKUETKOKPCPV HWPEVKQPU 6JG[ GORNQ[GF C YKPFQYGFUEJGOG VQ QXGTEQOG VJG RTQDNGO QH UKPIWNCT ITCFKGPV HWPEVKQPU CUUQEKCVGF YKVJ VJGGTTQT EQWPV KPFKECVQT HWPEVKQP QH VJG ENCUUKſGT # IGPGTCN CRRTQCEJ HQT OWNVKENCUUCPF PQPNKPGCT FKUETKOKPCPV HWPEVKQPU CTG RTQRQUGF D[ ,WCPI GV CN =? 6JKU IGPENCUUKſGT FGUKIP CPF RCTCOGVGT GUVKOCVKQP CTG VQ EQTTGEVN[ FKUETKOKPCVG VJG QDUGTXCVKQPU HQT DGUV TGEQIPKVKQPENCUUKſECVKQP TGUWNVU TCVJGT VJCP VQ ſV VJG FKUVTKDWVKQPU VQVJG FCVC

NQUU TGNCVGU VQ C OKPKOK\CVKQP QH VJG TGEQIPKVKQP GTTQT TCVG QH VJG ENCUUKſGT 6JKU KUCEJKGXGF VJTQWIJ C VJTGG UVGR RTQEGUU

 6JG OKUENCUUKſECVKQP OGCUWTG KP VJG /%' DCUGF CRRTQCEJ KU FGſPGF CU

ENCUUGU KPVQ EQPUKFGTCVKQP CEEQTFKPI VQ VJG KPFKXKFWCN UKIPKſECPEG YJGP UGCTEJKPI

 6JG ENCUUKſGT RCTCOGVGT GUVKOCVKQP KU DCUGF QP VJG OKPKOK\CVKQP QH VJG GZRGEVGF

HQT ENCUUKſGT RCTCOGVGT QRVKOK\CVKQP +V UJQWNF DG RQKPVGF QWV VJCV KH VJG EQTTGEV HQTO

6JG RWTRQUG QH VJG VTCKPKPI RTQEGUU KP VJG /%' CRRTQCEJ KU VQ ſPF C UGV QH RCTCOGVGTU

NQUU YG HQEWU QP CTG VJG GZRGEVGF NQUU CPF VJG GORKTKECN NQUU

8CTKQWU OKPKOK\CVKQP CNIQTKVJOU ECP DG WUGF VQ OKPKOK\G VJG GZRGEVGF NQUU 6JG

DG WUGF VQ CEEQORNKUJ VJKU VCUM =? +P )2& DCUGF OKPKOK\CVKQP CNIQTKVJO VJG VCTIGV

  ? CPF UQOGVKOGU WPFGT VJG PCOG QH UVQEJCUVKE CRRTQZKOCVKQP 7PFGT XGT[IGPGTCN EQPFKVKQPU VJG HQNNQYKPI EQPXGTIGPEG RTQRGTVKGU ECP DG GUVCDNKUJGF =?

Property 1 Suppose the following conditions are satisfied:

almost surely (i.e with probability one).

XCTKCVKQPU VQ VJG QTKIKPCN )2& CNIQTKVJOU CTG CNUQ RQUUKDNG EJQKEGU VQ URGGF WR VJGEQPXGTIGPEG CPF TGFWEG VJG ƀWEVWCVKQP FWTKPI VJG ENCUUKſGT VTCKPKPI RTQEGUU 6JGEQPXGTIGPEG RTQRGTVKGU QH VJGUG TGNCVGF CFCRVCVKQP CNIQTKVJOU CTG DCUGF QP XCTKQWUUVCVKUVKECN EQPXGTIGPEG VJGQTKGU UWEJ CU OCTVKPICNG VJGQT[ RQVGPVKCN HWPEVKQPU GVECPF KV KU UVKNN C XGT[ CEVKXG CTGC QH TGUGCTEJ *QYGXGT HTQO CP CRRNKECVKQP RQKPV

QH XKGY KP QTFGT VQ CRRN[ VJKU CNIQTKVJO VQ URGGEJ TGEQIPKVKQP UWEJ CU C URGGEJTGEQIPKVKQP U[UVGO WUKPI *//U VJG )2& CNIQTKVJO JCU VQ CEEQOOQFCVG XCTKQWUEQPUVTCKPVU KORQUGF QP VJG *// UVTWEVWTGU +P RCTVKEWNCT VJG )2& CNIQTKVJO KU CPWPEQPUVTCKPGF OKPKOK\CVKQP UEJGOG VJCV PGGFU OQFKſECVKQP HQT UQNXKPI OKPKOK\CVKQP RTQDNGOU YKVJ EQPUVTCKPVU #U YKNN DG UJQYP UJQTVN[ QPG ECP WVKNK\G RCTCOGVGTURCEG VTCPUHQTOCVKQPU VQ TGUQNXG VJKU KUUWG +P VJKU OGVJQF VJG QTKIKPCN RCTCOGVGTUCTG WRFCVGF VJTQWIJ VJG KPXGTUG VTCPUHQTO HTQO VJG VTCPUHQTOGF RCTCOGVGT URCEG VQVJG QTKIKPCN RCTCOGVGT URCEG 6JKU KU FQPG KP UWEJ C YC[ VJCV EQPUVTCKPVU QP VJG QTKIKPCN RCTCOGVGTU CTG CNYC[U OCKPVCKPGF /QTG FGVCKNGF KNNWUVTCVKQPU QH VJKU CRRTQCEJCTG IKXGP KP NCVGT UGEVKQPU

UWTG YJKEJ CUUKIPU GSWCN OCUU CV GCEJ UCORNG 6JG GORKTKECN NQUU QP VJG QVJGT JCPF

CTG QDVCKPGF D[ CP KPFGRGPFGPV UCORNKPI HTQO C URCEG YKVJ C ſZGF RTQDCDKNKV[ FKUVTK





GORKTKECN NQUU KU CP GUVKOCVG QH VJG GZRGEVGF NQUU 6JG IQQFPGUU QH VJKU GUVKOCVG KU

EQPXGTIGPEG TCVG QH VJG GORKTKECN RTQDCDKNKV[ OGCUWTG ECP DG HQWPF KP =?

+V UJQWNF DG RQKPVGF QWV VJCV CNVJQWIJ VJG )2& V[RG QH CFCRVCVKQP CNIQTKVJO KU GHHGEVKXG CPF OQUV RQRWNCT QVJGT QRVKOK\CVKQP OGVJQFU ECP CNUQ DG WUGF HQT GTTQT TCVGOKPKOK\CVKQP /%' DCUGF ENCUUKſGT FGUKIP KU XGT[ URGEKſE QP VJG HQTO CPF UVTWEVWTG

QH VJG FKUETKOKPCPV HWPEVKQP CPF NQUU HWPEVKQP TGICTFKPI VJG ENCUUKſGT CPF TGNCVKXGN[WPTGUVTKEVGF VQ YJCV RCTVKEWNCT QRVKOK\CVKQP OGVJQFU YJKEJ CTG WUGF VQ OKPKOK\GVJG NQUU /CP[ KPPQXCVKQPU CTG RQUUKDNG HQT DGVVGT QRVKOK\CVKQP TGUWNVU +P RCTVKEWNCT OGVJQFU QH NKPGCT RTQITCOOKPI =? ITCFKGPV RTQLGEVKQP =? CPF ITQYVJVTCPUHQTOCVKQP =  ? CTG CNUQ WUGF HQT OKPKOK\CVKQP QH VJG GZRGEVGF NQUU KP/%' ENCUUKſGT FGUKIP +P VJG ITQYVJ VTCPUHQTOCVKQP DCUGF CRRTQCEJ VJG IQCN KU VQ

RTQDCDKNKV[ EQFGDQQMU =? CVGT KV YCU HWTVJGT IGPGTCNK\GF VQ CPCN[VKE HWPEVKQPU

=? 5KPEG VJGP VJKU CRRTQCEJ YCU CFQRVGF HQT /%' VTCKPKPI QH *// DCUGF URGGEJTGEQIPKVKQP U[UVGOU YKVJ FKUETGVG RTQDCDKNKV[ FGPUKVKGU =?

+P VJG ITQYVJVTCPUHQTOCVKQP DCUGF QRVKOK\CVKQP CRRTQCEJ VJG OQFGN RCTCOGVGT

KP C OQTG IGPGTCN UGVVKPI $WV OQTG YQTM TGOCKPU VQ DG FQPG KP QTFGT VQ CRRN[VJG UKOKNCT OGVJQF HQT IGPGTCN /%' DCUGF RCTCOGVGT GUVKOCVKQP YKVJ EQPVKPWQWU

QH VJG QTKIKPCN CNIQTKVJO CPF WUKPI UGCTEJ JGWTKUVKEU CTG CVVGORVGF VQ URGGF WR VJGEQPXGTIGPEG CPF RGTHQTOCPEG KORTQXGOGPVU QXGT VJG QTKIKPCN CRRTQCEJ CTG CNUQTGRQTVGF KP = ?

+V OC[ DG FGUKTCDNG VQ OCKPVCKP VJG QTKIKPCN EQPUVTCKPVU KP VJG *// CU RTQDCDKNKV[

OGCP XGEVQT HQNNQYU

#U OGPVKQPGF GCTNKGT VJG )2& CNIQTKVJO KU C ITCFKGPV DCUGF CPF WPEQPUVTCKPGF OKPKOK\CVKQP OGVJQF +P QTFGT VQ WUG HQT FKUETKOKPCPV HWPEVKQPU HTQO EGTVCKP HCOKNKGUUWEJ CU RTQDCDKNKV[ FGPUKV[ HWPEVKQPU HTQO *//U ECTG OWUV DG VCMGP UWEJ VJCV VJQUGCTG WUGF HQT VJKU RWTRQUG #PQVJGT KORQTVCPV CPF RGTJCRU VJG OQUV FKHſEWNV KUUWG

KP )2& DCUGF NQUU HWPEVKQP OKPKOK\CVKQP CRRTQCEJ KU JQY VQ FGUKIP VJG UVGR UK\G1PG CRRCTGPV TGCUQP KU VJCV YG PGGF C IQQF UVGR UK\G VQ UVCTV YKVJ UKPEG VJG OQFGNCFCRVCVKQP YKNN DG RGTHQTOGF QPN[ C ſPKVG PWODGT QH VKOGU +H VJG UVGR UK\G KU VQQNCTIG VJG ENCUUKſGT YKNN DG FGITCFGF CV VJG UVCTV CPF UGSWGPVKCN NGCTPKPI ECPPQV DGOCFG UWEEGUUHWN +H VJG UVGR UK\G KU VQQ UOCNN VJG EQPXGTIGPEG URGGF QH VJG CNIQTKVJO

KU VQQ UNQY CPF KV KU RTCEVKECNN[ PQV WUGHWN 6JG UVGR UK\G RTQDNGO KU TGNCVGF VQ VJGRCTVKEWNCT HWPEVKQPCN HQTO QH VJG NQUU HWPEVKQP CPF VQ VJG DGUV QH QWT MPQYNGFIG VJGIGPGTCN UQNWVKQP VQ KV KU UVKNN NCEMKPI )GPGTCNN[ URGCMKPI KV UJQWNF DG TGNCVGF VQ VJGGKIGPXCNWGU QH VJG *GUUKCP OCVTKZ GXGP VJQWIJ KV KU CP KVGTCVKXG CNIQTKVJO (QT *//DCUGF U[UVGOU WUKPI OKZVWTG )CWUUKCP QDUGTXCVKQP FGPUKVKGU RCTCOGVGTU KP VJG ENCUUKſGT JCXG FKHHGTGPV UGPUKVKXKVKGU VQ VJG UVGR UK\G KP RCTCOGVGT CFCRVCVKQP 1PG UVGRUK\G ECP DG VQQ UOCNN HQT UQOG RCTCOGVGTU CPF VQQ NCTIG HQT QVJGTU +P RCTVKEWNCT VJGOCIPKVWFG QH XCTKCPEGU KP VJG OKZVWTG )CWUUKCP QDUGTXCVKQP FGPUKVKGU ECP XCT[ KP VJG

CNIQTKVJO YKNN GKVJGT PQV EQPXGTIG QT YKNN DG VQQ UNQY VQ DGEQOG RTCEVKECNN[ WUGNGUURTQDNGO +P UGIOGPVCN )2& CRRTQCEJ VJG GTTQT TCVG OKPKOK\CVKQP KU RGTHQTOGF QPVJG VTCPUHQTOGF OGCP XGEVQT PQTOCNK\GF D[ KVU UVCPFCTF FGXKCVKQP 6JKU VCMGU CYC[VJG FGRGPFGPEKGU QP VJG XCTKCPEG XCTKCVKQPU

&WTKPI )2& VTCKPKPI VJG VTCKPKPI FCVC ECP DG TGWUGF CPF VTCKPKPI ECP DG KVGTCVGFUGXGTCN VKOGU QP VJG UCOG FCVC VQ TGCEJ EQPXGTIGPEG /GVJQFU HTQO UVCVKUVKECN FCVCUCORNKPI VJGQT[ ECP CNUQ DG CRRNKGF JGTG +PUVGCF QH UGSWGPVKCNN[ WUKPI CNN VTCKPKPIUCORNGU DQQVUVTCR TGUCORNKPI UEJGOGU QT KORQTVCPEG QH UCORNKPI UEJGOGU ECP DGWUGF JGTG VQ GZVTCRQNCVG VJG UCORNG FCVC FKUVTKDWVKQP QT VQ CFCRV VJG ENCUUKſGT VQYCTFUUQOG URGEKſE RQRWNCVKQPU 9KVJ VJG CFXCPEG QH OKETQRTQEGUUQTU UWEJ OGVJQFU JCXGDGEQOG EQORWVCVKQPCNN[ HGCUKDNG 6JG CDQXGOGPVKQPGF UGIOGPVCN )2& CNIQTKVJOſPFU OCP[ CRRNKECVKQPU KP URGGEJ TGEQIPKVKQP 6JG TGEQIPKVKQP RGTHQTOCPEG CFXCPVCIG QXGT VJG VTCFKVKQPCN FKUVTKDWVKQP DCUGF / CRRTQCEJ KU TGRQTVGF HTQO XCTKQWUUKVGU CPF KP FKHHGTGPV CRRNKECVKQPU =    ? 6JG UWEEGUU QH VJKU CNIQTKVJO

KP URGGEJ TGEQIPKVKQP RTQXKFGU GZRGTKOGPVCN GXKFGPEG VJCV ENCUUKſGT FGUKIP DCUGF QPGTTQT TCVG OKPKOK\CVKQP KU HGCUKDNG GXGP HQT F[PCOKE RCVVGTPU CU FKHſEWNV CU URGGEJ+ORTQXGF TGEQIPKVKQP RGTHQTOCPEG QXGT VTCFKVKQPCN FKUVTKDWVKQP DCUGF / CRRTQCEJCTG CNUQ TGRQTVGF KP CTGCU QWVUKFG QH URGGEJ UWEJ CU 1%4 KOCIG TGEQIPKVKQP CPFJCPFYTKVKPI TGEQIPKVKQP =?

+P CFFKVKQP VQ VJG /%' ETKVGTKQP QVJGT ETKVGTKC CTG CNUQ WUGF KP UQECNNGF FKUETKOKPCVKXG ENCUUKſGT FGUKIP (QT *// DCUGF U[UVGOU VJG ETKVGTKC QH OCZKOWO OWVWCN

VGTPCVKXGU YJKEJ JCXG HQWPF VJGKT WUG KP URGGEJ TGEQIPKVKQP #OQPI VJGO //+ KUOQUV RQRWNCT CPF CRRNKGF KP OCP[ CRRNKECVKQPU YKVJ UWEEGUU 6JG //+ CRRTQCEJ KU

QH VJG OWVWCN KPHQTOCVKQP JCU VJG HQNNQYKPI HQTO

TGUWNVU KPFKECVG VJCV ENCUUKſGT FGUKIP DCUGF QP VJG //+ ETKVGTKQP ECP NGCF VQ DGVVGT TGEQIPKVKQP RGTHQTOCPEG VJCP VJG EQPXGPVKQPCN CRRTQCEJ WUKPI VJG / ETKVGTKQP

= ? #NVJQWIJ VJKU ETKVGTKQP KU YGNN HQWPFGF KP KPHQTOCVKQP VJGQT[ RQUUGUUKPIIQQF VJGQTGVKECN RTQRGTVKGU CPF WPKSWG KP OCP[ YC[U KV KU PQV DCUGF QP C FKTGEV OKPKOK\CVKQP QH VJG ENCUUKſECVKQP GTTQT TCVG CPF KU SWKVG FKHHGTGPV HTQO VJG /%' DCUGFCRRTQCEJ 6JG TGNCVKQP DGVYGGP //+ CPF /%' KU C XGT[ KPVGTGUVKPI VQRKE CPF UVWFKGF KP = ? +V KU HQWPF VJCV WPFGT EGTVCKP EQPFKVKQPU FKTGEV EQORCTKUQPU ECP DGOCFG DGVYGGP VJGUG VYQ CRRTQCEJGU 6JG FKUEWUUKQP DGNQY KU DCUGF QP =? 9GFGTKXG VJG GZRNKEKV TGNCVKQPU DGVYGGP /%' CPF //+ CPF HTQO VJGTG RTQRGTVKGU QHDQVJ CRRTQCEJGU ECP DG KNNWUVTCVGF

UKIOQKF HWPEVKQP KVUGNH CU KP /%' CRRTQCEJ 6JG F[PCOKE TCPIG QH VJKU NQUU HWPEVKQP

VQ CRRTQZKOCVG VJG TGEQIPKVKQP GTTQT TCVG HWPEVKQP CPF KVŏU QRVKOCNKV[ VQ ENCUUKſGTFGUKIP ECPPQV DG FKTGEVN[ GUVCDNKUJGF HTQO VJG GTTQT TCVG OKPKOK\CVKQP EQPUKFGTCVKQP(TQO VJG FKUETKOKPCPV HWPEVKQP RQKPV QH XKGY //+ KU VQ OKPKOK\G VJG CXGTCIG OKU

+V GZRNCKPU VJG GZRGTKOGPVCN TGEQIPKVKQP RGTHQTOCPEG KORTQXGOGPVU QDVCKPGF HTQOVJG //+ CRRTQCEJ GXGP KP VJG ECUG YJGTG VJG FKUVTKDWVKQPCN CUUWORVKQP KU MPQYPPQV XCNKF

   CPF

GTCIG KPEQTTGEV EQORGVKVKXG ECPFKFCVGU DQVJ VJG /%' CPF //+ QDLGEVKXG HWPEVKQPU

 6JG QDLGEVKXG HWPEVKQP KP VJG /%' CRRTQCEJ KU FKTGEVN[ TGNCVGF VQ VJG UKIP EJCPIGU KP

DGJCXKQT OC[ JCXG UQOG CFXGTUG GHHGEVU KP //+ DCUGF RCTCOGVGT GUVKOCVKQP UKPEG

(WTVJGT KPUKIJVU ECP DG ICKPGF D[ GZCOKPKPI VJG ITCFKGPV QH VJG QDLGEVKXG HWPEVKQPUCUUQEKCVGF YKVJ VJGUG VYQ CRRTQCEJGU 6JG ITCFKGPV QH VJG QDLGEVKXG HWPEVKQP KP /%'CRRTQCEJ JCU VJG HQNNQYKPI HQTO




 

YJGTG

KU VJG FGTKXCVKXG QH VJG UKIOQKF HWPEVKQP 1P VJG QVJGT JCPF VJG ITCFKGPV

QH VJG QDLGEVKXG HWPEVKQP KP VJG //+ CRRTQCEJ DCUGF QP VJG OKUENCUUKſECVKQP OGCUWTG

ITCFKGPV QH VJG QDLGEVKXG HWPEVKQP KP //+ CRRTQCEJ KU VJG UKIOQKF HWPEVKQP KVUGNH CHWPEVKQP YJKEJ KU OQPQVQPKE KPETGCUKPI CPF RWVU GORJCUKU QP GZVTGOG HCNUG ENCUUK



RTQRGT EQPVTQN VJG RCTCOGVGT GUVKOCVKQP ECP DG UVTQPIN[ KPƀWGPEGF D[ VJG QWVNKGTUCPF VJG GUVKOCVKQP TGUWNVU OC[ DGEQOG DKCUGF 6JKU RTQDNGO ECP DG CEWVG KP URGGEJTGEQIPKVKQP UKPEG UWEJ QWVNKGTU CTG QHVGP HTQO YTQPI NCDGNKPI CPF GZVTGOG OKUOCVEJ

KP CEQWUVKE EQPFKVKQPU 2CTCOGVGT GUVKOCVKQP KP FKUETKOKPCPV HWPEVKQP DCUGF CRRTQCEJ

KU VQ ſPF CP QRVKOCN RCTVKVKQP QH VJG UCORNG URCEG UWEJ VJCV VJG TGEQIPKVKQP GTTQT TCVGECP DG TGFWEGF 6JGTGHQTG C TQDWUV VTCKPKPI CNIQTKVJO DCUGF QP VJG /%' ETKVGTKQP UJQWNF DG OQTG UGPUKVKXG QP VJG EJCPIGU KP VJG FGEKUKQP DQWPFCTKGU UKPEG VJGUGVJCV VJKU RTQRGTV[ KU GODGFFGF KP VJG UKIOQKF HWPEVKQP WUGF KP VJG /%' DCUGF CR

(KI  VJG OQFGN RCTCOGVGT CFLWUVOGPVU KPUKIOQKF HWPEVKQP DCUGF /%' CRRTQCEJ CTG OQFWNCVGF D[ VJG FGTKXCVKXG QH VJG UKI

DG RQKPVGF QWV VJCV CNVJQWIJ GZRNKEKV TGNCVKQP DGVYGGP VJG //+ CPF /%' CRRTQCEJGUECP DG GUVCDNKUJGF WUKPI VJG OKUENCUUKſECVKQP OGCUWTG CPF WPFGT UQOG URGEKCN EQPFKVKQPU VJG VJGQTGVKECN UVWF[ CU YGNN CU OQTG GZVGPUKXG GZRGTKOGPVCN UVWFKGU DGVYGGPVJGUG VYQ ETKVGTKC CTG HCT HTQO EQORNGVG CPF OCP[ SWGUVKQPU TGOCKP VQ DG CPUYGTGF

6JG /%' CRRTQCEJ FGUETKDGF KP VJKU UGEVKQP KU C FKUETKOKPCPV HWPEVKQP DCUGF CRRTQCEJ VQ RCVVGTP ENCUUKſECVKQP 6JG FGEKUKQP TWNG QH VJG ENCUUKſGT KU VTGCVGF CU C FKUETKOKPCPV HWPEVKQP CPF VJG RCTCOGVGT GUVKOCVKQP KPXQNXGU OKPKOK\KPI VJG GZRGEVGFNQUU KPEWTTGF YJGP VJGUG FGEKUKQP TWNGU CTG CRRNKGF KP VJG ENCUUKſGT 6JG HQTO QH VJG

NQUU HWPEVKQP KU ETKVKECN KP FKUETKOKPCPV HWPEVKQP DCUGF ENCUUKGT FGUKIP +P VJG /%'CRRTQCEJ VJG NQUU HWPEVKQP KU EQPUVTWEVGF KP UWEJ C YC[ VJCV VJG TGEQIPKVKQP GTTQTTCVG QH VJG ENCUUKſGT KU GODGFFGF KP C UOQQVJ HWPEVKQPCN HQTO CPF OKPKOK\KPI VJGGZRGEVGF NQUU QH VJG ENCUUKſGT JCU C FKTGEV TGNCVKQP VQ VJG ENCUUKſGT GTTQT TCVG TGFWEVKQP 6JKU FKTGEV TGNCVKQP VQ TGEQIPKVKQP GTTQT TCVG KP VJG /%' CRRTQCEJ JCU UGXGTCNCFXCPVCIGU KP ENCUUKſGT FGUKIP

QH VJG ENCUUKſGT CPF VJKU RTQRGTV[ KU PQV FGRGPFGPV QP VJG RCTCOGVTKE HQTO QHVJG FKUETKOKPCPV HWPEVKQP PQT KVU TGNCVKQP VQ VJG HQTO QH VJG VTWG ENCUU RQUVGTKQTFKUVTKDWVKQP

CU[ORVQVKE DGJCXKQT QH VJG ENCUUKſGT YKNN CRRTQZKOCVG VJG OKPKOWO $C[GUTKUM

6JG FKUETKOKPCPV HWPEVKQP HQTOWNCVKQP KP VJG /%' CRRTQCEJ OCMGU KV CRRNKECDNG

VQ XCTKQWU HWPEVKQPCN FGEKUKQP TWNGU KPENWFKPI VJQUG FGEKUKQP TWNGU YJKEJ CTG PQVDCUGF QP RTQDCDKNKV[ HWPEVKQPU UWEJ CU IGPGTCNK\GF NKPGCT FKUETKOKPCPV HWPEVKQPUGVE +V CNUQ CRRNKGU VQ ECUGU YJGTG VJG RCTCOGVTKE HQTO QH VJG FKUETKOKPCPV HWPEVKQP KUMPQYP VQ DG FKHHGTGPV HTQO VJG VTWG ENCUU RQUVGTKQT FKUVTKDWVKQPU QT VJG FKUETKOKPCPVHWPEVKQP KU UGNGEVGF HTQO QVJGT EQPUKFGTCVKQPU UWEJ CU OCVJGOCVKECN VTCEVCDKNKV[ CPFCNIQTKVJOKE EQORNGZKV[

6JG / DCUGF FKUVTKDWVKQP GUVKOCVKQP CRRTQCEJ VQ RCVVGTP TGEQIPKVKQP KU HTQO C FKHPKVKQP KU GUVKOCVGF D[ CVVTKDWVKPI VQ VJG UQWTEG C RCTCOGVTKE OQFGN 2& CPF GUVKOCVKPIRCTCOGVGTU QH VJKU 2& HTQO IKXGP VTCKPKPI FCVC 6JG QRVKOCN /#2 FGEKUKQP TWNG KU CRRNKGF VQ VJG GUVKOCVGF OQFGN 2&U CU KH VJG[ YGTG VJG VTWG RTQDCDKNKV[ OGCUWTGU 5WEJ

CP CRRTQCEJ KU TGHGTTGF VQ CU VJG őRNWIKPŒ OGVJQF KP UVCVKUVKECN NKVGTCVWTG &GPQVG VJG

QH VJG OQFGNU CPF VJG QRVKOCNKV[ TGUWNVU QH VJG $C[GU ENCUUKſGT ECPPQV DG CRRNKGFFKTGEVN[ +V KU UVWFKGF KP =? VJCV CRRTQCEJGU QH /. //+ ECP DG HQTOWNCVGF CU ECUGU

KP VJG /&+ CRRTQCEJ CPF FKHHGTGPV CUUWORVKQPU CTG OCFG CDQWV VJG VTWG 2&U QH VJGUQWTEG VQ DG OQFGNGF CPF VJG 2&U VJCV CTG WUGF VQ OQFGN VJG UQWTEG 6JG /&+ KPVGTRTGVCVKQP QH VJG / CRRTQCEJ KU VJCV / GUVKOCVKQP QH RCTCOGVGTU KP VJG OQFGN 2&UHQT C IKXGP UQWTEG KU GSWKXCNGPV VQ CRRTQZKOCVKPI VJG GORKTKECN FKUVTKDWVKQP QH VJGFKUVCPEG QT TGNCVKXG GPVTQR[ UGPUG +P VJG / DCUGF CRRTQCEJ VJG /&+ OGCUWTG VQ

DG OKPKOK\GF JCU VJG HQNNQYKPI HQTO

CPF VJG FKUVTKDWVKQP QH VJG RCTCOGVTKE OQFGN GUVKOCVGF HTQO VJG VTCKPKPI FCVC HQT VJG

ETKVGTKQP HQT VJG / GUVKOCVG KU KPVTQFWEGF +H VJG 2&U QH VJG OQFGN KPENWFG VJG VTWG2&U QH VJG UQWTEG CU[ORVQVKECNN[ KV YKNN NGCF VQ C $C[GU ENCUUKſGT *QYGXGT UWEJRTQRGTVKGU OC[ GZKUV QPN[ WPFGT C OQFGN EQTTGEVPGUU CUUWORVKQP VJCV VJG VTWG 2&U QHVJG UQWTEG CTG EQXGTGF KP VJG 2&U QH VJG RCTCOGVTKE OQFGN

+H VJG 2&U QH VJG OQFGN CTG TKEJ GPQWIJ VQ RTQXKFG C IQQF CRRTQZKOCVKQP VQ VJGVTWG 2&U QH VJG UQWTEG YKVJ UWHſEKGPV VTCKPKPI FCVC VJG TGEQIPKVKQP RGTHQTOCPEGOC[ KORTQXG CU KV TGUWNVU KP C DGVVGT CRRTQZKOCVKQP VQ VJG VTWG 2&U QH VJG UQWTEGVJTQWIJ VJG GORKTKECN FKUVTKDWVKQP DCUGF QP VJG VTCKPKPI FCVC $WV KH VJG 2&U QH VJGOQFGN CTG SWKVG FKHHGTGPV EQORCTKPI VQ 2&U QH VJG UQWTEG VJG CEJKGXCDNG TGEQIPKVKQP RGTHQTOCPEG OC[ DG XGT[ NKOKVGF WUKPI VJG FKUVTKDWVKQP GUVKOCVKQP CRRTQCEJCPF FKUETKOKPCPV HWPEVKQP DCUGF ENCUUKſGT FGUKIP UJQWNF DG OQTG CRRTQRTKCVG +PURGGEJ TGEQIPKVKQP OCP[ CUUWORVKQPU QP VJG OQFGN 2&U CTG OCFG TGICTFKPI VJGURGGEJ IGPGTCVKQP RTQEGUU 5RGGEJ CU C UKIPCN UQWTEG HQT RCVVGTP TGEQIPKVKQP OC[PQV DG /CTMQXKCP PQT UJQWNF KV DG VJG ECUG VJCV EQPFKVKQPGF QP C IKXGP UVCVG VJGQDUGTXCVKQP 2&U UJQWNF DG CP KKF RTQEGUU 6JG UWEEGUU QH *//U KP URGGEJ TGEQIPKVKQP UJQWNF PQV DG EQPUVTWGF CU VJCV VJG 2&U QH VJG OQFGN EQXGT VJG VTWG 2&U QH VJGUQWTEG +P HCEV 2&U HTQO *//U CTG SWKVG NKOKVGF EQORCTKPI VQ VJG UQWTEG 2&U QHURGGEJ #NVJQWIJ VJG PCVWTG QH UQWTEG 2&U CTG WPMPQYP CPF PQ HWPFCOGPVCN CEJKGXGZRGTKOGPVCN TGUWNVU KPFKECVGF VJCV FKUETKOKPCPV HWPEVKQP DCUGF /%' CRRTQCEJ ECPNGCF VQ UKIPKſECPV KORTQXGOGPVU KP TGEQIPKVKQP RGTHQTOCPEG QXGT VJG / DCUGF CRRTQCEJ 6JG UKIPKſECPEG QH VJG /%' CRRTQCEJ KP URGGEJ TGEQIPKVKQP KU VYQHQNF(KTUV C ENCUUKſGT FGUKIP DCUGF QP FKTGEV OKPKOK\CVKQP QH VJG TGEQIPKVKQP GTTQT TCVG

KU C OGCPKPIHWN CNVGTPCVKXG VQ FKUVTKDWVKQP GUVKOCVKQP DCUGF CRRTQCEJ 5GEQPF VJG2&U WUGF KP RCTCOGVTKE OQFGNKPI QH URGGEJ CTG XGT[ NKOKVGF EQORCTGF VQ VJG VTWG2&U KP VJG UQWTEG CPF VJG FGEKUKQP TWNG DCUGF QP FKUETKOKPCPV HWPEVKQP CRRTQCEJ

KU C TGCUQPCDNG CNVGTPCVKXG VQ VJG őRNWIKPŒ /#2 TWNG YJKEJ KU DCUGF QP VJG OQFGNEQTTGEVPGUU CUUWORVKQP

1.6 Embedded String Model Based MCE Training

+P VJG CDQXG OGPVKQPGF FGXGNQROGPV QH VJG /%' VTCKPKPI HQTOCNKUO VJG WVVGTCPEG

PCVGF UVTKPI QH QDUGTXCVKQPU DGNQPIKPI VQ FKHHGTGPV ENCUUGU (QT GZCORNG C UGPVGPEG

KU C UGSWGPEG QH YQTFU GCEJ QH YJKEJ KU VQ DG OQFGNGF D[ C FKUVTKDWVKQP 6JG FGEQFJKIJGUV NKMGNKJQQF UEQTG KU EJQUGP CU VJG FGEQFGF UVTKPI 6JG NKMGNKJQQF UEQTG QH

&KUETKOKPCPV HWPEVKQPU DCUGF QP UVTKPI NGXGN OQFGNKPI CTG PGEGUUCT[ KP EQPVKPWQWUURGGEJ TGEQIPKVKQP DGECWUG VJG ENCUUKſGT FGEKUKQP TWNGU CTG DCUGF QP VJG YJQNG WVVGTCPEG NGXGN INQDCN OCVEJKPI 6JG UVTKPI OQFGN YJKEJ FGUETKDGU VJG IKXGP YQTF

UVTKPI VJCV DGUV OCVEJGU VJG KPRWV URGGEJ WVVGTCPEG JCU VQ DG FGVGTOKPGF D[ 8KVGTDKCNKIPOGPV RTQEGUU DGVYGGP CNN RQUUKDNG UVTKPI OQFGNU CPF VJG KPRWV URGGEJ WVVGTCPEG



½

   

UVTKPI OQFGN ſTUV CPF EQPUKFGT VJGO UGRCTCVGN[ NCVGT

U[UVGO WUKPI EQPVKPWQWU QDUGTXCVKQP FGPUKVKGU KU IKXGP D[

  



=? VJG FKUETKOKPCPV HWPEVKQP CV VJG UVTKPI NGXGN KU DCUGF QP VJG UVTKPI OQFGN HQT

GODGFFGF KP VJG /%' DCUGF NQUU HWPEVKQP VJTQWIJ VJG HQNNQYKPI UVGRU

 6JG OKUENCUUKſECVKQP OGCUWTG KP GODGFFGF UVTKPI OQFGN DCUGF /%' VTCKPKPI