Bài giảng Lý thuyết thông tin: Dung lượng kênh - Phạm Văn Sự

Bài giảng Lý thuyết thông tin: Dung lượng kênh cung cấp cho người học các kiến thức: Dung lượng kênh rời rạc,định lý mã hóa thứ 2 của Shannon cho nguồn rời rạc, đặc trưng của kênh Gausse nhiễu cộng, kênh có băng tần hạng chế,... Mời các bạn cùng tham khảo.

01234 56237829





!"#$%&'( )*+ %,- /0123/45%*,$%6 7,897:*,/;*<- %*'=

>?@0- %A$%6%6,.!B/@,+ %,C- D%*,$%6

EFGFHGIFEE

!- J%K8L%MN,L# CO%PQ RN2= 2S T/%6( BU%6VJ%, WXYXZY[XWW WY[\

01234

 !"#$"%

&' ()(*)+ ,-./0123)4506,(*78(9:;9<0=

>?@ABCDEF@GHIBFJKLMJNOPNQ@ARS@ATJDJKDUHVWX Y

Z W

>W[\]^]_`a^b_`cd_efghijklb_`menao

VW[pqlb_`menaa^r_`i]a\s_tuaevk`kh_wVW[\s_tuxchbyz

&' ()(*)+ ,-{)|(}(*3)4506,(*78(9:;9<0=

~BFJKLMJNOPNQ@Ă @€F?@ABCDEFVWX Y

Z W‚DPA€‚DÊJÔJKCDEF@GHJKLMJ ARS@ƠE@ATJD†

Ưˆ‰ĂÀXVWƯ‰ĂÀXƯ‰ĂÀ>

W

Ưˆ‰ĂÀ[‹Œ_`aeŽ_`ak_a^b_`cd_eyr_`b_mena^ha^r_`i]a\s_tuaevk

`kh_ws_tuxcka‘pz

Ưˆ‰ĂÀ’“”XVW‹r`‰•ÀX‹r`‰•ÀẢ>W

01234

 !"#$"%&'( !

)*+,

-./01234567189:6;0<=>3>3?@A9B@CDEFGHC/GD3.IJ1/KLMAN7O@9PQ

RS6JTJU6V6;IJ1//G43ODWO012Q

XY Z[Z\[] ^_X`+ab[c^de^Z\fgZhijhkdl

mn40./6;@o6pq4prDsC0./IJtIuvKw/J>6;/463r/3xyDz{s|CTJ43}3.9x

/J~ODWO6;@o63xyD3Ă6J6;J€OKLÂ

‚Êz{s|z{s|ÔƠ†Ưz{s|

ÔƠ† ʈƯz{s|z{s|

ÔƠ†ÊˆƯ‰

‰ÊÀ‹ŒÀ‹ŒÔƠ†Ž‘’“”•Ả•‘—•Đ

‚ ™Ã›‘œ•ž›ăÁă—âđ“đê‘ôơăẶ•ư•ž›ă”•ž•ă—ẨđẪàẬ‘™È›ẺẼ‘—•

É ° Ẹ ỀỂỄ Ếả ·ÌỈÌãÍÍẾãỊ½¾ẾÒỂáỂạằẾẳỂạỂẾả ẵÌằắặầ

ẩ$ ẫấậ%èẻ%ẽ éÐẹ ềẻể ễ ế ệ 'Ứẫ ìỉĩỉíĩịỉìì ÝĩịÞ

01234



 !"#$%&'(&)*%+,$!+,$*-!%./0*!&1$234(5!%6789:

;&1'$2!($<9(=,+> ?($@A!BC!&1'$2!($<9(&6D ?+A!@A!BE

FG*8AH!*%AI.$!($<9(=,+JK!%,$%!($<9(&6LM:NOLMPKQE

;9*/ !&AIR$!($*S6"#$%TK%6I!%'(2(6$!&A$23U$%/.!&AIR$7 !VHA!($

WKX Y

Z KE

'( )*)+*, -./0)*12)+)*345 6789:8;<=>?@A?BCCDEFCGHI8C>HJK=LMJNOPQR STHLMJNOPQ;>U=VL>W8>H:CXYZ8>@AVA[=88>\;<=>]^_CV`AaY;<=>]b=V

=>I8c=V^_CaBAV`AaY;<=>;>U=V]b=V=>I8R '( )*)+*, -./0)*1defg)+5

6789:8;<=>?@A?BCCDEFCGHI8C>HJK=LMJNOPQRSTHLMJNOPQhLhCZ=G8i;jak

;lhaXYLMJNOPQhmhCZ=G8i;ha8>\;<=>]^_CV`AaY]nAEo=VR

pq rst uvsq rswxrsrsyzs{r|}~€r‚ƒ„…†

‡ "ˆ‰Š& ‹ŒŽ Š‘ ’ “”• – —˜™˜š™›˜—— œ™›œ

01234

+, -.-/.0 1234-.5.6-/78-.9:

;<=>?@ABDEFGHIJ>GKLG=MNOPQNRNLSITFUGSV=W>GRLXIGYILZ[\N]^LG_F`IG ][aNJbScPF`IGFGHIJN^IG\TdedQZ@ceffWg

>?@ABDhCDijhkkkhCjh@Aijhkkkh@jEl>?@ABDE mno@Dpqrstustvwxpxsyz{pCD|

>?@jh@}hkkkh@~BjhC}hkkkhC~Bl~D€j>?@DBDE

x‚oƒx„s…†sz‡

ˆx‰sŠ‹Œzo‚spŽ†sŠszsŒ{ŒŠq‘stŒzo‚s’“Œ{Œ>?@ABDE

”{Œ•–pŽ—s˜{Œ™ošpŒzo‚s›lœ>DAvwx>DAl>?@ABDE

›l

ž

Ÿ

Ÿ  

>?@jBjE >?@}BjE kkk >?@¡BjE

>?@jB}E >?@}B}E kkk >?@¡B}E

¢

¢

>?@jB£E >?@}B£E kkk >?@¡B£E

¤

¥

¥

¦

01234

() *+*,+-

/01234567869::;<=>4?18416@AB4C@DEFGHIJKL81M:N016@AB4184KO15P

<=>4?15Q4?18416@AB4C@D234516R4?S01NT4KU1578?8D4<VW

EXFGHIJYKOEFGHIJYEFGHIJZ

O

ZO[Z\]^_`abcd`ec`

ZOYZ\]^_`aeaf`beagh`b

ZOiZ\]^_`a`j`ec`

k l mnom! pqrs touv uw xy  z{|{}|~{zz |~€

01234

   !"#$"%&

'()*+*,-(.*,/0123145*(678692:;,8<-6=2>2?98231:@A*,-(.*,-8*-60BC*

/0145*(-6D*,EF-?G*H=-(78,81*:IB-(JDEK84()*+*,2L-(MN

UVWXYPZ[\]^QRST

W YPZ[\]^QH_RST

W YZ[\]^`a8-bcd

Q H_O

OQRSTWYZ[\]^efghijiklgmiknoSpqSfrigstuvwuRxuyzo{

| }~€‚ƒ„ …† ‡ˆ‰ Š‡‹ŒŽ

| }~‡‘’“‘”•–—˜™“š

›œigpgzle

OPžŸOPQžfguv pg¡fgu[ v ] g¢ il¢ is£p¤¥¦§ frig¨©sªl{

OP«H_¤¢kZ¬^­¬¤ s£¤wipqSiko®i[¯

OP«H_¤¢kZ°^­° ¤ s£¤wipqSiko®i]¯

+,-./01234 5623782929:;9<279=23>?29@A79=2329B C1 DE82929:;9<24 FG5H23I

JKLMNOKOKPQKROSTUSVWMKXOYWZOK[OK\K]OK^_`\[UaRbcdUefgMNOKMKXOY WZOKUhijklWmnkoOKUpiQKqkkKia\rWsQKotkKiMKXOYWZftUuMKXOYWZmvUwc xqWfiykQKqkkoOKUpizmnQc{oOKMKeO|OYkKXOY}itW~tMNOKc

 "&€#& ‚ƒ„ (€… * †  !"# )‡ˆ‡‰ˆŠ‡)) ‹ˆŠ

01234

+,-./012323453627382923:;<=>?29@ABCD EFGHIJKJKLMKNJOPQORSHKTJUJKVWXQYZJUJK[K\JK]^_`aJKbcJUd[eJUHIJK_

01234

+,-./01232345362789:;2<=>:>?@A9 2?BCDB?EFBD

=3?22DG H

IJKLMNJNJOPJQNRSTRUVWXTYZN[LJ\N[NJ]V^Y^_NJ`JaNJbcdefTLJTgJh

W`iVLjJTkhlN^mcY^_dnjNJLJoNpN[gJ\N[qh_Vr_LMNJd

 "s&t#& uvwx (ty * z  !"# {|}|~}|{{ {{}

01234

'( )*+ ,

-./012343561789:;<=>?@AB835/C3DEFDG>< 31H1I3012343581J35K/@

>?@0L31M9:;<=NO:P81Q8C38GFAB861R6AS1T@UV5F2FASW@X>1XUFY>

8D/Z[38F3K/@0L31>T\7>W/]8^_F31H8`Za01FbBcVF8dASb?^e3f-5gh>^GF

81Q01J358C38GFAB861R6AS1T@3VX31gUiZf

'( )*+ ,

-./8j>bBck^FY/>l38D/Z[3m8D/Z[3K/@0L31>Tc/35^gh35O81H@AS3

mNO81Q8C38GFAB861R6AS1T@UV5F2FASW@X>1XUFY>8D/Z[38F3K/@0L31

>T\7>W/]8^_F31H8`Za01FbBcVF8dASb?^e3f-5gh>^GF81Q01J358C38GFAB8

61R6AS1T@3VX31gUiZf

-1i3\R8nopqrsturvwxyzqry{qy|}~r€qurvwxu‚urƒ„…†‡q

01234 123

&'()*+,-./0123.4(562'7862/9.:

&01;23<=>7+8?@AB82C>/D?@/01;23<=>7+80(BA>/C>/DE F@).'>GH2I'@))J/,KC'L2M+NO.*>=/,H/'>,1P.QRST5'8,UC'O/ VRST:WRQRSTXVRSTT

&+.,K/0>GY2.4(562'Z[

\62'0;80] '^(562'7862/9.:

_` abc d efghihjSfkhjlmnopnqrhfstrhSuoqfkhjhfvfwhqfghihjSfkhjlmnopn qrhfxytxzoof{nh|}

~Ă‚ÊÔƠ†~Ưˆ€Ư‰ƠƠÀ‹ŒĂ€Â‚ÊÔƠ

# !Ž‘’ “”•Ả —‘Đ™ Đà › œ  žăÁăâÁđ㞞 žêÁđô

$% &'&(') *+,-&'.*/0012 3456789::;<6=5>?@ABCDEF<456BA45FGHHIFJKFA5BLAMCNMCFJKFA5BLAO8BA45 6PMQA5689F6;NH=5>F6RHS

TUFVWXYUFVZ5UFV

FON5>?ISXWHN5:F[5UFVBC56A\9HE5>H]5>^ABC56A\9FO_5>HIK6`5aLH69b5 cUXdefVg

YUFVhijTUFVhkjlm5UFVhnonhcUpdef

qV YUFVlm5UFVrstuvwxyz{|

} ef

~Wef

ĂZef

qyz€Â‚ÊxÔr‚ÊxÔƠ~WƠĂZƠq

&'()*+,'()-.'() /01234+*56.'()78'9:;<)6 ,'()>?&'()@ABC@DEFGBHI@FJKB L'MNO)*P'O)QP'ORM)

P'O)*STUVWXYZ[\]^BC_DZ[*+<Z`-Z=

P'ORM)*Qaab',:&)STU'b'&R,))c,c&

d efghijhk lmnefgoijomp qrhk lsjhnqrosjop

qrhk lsnqros t=

t[ nqros u

t[ nqros

d v wrxk ysnz {|}~Àe =

 L'MNO)*u

<STU

‚ 5-Ê `

Ê =

Ô

Ơ !†Ưˆ‰Àˆ‹ ŒŽ À‘’ ‘“ ”•  ! uẢ—ẢЗ<Ảuu u™—<™

    !" # "$%&

'()*+*,-(.*,/0123145*(675*-8292:*,;76<=0*,6>?*,45*(675*-8296<,7@

-AB2C2DE72316>?*,-(.*,-7*-A0FG*/0145*(-AH*,IJ-DK*LB-(M7,71*6NF

-(OHI;74()*+*,2P-(Q231R(S*TU*,0V*R(@ AH*,DP4QDW*,7X7(E*2.*,

Y0N-R(@-Z

[\]L^ _`a

bcdef ghd i cjeklmnopqrs]L^ _`a

tf ghd i cjeklmnopqrs

bcdef ghd i cjeklmnopqrs] _`a

tf ghd i cjeklmnopqrs

L^] u

vjwxyz-{|}~Ăy€y`‚Ăy‚ÊÔ~Ơ`†

  Ư  !"ˆ‰‰À# ‹Œ&

'5*(ŽLX7,7X7(E*2.*,Y0N-R(@-‘L<2.*,Y0N-*(7’02P=0*,6>?*,“

[\]L”^{•€

Ả

—Đ™‘i‘

Ã

› []—”{•€

Ả

—Đ™‘i‘

Ã

›

01234 123



 !"#$%&'()*+,-./$+01))20/$34/5-67)8/5&90)2:/);<=>

?@ABC

"#D EF GHD EI"#21)3J)54-K)5L-M&/5NO:/53PQR)S TL)U/$GH)54-V/)U/$"#W)0X/5&:/Y&9-)U/$/(X3P$&Z&5;/[MGH2\& Y(M)4/5)2;/$3]M5^7S

_` abcdecf ghij kelm ln opqr stqua vwxwyxwvv vzx{



 !"# $% !"&' !""() !"

*+,-./0123456789:-;<=,>?@A7,-4B@-C4:-DCEFGHI/JKLMN ) !"O8P:Q,>R@,><SC5975T<-UV<7-=,>WX4UY7Z[,><\]^,>7_,`

IKLMNa bc<89UAd5e@f g

hi

jk lmn opqrlsn tulsvwxyzlm{|}~ €lsẢ‚lmƒrm„l…

†‡'ˆ‰Š‹'ˆŒẮŽẾ')‘`’E“”•–—'ˆ!˜')™‡)š'` “›ˆ•”•)š'Œœ'ˆỚ‡ž!Ÿ) !

¡ằŒẳ')•ẵ‡“”•ặỠ!ớٟ)ờŒœ'ˆỚ‡ž!)Ž•Ÿ)ởŽEFGHớŠ‹Œ% Œớỡ')Ũ

Ứợ#` UỪ>

ổ

Ử&E$h¡ằ

F`

Ỳ

³–ŸỚÍ

 !"# $%&'

()*+ ,-./012,3

4 56789: ;< = > ?:@ A ;< B@CD

+ E F-1E 12

G HI J K L

M A NOPJQRF3

4 STUVWXY VZ[X\]XT^_VWZ`YabVWXcV\dX\eVWf

gh12h12

G

4 56789Sijkl VTY mXn oUVXpVXiY f

qr s6t 8uqr s6t 8v6wssxsyz6x{|s6t } |s~z€

1Ả‚ƒ„…†ƒ‡ˆƒ‰Šˆ‰‹‚‚Œ‡ẮŽẾẮŒ‘’“‡‰…”•ƒ‡ẮQ–—˜ƒẮ™ˆ˜ƒ‡š‚’›ˆœẢ‚Ớ…ž‡Ớ‘ˆ

Ÿ ‡¡”ằ—Ắˆ„ˆẳˆẾ‚Ả‚‡ẵƒẮˆặ…ƒẮỠƒớÙờ‚ƒở…—Ắẳƒỡƒ„ŨẮẢ‡‚Ứ‘ƒ„…†ƒƒẮợ

ẮỪƒ—Ắẳƒỡƒ„‡Ắổƒ„Ử…‘‚Ứ‘—˜ƒẮỲ³„Ùờ‚™‹ˆÍ—Ắổƒ„‡ẮŽ‡Ắ̂ẮˆặƒớÙờ‚ŨẮ ŨẾ

ẮŒ‘’“„ˆẳˆẾ’›ˆỚ‘ˆỚộŸ ‡¡”ằỲ

Ỉ/ĨÓửNữLỎ A¾ựầœÁÂấLHQ

ẩẫ "!ậđẻ ÉÊẹ ỉđễị ễỹ ƯỦồ $ốÔ ÂAỏAơỏJAÂÂ ÂÈỏJừ

01234

()*+,-./0123

456789:5;<56789=5(56789>5?@AB+C-D45678EF(5678-./0123

>59G6HIJK

583 LM+C/N+COPQ@2,R@STCUVU,W+XYZ[:K

5\]^

_`ab2

Lcd/R/,2,e+SM@M+C/N+COPQ@2,R@CUfg/R/)*+,OgB/,B,h-W@-ij/kP+C

0ij+C/l/-WU3

&' ()* + ,-./0122341561/789:;<=>?@ABC=D=;EFAGHIJKILKMMMKINK=D=;EFOP

QJKQLKMMMKQNKABC=D=.D=;<121/CRF;<=>?@:JK:LKMMMK:NST=U>VW12.C1 VX12/Y./ZP4[1\].;^12./_=`

abIJcILcMMMcINdQJcQLcMMMcQNefg

h

i

jklm

n

iopqh

pN h

r

&' ()(s)t uvwx(s* yz(s{|u}~()€ ‚

ƒF12>VW12=„P561/2341;EFAGHAG1;EFOP;VW=…D=;†1/\‡C=ˆ12./_=`

Žq J  L ‘ N ’“”•– — L ™ š›abIJcILcMMMcINdQJcQLcMMMcQNe

œ žŸ ¡¢ £ ¤¥¦§ ¨¢©ª ©« ¬­® ¯ J°±°²±L°JJ LJ±L³

01234

  

 !"##$%"&'" ()*+,-./0123"#23"#.456"#/78"#9:"#;"#56"# /78"#.<.&'"  =" 1 >"& ?@= A& ?,>6@=3.41 B"9! 6C" DE%F.< ,?G6&?"H

IJKLJMLNNNLJOPQR

S TL

U V V W

XY K T NNN T

T XY M NNN T Z

Z ZZ ZZZ ZZ

T T NNN XY O

[

\

\ ]

^

O

_

`aK

XY `bX

01234

+,-./01234526789:-424;<=>?6@56=A-4BC-.DEFGHIDJ EKL2MN-.=OH

=>?664P-/8N64NQEGHIDJ EKLFDR

GSKLTUVW24UV=>?6@56=A-4BXYZ

GSKLF

[

S S\]

] S^]

_% `abcdbe fghi jdk l m'& no'p` qrsrtsurqq uvsuw

01234

*+ ,- /0 , 123-453367,8239:; < = ,>?-6-@ABC,-D8EFG6,>G6,>

   !" !# $%&' ()&* +,-,.-/,++ /0-/0