西南交通大学信息论与编码课程资料
资源内容介绍
西南交通大学信息论与编码课程上课PPT <link href="/image.php?url=https://csdnimg.cn/release/download_crawler_static/css/base.min.css" rel="stylesheet"/><link href="/image.php?url=https://csdnimg.cn/release/download_crawler_static/css/fancy.min.css" rel="stylesheet"/><link href="/image.php?url=https://csdnimg.cn/release/download_crawler_static/89538489/raw.css" rel="stylesheet"/><div id="sidebar" style="display: none"><div id="outline"></div></div><div class="pf w0 h0" data-page-no="1" id="pf1"><div class="pc pc1 w0 h0"><img alt="" class="bi x0 y0 w1 h1" src="/image.php?url=https://csdnimg.cn/release/download_crawler_static/89538489/bg1.jpg"/><div class="t m0 x1 h2 y1 ff1 fs0 fc0 sc0 ls0 ws0">1</div><div class="t m0 x2 h3 y2 ff2 fs1 fc1 sc0 ls0 ws0">信息论与编码</div><div class="t m0 x3 h4 y3 ff3 fs2 fc1 sc0 ls0 ws0">Information and Codin<span class="_ _0"></span>g Theory</div><div class="t m0 x4 h5 y4 ff4 fs3 fc0 sc0 ls0 ws0">西南交通大学</div></div><div class="pi" data-data='{"ctm":[1.333333,0.000000,0.000000,1.333333,0.000000,0.000000]}'></div></div><div id="pf2" class="pf w0 h0" data-page-no="2"><div class="pc pc2 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="/image.php?url=https://csdnimg.cn/release/download_crawler_static/89538489/bg2.jpg"><div class="t m0 x1 h2 y5 ff1 fs0 fc0 sc0 ls0 ws0">2</div><div class="t m0 x5 h6 y6 ff5 fs4 fc2 sc0 ls0 ws0">第2章<span class="_ _1"> </span>信息的度量</div><div class="t m0 x6 h7 y7 ff6 fs2 fc3 sc0 ls1 ws0">2.1 <span class="ls0">信源的数学模型及分类</span></div><div class="t m0 x6 h7 y8 ff6 fs2 fc0 sc0 ls1 ws0">2.2 <span class="ls0">离散信源的熵</span></div><div class="t m0 x6 h7 y9 ff6 fs2 fc0 sc0 ls1 ws0">2.3 <span class="ls0">离散信源序列的熵</span></div><div class="t m0 x6 h7 ya ff6 fs2 fc0 sc0 ls1 ws0">2.4 <span class="ls0">连续信源的互信息和微分熵</span></div><div class="t m0 x6 h7 yb ff6 fs2 fc0 sc0 ls1 ws0">2.5 <span class="ls0">信源的冗余度</span></div></div><div class="pi" data-data='{"ctm":[1.333333,0.000000,0.000000,1.333333,0.000000,0.000000]}'></div></div><div id="pf3" class="pf w0 h0" data-page-no="3"><div class="pc pc3 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="/image.php?url=https://csdnimg.cn/release/download_crawler_static/89538489/bg3.jpg"><div class="t m0 x1 h2 y5 ff1 fs0 fc0 sc0 ls0 ws0">3</div><div class="t m0 x7 h7 yc ff6 fs2 fc3 sc0 ls1 ws0">2.1 <span class="ls0">信源的数学模型及分类</span></div><div class="t m0 x8 h8 yd ff7 fs5 fc3 sc0 ls0 ws0">l<span class="_ _2"> </span><span class="ff8 fc0">消息</span></div><div class="t m0 x9 h9 ye ff9 fs6 fc0 sc0 ls0 ws0">由符号、文字、数字、语言、音符、图片、图像等能够被人们感</div><div class="t m0 xa h9 yf ff9 fs6 fc0 sc0 ls0 ws0">知器官所感知的形式组成的序列。</div><div class="t m0 x8 h8 y10 ff7 fs5 fc3 sc0 ls0 ws0">l<span class="_ _2"> </span><span class="ff8 fc0">信息</span></div><div class="t m0 x9 h9 y11 ff9 fs6 fc0 sc0 ls0 ws0">信息是包含在消息中的内容和意义，是通信系统传输的本质。</div><div class="t m0 x8 h8 y12 ff7 fs5 fc3 sc0 ls0 ws0">l<span class="_ _2"> </span><span class="ff8 fc0">信号</span></div><div class="t m0 x9 h9 y13 ff9 fs6 fc0 sc0 ls0 ws0">把消息变换成适合信道传输的物理量，这种物理量称为信号。如</div><div class="t m0 xa h9 y14 ff9 fs6 fc0 sc0 ls0 ws0">电信号、光信号、声信号、生物信号等。</div><div class="t m0 x8 h8 y15 ff7 fs5 fc3 sc0 ls0 ws0">l<span class="_ _2"> </span><span class="ff8 fc0">三者关系</span></div><div class="t m0 xb h9 y16 ff9 fs6 fc0 sc0 ls0 ws0">通信系统传输的是信号，信号携带着消息，消息中包含着信息。</div></div><div class="pi" data-data='{"ctm":[1.333333,0.000000,0.000000,1.333333,0.000000,0.000000]}'></div></div><div id="pf4" class="pf w0 h0" data-page-no="4"><div class="pc pc4 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="/image.php?url=https://csdnimg.cn/release/download_crawler_static/89538489/bg4.jpg"><div class="t m0 x1 h2 y5 ff1 fs0 fc0 sc0 ls0 ws0">4</div><div class="t m0 x8 h8 yd ff7 fs5 fc3 sc0 ls0 ws0">l<span class="_ _2"> </span><span class="ff8 fc0">信源</span></div><div class="t m0 x9 h8 ye ff8 fs5 fc0 sc0 ls0 ws0">信源输出的消息用<span class="ffa">m</span>表示。全体符号称为（语言的）</div><div class="t m0 xa h8 y17 ff8 fs5 fc0 sc0 ls0 ws0">符号集或字母集<span class="ffb">.</span></div><div class="t m0 xc h6 y18 ff5 fs4 fc3 sc0 ls0 ws0">信源输出的消息<span class="ffc">m</span>是一</div><div class="t m0 xd h6 y19 ff5 fs4 fc3 sc0 ls0 ws0">个随机变<span class="_ _2"> </span>量！</div><div class="t m0 x7 h7 yc ff6 fs2 fc3 sc0 ls1 ws0">2.1 <span class="ls0">信源的数学模型及分类</span></div></div><div class="pi" data-data='{"ctm":[1.333333,0.000000,0.000000,1.333333,0.000000,0.000000]}'></div></div><div id="pf5" class="pf w0 h0" data-page-no="5"><div class="pc pc5 w0 h0"><img class="bi x0 y0 w1 h1" alt="" src="/image.php?url=https://csdnimg.cn/release/download_crawler_static/89538489/bg5.jpg"><div class="t m0 x1 h2 y5 ff1 fs0 fc0 sc0 ls0 ws0">5</div><div class="t m0 xe h8 y1a ff7 fs5 fc3 sc0 ls0 ws0">l<span class="_ _2"> </span><span class="ff8 fc0">按照信源发出的时间和消息的分布分类</span></div><div class="t m0 xf h8 y1b ff7 fs5 fc4 sc0 ls0 ws0">u<span class="ff8 fc0">离散信源：信源发出消息的时间与消息的表示形</span></div><div class="t m0 x9 h8 y1c ff8 fs5 fc0 sc0 ls0 ws0">式都是离散的。</div><div class="t m0 x10 h8 y1d ff8 fs5 fc0 sc0 ls0 ws0">如：计算机输出的代码、文稿、人写的书信等</div><div class="t m0 xf h8 y1e ff7 fs5 fc4 sc0 ls0 ws0">u<span class="ff8 fc0">连续信源：信源发出消息的时间与消息的表示形</span></div><div class="t m0 x9 h8 y1f ff8 fs5 fc0 sc0 ls0 ws0">式都是连续的。</div><div class="t m0 xb h8 y20 ff8 fs5 fc0 sc0 ls0 ws0">如：语音、图像、图形等</div><div class="t m0 xe h8 y21 ff7 fs5 fc3 sc0 ls0 ws0">l<span class="_ _2"> </span><span class="ff8 fc0">按照信源发出符号之间的关系分类</span></div><div class="t m0 xf h8 y22 ff7 fs5 fc4 sc0 ls0 ws0">u<span class="ff8 fc0">无记忆信源</span></div><div class="t m0 x10 h8 y23 ff8 fs5 fc0 sc0 ls0 ws0">不同时刻发出的消息是独立的</div><div class="t m0 xf h8 y24 ff7 fs5 fc4 sc0 ls0 ws0">u<span class="ff8 fc0">有记忆信源</span></div><div class="t m0 x10 h8 y25 ff8 fs5 fc0 sc0 ls0 ws0">不同时刻发出的消息是相互依赖的</div><div class="t m0 x7 h7 yc ff6 fs2 fc3 sc0 ls1 ws0">2.1 <span class="ls0">信源的数学模型及分类</span></div></div><div class="pi" data-data='{"ctm":[1.333333,0.000000,0.000000,1.333333,0.000000,0.000000]}'></div></div>