資源描述：
《l06 entropy rates of a stochastic process》由會(huì)員上傳分享，免費(fèi)在線(xiàn)閱讀，更多相關(guān)內(nèi)容在教育資源-天天文庫(kù)。
1、教學(xué)內(nèi)容應(yīng)用信息論基礎(chǔ)?IntroductionandPreview?EntropyRelativeEntropyandMutualInformationEntropy,RelativeEntropy,andMutualInformation金明錄教授?AsymptoticEquipartitionProperty?EntropyRatesofaStochasticProcessEntropyRatesofaStochasticProcess?DataCompression?ChannelCapa
2、city?DifferentialEntropy?GaussianChannel?RateDistortionTheory?NetworkInformationTheory12-13學(xué)年第二學(xué)期DUT應(yīng)用信息論基礎(chǔ)金明錄教授DUT應(yīng)用信息論基礎(chǔ)金明錄教授ContentsReview?EtEntropyratte.TdfTwodefiiinititiftonsofentropyrattfeforastthtochastiicprocess?Revieware?SourceCodingSourceCo
3、ding?TreeofCode?KftiKraftinequalitlity?WhatWeCannotDo:FundamentalLimitationsofSCSourceCoddiing?Forastationarystochasticprocess,?SummaryofSourceCodingTheorem?EfficiencyofCodes?EntropyrateofastationaryMarkovchain?WhatWeCanDo:AnalysisofSomeGoodCodesWhatW
4、eCanDo:AnalysisofSomeGoodCodes?SummaryDUT應(yīng)用信息論基礎(chǔ)金明錄教授DUT應(yīng)用信息論基礎(chǔ)金明錄教授Review?FunctionsofaMarkovchain.IfX1,X2,...,XnformastationaryMarkovchainandYi=φ((),Xi),thenSCSourceCoddiing1、Amotivatinggpexample2、Codesforrandomvariables3、ExamplesofCodesand4、Prefix-F
5、reeorInstantaneousCodesFreeorInstantaneousCodesDUT應(yīng)用信息論基礎(chǔ)金明錄教授DUT應(yīng)用信息論基礎(chǔ)金明錄教授AmotivatingexampleCodesforrandomvariables?Youwouldliketosetupyourowntelephonesystemthatconnectsyou?Notation:theconcatenationoftwostringsxandyisdenotedbyxy.toyourthreebestfrie
6、nds.ThesetofallstringpgsoverafinitealphabetDisdenotedbyD?.W.l.o.g.assumeD=0,1,...,D?1whereD=
7、D
8、.?Thequestionishowtodesignefficientbinaryphonenumbers.?Definition:asourcecodeforarandomvariableXisamapasourcecodeforarandomvariableXisamap?InTable4.1youfind
9、sixdifferentwaysofhowyoucouldchoosethem.C:X→D?x→C(x)(codeword)whereC(x)isthecodewordassociatedwithisthecodewordassociatedwithx,lx,l(x)isthelengthofisthelengthofC(x)?ThelengthofacodeCisL(C)=EX[l(x)]DUT應(yīng)用信息論基礎(chǔ)金明錄教授DUT應(yīng)用信息論基礎(chǔ)金明錄教授CodesforrandomvariablesE
10、xampleofsomesourcecodesExamplesofCodesSourcepCodeⅠCodeⅡCodeⅢCodeⅣCodeⅤ?CisnonsingularifeveryelementofXmapsontoadifferentelementiofD?U1/20000001?TheextensionofacodeC:X?→D?isthecodeU1/4010110012C?:X?→D?U1/8101001100113xn→C?(xn)=C(x1)C(x2)...C(xn
