資源描述:
《Information Theory and Coding》由會(huì)員上傳分享,免費(fèi)在線閱讀,更多相關(guān)內(nèi)容在教育資源-天天文庫(kù)。
1、InformationTheoryandCodingComputerScienceTriposPartII,MichaelmasTerm11LecturesbyJGDaugman1.Foundations:Probability,Uncertainty,andInformation2.EntropiesDened,andWhytheyareMeasuresofInformation3.SourceCodingTheorem;Prex,Variable-,&Fixed-LengthCodes4.ChannelTypes,Properti
2、es,Noise,andChannelCapacity5.ContinuousInformation;Density;NoisyChannelCodingTheorem6.FourierSeries,Convergence,OrthogonalRepresentation7.UsefulFourierTheorems;TransformPairs;Sampling;Aliasing8.DiscreteFourierTransform.FastFourierTransformAlgorithms9.TheQuantizedDegrees-o
3、f-FreedominaContinuousSignal10.Gabor-Heisenberg-WeylUncertaintyRelation.OptimalLogons"11.KolmogorovComplexityandMinimalDescriptionLengthInformationTheoryandCodingJGDaugmanPrerequisitecourses:Probability;MathematicalMethodsforCS;DiscreteMathematicsAimsTheaimsofthiscoursea
4、retointroducetheprinciplesandapplicationsofinformationtheory.Thecoursewillstudyhowinformationismeasuredintermsofprobabilityandentropy,andtherelationshipsamongconditionalandjointentropies;howtheseareusedtocalculatethecapacityofacommunicationchannel,withandwithoutnoise;codi
5、ngschemes,includingerrorcorrectingcodes;howdiscretechannelsandmeasuresofinformationgeneralisetotheircontinuousforms;theFourierperspective;andextensionstowavelets,complexity,compression,andecientcodingofaudio-visualinformation.LecturesFoundations:probability,uncertainty,
6、information.Howconceptsofrandomness,redundancy,compressibility,noise,bandwidth,anduncertaintyarerelatedtoinformation.Ensembles,randomvariables,marginalandconditionalprobabilities.Howthemetricsofinformationaregroundedintherulesofprobability.Entropiesdened,andwhytheyareme
7、asuresofinformation.Marginalentropy,jointentropy,conditionalentropy,andtheChainRuleforentropy.Mutualinformationbetweenensemblesofrandomvariables.Whyentropyisthefundamentalmeasureofinfor-mationcontent.Sourcecodingtheorem;prex,variable-,andxed-lengthcodes.Symbolcodes.The
8、binarysymmetricchannel.Capacityofanoiselessdiscretechannel.Errorcorrectingcodes.Channeltypes,pr