資源描述:
《Markov Chain Monte Carlo.pdf》由會員上傳分享,免費在線閱讀,更多相關內容在學術論文-天天文庫。
1、AlexanderV.Mantzaris(2008/2009)BasicIntroductioninto-MCMC(MarkovChainMonteCarlo)*ConsideredtobeoneofthetoptenmostimportantalgorithmseverToseehowgreatMCMCis,wewilllookatthemotivationforsamplingfirst,andthenthemethodsusedbeforeitsintroductionMotivationofsampling?Manyfunctio
2、ns,Evensuchasimplefunctioncannotbeequations,andintegrated,withoutnumericalmethods.distributionscannotInthefieldofprobability,integrals/summationsbeintegrated(continuous/discreterespectively),arevitalforcalculatingtheexpectationoranalytically.Forexpectedvaluesofdistributio
3、ns.example:Andthisisessentiallywhatmarginalisationisallaboutaswell.2xMotivationofsampling?Drawingstatisticallyconsistentsamplesfromadistribution-Bydrawingsamplesconsistenttoyourdistribution,youareeffectivelycreatingasimulation.Whichcanbeusefulforanalyzinghowfastthemeans,v
4、ariances,etc,progress,andifthedistribution’ssamplesarerequiredasinputintoanotherdistribution.?WesamplewhentheCumulativeDistributionFunction(CDF)cannotbefoundanalytically.SamplingfromtheCDFishowMatlabcomesupwithrandomsamplesfordistributionsliketheGaussian…NextslideMotivati
5、onofsamplingWikipedia?Withnormaliseddistributionstheintegral=1,andsamplingrandomnumbersin[0,1]tothenmapthemfromtheCDFy-axistotheCDFx-axis,givesusthepointwhereasampleischosenOntheoriginaldistribution,wheretheheightislargertheslopeontheCDFishigherexposingittogreaterchanceso
6、farandomnumbergettingchosenonthey-axisMonteCarlo?ThemostwidelyusedplaceofMonteCarlosamplingisinMonteCarloNrandomsamplesalongIntegrationthedomain?Usesrandomnesstocomeupwitharandomvariableestimates,similartox,x,...,x12Nthegamblingprocessincasinos,wherethenamederives.?Define
7、ddomainalongwhichweTheaverageofthesample,uniformly(non-uniformisaindependentsamplespriorhardertoincorporatehere),andN1sinceeachpointwastakenwithE(f;N)=∑f(x)equalprobability,theintegraliNi=1(expectationforrandomvariables),issimplytheaverageofthesamples.?Eachsampleisindepen
8、dentlysampledMonteCarloFromthelawoflargenumbers,asNincreasestheconfidenceintheestimateprovideinc