資源描述:
《Pattern Recognition and Machine Learning (Book Part 2).pdf》由會員上傳分享,免費在線閱讀,更多相關(guān)內(nèi)容在學(xué)術(shù)論文-天天文庫。
1、8GraphicalModelsProbabilitiesplayacentralroleinmodernpatternrecognition.WehaveseeninChapter1thatprobabilitytheorycanbeexpressedintermsoftwosimpleequationscorrespondingtothesumruleandtheproductrule.Alloftheprobabilisticinfer-enceandlearningmanipulationsdisc
2、ussedinthisbook,nomatterhowcomplex,amounttorepeatedapplicationofthesetwoequations.Wecouldthereforeproceedtoformulateandsolvecomplicatedprobabilisticmodelspurelybyalgebraicma-nipulation.However,weshall?ndithighlyadvantageoustoaugmenttheanalysisusingdiagramm
3、aticrepresentationsofprobabilitydistributions,calledprobabilisticgraphicalmodels.Theseofferseveralusefulproperties:1.Theyprovideasimplewaytovisualizethestructureofaprobabilisticmodelandcanbeusedtodesignandmotivatenewmodels.2.Insightsintothepropertiesofthem
4、odel,includingconditionalindependenceproperties,canbeobtainedbyinspectionofthegraph.3593608.GRAPHICALMODELS3.Complexcomputations,requiredtoperforminferenceandlearninginsophis-ticatedmodels,canbeexpressedintermsofgraphicalmanipulations,inwhichunderlyingmath
5、ematicalexpressionsarecarriedalongimplicitly.Agraphcomprisesnodes(alsocalledvertices)connectedbylinks(alsoknownasedgesorarcs).Inaprobabilisticgraphicalmodel,eachnoderepresentsarandomvariable(orgroupofrandomvariables),andthelinksexpressprobabilisticrelation
6、-shipsbetweenthesevariables.Thegraphthencapturesthewayinwhichthejointdistributionoveralloftherandomvariablescanbedecomposedintoaproductoffactorseachdependingonlyonasubsetofthevariables.Weshallbeginbydis-cussingBayesiannetworks,alsoknownasdirectedgraphicalm
7、odels,inwhichthelinksofthegraphshaveaparticulardirectionalityindicatedbyarrows.TheothermajorclassofgraphicalmodelsareMarkovrandom?elds,alsoknownasundirectedgraphicalmodels,inwhichthelinksdonotcarryarrowsandhavenodirectionalsigni?cance.Directedgraphsareusef
8、ulforexpressingcausalrelationshipsbetweenrandomvariables,whereasundirectedgraphsarebettersuitedtoexpressingsoftcon-straintsbetweenrandomvariables.Forthepurposesofsolvinginferenceproblems,itisoftenconvenientto