資源描述：
《Chukwa A large-scale monitoring system》由會(huì)員上傳分享，免費(fèi)在線閱讀，更多相關(guān)內(nèi)容在學(xué)術(shù)論文-天天文庫(kù)。
1、Chukwa:Alarge-scalemonitoringsystemJeromeBoulonAndyKonwinskiRunpingQijboulon@yahoo-inc.comandyk@cs.berkeley.edurunping@yahoo-inc.comYahoo!,incUCBerkeleyYahoo!,incArielRabkinEricYangMacYangasrabkin@cs.berkeley.edueyang@yahoo-inc.commacyang@yahoo-inc.comUCBerkeleyYahoo!,incYahoo!,incAbs
2、tractdata.Logsareperiodicallydeleted,unlessuserstaketheinitiativeinstoringthem.WedescribethedesignandinitialimplementationofWebelievethatoursituationistypical,andthatlo-Chukwa,adatacollectionsystemformonitoringandan-calstorageofloggingdataisacommonmodelforveryalyzinglargedistributedsy
3、stems.Chukwaisbuiltonlargedeployments.TotheextentthatmoresophisticatedtopofHadoop,anopensourcedistributed?lesystemanddatamanagementtechniquesareutilized,theyarelargelyMapReduceimplementation,andinheritsHadoop’sscal-supportedbyad-hocproprietarysolutions.Awelldocu-abilityandrobustness.C
4、hukwaalsoincludesa?exiblementedopensourcetoolsetforhandlingmonitoringdataandpowerfultoolkitfordisplayingmonitoringandanal-thussolvesasigni?cantpracticalproblemandprovidesysisresults,inordertomakethebestuseofthiscollectedavaluablereferencepointforfuturedevelopmentinthisdata.area.Wedidn
5、otaimtosolvetheproblemofreal-timemon-1Introductionitoringforfailuredetection,whichsystemssuchasGan-gliaalreadydowell.Rather,wewantedasystemthatHadoopisadistributed?lesystemandMapReduce[1]wouldprocesslargevolumesofdatainatimescaleofimplementationthatisusedpervasivelyatYahoo!foraminutes
6、,notseconds,todetectmoresubtleconditions,varietyofcriticalbusinesspurposes.Productionclustersandtoaidinfailurediagnosis.Humanengineersandop-oftenincludethousandsofnodes.Largedistributedsys-eratorsdonotgenerallyreactonatimescaleofseconds,temssuchasHadooparefearsomelycomplex,andcanandso
7、aprocessingdelayofafewminutesisnotacon-failincomplicatedandsubtleways.Asaresult,Hadoopcernforus.isextensivelyinstrumented.Atwo-thousandnodeclus-Weareintheprocessofbuildingasystem,whichwetercon?guredfornormaloperationgeneratesnearlyhalfcallChukwa,todemonstratethatpracticallarge-scaleca
8、nbere
