資源描述：
《Efficient Object Storage Journaling in a Distributed Parallel File System版本》由會員上傳分享，免費在線閱讀，更多相關(guān)內(nèi)容在學(xué)術(shù)論文-天天文庫。
1、Ef?cientObjectStorageJournalinginaDistributedParallelFileSystemSarpOral,FeiyiWang,DavidDillow,GalenShipman,RossMillerNationalCenterforComputationalSciencesOakRidgeNationalLaboratory{oralhs,fwang2,gshipman,dillowda,rgmiller}@ornl.govOlegDrokinLustreCenterofExcellence
2、atORNLSunMicrosystemInc.oleg.drokin@sun.comAbstract1IntroductionLarge-scaleHPCsystemstargetabalanceof?leI/Oper-Journalingisawidelyusedtechniquetoincrease?lesys-formancewithcomputationalcapability.Traditionally,thetemrobustnessagainstmetadataand/ordatacorruptions.sta
3、ndardwas2bytespersecondofI/ObandwidthforeachWhiletheoverheadofjournalingcanbemaskedbythepage1,000FLOPsofcomputationalcapacity[18].Maintain-cacheforsmall-scale,local?lesystems,wefoundthatLus-ingthatbalancefora1Peta?ops(PFLOPs)supercomputertre’suseofjournalingfortheob
4、jectstoresigni?cantlyim-wouldrequirethedeploymentastoragesubsystemcapa-pactedtheoverallperformanceofourlarge-scalecenter-bleofdelivering2TB/secofI/Obandwidthataminimum.wideparallel?lesystem.Byrequiringthateachwritere-Buildingsuchasystemwithcurrentornear-termstorageq
5、uestwaitforajournaltransactiontocommit,Lustrein-technologywouldrequireontheorderof100,000magnetictroducedserializationtotheclientrequeststreamandim-disks.Thiswouldbecostprohibitivenotonlyduetotheposedadditionallatencyduetodiskheadmovement(seeks)rawmaterialcostsofthe
6、disksthemselves,butalsototheforeachrequest.magnitudeofthedesign,installation,andongoingmanage-Inthispaper,wepresentthechallengeswefacedwhilementandelectricalcostsfortheentiresystem,includingdeployingaverylargescaleproductionstoragesystem.theRAIDcontrollers,networkli
7、nks,andswitches.AtthisOurworkprovidesahead-to-headcomparisonoftwosig-scale,reliabilitymetricsforeachcomponentwouldvirtu-ni?cantlydifferentapproachestoincreasingtheoverallef?-allyguaranteethatsuchasystemwouldcontinuouslyoper-ciencyoftheLustre?lesystem.First,wepresent
8、ahardwareateinadegradedmodeduetoongoingsimultaneousrecon-solutionusingexternaljournalingdevicestoeliminatethestructionoperations[22].laten
