資源描述:
《Improving_the_Performance_and_Scalability_of_Twitter.pdf》由會員上傳分享,免費在線閱讀,更多相關(guān)內(nèi)容在學(xué)術(shù)論文-天天文庫。
1、FixingTwitter...andFindingyourownFailWhaleJohnAdamsTwitterOperationsOperations?Smallteam,growingrapidly.?Whatdowedo??SoftwarePerformance(back-end)?Availability?CapacityPlanning(metrics-driven)?Con?gurationManagement?Wedon’tdealwiththephysical
2、plant.ManagedServices?Dedicatedteam(NTTA)?24/7Handsonremotesupport?Noclouds.Wetriedthat!?Needrawprocessingpower,latencytoohighinexistingcloudofferings?Freesustodealwithreal,intellectual,computerscienceproblems.752%2008Growth53.752.51.250Dec07Feb08Apr08Jun08Au
3、g08Oct08Dec08UniqueVisitors(inMillions)Thatwasonlythebeginning...previousgraph!UniquesNotslowingdown,despitewhatoutsiderssay.HardforoutsiderstomeasureAPIusage!Growth=Pain+anappreciationforInstitutionalizedFearMantra!FindWeakestPointMetrics+Logs+Science=Analys
4、isMantra!FindWeakestTakeCorrectivePointActionMetrics+ProcessLogs+Science=AnalysisMantra!FindWeakestTakeCorrectiveMovetoNextPointActionWeakestPointMetrics+ProcessRepeatabilityLogs+Science=AnalysisFindtheWeakestPoint?Metrics+Graphs?Individualmetricsareirrelevan
5、t?Logs?SCIENCE!?Findoutwhattheactionableitemsare.InstrumentEverything(cc)seenoevil@?ickrMonitoring?Graphandreportcriticalmetricsinasnearrealtimeaspossible?Youalreadyhavethetools.?RRD?Ganglia+customgMetricscripts?MRTGDashboards?“Criticals”view?Smokeping/MRTG?G
6、oogleAnalytics?NotjustforHTTP200s/SEO?XMLFeedsfrommanagedservices?DataPorn!Analyze?Turndataintoinformation?Whereisthecodebasegoing??Arethingsworsethantheywere??Understandtheimpactofthelastsoftwaredeploy?Runcheckscriptsduringandafterdeploys?CapacityPlanning,no
7、tFireFighting!ForecastingCurve-?ttingforcapacityplanning(R,?tyk,Mathematica,CurveFit)unsignedint(32bit)Twitpocolypsestatus_idsignedint(32bit)Twitpocolypser2=0.99Deploys?Graphtime-of-deployalongsideserverCPUandLatency?Displaytime-of-last-deployondashboardlastd
8、eploytimesWhale-Watcher?Simpleshellscript,?MASSIVEWIN.?Whale=HTTP503(timeout)?Robot=HTTP500(error)?Examineslast100,000linesofaggregateddaemon/wwwlogs?“WhalesperSecond”>Wthreshold?Tharbewh