資源描述:
《基于hbase查詢引擎的業(yè)務(wù)支撐系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)》由會(huì)員上傳分享,免費(fèi)在線閱讀,更多相關(guān)內(nèi)容在學(xué)術(shù)論文-天天文庫。
1、哈爾濱工業(yè)大學(xué)工程碩士學(xué)位論文AbstractInrecentyears,theE-Businessindustrycontinuestodevelop,moreandmoreattentionsbythemostE-Businessareconcentratedonthelargedatastorage,extraction,calculation,analysisanddisplay.Withtheexplosivegrowthofbusinessdataandonurgentneedingofdataprocessingordataanalyzing,alsoduetotheintens
2、ificationofthecontradictionbetweenthedatastoragespaceanddataaccesstime,themostE-BusinesschoosedistributedstoragesystemHBasefordatastorage,tomeettheefficientdatainsertionandtheefficientdatareadoperation,buttheK-V'sdatamodelquerybyHBaseunabletomeetthebusinessdatamodelwhichtheuppersystemdemand.Inordert
3、osolvethisproblem,theauthorproposedtheneedsofbusinesssupportsystem,throughtheHBasequeryenginedataqueryanddatastandardoftwodatamodeltransformationstagetocompletetheconversionformK-Vdatamodeltorelationaldatamodelandfinallytothebusinessdatamodel.Thispaperbasedonthedevelopmentofthedatastandardizationstr
4、ategy,distributedSQLlikequerytechnologyandreal-timecalculationasthebackground,analyzedthedistributeddatastorageanddatastandardizationofthecurrentsituation,summeduptherequirementsfordataqueryanddatastandardization.Fromthetechnicalpointofview,thepaperintroducestheSQLparsing,cachingstrategy,coprocessor
5、andreal-timecalculate,finallyimplementstheefficientdataqueryandcomputeoperation.AnditcanprovidereferencefortheimplementationanddevelopmentoftheHBasebasedqueryengineandtheplatformoflargedatastandardization.ThebusinessoperationsupportingsystemuseJavalanguagetodevelopment,itrealizedtheHBasequeryenginea
6、nddatastandardizationandthedesignisdividedintologicalmodelofphysicallayer,datalogicmodellayerandbusinesslogicmodellayer.Physicalandlogicalmodellayerismainlythroughthemessagequeueandoff-linedatacomputingandtaskschedulingwillbeinthebottomofthereal-timedatawarehouseJRDWandofflinedatawarehouseJDWdataout
7、toHBasedistributedstoragesystem.LogicaldatamodellayerisdividedforK-Vlogicaldatamodelandrelationallogicaldatamodel,throughHBaseSQLlikequeryengineRunSQLwillquerytheincomeofK-Vlogicaldatamodeltransformat