資源描述：
《大數(shù)據(jù)平臺部署文檔.pdf》由會員上傳分享，免費在線閱讀，更多相關(guān)內(nèi)容在行業(yè)資料-天天文庫。
1、大數(shù)據(jù)平臺搭建一．Linux環(huán)境準備1)格式化磁盤mkfs.ext4/dev/dm-0mkdir/datamount/dev/dm-0/data系統(tǒng)重啟需要手動掛載把mount/dev/dm-0/data的命令放到/etc/rc.d/rc.local重啟自動掛載。df-h查看掛載點2)網(wǎng)卡綁定(當服務(wù)器有多塊網(wǎng)卡需要網(wǎng)卡綁定)?配置綁定網(wǎng)卡[root@hadoop001network-scripts]#vi/etc/sysconfig/network-scripts/ifcfg-bond0DEVICE=bond0TYPE=Ether
2、netONBOOT=yesBOOTPROTO=staticIPADDR=19.106.64.7NETMASK=255.255.255.0GATEWAY=19.106.64.254NDS1=19.104.4.3DNS2=19.104.8.3USERCTL=no?各網(wǎng)卡設(shè)置[root@hadoop001network-scripts]#vi/etc/sysconfig/network-scripts/ifcfg-eth0DEVICE=eth0TYPE=EthernetBOOTPROTO=noneONBOOT=yesMASTER=bond
3、0SLAVE=yes?配置文件添加vi/etc/modprobe.d/dist.conf末尾追加aliasbond0bondingoptionsbond0miimon=100mode=0#每100ms檢測一次鏈路mode=0網(wǎng)卡冗余機制?設(shè)置服務(wù)serviceNetworkManagerstopchkconfigNetworkManageroffservicenetworkrestartchkconfignetworkon?測試綁定網(wǎng)卡modprobebond0#如果報錯就配置錯誤查看bond0網(wǎng)卡信息3)添加用hadoopuser
4、addhadooppasswdhadoop#hadoop4)修改主機名文件vi/etc/sysconfig/network#修改該文件Hostname=hadoop0015）修改本地hosts文件19.106.64.7hadoop00119.106.64.8hadoop00219.106.64.9hadoop00319.106.64.10hadoop00419.106.64.11hadoop00519.106.64.12hadoop0066）關(guān)閉防火墻（root用戶下操作）serviceiptablesstatus查看防火墻狀態(tài)se
5、rviceiptablesstop臨時關(guān)閉防火墻chkconfigiptablesoff永久關(guān)閉防火墻7）修改selinuxvi/etc/selinux/configselinux=disabled8）ssh互信（hadoop用戶下）生成密鑰對ssh-keygen#一路回車就行ssh-copy-idhadoop001分發(fā)公鑰ssh-copy-idhadoop002ssh-copy-idhadoop003測試連接獲取主機名文件；cd/home/hadoop/.ssh將私鑰和hosts文件分發(fā)各個節(jié)點確保完全互信scpid_rsakno
6、wn_hostshadoop@hadoop002:/home/hadoop/.sshscpid_rsaknown_hostshadoop@hadoop003:/home/hadoop/.ssh……9)配置時間同步服務(wù)設(shè)置NTP服務(wù)自動同步硬件時間vi/etc/sysconfig/ntpdSYNC_HWCLOCK=yesServer端：restrict19.106.64.0mask255.255.255.0nomodifynotrapserver127.127.1.0fudge127.127.1.0stratum8client端：re
7、strict19.106.64.0mask255.255.255.0nomodifynotrapserver19.106.64.7servicentpdstartchkconfigntpdon10）卸載系統(tǒng)自帶的jdk[root@hadoop001~]#rpm-qa
8、grepjavajava-1.7.0-openjdk-1.7.0.45-2.4.3.3.el6.x86_64java-1.6.0-openjdk-1.6.0.0-1.66.1.13.0.el6.x86_64tzdata-java-2013g-1.el6.noarch[r
9、oot@hadoop001~]#rpm-e--nodepstzdata-java-2013g-1.el6.noarch[root@hadoop001~]#rpm-qa
10、grepjavajava-1.7.0-openjdk-1.7.0.
