CDH部署 環境準備

hostnamectl set-hostname cm-server #更改個主機名

sed -i 's/selinux=enforcing/selinux=disable/g' /etc/selinux/config

setenforce 0

cat>>/etc/hosts<

172.16.1.100 cm-server

172.16.1.101 hadoop-1

172.16.1.102 hadoop-2

172.16.1.103 hadoop-3

eof

systemctl stop firewalld

systemctl disable firewalld.service
hostnamectl set-hostname hadoop-1 #更改個主機名
sed -i 's/selinux=enforcing/selinux=disable/g' /etc/selinux/config
setenforce 0
cat>>/etc/hosts<
172.16.1.100 cm-server
172.16.1.101 hadoop-1
172.16.1.102 hadoop-2
172.16.1.103 hadoop-3
eof

systemctl stop firewalld

systemctl disable firewalld.service
hostnamectl set-hostname hadoop-2 #更改個主機名
sed -i 's/selinux=enforcing/selinux=disable/g' /etc/selinux/config
setenforce 0
cat>>/etc/hosts<
172.16.1.100 cm-server
172.16.1.101 hadoop-1
172.16.1.102 hadoop-2
172.16.1.103 hadoop-3
eof

systemctl stop firewalld

systemctl disable firewalld
hostnamectl set-hostname hadoop-3 #更改個主機名
sed -i 's/selinux=enforcing/selinux=disable/g' /etc/selinux/config
setenforce 0
cat>>/etc/hosts<
172.16.1.100 cm-server
172.16.1.101 hadoop-1
172.16.1.102 hadoop-2
172.16.1.103 hadoop-3
eof

ssh-keygen -t rsa     #在cm-server生成金鑰對

for num in
`seq 1 3`
;do ssh-copy-id -i /root/.ssh/id_rsa.pub root@hadoop-$num
;done

yum  -y install ntp

driftfile /var/lib/ntp/drift

restrict default kod nomodify notrap nopeer noquery
restrict -6 default kod nomodify notrap nopeer noquery
restrict 127.0.0.1
restrict -6 ::1
server 192.168.130.144 iburst
restrict 192.168.130.144 nomodify notrap noquery
includefile /etc/ntp/crypto/pw
keys /etc/ntp/keys

同上hadoop-2

同上hadoop-3

同上vim /etc/ntp/step-tickers

0.centos.pool.ntp.org

systemctl start ntpd

systemctl enable ntpd

ntpdate -u

hwclock --systohc

ntpq -p

所有伺服器配置

重啟永久生效：

vi /etc/sysctl.conf

#然後將同一命令新增到 /etc/rc.local 等初始化指令碼中，以便在系統重啟時予以設定。以下主機將受到影響:
vi /etc/rc.local
echo never > /sys/kernel/mm/transparent_hugepage/defrag
echo never > /sys/kernel/mm/transparent_hugepage/enabled

CDH部署 全網最簡單CDH6 2 0環境部署

主機規劃 sparkproject1 manager 8g 50gb sparkproject2 agent 4g 50gb sparkproject3 agent 4g 50gb 可參考hadoop中linux基本配置那篇文章 hadoop部署 hadoop環境部署1 linux基礎設定 syst...

CDH部署搭建

鏈結 部署環境準備 4 安裝cloudera manager server 5 建立系統使用者 6 配置cm agent 7 配置資料庫 8 在server節點建立parcel repo目錄,賦權 9 在所有agent節點建立parcels目錄,賦權 10 製作cdh本地源 將這兩個檔案放到serv...

Hadoop 部署之環境準備 一

id主機型別主機名ip應用軟體作業系統硬體配置 1物理機 namenode01 192.168.1.200 jdk1.8.0 171 hadoop 2.7.3 hive 2.3.3 hbase 1.2.6 zookeeper 3.4.10 spark 2.3.1 centos7.4 6核cpu 8g...