ceph0.94安装-白红宇

ceph0.94安装

阅读量：6299 次

发布时间：2019-06-22

本文共 10543 字，大约阅读时间需要 35 分钟。

Install ceph

docment: http://docs.ceph.com/docs/master/start/quick-start-preflight/#rhel-centos

Config system

systemctl stop firewalld.service systemctl disable firewalld.service hostnamectl set-hostname ceph-osd-node1timedatectl set-timezone Asia/Shanghaiyum install chrony -ysystemctl enable chronyd.servicesystemctl start chronyd.servicechronyc sources

for RHEL/Centos

yum install centos-release-openstack-mitakayum install -y ftp://ftp.linux.kiev.ua/puias/updates/7.1/en/os/x86_64/python-setuptools-0.9.8-4.el7.noarch.rpmyum install ceph-deploy -y

Create Ceph Deploy User

# useradd ceph# passwd cephChanging password for user ceph.New password: BAD PASSWORD: The password is shorter than 8 charactersRetype new password: passwd: all authentication tokens updated successfully.# echo "ceph ALL = (root) NOPASSWD:ALL" | sudo tee /etc/sudoers.d/ceph# chmod 0440 /etc/sudoers.d/ceph

# su - ceph# pwd/home/ceph# ssh-keygenGenerating public/private rsa key pair.Enter file in which to save the key (/home/ceph/.ssh/id_rsa): Created directory '/home/ceph/.ssh'.Enter passphrase (empty for no passphrase): Enter same passphrase again: Your identification has been saved in /home/ceph/.ssh/id_rsa.Your public key has been saved in /home/ceph/.ssh/id_rsa.pub.The key fingerprint is:a5:bd:fe:c7:57:e8:46:2d:71:a0:c7:1f:dc:0a:d1:8e ceph@ceph-osd-node1The key's randomart image is:+--[ RSA 2048]----+|             .   ||            . o  ||          .  *...||         +  E =oo||        S .  o B.||           .  = +||          .  + ..||         .    = .||          ...o . |+-----------------+# ll .ssh/total 8-rw-------. 1 ceph ceph 1675 Mar 16 15:46 id_rsa-rw-r--r--. 1 ceph ceph  401 Mar 16 15:46 id_rsa.pubssh-copy-id {username}@node1ssh-copy-id {username}@node2ssh-copy-id {username}@node3

Disable Firewall

# sudo systemctl stop firewalld.service # sudo systemctl disable firewalld.service

TTY config

在Ceph nodes上将Defaults requiretty 设置为Defaults:ceph !requiretty，使用sudo visudo定位并更改。

# visudo# Defaults    requirettyDefaults:ceph !requiretty

注: Centos7 没有 Defaults requiretty 只需要添加上Defaults:ceph !requiretty 即可

Create A Cluster

只在管理节点上运行即可

测试环境

$ cd my-cluster/$ ceph-deploy purgedata  ceph-osd-node1 ceph-osd-node2ceph_deploy.conf][DEBUG ] found configuration file at: /home/ceph/.cephdeploy.conf[ceph_deploy.cli][INFO  ] Invoked (1.5.31): /bin/ceph-deploy purgedata ceph-osd-node1 ceph-osd-node2[ceph_deploy.cli][INFO  ] ceph-deploy options:[ceph_deploy.cli][INFO  ]  username                      : None[ceph_deploy.cli][INFO  ]  verbose                       : False[ceph_deploy.cli][INFO  ]  overwrite_conf                : False[ceph_deploy.cli][INFO  ]  quiet                         : False[ceph_deploy.cli][INFO  ]  cd_conf                       : 
    
     [ceph_deploy.cli][INFO  ]  cluster                       : ceph[ceph_deploy.cli][INFO  ]  host                          : ['ceph-osd-node1', 'ceph-osd-node2'][ceph_deploy.cli][INFO  ]  func                          : 
     
      [ceph_deploy.cli][INFO  ]  ceph_conf                     : None[ceph_deploy.cli][INFO  ]  default_release               : False[ceph_deploy.install][DEBUG ] Purging data from cluster ceph hosts ceph-osd-node1 ceph-osd-node2[ceph-osd-node1][DEBUG ] connection detected need for sudo[ceph-osd-node1][DEBUG ] connected to host: ceph-osd-node1 [ceph-osd-node1][DEBUG ] detect platform information from remote host[ceph-osd-node1][DEBUG ] detect machine type[ceph-osd-node1][DEBUG ] find the location of an executable[ceph-osd-node2][DEBUG ] connection detected need for sudo[ceph-osd-node2][DEBUG ] connected to host: ceph-osd-node2 [ceph-osd-node2][DEBUG ] detect platform information from remote host[ceph-osd-node2][DEBUG ] detect machine type[ceph-osd-node2][DEBUG ] find the location of an executable[ceph-osd-node1][DEBUG ] connection detected need for sudo[ceph-osd-node1][DEBUG ] connected to host: ceph-osd-node1 [ceph-osd-node1][DEBUG ] detect platform information from remote host[ceph-osd-node1][DEBUG ] detect machine type[ceph_deploy.install][INFO  ] Distro info: CentOS Linux 7.3.1611 Core[ceph-osd-node1][INFO  ] purging data on ceph-osd-node1[ceph-osd-node1][INFO  ] Running command: sudo rm -rf --one-file-system -- /var/lib/ceph[ceph-osd-node1][INFO  ] Running command: sudo rm -rf --one-file-system -- /etc/ceph/[ceph-osd-node2][DEBUG ] connection detected need for sudo[ceph-osd-node2][DEBUG ] connected to host: ceph-osd-node2 [ceph-osd-node2][DEBUG ] detect platform information from remote host[ceph-osd-node2][DEBUG ] detect machine type[ceph_deploy.install][INFO  ] Distro info: CentOS Linux 7.3.1611 Core[ceph-osd-node2][INFO  ] purging data on ceph-osd-node2[ceph-osd-node2][INFO  ] Running command: sudo rm -rf --one-file-system -- /var/lib/ceph[ceph-osd-node2][INFO  ] Running command: sudo rm -rf --one-file-system -- /etc/ceph/

生成key

$ ceph-deploy forgetkeys [ceph_deploy.conf][DEBUG ] found configuration file at: /home/ceph/.cephdeploy.conf[ceph_deploy.cli][INFO  ] Invoked (1.5.31): /bin/ceph-deploy forgetkeys[ceph_deploy.cli][INFO  ] ceph-deploy options:[ceph_deploy.cli][INFO  ]  username                      : None[ceph_deploy.cli][INFO  ]  verbose                       : False[ceph_deploy.cli][INFO  ]  overwrite_conf                : False[ceph_deploy.cli][INFO  ]  quiet                         : False[ceph_deploy.cli][INFO  ]  cd_conf                       : 
    
     [ceph_deploy.cli][INFO  ]  cluster                       : ceph[ceph_deploy.cli][INFO  ]  func                          : 
     
      [ceph_deploy.cli][INFO  ]  ceph_conf                     : None[ceph_deploy.cli][INFO  ]  default_release               : False

清除ceph安装包

$ ceph-deploy purge ceph-osd-node1 ceph-osd-node2[ceph_deploy.conf][DEBUG ] found configuration file at: /home/ceph/.cephdeploy.conf[ceph_deploy.cli][INFO  ] Invoked (1.5.31): /bin/ceph-deploy purge ceph-osd-node1 ceph-osd-node2[ceph_deploy.cli][INFO  ] ceph-deploy options:[ceph_deploy.cli][INFO  ]  username                      : None[ceph_deploy.cli][INFO  ]  verbose                       : False[ceph_deploy.cli][INFO  ]  overwrite_conf                : False[ceph_deploy.cli][INFO  ]  quiet                         : False[ceph_deploy.cli][INFO  ]  cd_conf                       : 
    
     [ceph_deploy.cli][INFO  ]  cluster                       : ceph[ceph_deploy.cli][INFO  ]  host                          : ['ceph-osd-node1', 'ceph-osd-node2'][ceph_deploy.cli][INFO  ]  func                          : 
     
      [ceph_deploy.cli][INFO  ]  ceph_conf                     : None[ceph_deploy.cli][INFO  ]  default_release               : False[ceph_deploy.install][INFO  ] note that some dependencies *will not* be removed because they can cause issues with qemu-kvm[ceph_deploy.install][INFO  ] like: librbd1 and librados2[ceph_deploy.install][DEBUG ] Purging on cluster ceph hosts ceph-osd-node1 ceph-osd-node2[ceph_deploy.install][DEBUG ] Detecting platform for host ceph-osd-node1 ...[ceph-osd-node1][DEBUG ] connection detected need for sudo[ceph-osd-node1][DEBUG ] connected to host: ceph-osd-node1 [ceph-osd-node1][DEBUG ] detect platform information from remote host[ceph-osd-node1][DEBUG ] detect machine type[ceph_deploy.install][INFO  ] Distro info: CentOS Linux 7.3.1611 Core[ceph-osd-node1][INFO  ] Purging Ceph on ceph-osd-node1[ceph-osd-node1][INFO  ] Running command: sudo yum -y -q remove ceph ceph-release ceph-common ceph-radosgw[ceph-osd-node1][WARNIN] No Match for argument: ceph[ceph-osd-node1][WARNIN] No Match for argument: ceph-release[ceph-osd-node1][WARNIN] No Match for argument: ceph-common[ceph-osd-node1][WARNIN] No Match for argument: ceph-radosgw[ceph-osd-node1][INFO  ] Running command: sudo yum clean all[ceph-osd-node1][DEBUG ] Loaded plugins: fastestmirror[ceph-osd-node1][DEBUG ] Cleaning repos: base centos-ceph-hammer centos-openstack-mitaka centos-qemu-ev[ceph-osd-node1][DEBUG ]               : extras updates[ceph-osd-node1][DEBUG ] Cleaning up everything[ceph-osd-node1][DEBUG ] Cleaning up list of fastest mirrors[ceph_deploy.install][DEBUG ] Detecting platform for host ceph-osd-node2 ...[ceph-osd-node2][DEBUG ] connection detected need for sudo[ceph-osd-node2][DEBUG ] connected to host: ceph-osd-node2 [ceph-osd-node2][DEBUG ] detect platform information from remote host[ceph-osd-node2][DEBUG ] detect machine type[ceph_deploy.install][INFO  ] Distro info: CentOS Linux 7.3.1611 Core[ceph-osd-node2][INFO  ] Purging Ceph on ceph-osd-node2[ceph-osd-node2][INFO  ] Running command: sudo yum -y -q remove ceph ceph-release ceph-common ceph-radosgw[ceph-osd-node2][WARNIN] No Match for argument: ceph[ceph-osd-node2][WARNIN] No Match for argument: ceph-release[ceph-osd-node2][WARNIN] No Match for argument: ceph-common[ceph-osd-node2][WARNIN] No Match for argument: ceph-radosgw[ceph-osd-node2][INFO  ] Running command: sudo yum clean all[ceph-osd-node2][DEBUG ] Loaded plugins: fastestmirror[ceph-osd-node2][DEBUG ] Cleaning repos: base centos-ceph-hammer centos-openstack-mitaka centos-qemu-ev[ceph-osd-node2][DEBUG ]               : extras updates[ceph-osd-node2][DEBUG ] Cleaning up everything[ceph-osd-node2][DEBUG ] Cleaning up list of fastest mirrors

Create Cluster

# ceph-deploy new  ceph-osd-node1 //initial-monitor-node(s)

该命令将node1初始化为Monitor节点，同时生成Ceph configure file，也就是Ceph的配置文件。

edit ceph.conf add line

[global]osd_pool_default_size = 2

Install Ceph

install ceph rpm

yum -y install ceph ceph-radosgw

ceph-deploy install ceph-osd-node1 ceph-osd-node2

添加初始monitor并收集keys

ceph-deploy mon create-initial

Add 4 OSDs

# ssh ceph-osd-node1# sudo mkdir /var/local/osd0 # sudo mkdir /var/local/osd1# chmod 777 /var/local/osd1 /var/local/osd1 //防止后文osd activate操作被拒绝 # exit# ssh  ceph-osd-node2 # sudo mkdir /var/local/osd2 # sudo mkdir /var/local/osd3 # chmod 777 /var/local/osd1  /var/local/osd3 # exitceph-deploy osd prepare ceph-osd-node1:/var/local/osd0  ceph-osd-node1:/var/local/osd1ceph-deploy osd prepare ceph-osd-node2:/var/local/osd2  ceph-osd-node2:/var/local/osd3ceph-deploy osd activate ceph-osd-node1:/var/local/osd0  ceph-osd-node1:/var/local/osd1ceph-deploy osd activate ceph-osd-node2:/var/local/osd2  ceph-osd-node2:/var/local/osd3

使用ceph-deploy将configure file和admin key拷贝到admin节点和Ceph节点上

ceph-deploy admin  ceph-osd-node1 ceph-osd-node2

delete ceph

yum erase ceph-deploy ceph-mon ceph-osd ceph ceph-radosgw python-cephfs ceph-common ceph-base ceph-mds libcephfs1 ceph-selinux

转载于:https://www.cnblogs.com/zhaogaolong/articles/7001350.html

你可能感兴趣的文章

Confluence 6 获得 Active Directory 服务器证书

查看>>

Ruby学习资源

查看>>

Confluence 6 有关 AD 的一些特殊说明

查看>>

IDEA环境下SSM整合------注解开发

查看>>

Docker的魔力，Make Apps Work Everywhere

查看>>

open文件操作

查看>>

论文 | 自然语言处理顶会ACL 2018该关注什么？蚂蚁金服专家告诉你！

查看>>

第6章 Spring Boot数据库集成

查看>>

专家教你使用MaxCompute玩转大数据分析！

查看>>

1-SII--SharedPreferences完美封装

查看>>

Idea_学习_09_Idea 方法自动生成参数默认名

查看>>

4-SII--☆Android缓存文件(带有效时长)封装

查看>>

go-fastdfs v1.2.5 发布，支持图片缩放，高性能、高可靠分布式文件系统

查看>>

第一章十天干，十二地支

查看>>

Unity 3D-AR开发-Vuforia教程手册

查看>>

05.企业信息化战略与实施

查看>>

iOS设置拍照retake和use按钮为中文简体

查看>>

.NET快速信息化系统开发框架 V3.2-&gt;Web版本新增“文件管理中心”集上传、下载、文件共享等一身，非常实用的功能...

查看>>

解决因为ssh秘钥权限问题导致的Connection closed by 192.168.1.31 port 2222

查看>>

区块链开发公司谈区块链有哪些算法

查看>>

Install ceph

Config system

for RHEL/Centos

Create Ceph Deploy User

No password login for ceph user

Disable Firewall

TTY config

Create A Cluster

只在管理节点上运行即可

测试环境

生成key

清除ceph安装包

Create Cluster

edit ceph.conf add line

Install Ceph

install ceph rpm

添加初始monitor并收集keys

Add 4 OSDs

使用ceph-deploy将configure file和admin key拷贝到admin节点和Ceph节点上

delete ceph