Table of Contents

CEPH

Ceph RADOS Block Devices (RBD)

CEPH provides only a pools of object. To use it for VMs block devices additional layer (RBD) is needed. It can be created manually or during CEPH pool creation (option Add as Storage)

Ceph FS

It is implementation of POSIX compliant FS top of CEPH POOL. It requires one pool for data (block data) and to keep filesystem information (metadata). Performance strictly depends on metadata pool, so it is recommended to use for backups files.

Used ports:

Prepare

Read Proxmox CEPH requirements. It requires at least one spare hard drive on each node. Topic for later.

Installation

create OSD

Create Object Storage Daemon

On every node in cluster

If there is no unused disk to choose, erase content of disk with command:

ceph-volume lvm zap /dev/... --destroy

restart ceph services

systemctl stop ceph\*.service ceph\*.target
systemctl start ceph.target

create pool

pool benchmark

Benchmarks for pool name 'rbd' and 10 seconds duration

# Write benchmark
rados -p rbd bench 10 write --no-cleanup
 
# Read performance
rados -p rbd bench 10 seq