CEPH inline compression

https://docs.ceph.com/en/latest/rados/configuration/bluestore-config-ref/#inline-compression

BlueStore compression performance

ceph osd pool set rbd compression_algorithm snappy
ceph osd pool set rbd compression_mode aggressive

Check compression ratios:

ceph daemon osd.2 perf dump | egrep -i "bluestore_compressed|bluestore_allocated|bluestore_stored|compress_.*_count"

or

ceph daemon osd.0 perf dump | egrep -i "bluestore_compressed|bluestore_allocated|bluestore_stored|compress_.*_count|bluestore_write_big|bluestore_write_small"