Table of Contents

Proxmox Backup Server

aka: PBS

Internet access

Only https on port 8007 is needed. Use VPN to secure connection between peers.

Deduplication

PBS has own deduplication system. It stores 4MB chunks as file where name of file is a hash of chunk. So deduplication works across one storage, but works for all VM.

Dirty bitmap

On client side, dirty bitmap is created to notice changed on block device. So client do not need to read back whole disk and only changes are sent to PBS (and deduplicated on server side). 

INFO: scsi0: dirty-bitmap status: OK (2.2 GiB of 4.0 GiB dirty)
INFO: scsi1: dirty-bitmap status: OK (drive clean)
INFO: using fast incremental mode (dirty-bitmap), 2.2 GiB dirty of 5.0 GiB total
INFO:   4% (96.0 MiB of 2.2 GiB) in 3s, read: 32.0 MiB/s, write: 22.7 MiB/s
INFO:   8% (192.0 MiB of 2.2 GiB) in 6s, read: 32.0 MiB/s, write: 32.0 MiB/s
INFO:  11% (264.0 MiB of 2.2 GiB) in 9s, read: 24.0 MiB/s, write: 24.0 MiB/s
INFO:  14% (328.0 MiB of 2.2 GiB) in 12s, read: 21.3 MiB/s, write: 21.3 MiB/s
INFO:  19% (432.0 MiB of 2.2 GiB) in 15s, read: 34.7 MiB/s, write: 34.7 MiB/s
INFO:  22% (500.0 MiB of 2.2 GiB) in 18s, read: 22.7 MiB/s, write: 18.7 MiB/s
INFO:  26% (608.0 MiB of 2.2 GiB) in 21s, read: 36.0 MiB/s, write: 22.7 MiB/s
INFO: 100% (2.2 GiB of 2.2 GiB) in 23s, read: 828.0 MiB/s, write: 30.0 MiB/s
INFO: backup is sparse: 1.61 GiB (72%) total zero data
INFO: backup was done incrementally, reused 4.43 GiB (88%)
INFO: transferred 2.21 GiB in 23 seconds (98.4 MiB/s)

File storage structure

|-- .chunks
|   |-- 0000
|   |-- 0001
|   |-- 0002
...
|   |-- fffc
|   |   `-- fffc231067e4f52accf1a820c82d52c0e463db2495c71658a295c218e074866a
|   |-- fffd
|   |-- fffe
|   `-- ffff
|-- .gc-status
|-- .lock
|-- ct
|   `-- 113
|       |-- 2021-05-24T16:41:32Z
|       |   |-- catalog.pcat1.didx
|       |   |-- client.log.blob
|       |   |-- index.json.blob
|       |   |-- pct.conf.blob
|       |   `-- root.pxar.didx
|       `-- owner
`-- vm
    `-- 120
        |-- 2021-05-24T16:09:24Z
        |   |-- client.log.blob
        |   |-- drive-scsi0.img.fidx
        |   |-- drive-scsi1.img.fidx
        |   |-- index.json.blob
        |   `-- qemu-server.conf.blob
        |-- 2021-05-24T16:16:06Z
        |   |-- client.log.blob
        |   |-- drive-scsi0.img.fidx
        |   |-- drive-scsi1.img.fidx
        |   |-- index.json.blob
        |   `-- qemu-server.conf.blob
        |-- 2021-05-24T16:18:06Z
        |   |-- client.log.blob
        |   |-- drive-scsi0.img.fidx
        |   |-- drive-scsi1.img.fidx
        |   |-- index.json.blob
        |   `-- qemu-server.conf.blob
        |-- 2021-05-24T16:23:02Z
        |   |-- client.log.blob
        |   |-- drive-scsi0.img.fidx
        |   |-- drive-scsi1.img.fidx
        |   |-- index.json.blob
        |   `-- qemu-server.conf.blob
        `-- owner