Ceph

- Знакомство с хранилищем Ceph в картинках
- Как запускать Ceph в 2022 году?
- Разворачиваем распределенное хранилище CEPH и подключаем его к Kubernetes
- Ceph. Анатомия катастрофы
- Принцип и развертывание ceph-iscsi
- Youtube Setting up iSCSI in Ceph
- Ceph Quincy : Configure Ceph Cluster #1 2022/06/14 
- Ceph Quincy : Configure Ceph Cluster #2 2022/06/14 
- Ceph Quincy : Use File System 2022/06/14

- Подробное объяснение состояния PG распределенного хранилища Ceph

ceph enable telemertry

ceph telemetry on --license sharing-1-0
ceph telemetry enable channel basic
ceph telemetry enable channel crash
ceph telemetry enable channel device
ceph telemetry enable channel ident
ceph telemetry enable channel perf

ceph -w
ceph osd reweight-by-utilization
systemctl status ceph-osd@2
ceph-volume lvm activate --all
ceph-volume lvm list
ceph-volume lvm activate 2 54d41a06-f6d4-44f2-b662-e6dc7d17c1b0
ceph auth add osd.2 osd 'allow *' mon 'allow rwx' -i /var/lib/ceph/osd/ceph-2/keyring
ceph osd status
ceph osd df tree
ceph health detail

chown -R ceph. /etc/ceph /var/lib/ceph
parted --script /dev/sdb 'mklabel gpt';  parted --script /dev/sdb "mkpart primary 0% 100%";
ceph-volume lvm create --data /dev/sdb1

ceph pg dump | grep undersized

ceph osd pool get cephfs_data 
ceph osd pool get cephfs_data pg_autoscale_mode
ceph osd pool get cephfs_data min_size

ceph osd dump | egrep 'replicated size|min_size'

Ceph Osd Reweight

ceph osd getcrushmap -o crushmap.bin
crushtool -d crushmap.bin -o crushmap.txt
mcedit crushmap.txt
crushtool -c crushmap.txt -o crushmap-new.bin
crushtool --test -i crushmap-new.bin --show-utilization --rule 0 --num-rep=2
ceph osd setcrushmap -i crushmap-new.bin

Deacrese osd weight

ceph osd crush reweight osd.7 2.6
reweighted item id 7 name 'osd.7' to 2.6 in crush map

Monitor

cd /etc/ceph
HOSTNAME=`hostname -s`
MONITOR=$(ceph mon stat | awk -F'[][]' '{print $2}' | awk -F':' '{print $2}')
HOSTIP=$(ip -o route get to $MONITOR | sed -n 's/.*src \([0-9.]\+\).*/\1/p')
yum install ceph-mon -y
mkdir -p /var/lib/ceph/mon/ceph-$HOSTNAME
ceph auth get mon. -o /etc/ceph/mon-keyring
ceph mon getmap -o /etc/ceph/monmap
ceph-mon -i $HOSTNAME --mkfs --monmap /etc/ceph/monmap --keyring /etc/ceph/mon-keyring
chown -R ceph. /var/lib/ceph/mon
ceph-mon -i $HOSTNAME --public-addr=$HOSTIP:6789

if mon failed

rm -f /run/ceph/ceph-mon.node03.asok 
rm -f /var/lib/ceph/mon/ceph-`hostname -s`/store.db/LOCK 
chown -R ceph. /var/lib/ceph/ 
systemctl start ceph-mon@`hostname -s`

Clear warn events

ceph crash archive-all