log

root@u1:/# ceph health detail
HEALTH_WARN 4 failed cephadm daemon(s); mons u2,u3 are low on available space; nobackfill,norebalance,norecover flag(s) set; Degraded data redundancy: 2540/8550 objects degraded (29.708%), 32 pgs degraded, 32 pgs undersized; 5 daemons have recently crashed; 2 mgr modules have recently crashed
[WRN] CEPHADM_FAILED_DAEMON: 4 failed cephadm daemon(s)
daemon nfs.my-nfs.0.1129.u1.teifxa on u1 is in error state
daemon nfs.my-nfs.1.1129.u2.dcelbn on u2 is in error state
daemon iscsi.gw.u2.ycfman on u2 is in error state
daemon nfs.my-nfs.2.1092.u3.qcxtph on u3 is in error state
[WRN] MON_DISK_LOW: mons u2,u3 are low on available space
mon.u2 has 25% avail
mon.u3 has 30% avail
[WRN] OSDMAP_FLAGS: nobackfill,norebalance,norecover flag(s) set
[WRN] PG_DEGRADED: Degraded data redundancy: 2540/8550 objects degraded (29.708%), 32 pgs degraded, 32 pgs undersized
pg 4.0 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [4,7]
pg 4.1 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [7,8]
pg 4.2 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,8]
pg 4.3 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [5,8]
pg 4.4 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,8]
pg 4.5 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [6,7]
pg 4.6 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [5,4]
pg 4.7 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [5,8]
pg 4.8 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,4]
pg 4.9 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [5,6]
pg 4.a is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [8,7]
pg 4.b is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,4]
pg 4.c is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [8,5]
pg 4.d is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [8,5]
pg 4.e is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [8,5]
pg 4.f is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,4]
pg 4.10 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,4]
pg 4.11 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [4,7]
pg 4.12 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,4]
pg 4.13 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [4,7]
pg 4.14 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [5,8]
pg 4.15 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [5,8]
pg 4.16 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [5,6]
pg 4.17 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,8]
pg 4.18 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [8,7]
pg 4.19 is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,6]
pg 4.1a is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [4,5]
pg 4.1b is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [4,3]
pg 4.1c is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [5,4]
pg 4.1d is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [7,6]
pg 4.1e is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [4,7]
pg 4.1f is stuck undersized for 2d, current state active+undersized+degraded+remapped+backfilling, last acting [3,8]
[WRN] RECENT_CRASH: 5 daemons have recently crashed
osd.4 crashed on host u2 at 2022-06-22T10:05:42.431117Z
osd.6 crashed on host u2 at 2022-06-22T10:11:39.700728Z
osd.5 crashed on host u3 at 2022-06-22T10:21:36.696408Z
osd.2 crashed on host u1 at 2022-06-22T11:03:41.160979Z
osd.6 crashed on host u2 at 2022-06-24T10:18:52.571920Z
[WRN] RECENT_MGR_MODULE_CRASH: 2 mgr modules have recently crashed
mgr module nfs crashed in daemon mgr.u3.egcdon on host u3 at 2022-06-22T07:09:05.180482Z
mgr module nfs crashed in daemon mgr.u3.egcdon on host u3 at 2022-06-24T09:52:21.513723Z
root@u1:/#