bs2020s root disk seems to have hiccuped

[D Delmar Davis]

BS2020 wouldn't let me log in as the root disk was mounted ro.
Went away with a powercycle. dmesg complains about ulookahead
Syslog disappears around 4am.

Mar 23 03:17:01 bs2020 CRON[14580]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Mar 23 03:23:01 bs2020 CRON[17085]: (root) CMD (if test -x /usr/sbin/apticron; then /usr/sbin/apticron --cron; else true; fi)
Mar 23 04:17:01 bs2020 CRON[21050]: (root) CMD (   cd / && run-parts --report /etc/cron.hourly)
Mar 23 04:21:55 bs2020 lxd[4693]: t=2019-03-23T04:21:55-0700 lvl=eror msg="Error getting source image" err="No such object" fp=700c86f315466dc8579a29f728cfedf0d5eab6df9577da900fe1913
Mar 23 04:21:58 bs2020 zed: eid=380 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:21:58 bs2020 zed: eid=381 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:21:59 bs2020 zed: eid=382 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:05 bs2020 zed: eid=383 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:05 bs2020 zed: eid=384 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:06 bs2020 zed: eid=385 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:06 bs2020 zed: eid=386 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:06 bs2020 zed: eid=387 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:15 bs2020 zed: eid=388 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:15 bs2020 zed: eid=389 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:16 bs2020 zed: eid=390 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:21 bs2020 zed: eid=391 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23 04:22:21 bs2020 zed: eid=392 class=history_event pool_guid=0x9DB7C960E3373502
Mar 23Mar 23 16:02:53 bs2020 systemd-modules-load[686]: Inserted module 'iscsi_tcp'
Mar 23 16:02:53 bs2020 systemd[1]: Mounted POSIX Message Queue File System.
Mar 23 16:02:53 bs2020 systemd[1]: Started Create list of required static device nodes for the current kernel.
Mar 23 16:02:53 bs2020 systemd[1]: Started Set the console keyboard layout.
Mar 23 16:02:53 bs2020 systemd[1]: Started Uncomplicated firewall.
Mar 23 16:02:53 bs2020 systemd[1]: Mounted Kernel Debug File System.

[D Delmar Davis]

Was good to visit the systems as it turns out that one of Bernie's root disks was flagged as failing.

• Pulled the failing disk and rebooted with the array in a degraded state.
• Found a replacement.
• Replaced the disk.

Array controller did all of the heavy lifting (Joe actually did the work).

Will start a discovery ticket to see if we can get the perccli to tell us when a disk is failing without having to reboot the system.