| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Comment |
|---|---|---|---|
| runtests test 1: All Runtests | LustreError: 14427:0:(mdd_device.c:996:mdd_trash_setup()) ASSERTION( ((&mdo->mo_lu)->lo_header->loh_attr & LOHA_EXISTS) ) failed: LustreError: 14427:0:(mdd_device.c:996:mdd_trash_setup()) LBUG CPU: 3 PID: 14427 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? lbug_with_loc.cold.4+0xd/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae Kernel panic - not syncing: LBUG CPU: 3 PID: 14427 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? panic+0x142/0x44c ? lbug_with_loc.cold.4+0x32/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae | Lustre: DEBUG MARKER: touching /mnt/lustre at Fri Mar 27 04:20:28 EDT 2026 (@1774599628) Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.7590 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7590 Lustre: DEBUG MARKER: comparing /etc/hosts and /mnt/lustre/hosts.7590 Lustre: DEBUG MARKER: renaming /mnt/lustre/hosts.7590 to /mnt/lustre/hosts.7590.ren Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7590 again Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7590 Lustre: DEBUG MARKER: removing /mnt/lustre/hosts.7590 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7590.2 Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7590.2 to 123 bytes Lustre: DEBUG MARKER: creating /mnt/lustre/d1.runtests Lustre: DEBUG MARKER: copying 1000 files from /etc, /usr/bin to /mnt/lustre/d1.runtests/etc, /mnt/lustre/d1.runtests/usr/bin at Fri Mar 27 04:20:59 EDT 2026 Lustre: DEBUG MARKER: comparing 1000 newly copied files at Fri Mar 27 04:22:45 EDT 2026 Lustre: DEBUG MARKER: running createmany -d /mnt/lustre/d1.runtests/d 1000 Lustre: DEBUG MARKER: finished at Fri Mar 27 04:23:39 EDT 2026 (191) LustreError: 12995:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup Lustre: server umount lustre-MDT0000 complete LustreError: 5771:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1774599831 with bad export cookie 1896455065509695139 LustreError: MGC192.168.202.110@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 13198:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup LustreError: 13198:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages Lustre: server umount lustre-OST0000 complete Lustre: 3314:0:(client.c:2468:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1774599828/real 1774599828] req@ffff8d5ec9609c00 x1860802311333376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1774599844 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete LustreError: 13404:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup LustreError: 13404:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg210-server.virtnet: executing load_modules_local Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 | Link to test |
| runtests test 1: All Runtests | LustreError: 14292:0:(mdd_device.c:996:mdd_trash_setup()) ASSERTION( ((&mdo->mo_lu)->lo_header->loh_attr & LOHA_EXISTS) ) failed: LustreError: 14292:0:(mdd_device.c:996:mdd_trash_setup()) LBUG CPU: 3 PID: 14292 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? lbug_with_loc.cold.4+0xd/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae Kernel panic - not syncing: LBUG CPU: 3 PID: 14292 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? panic+0x142/0x44c ? lbug_with_loc.cold.4+0x32/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae | Lustre: DEBUG MARKER: touching /mnt/lustre at Thu Mar 19 03:05:09 EDT 2026 (@1773903909) Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.7587 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7587 Lustre: DEBUG MARKER: comparing /etc/hosts and /mnt/lustre/hosts.7587 Lustre: DEBUG MARKER: renaming /mnt/lustre/hosts.7587 to /mnt/lustre/hosts.7587.ren Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7587 again Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7587 Lustre: DEBUG MARKER: removing /mnt/lustre/hosts.7587 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7587.2 Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7587.2 to 123 bytes Lustre: DEBUG MARKER: creating /mnt/lustre/d1.runtests Lustre: DEBUG MARKER: copying 1000 files from /etc, /usr/bin to /mnt/lustre/d1.runtests/etc, /mnt/lustre/d1.runtests/usr/bin at Thu Mar 19 03:05:24 EDT 2026 Lustre: DEBUG MARKER: comparing 1000 newly copied files at Thu Mar 19 03:06:09 EDT 2026 Lustre: DEBUG MARKER: running createmany -d /mnt/lustre/d1.runtests/d 1000 Lustre: DEBUG MARKER: finished at Thu Mar 19 03:06:28 EDT 2026 (79) LustreError: 12859:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup Lustre: server umount lustre-MDT0000 complete LustreError: 5735:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1773903996 with bad export cookie 5083937654393536658 LustreError: MGC192.168.202.115@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 13064:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup LustreError: 13064:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages Lustre: server umount lustre-OST0000 complete LustreError: 13268:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup LustreError: 13268:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg215-server.virtnet: executing load_modules_local Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 | Link to test |
| runtests test 1: All Runtests | LustreError: 14257:0:(mdd_device.c:996:mdd_trash_setup()) ASSERTION( ((&mdo->mo_lu)->lo_header->loh_attr & LOHA_EXISTS) ) failed: LustreError: 14257:0:(mdd_device.c:996:mdd_trash_setup()) LBUG CPU: 0 PID: 14257 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? lbug_with_loc.cold.4+0xd/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae Kernel panic - not syncing: LBUG CPU: 0 PID: 14257 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? panic+0x142/0x44c ? lbug_with_loc.cold.4+0x32/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae | Lustre: DEBUG MARKER: touching /mnt/lustre at Wed Feb 4 04:10:38 EST 2026 (@1770196238) Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.7530 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7530 Lustre: DEBUG MARKER: comparing /etc/hosts and /mnt/lustre/hosts.7530 Lustre: DEBUG MARKER: renaming /mnt/lustre/hosts.7530 to /mnt/lustre/hosts.7530.ren Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7530 again Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7530 Lustre: DEBUG MARKER: removing /mnt/lustre/hosts.7530 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7530.2 Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7530.2 to 123 bytes Lustre: DEBUG MARKER: creating /mnt/lustre/d1.runtests Lustre: DEBUG MARKER: copying 1000 files from /etc, /usr/bin to /mnt/lustre/d1.runtests/etc, /mnt/lustre/d1.runtests/usr/bin at Wed Feb 4 04:10:47 EST 2026 Lustre: DEBUG MARKER: comparing 1000 newly copied files at Wed Feb 4 04:11:06 EST 2026 Lustre: DEBUG MARKER: running createmany -d /mnt/lustre/d1.runtests/d 1000 Lustre: DEBUG MARKER: finished at Wed Feb 4 04:11:19 EST 2026 (41) Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: Skipped 1 previous similar message Lustre: Skipped 1 previous similar message Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: Skipped 1 previous similar message LustreError: 12830:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup Lustre: server umount lustre-MDT0000 complete LustreError: 5744:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1770196288 with bad export cookie 1675836488036547167 LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 5744:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) Skipped 2 previous similar messages LustreError: 13038:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup LustreError: 13038:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages Lustre: server umount lustre-OST0000 complete LustreError: 13240:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup LustreError: 13240:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg231-server.virtnet: executing load_modules_local Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 | Link to test |
| runtests test 1: All Runtests | LustreError: 14318:0:(mdd_device.c:996:mdd_trash_setup()) ASSERTION( ((&mdo->mo_lu)->lo_header->loh_attr & LOHA_EXISTS) ) failed: LustreError: 14318:0:(mdd_device.c:996:mdd_trash_setup()) LBUG CPU: 1 PID: 14318 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? lbug_with_loc.cold.4+0xd/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae Kernel panic - not syncing: LBUG CPU: 1 PID: 14318 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? panic+0x142/0x44c ? lbug_with_loc.cold.4+0x32/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae | Lustre: DEBUG MARKER: touching /mnt/lustre at Mon Jan 26 23:18:17 EST 2026 (@1769487497) Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.7549 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7549 Lustre: DEBUG MARKER: comparing /etc/hosts and /mnt/lustre/hosts.7549 Lustre: DEBUG MARKER: renaming /mnt/lustre/hosts.7549 to /mnt/lustre/hosts.7549.ren Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7549 again Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7549 Lustre: DEBUG MARKER: removing /mnt/lustre/hosts.7549 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7549.2 Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7549.2 to 123 bytes Lustre: DEBUG MARKER: creating /mnt/lustre/d1.runtests Lustre: DEBUG MARKER: copying 1000 files from /etc, /usr/bin to /mnt/lustre/d1.runtests/etc, /mnt/lustre/d1.runtests/usr/bin at Mon Jan 26 23:18:29 EST 2026 Lustre: DEBUG MARKER: comparing 1000 newly copied files at Mon Jan 26 23:19:00 EST 2026 Lustre: DEBUG MARKER: running createmany -d /mnt/lustre/d1.runtests/d 1000 Lustre: DEBUG MARKER: finished at Mon Jan 26 23:19:18 EST 2026 (61) LustreError: 12886:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup Lustre: server umount lustre-MDT0000 complete LustreError: 7421:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1769487566 with bad export cookie 2021796107153554503 LustreError: MGC192.168.204.144@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 13091:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup LustreError: 13091:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages Lustre: server umount lustre-OST0000 complete LustreError: 13295:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup LustreError: 13295:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg444-server.virtnet: executing load_modules_local Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 | Link to test |
| runtests test 1: All Runtests | LustreError: 14333:0:(mdd_device.c:996:mdd_trash_setup()) ASSERTION( ((&mdo->mo_lu)->lo_header->loh_attr & LOHA_EXISTS) ) failed: LustreError: 14333:0:(mdd_device.c:996:mdd_trash_setup()) LBUG CPU: 2 PID: 14333 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? lbug_with_loc.cold.4+0xd/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae Kernel panic - not syncing: LBUG CPU: 2 PID: 14333 Comm: mount.lustre Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-8.fc42 06/10/2025 Call Trace: ? dump_stack+0xbb/0x10e ? panic+0x142/0x44c ? lbug_with_loc.cold.4+0x32/0x86 [libcfs] ? mdd_dot_lustre_setup+0xc64/0xc80 [mdd] ? osd_xattr_get+0x2d8/0x8d0 [osd_zfs] ? mdd_prepare+0x860/0x1b40 [mdd] ? tgt_ses_key_init+0x31/0x150 [ptlrpc] ? mdt_prepare+0x5d/0x510 [mdt] ? server_start_targets+0x2517/0x2e50 [ptlrpc] ? class_config_dump_handler+0x950/0x950 [obdclass] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? cfs_trace_unlock_tcd+0x28/0xa0 [libcfs] ? libcfs_debug_msg+0xcf4/0x1200 [libcfs] ? do_raw_spin_unlock+0x75/0x190 ? debug_check_no_obj_freed+0x16f/0x2e8 ? slab_free_freelist_hook.isra.49+0x107/0x220 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? kfree+0x335/0x380 ? lustre_start_mgc+0x128b/0x2970 [obdclass] ? server_fill_super+0xbc6/0x1190 [ptlrpc] ? obd_zombie_barrier+0x63/0x120 [obdclass] ? lustre_fill_super+0x488/0x5c0 [lustre] ? lustre_mount+0x30/0x30 [lustre] ? mount_nodev+0x56/0xf0 ? lustre_mount+0x1c/0x30 [lustre] ? legacy_get_tree+0x2f/0x80 ? vfs_get_tree+0x27/0x130 ? do_mount+0xc17/0x1030 ? ksys_mount+0x11d/0x150 ? __x64_sys_mount+0x29/0x40 ? do_syscall_64+0xc1/0x440 ? entry_SYSCALL_64_after_hwframe+0x49/0xae | Lustre: DEBUG MARKER: touching /mnt/lustre at Tue Jan 20 08:21:32 EST 2026 (@1768915292) Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.7568 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7568 Lustre: DEBUG MARKER: comparing /etc/hosts and /mnt/lustre/hosts.7568 Lustre: DEBUG MARKER: renaming /mnt/lustre/hosts.7568 to /mnt/lustre/hosts.7568.ren Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7568 again Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7568 Lustre: DEBUG MARKER: removing /mnt/lustre/hosts.7568 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.7568.2 Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.7568.2 to 123 bytes Lustre: DEBUG MARKER: creating /mnt/lustre/d1.runtests Lustre: DEBUG MARKER: copying 1000 files from /etc, /usr/bin to /mnt/lustre/d1.runtests/etc, /mnt/lustre/d1.runtests/usr/bin at Tue Jan 20 08:21:46 EST 2026 Lustre: DEBUG MARKER: comparing 1000 newly copied files at Tue Jan 20 08:22:42 EST 2026 Lustre: DEBUG MARKER: running createmany -d /mnt/lustre/d1.runtests/d 1000 Lustre: DEBUG MARKER: finished at Tue Jan 20 08:23:00 EST 2026 (88) LustreError: 12900:0:(obd_class.h:479:obd_check_dev()) Device 17 not setup Lustre: server umount lustre-MDT0000 complete LustreError: 5743:0:(ldlm_lockd.c:2563:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1768915387 with bad export cookie 6950949362017169677 LustreError: MGC192.168.202.139@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 13103:0:(obd_class.h:479:obd_check_dev()) Device 12 not setup LustreError: 13103:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages Lustre: server umount lustre-OST0000 complete LustreError: 13306:0:(obd_class.h:479:obd_check_dev()) Device 2 not setup LustreError: 13306:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg239-server.virtnet: executing load_modules_local Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 | Link to test |