| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Comment |
|---|---|---|---|
| recovery-small test complete, duration 390 sec | stack segment: 0000 [#1] SMP DEBUG_PAGEALLOC CPU: 0 PID: 22902 Comm: kworker/0:2 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Workqueue: events rsc_entry_free_work [ptlrpc_gss] RIP: 0010:debugfs_remove_recursive+0x45/0x260 Code: 41 57 49 89 ff 41 56 49 c7 c6 d4 87 05 90 41 55 4c 8d af b8 00 00 00 41 54 55 48 89 fd 53 48 83 ec 08 48 83 05 eb 9a 17 03 01 <48> 8b 45 30 4c 8d 65 58 48 8d b8 c0 00 00 00 e8 c7 3e 8f 00 48 83 RSP: 0018:ffffa7c1419bbda8 EFLAGS: 00010206 RAX: 0000000000000000 RBX: ffff91ad8839af80 RCX: 0000000006bceba4 RDX: 0000000000000000 RSI: 0000000000000000 RDI: dead000000000200 RBP: dead000000000200 R08: 0000000000000733 R09: 0000000000000000 R10: 0000000002322d24 R11: ffff91aebff92000 R12: ffff91aec2038a00 R13: dead0000000002b8 R14: ffffffff900587d4 R15: dead000000000200 FS: 0000000000000000(0000) GS:ffff91aec2000000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000563a533f69f8 CR3: 0000000115e16004 CR4: 0000000000170ef0 Call Trace: ? show_regs.cold.9+0x22/0x2f ? __die_body+0x22/0x90 ? __die+0x33/0x4a ? die+0x3a/0x6f ? do_trap+0x118/0x150 ? do_error_trap+0x8b/0x130 ? do_stack_segment+0x29/0x40 ? stack_segment+0x1e/0x30 ? debugfs_remove_recursive+0x45/0x260 lprocfs_nodemap_remove+0x1a/0x160 [ptlrpc] nodemap_destroy+0x45/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] nodemap_destroy+0x298/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] gssiam_delete_sec_context+0x22/0x80 [ptlrpc_gss] lgss_delete_sec_context+0x60/0x2d0 [ptlrpc_gss] __rsc_free+0x9b/0x140 [ptlrpc_gss] rsc_entry_free_work+0x21/0xf0 [ptlrpc_gss] process_one_work+0x2c8/0x700 worker_thread+0x296/0x6e0 ? rescuer_thread+0x570/0x570 kthread+0x1d1/0x200 ? set_kthread_struct+0x70/0x70 ret_from_fork+0x1f/0x30 Modules linked in: zfs(O) spl(O) ldiskfs(O) lquota(O) ec(O) ptlrpc_gss(O-) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel serio_raw ata_piix libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: mgc] | Lustre: DEBUG MARKER: === recovery-small: start cleanup 02:14:03 (1779430443) === Lustre: DEBUG MARKER: === recovery-small: finish cleanup 02:14:04 (1779430444) === Lustre: server umount lustre-MDT0000 complete Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete LustreError: 6596:0:(ldlm_lib.c:1182:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. Lustre: Skipped 3 previous similar messages LustreError: 6596:0:(ldlm_lib.c:1182:target_handle_connect()) Skipped 2 previous similar messages LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 LustreError: 6580:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779430450 with bad export cookie 5600647166973913664 LustreError: MGC192.168.204.107@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 6580:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages Lustre: server umount lustre-MDT0001 complete Lustre: server umount lustre-OST0000 complete Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg407-server.virtnet: executing unload_modules_local Key type lgssc unregistered | Link to test |
| recovery-small test complete, duration 405 sec | stack segment: 0000 [#1] SMP DEBUG_PAGEALLOC CPU: 1 PID: 3401 Comm: kworker/1:4 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Workqueue: events rsc_entry_free_work [ptlrpc_gss] RIP: 0010:debugfs_remove_recursive+0x45/0x260 Code: 41 57 49 89 ff 41 56 49 c7 c6 d4 87 c5 b0 41 55 4c 8d af b8 00 00 00 41 54 55 48 89 fd 53 48 83 ec 08 48 83 05 eb 9a 17 03 01 <48> 8b 45 30 4c 8d 65 58 48 8d b8 c0 00 00 00 e8 c7 3e 8f 00 48 83 RSP: 0018:ffff9ffc41963da8 EFLAGS: 00010206 RAX: 0000000000000000 RBX: ffff91fc177396c0 RCX: 0000000007077a48 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 657361656c657264 RBP: 657361656c657264 R08: 0000000000000917 R09: 0000000000000000 R10: 0000000002536455 R11: ffff91fc08894000 R12: ffff91fc420b8a00 R13: 657361656c65731c R14: ffffffffb0c587d4 R15: 657361656c657264 FS: 0000000000000000(0000) GS:ffff91fc42080000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000562b16b609f8 CR3: 0000000049c16002 CR4: 0000000000170ee0 Call Trace: ? show_regs.cold.9+0x22/0x2f ? __die_body+0x22/0x90 ? __die+0x33/0x4a ? die+0x3a/0x6f ? do_trap+0x118/0x150 ? do_error_trap+0x8b/0x130 ? do_stack_segment+0x29/0x40 ? stack_segment+0x1e/0x30 ? debugfs_remove_recursive+0x45/0x260 lprocfs_nodemap_remove+0x1a/0x160 [ptlrpc] nodemap_destroy+0x45/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] nodemap_destroy+0x298/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] gssiam_delete_sec_context+0x22/0x80 [ptlrpc_gss] lgss_delete_sec_context+0x60/0x2d0 [ptlrpc_gss] __rsc_free+0x9b/0x140 [ptlrpc_gss] rsc_entry_free_work+0x21/0xf0 [ptlrpc_gss] process_one_work+0x2c8/0x700 worker_thread+0x296/0x6e0 ? rescuer_thread+0x570/0x570 kthread+0x1d1/0x200 ? set_kthread_struct+0x70/0x70 ret_from_fork+0x1f/0x30 Modules linked in: zfs(O) spl(O) ldiskfs(O) lquota(O) ec(O) ptlrpc_gss(O-) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs crct10dif_pclmul crc32_pclmul ata_generic crc32c_intel ata_piix ghash_clmulni_intel serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: mgc] | Lustre: DEBUG MARKER: === recovery-small: start cleanup 02:14:07 (1779430447) === Lustre: DEBUG MARKER: === recovery-small: finish cleanup 02:14:09 (1779430449) === LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: Skipped 3 previous similar messages Lustre: Skipped 3 previous similar messages Lustre: server umount lustre-MDT0000 complete LustreError: 6584:0:(ldlm_lib.c:1182:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: 6584:0:(ldlm_lib.c:1182:target_handle_connect()) Skipped 7 previous similar messages LustreError: 20915:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779430459 with bad export cookie 14785502813712523938 LustreError: MGC192.168.202.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 20915:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages Lustre: server umount lustre-MDT0001 complete Lustre: server umount lustre-OST0000 complete Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg243-server.virtnet: executing unload_modules_local Key type lgssc unregistered | Link to test |
| recovery-small test complete, duration 409 sec | stack segment: 0000 [#1] SMP DEBUG_PAGEALLOC CPU: 3 PID: 13974 Comm: kworker/3:1 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Workqueue: events rsc_entry_free_work [ptlrpc_gss] RIP: 0010:debugfs_remove_recursive+0x45/0x260 Code: 41 57 49 89 ff 41 56 49 c7 c6 d4 87 25 98 41 55 4c 8d af b8 00 00 00 41 54 55 48 89 fd 53 48 83 ec 08 48 83 05 eb 9a 17 03 01 <48> 8b 45 30 4c 8d 65 58 48 8d b8 c0 00 00 00 e8 c7 3e 8f 00 48 83 RSP: 0018:ffffae54c149bda8 EFLAGS: 00010202 RAX: 0000000000000000 RBX: ffff913c85acffc0 RCX: 0000000007b538de RDX: 0000000000000000 RSI: 0000000000000000 RDI: 7479625f6e695f65 RBP: 7479625f6e695f65 R08: 0000000000000cdd R09: 0000000000000000 R10: 00000000023e174c R11: ffff913c85ade000 R12: ffff913dc21b8a00 R13: 7479625f6e69601d R14: ffffffff982587d4 R15: 7479625f6e695f65 FS: 0000000000000000(0000) GS:ffff913dc2180000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000055e98b7249f8 CR3: 000000002e416004 CR4: 0000000000170ee0 Call Trace: ? show_regs.cold.9+0x22/0x2f ? __die_body+0x22/0x90 ? __die+0x33/0x4a ? die+0x3a/0x6f ? do_trap+0x118/0x150 ? do_error_trap+0x8b/0x130 ? do_stack_segment+0x29/0x40 ? stack_segment+0x1e/0x30 ? debugfs_remove_recursive+0x45/0x260 lprocfs_nodemap_remove+0x1a/0x160 [ptlrpc] nodemap_destroy+0x45/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] nodemap_destroy+0x298/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] gssiam_delete_sec_context+0x22/0x80 [ptlrpc_gss] lgss_delete_sec_context+0x60/0x2d0 [ptlrpc_gss] __rsc_free+0x9b/0x140 [ptlrpc_gss] rsc_entry_free_work+0x21/0xf0 [ptlrpc_gss] process_one_work+0x2c8/0x700 worker_thread+0x296/0x6e0 ? rescuer_thread+0x570/0x570 kthread+0x1d1/0x200 ? set_kthread_struct+0x70/0x70 ret_from_fork+0x1f/0x30 Modules linked in: lquota(O) ec(O) ptlrpc_gss(O-) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) zfs(O) spl(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel serio_raw ata_piix libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: mgc] | Lustre: DEBUG MARKER: === recovery-small: start cleanup 02:13:55 (1779430435) === Lustre: DEBUG MARKER: === recovery-small: finish cleanup 02:13:57 (1779430437) === LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: Skipped 1 previous similar message Lustre: server umount lustre-MDT0000 complete LustreError: 9715:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779430441 with bad export cookie 3004021279520060275 LustreError: MGC192.168.202.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 9715:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 3 previous similar messages Lustre: server umount lustre-MDT0001 complete Lustre: server umount lustre-OST0000 complete Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg231-server.virtnet: executing unload_modules_local Key type lgssc unregistered | Link to test |
| recovery-small test complete, duration 427 sec | stack segment: 0000 [#1] SMP DEBUG_PAGEALLOC CPU: 2 PID: 10853 Comm: kworker/2:2 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Workqueue: events rsc_entry_free_work [ptlrpc_gss] RIP: 0010:debugfs_remove_recursive+0x45/0x260 Code: 41 57 49 89 ff 41 56 49 c7 c6 d4 87 85 b5 41 55 4c 8d af b8 00 00 00 41 54 55 48 89 fd 53 48 83 ec 08 48 83 05 eb 9a 17 03 01 <48> 8b 45 30 4c 8d 65 58 48 8d b8 c0 00 00 00 e8 c7 3e 8f 00 48 83 RSP: 0018:ffffa53481b07da8 EFLAGS: 00010202 RAX: 0000000000000000 RBX: ffff8b7ff6defa00 RCX: 000000000810dd13 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 746e756f6d2e656c RBP: 746e756f6d2e656c R08: 000000000000091f R09: 0000000000000000 R10: 0000000002629d2a R11: ffff8b7ffc9d0000 R12: ffff8b8002138a00 R13: 746e756f6d2e6624 R14: ffffffffb58587d4 R15: 746e756f6d2e656c FS: 0000000000000000(0000) GS:ffff8b8002100000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000556633c989f8 CR3: 000000003c816005 CR4: 0000000000170ee0 Call Trace: ? show_regs.cold.9+0x22/0x2f ? __die_body+0x22/0x90 ? __die+0x33/0x4a ? die+0x3a/0x6f ? do_trap+0x118/0x150 ? do_error_trap+0x8b/0x130 ? do_stack_segment+0x29/0x40 ? stack_segment+0x1e/0x30 ? debugfs_remove_recursive+0x45/0x260 lprocfs_nodemap_remove+0x1a/0x160 [ptlrpc] nodemap_destroy+0x45/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] nodemap_destroy+0x298/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] gssiam_delete_sec_context+0x22/0x80 [ptlrpc_gss] lgss_delete_sec_context+0x60/0x2d0 [ptlrpc_gss] __rsc_free+0x9b/0x140 [ptlrpc_gss] rsc_entry_free_work+0x21/0xf0 [ptlrpc_gss] process_one_work+0x2c8/0x700 worker_thread+0x296/0x6e0 ? rescuer_thread+0x570/0x570 kthread+0x1d1/0x200 ? set_kthread_struct+0x70/0x70 ret_from_fork+0x1f/0x30 Modules linked in: lquota(O) ec(O) ptlrpc_gss(O-) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) zfs(O) spl(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs ata_generic ata_piix crct10dif_pclmul crc32_pclmul crc32c_intel serio_raw ghash_clmulni_intel libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: mgc] | Lustre: DEBUG MARKER: === recovery-small: start cleanup 02:13:35 (1779430415) === Lustre: DEBUG MARKER: === recovery-small: finish cleanup 02:13:37 (1779430417) === LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: server umount lustre-MDT0000 complete LustreError: 6461:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779430422 with bad export cookie 7132357011030906874 LustreError: MGC192.168.204.130@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 6461:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 4 previous similar messages Lustre: lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete LustreError: 20418:0:(ldlm_lib.c:1182:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) Lustre: Skipped 3 previous similar messages LustreError: 20418:0:(ldlm_lib.c:1182:target_handle_connect()) Skipped 4 previous similar messages Lustre: server umount lustre-MDT0001 complete Lustre: server umount lustre-OST0000 complete Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg430-server.virtnet: executing unload_modules_local Key type lgssc unregistered | Link to test |
| replay-single test complete, duration 272 sec | stack segment: 0000 [#1] SMP DEBUG_PAGEALLOC CPU: 2 PID: 59 Comm: kworker/2:1 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Workqueue: events rsc_entry_free_work [ptlrpc_gss] RIP: 0010:debugfs_remove_recursive+0x45/0x260 Code: 41 57 49 89 ff 41 56 49 c7 c6 d4 87 e5 9b 41 55 4c 8d af b8 00 00 00 41 54 55 48 89 fd 53 48 83 ec 08 48 83 05 eb 9a 17 03 01 <48> 8b 45 30 4c 8d 65 58 48 8d b8 c0 00 00 00 e8 c7 3e 8f 00 48 83 RSP: 0018:ffffa24440f67da8 EFLAGS: 00010202 RAX: 0000000000000001 RBX: ffff96b3d0d24880 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ffff96b3f44eb02c RDI: 6d2e646565736432 RBP: 6d2e646565736432 R08: 0000000000000000 R09: 0000000000000000 R10: ffff96b3c4398160 R11: 00000000ffffffe0 R12: ffff96b402138a00 R13: 6d2e6465657364ea R14: ffffffff9be587d4 R15: 6d2e646565736432 FS: 0000000000000000(0000) GS:ffff96b402100000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00005597c31349f8 CR3: 0000000034216005 CR4: 0000000000170ee0 Call Trace: ? show_regs.cold.9+0x22/0x2f ? __die_body+0x22/0x90 ? __die+0x33/0x4a ? die+0x3a/0x6f ? do_trap+0x118/0x150 ? do_error_trap+0x8b/0x130 ? do_stack_segment+0x29/0x40 ? stack_segment+0x1e/0x30 ? debugfs_remove_recursive+0x45/0x260 ? _cond_resched+0x1d/0x50 ? mutex_lock+0x31/0x70 lprocfs_nodemap_remove+0x1a/0x160 [ptlrpc] nodemap_destroy+0x45/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] nodemap_destroy+0x298/0x700 [ptlrpc] nodemap_putref+0xd3/0x130 [ptlrpc] gssiam_delete_sec_context+0x22/0x80 [ptlrpc_gss] lgss_delete_sec_context+0x60/0x2d0 [ptlrpc_gss] __rsc_free+0x9b/0x140 [ptlrpc_gss] rsc_entry_free_work+0x21/0xf0 [ptlrpc_gss] process_one_work+0x2c8/0x700 worker_thread+0x296/0x6e0 ? rescuer_thread+0x570/0x570 kthread+0x1d1/0x200 ? set_kthread_struct+0x70/0x70 ret_from_fork+0x1f/0x30 Modules linked in: zfs(O) spl(O) ldiskfs(O) lquota(O) ec(O) ptlrpc_gss(O-) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl i2c_piix4 pcspkr squashfs crct10dif_pclmul crc32_pclmul crc32c_intel ata_generic ghash_clmulni_intel ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: mgc] | Lustre: DEBUG MARKER: === replay-single: start cleanup 02:11:48 (1779430308) === Lustre: DEBUG MARKER: === replay-single: finish cleanup 02:11:50 (1779430310) === Lustre: lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: Skipped 3 previous similar messages Lustre: server umount lustre-MDT0000 complete LustreError: 6600:0:(ldlm_lib.c:1182:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: 6600:0:(ldlm_lib.c:1182:target_handle_connect()) Skipped 19 previous similar messages LustreError: 17431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1779430321 with bad export cookie 2359407104126321671 LustreError: MGC192.168.204.131@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail LustreError: 17431:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) Skipped 2 previous similar messages Lustre: server umount lustre-MDT0001 complete Lustre: server umount lustre-OST0000 complete Lustre: server umount lustre-OST0001 complete Lustre: DEBUG MARKER: oleg431-server.virtnet: executing unload_modules_local Key type lgssc unregistered | Link to test |