| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Link and date |
|---|---|---|---|
| runtests test 1: All Runtests | BUG: unable to handle kernel paging request at ffff9e2e87360050 PGD 12f601067 P4D 12f601067 PUD 146dcf067 PMD 146694067 PTE 800ffffef8c9f060 Lustre: Unmounted lustre-client Oops: 0002 [#1] SMP DEBUG_PAGEALLOC CPU: 1 PID: 21283 Comm: kworker/1:1 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #2 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.17.0-10.fc44 06/10/2025 Workqueue: events sec_gc_main [ptlrpc] RIP: 0010:lprocfs_counter_add+0x92/0x210 [obdclass] Code: c0 0f 88 13 01 00 00 89 c0 48 8b b5 38 02 00 00 48 89 da 48 8b 8c c5 40 02 00 00 48 c1 e2 06 48 8d 04 9b 48 01 d6 48 8d 04 c1 <48> 83 00 01 f6 06 02 74 48 48 83 05 c5 76 12 00 01 4c 01 60 18 f6 RSP: 0018:ffffb8c181f97cb8 EFLAGS: 00010282 RAX: ffff9e2e87360050 RBX: 0000000000000002 RCX: ffff9e2e87360000 RDX: 0000000000000080 RSI: ffff9e2e87ea4080 RDI: ffff9e2e86ff0800 RBP: ffff9e2e86ff0800 R08: 0000000000000073 R09: ffff9e2e84a66b00 R10: ffff9e2e84a66b00 R11: 000000003240fea1 R12: 0000000000000000 R13: 0000000000000323 R14: 0000000000000001 R15: ffff9e2e841ece00 FS: 0000000000000000(0000) GS:ffff9e2ec2080000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: ffff9e2e87360050 CR3: 000000012d216004 CR4: 0000000000170ee0 Call Trace: ? show_regs.cold.9+0x22/0x2f ? __die_body+0x22/0x90 ? __die+0x33/0x4a ? no_context+0x30f/0x5a0 ? __bad_area_nosemaphore+0x1c6/0x260 ? bad_area_nosemaphore+0x1a/0x30 ? do_kern_addr_fault+0x73/0x130 ? __do_page_fault+0x8e/0xa0 ? do_page_fault+0x87/0x30f ? page_fault+0x1e/0x30 ? lprocfs_counter_add+0x92/0x210 [obdclass] ? lprocfs_counter_add+0x67/0x210 [obdclass] ptl_send_rpc+0xb90/0x1c50 [ptlrpc] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x12/0x30 ? ptlrpc_request_bufs_pack+0x25a/0xa60 [ptlrpc] gss_do_ctx_fini_rpc+0x148/0x6d0 [ptlrpc_gss] gss_cli_ctx_fini_common+0x72/0x410 [ptlrpc_gss] ctx_destroy_kr+0x89/0x340 [ptlrpc_gss] ctx_release_kr+0x16/0x50 [ptlrpc_gss] gss_sec_release_ctx_kr+0x28/0xc0 [ptlrpc_gss] sptlrpc_cli_ctx_put+0x3d/0xd0 [ptlrpc] sec_process_ctx_list+0x176/0x270 [ptlrpc] ? debug_object_deactivate+0x154/0x200 sec_gc_main+0x23/0x3b0 [ptlrpc] process_one_work+0x2c8/0x700 worker_thread+0x296/0x6e0 ? rescuer_thread+0x570/0x570 kthread+0x1d1/0x200 ? set_kthread_struct+0x70/0x70 ret_from_fork+0x1f/0x30 Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) ec(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel serio_raw ata_piix libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: libcfs] CR2: ffff9e2e87360050 | Lustre: DEBUG MARKER: touching /mnt/lustre at Fri Sep 4 18:58:24 EDT 2026 (@1788562704) Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.9273 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.9273 Lustre: DEBUG MARKER: comparing /etc/hosts and /mnt/lustre/hosts.9273 Lustre: DEBUG MARKER: renaming /mnt/lustre/hosts.9273 to /mnt/lustre/hosts.9273.ren Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.9273 again Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.9273 Lustre: DEBUG MARKER: removing /mnt/lustre/hosts.9273 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.9273.2 Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.9273.2 to 123 bytes Lustre: DEBUG MARKER: creating /mnt/lustre/d1.runtests Lustre: DEBUG MARKER: copying 1000 files from /etc, /usr/bin to /mnt/lustre/d1.runtests/etc, /mnt/lustre/d1.runtests/usr/bin at Fri Sep 4 18:58:49 EDT 2026 Lustre: DEBUG MARKER: comparing 1000 newly copied files at Fri Sep 4 19:00:51 EDT 2026 Lustre: DEBUG MARKER: running createmany -d /mnt/lustre/d1.runtests/d 1000 Lustre: DEBUG MARKER: finished at Fri Sep 4 19:02:04 EDT 2026 (220) Lustre: Unmounted lustre-client Key type lgssc unregistered LNet: 18070:0:(lib-ptl.c:964:lnet_clear_lazy_portal()) Active lazy portal 0 on exit LNetError: 18070:0:(acceptor.c:252:lnet_acceptor_remove_socket()) Interface ens2 not found LNet: Removed LNI 192.168.201.6@tcp Key type .llcrypt unregistered Key type ._llcrypt unregistered Key type ._llcrypt registered Key type .llcrypt registered libcfs: HW NUMA nodes: 1, HW CPU cores: 4, npartitions: 2 alg: No test for adler32 (adler32-zlib) Lustre: Lustre: Build Version: 2.17.58_5_g95eb523 LNet: Added LNI 192.168.201.6@tcp [8/256/0/180] Key type lgssc registered Lustre: Echo OBD driver; http://www.lustre.org/ Lustre: Mounted lustre-client - version 2.17.58_5_g95eb523 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=ski Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=ski Lustre: lustre-OST0000-osc-ffff9e2e9910d800: disconnect after 23s idle Lustre: DEBUG MARKER: After first remount. comparing 1000 previously copied files Lustre: DEBUG MARKER: running statmany -s /mnt/lustre/d1.runtests/d 1000 2000 | Link to test (2026-09-04 19:21) |
| runtests test 1: All Runtests | BUG: unable to handle kernel paging request at ffff8e2df8eca050 PGD 2a201067 P4D 2a201067 PUD 146dcf067 PMD 146d07067 PTE 800ffffec7135060 Oops: 0002 [#1] SMP DEBUG_PAGEALLOC CPU: 0 PID: 256 Comm: kworker/0:3 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #7 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-1.fc39 04/01/2014 Workqueue: events sec_gc_main [ptlrpc] RIP: 0010:lprocfs_counter_add+0x92/0x210 [obdclass] Code: c0 0f 88 13 01 00 00 89 c0 48 8b b5 68 02 00 00 48 89 da 48 8b 8c c5 70 02 00 00 48 c1 e2 05 48 8d 04 9b 48 01 d6 48 8d 04 c1 <48> 83 00 01 f6 06 02 74 48 48 83 05 95 1f 12 00 01 4c 01 60 18 f6 RSP: 0018:ffffab30421dbc80 EFLAGS: 00010282 RAX: ffff8e2df8eca050 RBX: 0000000000000002 RCX: ffff8e2df8eca000 RDX: 0000000000000040 RSI: ffff8e2dd8401040 RDI: ffff8e2dd1d76400 RBP: ffff8e2dd1d76400 R08: 0000000000000073 R09: 0000000000000001 R10: ffffffffa25acbe0 R11: ffffffffa0a0bc00 R12: 0000000000000000 R13: 0000000000000323 R14: 0000000000000001 R15: ffff8e2de9b267c0 FS: 0000000000000000(0000) GS:ffff8e2e01200000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: ffff8e2df8eca050 CR3: 0000000027628001 CR4: 0000000000170ef0 Call Trace: ? show_regs.cold.9+0x22/0x2f ? __die_body+0x22/0x90 ? __die+0x33/0x4a ? no_context+0x30f/0x5a0 ? __bad_area_nosemaphore+0x1c6/0x260 ? bad_area_nosemaphore+0x1a/0x30 ? do_kern_addr_fault+0x73/0x130 ? __do_page_fault+0x8e/0xa0 ? do_page_fault+0x87/0x4b6 ? page_fault+0x1e/0x30 ? lprocfs_counter_add+0x92/0x210 [obdclass] ptl_send_rpc+0xc51/0x1d50 [ptlrpc] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x3f/0x60 ? ptlrpc_request_bufs_pack+0x260/0xa70 [ptlrpc] gss_do_ctx_fini_rpc+0x147/0x690 [ptlrpc_gss] gss_cli_ctx_fini_common+0x72/0x3f0 [ptlrpc_gss] ctx_destroy_kr+0x89/0x370 [ptlrpc_gss] ctx_release_kr+0x16/0x50 [ptlrpc_gss] gss_sec_release_ctx_kr+0x28/0xc0 [ptlrpc_gss] sptlrpc_cli_ctx_put+0x3d/0xd0 [ptlrpc] sec_process_ctx_list+0x161/0x260 [ptlrpc] sec_gc_main+0x23/0x3b0 [ptlrpc] process_one_work+0x3dd/0x9b0 worker_thread+0x296/0x6e0 ? rescuer_thread+0x570/0x570 kthread+0x1d7/0x210 ? set_kthread_struct+0x70/0x70 ret_from_fork+0x1f/0x30 Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ata_piix ghash_clmulni_intel serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic CR2: ffff8e2df8eca050 | Lustre: lustre-OST0000-osc-ffff8e2dd810c000: disconnect after 24s idle Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: touching /mnt/lustre at Tue Jun 17 04:37:20 EDT 2025 (@1750149440) Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.9212 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.9212 Lustre: DEBUG MARKER: comparing /etc/hosts and /mnt/lustre/hosts.9212 Lustre: DEBUG MARKER: renaming /mnt/lustre/hosts.9212 to /mnt/lustre/hosts.9212.ren Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.9212 again Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.9212 Lustre: DEBUG MARKER: removing /mnt/lustre/hosts.9212 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.9212.2 Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.9212.2 to 123 bytes Lustre: DEBUG MARKER: creating /mnt/lustre/d1.runtests Lustre: DEBUG MARKER: copying 1000 files from /etc, /usr/bin to /mnt/lustre/d1.runtests/etc, /mnt/lustre/d1.runtests/usr/bin at Tue Jun 17 04:37:56 EDT 2025 Lustre: DEBUG MARKER: comparing 1000 newly copied files at Tue Jun 17 04:38:47 EDT 2025 Lustre: DEBUG MARKER: running createmany -d /mnt/lustre/d1.runtests/d 1000 Lustre: DEBUG MARKER: finished at Tue Jun 17 04:39:18 EDT 2025 (118) LustreError: 17306:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8e2dd810c000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 LustreError: 17306:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup Lustre: Unmounted lustre-client Lustre: Mounted lustre-client Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=ski Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=ski Lustre: lustre-OST0000-osc-ffff8e2dd810c000: disconnect after 20s idle Lustre: Skipped 1 previous similar message Lustre: DEBUG MARKER: After first remount. comparing 1000 previously copied files Lustre: DEBUG MARKER: running statmany -s /mnt/lustre/d1.runtests/d 1000 2000 LustreError: 21695:0:(lov_obd.c:784:lov_cleanup()) lustre-clilov-ffff8e2dd810c000: lov tgt 0 not cleaned! deathrow=0, lovrc=1 LustreError: 21695:0:(lov_obd.c:784:lov_cleanup()) Skipped 1 previous similar message LustreError: 21695:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup LustreError: 21695:0:(obd_class.h:479:obd_check_dev()) Skipped 7 previous similar messages | Link to test (2025-06-17 04:49) |
| runtests test 1: All Runtests | BUG: unable to handle kernel paging request at ffff9daa9007a050 PGD 1be01067 P4D 1be01067 PUD 146dcf067 PMD 14664d067 PTE 800ffffeeff85060 Oops: 0002 [#1] SMP DEBUG_PAGEALLOC CPU: 3 PID: 766 Comm: kworker/3:3 Kdump: loaded Tainted: G O -------- - - 4.18.0rh8.10-debug #7 Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.3-1.fc39 04/01/2014 Workqueue: events sec_gc_main [ptlrpc] RIP: 0010:lprocfs_counter_add+0x92/0x210 [obdclass] Code: c0 0f 88 13 01 00 00 89 c0 48 8b b5 68 02 00 00 48 89 da 48 8b 8c c5 70 02 00 00 48 c1 e2 05 48 8d 04 9b 48 01 d6 48 8d 04 c1 <48> 83 00 01 f6 06 02 74 48 48 83 05 45 e8 11 00 01 4c 01 60 18 f6 RSP: 0018:ffffacd742167c80 EFLAGS: 00010282 RAX: ffff9daa9007a050 RBX: 0000000000000002 RCX: ffff9daa9007a000 RDX: 0000000000000040 RSI: ffff9daa86321040 RDI: ffff9daa8630a800 RBP: ffff9daa8630a800 R08: 0000000000000073 R09: 0000000000000001 R10: ffffffffb4facbe0 R11: ffffffffb340bc00 R12: 0000000000000000 R13: 0000000000000323 R14: 0000000000000001 R15: ffff9daabb1bd680 FS: 0000000000000000(0000) GS:ffff9daac1e00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: ffff9daa9007a050 CR3: 0000000019228004 CR4: 0000000000170ee0 Call Trace: ? show_regs.cold.9+0x22/0x2f ? __die_body+0x22/0x90 ? __die+0x33/0x4a ? no_context+0x30f/0x5a0 ? __bad_area_nosemaphore+0x1c6/0x260 ? bad_area_nosemaphore+0x1a/0x30 ? do_kern_addr_fault+0x73/0x130 ? __do_page_fault+0x8e/0xa0 ? do_page_fault+0x87/0x4b6 ? page_fault+0x1e/0x30 ? lprocfs_counter_add+0x92/0x210 [obdclass] ptl_send_rpc+0xc51/0x1d50 [ptlrpc] ? do_raw_spin_unlock+0x75/0x190 ? _raw_spin_unlock+0x3f/0x60 ? ptlrpc_request_bufs_pack+0x260/0xa70 [ptlrpc] gss_do_ctx_fini_rpc+0x147/0x690 [ptlrpc_gss] gss_cli_ctx_fini_common+0x72/0x3f0 [ptlrpc_gss] ctx_destroy_kr+0x89/0x370 [ptlrpc_gss] ctx_release_kr+0x16/0x50 [ptlrpc_gss] gss_sec_release_ctx_kr+0x28/0xc0 [ptlrpc_gss] sptlrpc_cli_ctx_put+0x3d/0xd0 [ptlrpc] sec_process_ctx_list+0x161/0x260 [ptlrpc] sec_gc_main+0x23/0x3b0 [ptlrpc] process_one_work+0x3dd/0x9b0 worker_thread+0x296/0x6e0 ? rescuer_thread+0x570/0x570 kthread+0x1d7/0x210 ? set_kthread_struct+0x70/0x70 ret_from_fork+0x1f/0x30 Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver intel_rapl_msr intel_rapl_common sb_edac rapl pcspkr i2c_piix4 squashfs ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ata_piix ghash_clmulni_intel serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic CR2: ffff9daa9007a050 | Lustre: DEBUG MARKER: touching /mnt/lustre at Thu Apr 17 13:25:23 EDT 2025 (@1744910723) Lustre: DEBUG MARKER: create an empty file /mnt/lustre/hosts.8983 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.8983 Lustre: DEBUG MARKER: comparing /etc/hosts and /mnt/lustre/hosts.8983 Lustre: DEBUG MARKER: renaming /mnt/lustre/hosts.8983 to /mnt/lustre/hosts.8983.ren Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.8983 again Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.8983 Lustre: DEBUG MARKER: removing /mnt/lustre/hosts.8983 Lustre: DEBUG MARKER: copying /etc/hosts to /mnt/lustre/hosts.8983.2 Lustre: DEBUG MARKER: truncating /mnt/lustre/hosts.8983.2 to 123 bytes Lustre: DEBUG MARKER: creating /mnt/lustre/d1.runtests Lustre: DEBUG MARKER: copying 1000 files from /etc, /usr/bin to /mnt/lustre/d1.runtests/etc, /mnt/lustre/d1.runtests/usr/bin at Thu Apr 17 13:25:59 EDT 2025 Lustre: DEBUG MARKER: comparing 1000 newly copied files at Thu Apr 17 13:26:56 EDT 2025 Lustre: DEBUG MARKER: running createmany -d /mnt/lustre/d1.runtests/d 1000 Lustre: DEBUG MARKER: finished at Thu Apr 17 13:27:40 EDT 2025 (137) LustreError: 17078:0:(obd_class.h:479:obd_check_dev()) Device 5 not setup | Link to test (2025-04-17 13:35) |