| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Link and date |
|---|---|---|---|
| sanity-sec test 26: test transferring very large nodemap | LustreError: 1045988:0:(nodemap_handler.c:5595:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 1045988:0:(nodemap_handler.c:5595:nodemap_config_set_active()) LBUG CPU: 1 UID: 0 PID: 1045988 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 6.12.0-211.47.1.el10_2_lustre.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x412/0x560 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ? __ptlrpc_free_req+0x345/0x550 [ptlrpc] nodemap_config_set_active_mgc+0x21/0x50 [ptlrpc] mgc_process_nodemap_log+0x2c6/0xe50 [mgc] mgc_process_log+0x887/0x970 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? __timer_delete_sync+0x28/0x40 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd9/0x2b0 [mgc] mgc_requeue_thread+0x17b/0x490 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | Autotest: Test running for 620 minutes (lustre-master-next_full-dne-part-2_1020.68) | 2026-10-23 16:29:17 Autotest: Test running for 625 minutes (lustre-master-next_full-dne-part-2_1020.68) | 2026-10-23 16:34:17 | Link to test (2026-10-23 19:33) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 587757:0:(nodemap_handler.c:5596:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 587757:0:(nodemap_handler.c:5596:nodemap_config_set_active()) LBUG CPU: 1 PID: 587757 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-687.39.1.el9_8_lustre.ddn1.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x33/0x50 lbug_with_loc+0x3a/0x80 [libcfs] nodemap_config_set_active+0x414/0x560 [ptlrpc] ? __ptlrpc_free_req+0x33d/0x540 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41d/0xd20 [mgc] mgc_process_log+0x7e6/0x870 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x113/0x240 ? __pfx_kthread+0x10/0x10 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2b/0x50 </TASK> | Autotest: Test running for 675 minutes (lustre-b_es7_0-next_full-dne-o2ib-part-2_27.14) | 2026-10-20 02:52:01 | Link to test (2026-10-20 06:24) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 1245246:0:(nodemap_handler.c:5595:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 1245246:0:(nodemap_handler.c:5595:nodemap_config_set_active()) LBUG CPU: 0 UID: 0 PID: 1245246 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.56.1.el10_1_lustre.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x412/0x560 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ? __ptlrpc_free_req+0x345/0x550 [ptlrpc] nodemap_config_set_active_mgc+0x21/0x50 [ptlrpc] mgc_process_nodemap_log+0x2c6/0xe50 [mgc] mgc_process_log+0x887/0x970 [mgc] ? __timer_delete_sync+0x28/0x40 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd9/0x2b0 [mgc] mgc_requeue_thread+0x17b/0x490 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | Autotest: Test running for 630 minutes (lustre-master-next_full-dne-part-2_1017.53) | 2026-10-14 14:28:35 Autotest: Test running for 635 minutes (lustre-master-next_full-dne-part-2_1017.53) | 2026-10-14 14:33:35 Autotest: Test running for 640 minutes (lustre-master-next_full-dne-part-2_1017.53) | 2026-10-14 14:38:41 | Link to test (2026-10-14 17:26) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 1035653:0:(nodemap_handler.c:5036:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 1035653:0:(nodemap_handler.c:5036:nodemap_config_set_active()) LBUG CPU: 0 UID: 0 PID: 1035653 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 6.12.0-55.43.1.el10_0_lustre.ddn1.x86_64 #1 Tainted: [W]=WARN, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x42 [libcfs] nodemap_config_set_active+0x321/0x340 [ptlrpc] nodemap_config_set_active_mgc+0x21/0x50 [ptlrpc] mgc_process_nodemap_log+0x3fd/0xe70 [mgc] mgc_process_log+0x8dc/0x9c0 [mgc] ? __timer_delete_sync+0x28/0x40 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd9/0x2b0 [mgc] mgc_requeue_thread+0x155/0x480 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xd2/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x34/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | Link to test (2026-09-10 04:11) | |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 1552422:0:(nodemap_handler.c:5166:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 1552422:0:(nodemap_handler.c:5166:nodemap_config_set_active()) LBUG CPU: 1 UID: 0 PID: 1552422 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.56.1.el10_1_lustre.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x321/0x340 [ptlrpc] nodemap_config_set_active_mgc+0x21/0x50 [ptlrpc] mgc_process_nodemap_log+0x2c5/0xe20 [mgc] mgc_process_log+0x897/0x9b0 [mgc] ? __timer_delete_sync+0x28/0x40 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd9/0x2b0 [mgc] mgc_requeue_thread+0x178/0x490 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | Autotest: Test running for 775 minutes (lustre-master-next_full-dne-part-2_1003.53) Autotest: Test running for 780 minutes (lustre-master-next_full-dne-part-2_1003.53) | Link to test (2026-08-13 21:33) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 1206160:0:(nodemap_handler.c:4915:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 1206160:0:(nodemap_handler.c:4915:nodemap_config_set_active()) LBUG CPU: 1 UID: 0 PID: 1206160 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.45.1_lustre.ddn1.el10.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x321/0x340 [ptlrpc] nodemap_config_set_active_mgc+0x21/0x50 [ptlrpc] mgc_process_nodemap_log+0x3fd/0xe70 [mgc] mgc_process_log+0x8dc/0x9c0 [mgc] ? __timer_delete_sync+0x28/0x40 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd9/0x2b0 [mgc] mgc_requeue_thread+0x155/0x480 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | Autotest: Test running for 610 minutes (lustre-b_es7_0_full-dne-part-2_310.22) | Link to test (2026-07-10 07:22) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 874000:0:(nodemap_handler.c:4910:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 874000:0:(nodemap_handler.c:4910:nodemap_config_set_active()) LBUG CPU: 0 PID: 874000 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------ --- 5.14.0-611.42.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 525 minutes (lustre-b_es7_0_full-dne-part-2_294.38) Autotest: Test running for 530 minutes (lustre-b_es7_0_full-dne-part-2_294.38) Autotest: Test running for 535 minutes (lustre-b_es7_0_full-dne-part-2_294.38) Autotest: Test running for 540 minutes (lustre-b_es7_0_full-dne-part-2_294.38) | Link to test (2026-05-08 05:55) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 993796:0:(nodemap_handler.c:4821:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 993796:0:(nodemap_handler.c:4821:nodemap_config_set_active()) LBUG CPU: 0 PID: 993796 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x81d/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Link to test (2026-05-01 16:54) | |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 850439:0:(nodemap_handler.c:4804:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 850439:0:(nodemap_handler.c:4804:nodemap_config_set_active()) LBUG CPU: 1 PID: 850439 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.42.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x81d/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 545 minutes (lustre-master_full-dne-part-2_4715.38) Autotest: Test running for 550 minutes (lustre-master_full-dne-part-2_4715.38) Autotest: Test running for 555 minutes (lustre-master_full-dne-part-2_4715.38) Autotest: Test running for 560 minutes (lustre-master_full-dne-part-2_4715.38) Autotest: Test running for 565 minutes (lustre-master_full-dne-part-2_4715.38) Autotest: Test running for 570 minutes (lustre-master_full-dne-part-2_4715.38) | Link to test (2026-04-19 09:38) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 730685:0:(nodemap_handler.c:4804:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 730685:0:(nodemap_handler.c:4804:nodemap_config_set_active()) LBUG CPU: 0 PID: 730685 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.42.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x81d/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 500 minutes (lustre-master_full-part-2_4715.107) Autotest: Test running for 505 minutes (lustre-master_full-part-2_4715.107) Autotest: Test running for 510 minutes (lustre-master_full-part-2_4715.107) Autotest: Test running for 515 minutes (lustre-master_full-part-2_4715.107) | Link to test (2026-04-19 08:53) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 765546:0:(nodemap_handler.c:4910:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 765546:0:(nodemap_handler.c:4910:nodemap_config_set_active()) LBUG CPU: 0 PID: 765546 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 455 minutes (lustre-b_es7_0_full-dne-o2ib-part-2_291.14) Autotest: Test running for 460 minutes (lustre-b_es7_0_full-dne-o2ib-part-2_291.14) Autotest: Test running for 465 minutes (lustre-b_es7_0_full-dne-o2ib-part-2_291.14) Autotest: Test running for 470 minutes (lustre-b_es7_0_full-dne-o2ib-part-2_291.14) | Link to test (2026-04-14 19:51) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 691225:0:(nodemap_handler.c:4910:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 691225:0:(nodemap_handler.c:4910:nodemap_config_set_active()) LBUG CPU: 1 PID: 691225 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-570.62.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 465 minutes (lustre-b_es7_0_full-part-2_288.86) | Link to test (2026-04-04 00:22) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 658821:0:(nodemap_handler.c:4910:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 658821:0:(nodemap_handler.c:4910:nodemap_config_set_active()) LBUG CPU: 1 PID: 658821 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 470 minutes (lustre-b_es7_0_full-o2ib-part-2_288.10) | Link to test (2026-04-04 00:22) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 731671:0:(nodemap_handler.c:4808:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 731671:0:(nodemap_handler.c:4808:nodemap_config_set_active()) LBUG CPU: 0 PID: 731671 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.42.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x81d/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 470 minutes (lustre-master-next_full-part-2_963.32) Autotest: Test running for 475 minutes (lustre-master-next_full-part-2_963.32) | Link to test (2026-04-03 12:13) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 847696:0:(nodemap_handler.c:4810:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 847696:0:(nodemap_handler.c:4810:nodemap_config_set_active()) LBUG CPU: 0 PID: 847696 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.13.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x81d/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 575 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 580 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 585 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 590 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 595 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 600 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 605 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 610 minutes (lustre-master_full-dne-part-2_4710.38) | Link to test (2026-04-02 13:42) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 569992:0:(nodemap_handler.c:4810:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 569992:0:(nodemap_handler.c:4810:nodemap_config_set_active()) LBUG CPU: 0 PID: 569992 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.13.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x81d/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 575 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 580 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 585 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 590 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 595 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 600 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 605 minutes (lustre-master_full-dne-part-2_4710.38) Autotest: Test running for 610 minutes (lustre-master_full-dne-part-2_4710.38) LNet: Host 10.240.23.227 reset our connection while we were sending data; it may have rebooted: rc = -104 Lustre: 6086:0:(client.c:2473:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1775149955/real 1775149955] req@ff441e9a73f56700 x1861341291218816/t0(0) o400->lustre-OST0000-osc-MDT0001@10.240.23.227@tcp:28/4 lens 224/224 e 0 to 1 dl 1775149971 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Lustre: 6086:0:(client.c:2473:ptlrpc_expire_one_request()) Skipped 5 previous similar messages Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 10.240.23.227@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 7 previous similar messages Autotest: Killing test framework, node(s) in the cluster crashed (lustre-master_full-dne-part-2_4710.38) Lustre: 6086:0:(client.c:2473:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1775149950/real 1775149950] req@ff441e9a6158e080 x1861341291212800/t0(0) o13->lustre-OST0001-osc-MDT0001@10.240.23.227@tcp:7/4 lens 224/368 e 0 to 1 dl 1775149966 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 Lustre: 6086:0:(client.c:2473:ptlrpc_expire_one_request()) Skipped 15 previous similar messages Autotest: Sleeping to ensure other nodes in the cluster have not crashed (lustre-master_full-dne-part-2_4710.38) Autotest: onyx-156vm150 crashed during sanity-sec (lustre-master_full-dne-part-2_4710.38) Lustre: lustre-MDT0003: haven't heard from client lustre-MDT0003-lwp-OST0000_UUID (at 10.240.23.227@tcp) in 104 seconds. I think it's dead, and I am evicting it. exp ff441e9a97b97400, cur 1775150050 deadline 1775150046 last 1775149946 | Link to test (2026-04-02 13:36) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 771860:0:(nodemap_handler.c:4804:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 771860:0:(nodemap_handler.c:4804:nodemap_config_set_active()) LBUG CPU: 1 PID: 771860 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x81d/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 560 minutes (lustre-master_full-dne-part-2_4709.23) Autotest: Test running for 565 minutes (lustre-master_full-dne-part-2_4709.23) Autotest: Test running for 570 minutes (lustre-master_full-dne-part-2_4709.23) Autotest: Test running for 575 minutes (lustre-master_full-dne-part-2_4709.23) Autotest: Test running for 580 minutes (lustre-master_full-dne-part-2_4709.23) Autotest: Test running for 585 minutes (lustre-master_full-dne-part-2_4709.23) | Link to test (2026-03-31 19:01) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 760106:0:(nodemap_handler.c:4910:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 760106:0:(nodemap_handler.c:4910:nodemap_config_set_active()) LBUG CPU: 0 PID: 760106 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-570.62.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 425 minutes (lustre-b_es7_0_full-part-2_274.87) Autotest: Test running for 430 minutes (lustre-b_es7_0_full-part-2_274.87) | Link to test (2026-03-29 22:33) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 786630:0:(nodemap_handler.c:4910:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 786630:0:(nodemap_handler.c:4910:nodemap_config_set_active()) LBUG CPU: 0 PID: 786630 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------ --- 5.14.0-611.36.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x104/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2b/0x50 </TASK> | LustreError: 792811:0:(qsd_reint.c:616:qqi_reint_delayed()) lustre-OST0003: Delaying reintegration for qtype:0 until pending updates are flushed. LustreError: 792811:0:(qsd_reint.c:616:qqi_reint_delayed()) Skipped 29 previous similar messages Autotest: Test running for 455 minutes (lustre-b_es7_0_full-part-2_269.155) | Link to test (2026-03-19 03:45) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 790960:0:(nodemap_handler.c:4804:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 790960:0:(nodemap_handler.c:4804:nodemap_config_set_active()) LBUG CPU: 1 PID: 790960 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.13.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 515 minutes (lustre-master_full-part-2_4707.113) Autotest: Test running for 520 minutes (lustre-master_full-part-2_4707.113) | Link to test (2026-03-12 11:30) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 756960:0:(nodemap_handler.c:4905:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 756960:0:(nodemap_handler.c:4905:nodemap_config_set_active()) LBUG CPU: 1 PID: 756960 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 535 minutes (lustre-b_es7_0_full-dne-part-2_264.6) Autotest: Test running for 540 minutes (lustre-b_es7_0_full-dne-part-2_264.6) Autotest: Test running for 545 minutes (lustre-b_es7_0_full-dne-part-2_264.6) Autotest: Test running for 550 minutes (lustre-b_es7_0_full-dne-part-2_264.6) Autotest: Test running for 555 minutes (lustre-b_es7_0_full-dne-part-2_264.6) Autotest: Test running for 560 minutes (lustre-b_es7_0_full-dne-part-2_264.6) Autotest: Test running for 565 minutes (lustre-b_es7_0_full-dne-part-2_264.6) Autotest: Test running for 570 minutes (lustre-b_es7_0_full-dne-part-2_264.6) | Link to test (2026-03-11 21:11) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 715386:0:(nodemap_handler.c:4905:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 715386:0:(nodemap_handler.c:4905:nodemap_config_set_active()) LBUG CPU: 1 PID: 715386 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 495 minutes (lustre-b_es7_0_full-part-2_264.63) Autotest: Test running for 500 minutes (lustre-b_es7_0_full-part-2_264.63) | Link to test (2026-03-11 19:50) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 688815:0:(nodemap_handler.c:4905:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 688815:0:(nodemap_handler.c:4905:nodemap_config_set_active()) LBUG CPU: 0 PID: 688815 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-570.62.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 460 minutes (lustre-b_es7_0_full-part-2_264.83) Autotest: Test running for 465 minutes (lustre-b_es7_0_full-part-2_264.83) Autotest: Test running for 470 minutes (lustre-b_es7_0_full-part-2_264.83) Autotest: Test running for 475 minutes (lustre-b_es7_0_full-part-2_264.83) | Link to test (2026-03-11 19:05) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 773660:0:(nodemap_handler.c:4804:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 773660:0:(nodemap_handler.c:4804:nodemap_config_set_active()) LBUG CPU: 0 PID: 773660 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 525 minutes (lustre-master-next_full-dne-part-2_959.23) Autotest: Test running for 530 minutes (lustre-master-next_full-dne-part-2_959.23) Autotest: Test running for 535 minutes (lustre-master-next_full-dne-part-2_959.23) Autotest: Test running for 540 minutes (lustre-master-next_full-dne-part-2_959.23) Autotest: Test running for 545 minutes (lustre-master-next_full-dne-part-2_959.23) LNet: Host 10.240.31.83 reset our connection while we were sending data; it may have rebooted: rc = -104 Lustre: 12284:0:(client.c:2472:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1772917517/real 1772917517] req@ff1c49c269c02700 x1859004379131264/t0(0) o400->lustre-MDT0001-lwp-OST0000@10.240.31.83@tcp:12/10 lens 224/224 e 0 to 1 dl 1772917533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Lustre: lustre-MDT0001-lwp-OST0000: Connection to lustre-MDT0001 (at 10.240.31.83@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 7 previous similar messages Autotest: Killing test framework, node(s) in the cluster crashed (lustre-master-next_full-dne-part-2_959.23) Lustre: 12284:0:(client.c:2472:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1772917512/real 1772917512] req@ff1c49c29f954d00 x1859004379130368/t0(0) o400->lustre-MDT0003-lwp-OST0007@10.240.31.83@tcp:12/10 lens 224/224 e 0 to 1 dl 1772917528 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Lustre: 12284:0:(client.c:2472:ptlrpc_expire_one_request()) Skipped 15 previous similar messages Autotest: Sleeping to ensure other nodes in the cluster have not crashed (lustre-master-next_full-dne-part-2_959.23) Autotest: Test running for 550 minutes (lustre-master-next_full-dne-part-2_959.23) Lustre: lustre-OST0007: haven't heard from client lustre-MDT0003-mdtlov_UUID (at 10.240.31.83@tcp) in 101 seconds. I think it's dead, and I am evicting it. exp ff1c49c2572af000, cur 1772917607 deadline 1772917606 last 1772917506 Lustre: lustre-OST0003: haven't heard from client lustre-MDT0001-mdtlov_UUID (at 10.240.31.83@tcp) in 104 seconds. I think it's dead, and I am evicting it. exp ff1c49c271cf4000, cur 1772917612 deadline 1772917608 last 1772917508 Lustre: Skipped 7 previous similar messages | Link to test (2026-03-07 21:46) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 652361:0:(nodemap_handler.c:4905:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 652361:0:(nodemap_handler.c:4905:nodemap_config_set_active()) LBUG CPU: 1 PID: 652361 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 420 minutes (lustre-b_es7_0_full-part-2_261.43) Autotest: Test running for 425 minutes (lustre-b_es7_0_full-part-2_261.43) | Link to test (2026-03-06 23:45) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 693657:0:(nodemap_handler.c:4832:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 693657:0:(nodemap_handler.c:4832:nodemap_config_set_active()) LBUG CPU: 0 PID: 693657 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-427.42.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 460 minutes (lustre-b_es7_0_full-dne-part-2_252.6) Autotest: Test running for 465 minutes (lustre-b_es7_0_full-dne-part-2_252.6) | Link to test (2026-02-25 02:15) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 723778:0:(nodemap_handler.c:4804:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 723778:0:(nodemap_handler.c:4804:nodemap_config_set_active()) LBUG CPU: 0 PID: 723778 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.13.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 450 minutes (lustre-master-next_full-part-2_955.32) Autotest: Test running for 455 minutes (lustre-master-next_full-part-2_955.32) Autotest: Test running for 460 minutes (lustre-master-next_full-part-2_955.32) Autotest: Test running for 465 minutes (lustre-master-next_full-part-2_955.32) Autotest: Test running for 470 minutes (lustre-master-next_full-part-2_955.32) | Link to test (2026-02-20 07:09) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 839991:0:(nodemap_handler.c:4766:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 839991:0:(nodemap_handler.c:4766:nodemap_config_set_active()) LBUG CPU: 1 PID: 839991 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.13.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Autotest: Test running for 575 minutes (lustre-master_full-dne-part-2_4702.38) Autotest: Test running for 580 minutes (lustre-master_full-dne-part-2_4702.38) Autotest: Test running for 585 minutes (lustre-master_full-dne-part-2_4702.38) Autotest: Test running for 590 minutes (lustre-master_full-dne-part-2_4702.38) Autotest: Test running for 595 minutes (lustre-master_full-dne-part-2_4702.38) Autotest: Test running for 600 minutes (lustre-master_full-dne-part-2_4702.38) Autotest: Test running for 605 minutes (lustre-master_full-dne-part-2_4702.38) Autotest: Test running for 610 minutes (lustre-master_full-dne-part-2_4702.38) Autotest: Test running for 615 minutes (lustre-master_full-dne-part-2_4702.38) | Link to test (2026-02-18 16:34) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 720369:0:(nodemap_handler.c:4768:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 720369:0:(nodemap_handler.c:4768:nodemap_config_set_active()) LBUG CPU: 0 PID: 720369 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 525 minutes (lustre-master-next_full-dne-part-2_950.23) Autotest: Test running for 530 minutes (lustre-master-next_full-dne-part-2_950.23) Autotest: Test running for 535 minutes (lustre-master-next_full-dne-part-2_950.23) | Link to test (2026-02-05 19:12) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 622495:0:(nodemap_handler.c:4766:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 622495:0:(nodemap_handler.c:4766:nodemap_config_set_active()) LBUG CPU: 1 PID: 622495 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 475 minutes (lustre-master_full-part-2_4698.89) Autotest: Test running for 480 minutes (lustre-master_full-part-2_4698.89) | Link to test (2026-02-05 15:45) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 667667:0:(nodemap_handler.c:4766:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 667667:0:(nodemap_handler.c:4766:nodemap_config_set_active()) LBUG CPU: 0 PID: 667667 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 435 minutes (lustre-master-next_full-part-2_949.32) Autotest: Test running for 440 minutes (lustre-master-next_full-part-2_949.32) | Link to test (2026-02-04 08:01) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 718474:0:(nodemap_handler.c:4766:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 718474:0:(nodemap_handler.c:4766:nodemap_config_set_active()) LBUG CPU: 0 PID: 718474 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 500 minutes (lustre-master_full-dne-part-2_4695.23) Autotest: Test running for 505 minutes (lustre-master_full-dne-part-2_4695.23) Autotest: Test running for 510 minutes (lustre-master_full-dne-part-2_4695.23) | Link to test (2026-01-15 15:09) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 718988:0:(nodemap_handler.c:4514:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 718988:0:(nodemap_handler.c:4514:nodemap_config_set_active()) LBUG CPU: 1 PID: 718988 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.13.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x91/0x160 do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | Link to test (2026-01-15 01:45) | |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 667640:0:(nodemap_handler.c:4604:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 667640:0:(nodemap_handler.c:4604:nodemap_config_set_active()) LBUG CPU: 1 PID: 667640 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? srso_alias_return_thunk+0x5/0xfbef5 ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Autotest: Test running for 405 minutes (lustre-master-next_full-part-2_944.110) | Link to test (2025-12-21 09:36) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 680644:0:(nodemap_handler.c:4514:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 680644:0:(nodemap_handler.c:4514:nodemap_config_set_active()) LBUG CPU: 0 PID: 680644 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 580 minutes (lustre-master_full-dne-part-2_4685.23) | Link to test (2025-12-12 17:15) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 696553:0:(nodemap_handler.c:4508:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 696553:0:(nodemap_handler.c:4508:nodemap_config_set_active()) LBUG CPU: 0 PID: 696553 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.42.2_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x317/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x402/0xc30 [mgc] mgc_process_log+0x815/0x8a0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 495 minutes (lustre-master-next_full-part-2_927.77) | Link to test (2025-10-23 13:06) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 10120:0:(nodemap_handler.c:4443:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 10120:0:(nodemap_handler.c:4443:nodemap_config_set_active()) LBUG CPU: 1 PID: 10120 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x2b0/0x2c0 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x413/0xc40 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 165 minutes (lustre-master-next_full-part-2_921.62) | Link to test (2025-09-14 17:51) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 10195:0:(nodemap_handler.c:4443:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 10195:0:(nodemap_handler.c:4443:nodemap_config_set_active()) LBUG CPU: 0 PID: 10195 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x2b0/0x2c0 [ptlrpc] nodemap_config_set_active_mgc+0x1d/0x50 [ptlrpc] mgc_process_nodemap_log+0x413/0xc40 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 20 minutes (lustre-master-next_full-part-2_920.68) | Link to test (2025-09-14 07:38) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 710595:0:(nodemap_handler.c:3200:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 710595:0:(nodemap_handler.c:3200:nodemap_config_set_active()) LBUG CPU: 1 PID: 710595 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-427.42.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x311/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 565 minutes (lustre-b_es7_0_full-dne-part-2_156.6) | Link to test (2025-07-16 19:13) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 13128:0:(nodemap_handler.c:2998:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 13128:0:(nodemap_handler.c:2998:nodemap_config_set_active()) LBUG CPU: 1 PID: 13128 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-427.42.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41b/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 165 minutes (lustre-master_full-part-2_4640.14) | Link to test (2025-07-08 15:29) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 10655:0:(nodemap_handler.c:2895:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 10655:0:(nodemap_handler.c:2895:nodemap_config_set_active()) LBUG CPU: 0 PID: 10655 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x311/0x320 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 95 minutes (lustre-b_es7_0_full-part-2_148.38) | Link to test (2025-06-27 14:23) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 10703:0:(nodemap_handler.c:2826:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 10703:0:(nodemap_handler.c:2826:nodemap_config_set_active()) LBUG CPU: 0 PID: 10703 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.38.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41b/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 190 minutes (lustre-master-next_full-dne-part-2_880.32) | Link to test (2025-05-06 21:54) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 4896:0:(nodemap_handler.c:2826:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 4896:0:(nodemap_handler.c:2826:nodemap_config_set_active()) LBUG CPU: 0 PID: 4896 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.38.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41b/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x154/0x440 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 190 minutes (lustre-master-next_full-dne-part-2_880.32) LNet: Host 10.240.40.30 reset our connection while we were sending data; it may have rebooted: rc = -104 Lustre: 4858:0:(client.c:2445:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1746581315/real 1746581315] req@ffff9091a90d1a00 x1831411240436864/t0(0) o400->lustre-OST0000-osc-MDT0001@10.240.40.30@tcp:28/4 lens 224/224 e 0 to 1 dl 1746581331 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 10.240.40.30@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 3 previous similar messages Autotest: Killing test framework, node(s) in the cluster crashed (lustre-master-next_full-dne-part-2_880.32) Autotest: Sleeping to ensure other nodes in the cluster have not crashed (lustre-master-next_full-dne-part-2_880.32) Lustre: 4859:0:(client.c:2445:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1746581310/real 1746581310] req@ffff9091b053c9c0 x1831411240435328/t0(0) o13->lustre-OST0003-osc-MDT0003@10.240.40.30@tcp:7/4 lens 224/368 e 0 to 1 dl 1746581326 ref 1 fl Rpc:XQr/200/ffffffff rc 0/-1 job:'osp-pre-3-3.0' uid:0 gid:0 projid:4294967295 Lustre: 4859:0:(client.c:2445:ptlrpc_expire_one_request()) Skipped 19 previous similar messages Autotest: trevis-47vm3 crashed during sanity-sec (lustre-master-next_full-dne-part-2_880.32) Lustre: lustre-MDT0003: haven't heard from client lustre-MDT0003-lwp-OST0000_UUID (at 10.240.40.30@tcp) in 102 seconds. I think it's dead, and I am evicting it. exp ffff9091a6879400, cur 1746581405 deadline 1746581403 last 1746581303 | Link to test (2025-05-06 21:54) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 709529:0:(nodemap_handler.c:2190:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 709529:0:(nodemap_handler.c:2190:nodemap_config_set_active()) LBUG CPU: 1 PID: 709529 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.38.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Link to test (2025-04-23 02:31) | |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 454854:0:(nodemap_handler.c:2187:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 454854:0:(nodemap_handler.c:2187:nodemap_config_set_active()) LBUG CPU: 0 PID: 454854 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-427.42.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 535 minutes (lustre-b_es7_0_full-dne-part-2_56.2) | Link to test (2025-02-20 23:04) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 669918:0:(nodemap_handler.c:1918:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 669918:0:(nodemap_handler.c:1918:nodemap_config_set_active()) LBUG CPU: 1 PID: 669918 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-427.31.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x58 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x818/0x8a0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Link to test (2024-12-20 23:12) | |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 14473:0:(nodemap_handler.c:2001:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 14473:0:(nodemap_handler.c:2001:nodemap_config_set_active()) LBUG CPU: 0 PID: 14473 Comm: ll_cfg_requeue Kdump: loaded Tainted: G OE ------- --- 5.14.0-362.24.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x58 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x82c/0x8b0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x162/0x460 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Link to test (2024-12-04 13:53) | |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 574178:0:(nodemap_handler.c:1918:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 574178:0:(nodemap_handler.c:1918:nodemap_config_set_active()) LBUG CPU: 0 PID: 574178 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-427.31.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x58 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x818/0x8a0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 405 minutes (lustre-master_full-part-2_4586.71) | Link to test (2024-10-21 04:39) |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 1534958:0:(nodemap_handler.c:1918:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 1534958:0:(nodemap_handler.c:1918:nodemap_config_set_active()) LBUG CPU: 0 PID: 1534958 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-427.31.1.el9_4.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x58 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x818/0x8a0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x155/0x450 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Link to test (2024-09-27 23:42) | |
| sanity-sec test 26: test transferring very large nodemap | LustreError: 668649:0:(nodemap_handler.c:1918:nodemap_config_set_active()) ASSERTION( config->nmc_default_nodemap ) failed: LustreError: 668649:0:(nodemap_handler.c:1918:nodemap_config_set_active()) LBUG CPU: 1 PID: 668649 Comm: ll_cfg_requeue Kdump: loaded Tainted: G W OE ------- --- 5.14.0-362.24.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x58 [libcfs] nodemap_config_set_active+0x2aa/0x2b0 [ptlrpc] nodemap_config_set_active_mgc+0x36/0x200 [ptlrpc] ? __ptlrpc_free_req+0x346/0x510 [ptlrpc] mgc_process_nodemap_log+0x41f/0xcf0 [mgc] mgc_process_log+0x818/0x8a0 [mgc] ? schedule_timeout+0x92/0x160 ? __pfx_mgc_requeue_thread+0x10/0x10 [mgc] do_requeue+0xd3/0x290 [mgc] mgc_requeue_thread+0x162/0x460 [mgc] ? __pfx_autoremove_wake_function+0x10/0x10 kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | Autotest: Test running for 535 minutes (lustre-master_full-dne-part-2_4570.44) | Link to test (2024-09-04 10:10) |