Edit new crash report

Reason	Crashing Function	Where to cut Backtrace	Reports Count
ASSERTION( dt->do_body_ops ) failed	dt_ladvise	ofd_ladvise_hdl tgt_request_handle ptlrpc_server_handle_request ptlrpc_main kthread ret_from_fork	26

Reason

Crashing Function

Where to cut Backtrace

Reports Count

ASSERTION( dt->do_body_ops ) failed

dt_ladvise

ofd_ladvise_hdl
tgt_request_handle
ptlrpc_server_handle_request
ptlrpc_main
kthread
ret_from_fork

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):

Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):

Limit to a test:
(Copy from below "Failing text"):

Delete these reports as invalid (real bug in review or some such)

Bug or comment:

Extra info:

Failures list (last 100):

Failing Test	Full Crash	Messages before crash	Comment
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 513744:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 513744:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 513744, comm: ll_ost_io00_020 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 513744:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000335bb78e/0xad61ff9f0709afa0 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 513744 timeout: 0 lvb_type: 0 LustreError: 513744:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 343806:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 343806:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 343806, comm: ll_ost_io00_000 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 343806:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000532b6725/0x3728fd90b6ca915c lrc: 2/0,0 mode: --/PR res: [0x280008100:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 343806 timeout: 0 lvb_type: 0 LustreError: 343806:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 513685:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 513685:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 513685, comm: ll_ost_io00_018 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 513685:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000002301dd64/0x392a1b45549b1103 lrc: 2/0,0 mode: --/PR res: [0x280006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 513685 timeout: 0 lvb_type: 0 LustreError: 513685:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 18 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 349637:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 349637:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 349637, comm: ll_ost_io00_000 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 349637:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000a0aa5845/0x7e2b228870f2818c lrc: 2/0,0 mode: --/PR res: [0x240008100:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 349637 timeout: 0 lvb_type: 0 LustreError: 349637:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 443226:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 443226:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 443226, comm: ll_ost_io00_009 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 443226:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000d9757c1e/0x3160cbaf244071df lrc: 2/0,0 mode: --/PR res: [0x2400090a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 443226 timeout: 0 lvb_type: 0	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 512802:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 512802:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 512802, comm: ll_ost_io00_037 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 512802:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000954e14f7/0x98a3317c54e74903 lrc: 2/0,0 mode: --/PR res: [0x280008100:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 512802 timeout: 0 lvb_type: 0	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 506851:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 506851:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 506851, comm: ll_ost_io00_010 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 506851:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000aa5c714f/0x98d26dfbc5068146 lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 506851 timeout: 0 lvb_type: 0 LustreError: 506851:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 430449:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 430449:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 430449, comm: ll_ost_io00_004 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 430449:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000009c4f5eec/0xde5f1f883914d9d5 lrc: 2/0,0 mode: --/PR res: [0x2400090a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 430449 timeout: 0 lvb_type: 0	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 428451:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 428451:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 428451, comm: ll_ost_io00_006 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 428451:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 0000000082281e3d/0x94f01599cb93e983 lrc: 2/0,0 mode: --/PR res: [0x2400061c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 428451 timeout: 0 lvb_type: 0 LustreError: 428451:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 425655:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 425655:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 425655, comm: ll_ost_io00_005 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 425655:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000b3b3b2c5/0x194c00ec09823a lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 425655 timeout: 0 lvb_type: 0	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 532236:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 532236:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 532236, comm: ll_ost_io00_027 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 532236:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 0000000071734462/0x82a60e4e5fbb18e3 lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 532236 timeout: 0 lvb_type: 0 LustreError: 532236:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 426359:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 426359:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 426359, comm: ll_ost_io00_007 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 426359:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000bd939b29/0xb7f3414fbe5c91b7 lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 426359 timeout: 0 lvb_type: 0 LustreError: 426359:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 520362:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 520362:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 520362, comm: ll_ost_io00_037 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 520362:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000c669f611/0x7f04a08476224321 lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 520362 timeout: 0 lvb_type: 0 LustreError: 520362:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 346697:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 346697:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 346697, comm: ll_ost_io00_001 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 346697:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000f28c48d7/0xa1da39f9670710cf lrc: 2/0,0 mode: --/PR res: [0x2400061c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 346697 timeout: 0 lvb_type: 0 LustreError: 346697:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 3 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 428094:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 428094:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 428094, comm: ll_ost_io00_004 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 428094:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000f89eae78/0x3716b352abf58bad lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 428094 timeout: 0 lvb_type: 0 LustreError: 428094:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 18 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 444542:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 444542:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 444542, comm: ll_ost_io00_005 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 444542:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000003aed11cf/0xd539e375ebe0cfc lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 444542 timeout: 0 lvb_type: 0 LustreError: 444542:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 19 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 514287:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 514287:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 514287, comm: ll_ost_io00_011 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 514287:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000a8784226/0x59833df8485a48b4 lrc: 2/0,0 mode: --/PR res: [0x280007930:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 514287 timeout: 0 lvb_type: 0 LustreError: 514287:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 443967:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 443967:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 443967, comm: ll_ost_io00_004 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 443967:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 0000000007d61100/0x66d9b01a0debb54c lrc: 2/0,0 mode: --/PR res: [0x2400059f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 443967 timeout: 0 lvb_type: 0 LustreError: 443967:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 529435:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 529435:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 529435, comm: ll_ost_io00_025 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 529435:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000002db47c38/0xa38a85b2de487b1 lrc: 2/0,0 mode: --/PR res: [0x240007930:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 529435 timeout: 0 lvb_type: 0 LustreError: 529435:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 519701:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 519701:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 519701, comm: ll_ost_io00_036 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 519701:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000007d1b283b/0x4685884b111fb0dd lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 519701 timeout: 0 lvb_type: 0 LustreError: 519701:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 18 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 509325:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 509325:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 509325, comm: ll_ost_io00_035 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 509325:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000dbed1d76/0x78a75efea15ab55d lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 509325 timeout: 0 lvb_type: 0 LustreError: 509325:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 4 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 444440:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 444440:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 444440, comm: ll_ost_io00_009 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 444440:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000a6e38f67/0x2195157d94cfe760 lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 444440 timeout: 0 lvb_type: 0	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 346736:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 346736:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 346736, comm: ll_ost_io00_001 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 346736:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000c98e21eb/0x67d426b3d5afc380 lrc: 2/0,0 mode: --/PR res: [0x2400059f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 346736 timeout: 0 lvb_type: 0 LustreError: 346736:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 429635:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 429635:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 429635, comm: ll_ost_io00_006 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 429635:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000009d843aa9/0xcb557751506f65e0 lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 429635 timeout: 0 lvb_type: 0 LustreError: 429635:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 449633:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 449633:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 449633, comm: ll_ost_io00_009 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0xa0 [libcfs] [<0>] lbug_with_loc+0x3f/0x70 [libcfs] [<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd] [<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc] [<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc] [<0>] kthread+0x134/0x150 [<0>] ret_from_fork+0x35/0x40	LustreError: 449633:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000f811cdf5/0xde19e6346f414624 lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 449633 timeout: 0 lvb_type: 0 LustreError: 449633:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages	Link to test
sanity test 255b: check 'lfs ladvise -a dontneed'	LustreError: 630133:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed: LustreError: 630133:0:(dt_object.h:2644:dt_ladvise()) LBUG Pid: 630133, comm: ll_ost_io00_004 4.18.0-240.22.1.el8_lustre.x86_64 #1 SMP Mon Nov 15 17:17:07 UTC 2021 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0x90 [libcfs] [<0>] lbug_with_loc+0x43/0x80 [libcfs] [<0>] ofd_ladvise_hdl+0x893/0x8d0 [ofd] [<0>] tgt_request_handle+0xc93/0x1a00 [ptlrpc] [<0>] ptlrpc_server_handle_request+0x323/0xbd0 [ptlrpc] [<0>] ptlrpc_main+0xc06/0x1550 [ptlrpc] [<0>] kthread+0x112/0x130 [<0>] ret_from_fork+0x35/0x40	LustreError: 630133:0:(ldlm_request.c:489:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -11) ns: filter-lustre-OST0000_UUID lock: 000000002fa504d1/0xc96b7068d11efe65 lrc: 2/0,0 mode: --/PR res: [0x300000403:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 630133 timeout: 0 lvb_type: 0 LustreError: 630133:0:(ldlm_request.c:489:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages	Externally reported by Unrecognized email message from maloo-prod@whamcloud.com

Failing Test

Full Crash

Messages before crash

Comment

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 513744:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 513744:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 513744, comm: ll_ost_io00_020 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 513744:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000335bb78e/0xad61ff9f0709afa0 lrc: 2/0,0 mode: --/PR res: [0x240002b10:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 513744 timeout: 0 lvb_type: 0
LustreError: 513744:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 343806:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 343806:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 343806, comm: ll_ost_io00_000 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 343806:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000532b6725/0x3728fd90b6ca915c lrc: 2/0,0 mode: --/PR res: [0x280008100:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 343806 timeout: 0 lvb_type: 0
LustreError: 343806:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 513685:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 513685:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 513685, comm: ll_ost_io00_018 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 513685:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000002301dd64/0x392a1b45549b1103 lrc: 2/0,0 mode: --/PR res: [0x280006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 513685 timeout: 0 lvb_type: 0
LustreError: 513685:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 18 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 349637:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 349637:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 349637, comm: ll_ost_io00_000 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 349637:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000a0aa5845/0x7e2b228870f2818c lrc: 2/0,0 mode: --/PR res: [0x240008100:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 349637 timeout: 0 lvb_type: 0
LustreError: 349637:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 443226:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 443226:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 443226, comm: ll_ost_io00_009 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 443226:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000d9757c1e/0x3160cbaf244071df lrc: 2/0,0 mode: --/PR res: [0x2400090a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 443226 timeout: 0 lvb_type: 0

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 512802:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 512802:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 512802, comm: ll_ost_io00_037 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 512802:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000954e14f7/0x98a3317c54e74903 lrc: 2/0,0 mode: --/PR res: [0x280008100:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 512802 timeout: 0 lvb_type: 0

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 506851:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 506851:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 506851, comm: ll_ost_io00_010 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 506851:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000aa5c714f/0x98d26dfbc5068146 lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 506851 timeout: 0 lvb_type: 0
LustreError: 506851:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 430449:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 430449:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 430449, comm: ll_ost_io00_004 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 430449:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000009c4f5eec/0xde5f1f883914d9d5 lrc: 2/0,0 mode: --/PR res: [0x2400090a0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 430449 timeout: 0 lvb_type: 0

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 428451:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 428451:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 428451, comm: ll_ost_io00_006 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 428451:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 0000000082281e3d/0x94f01599cb93e983 lrc: 2/0,0 mode: --/PR res: [0x2400061c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 428451 timeout: 0 lvb_type: 0
LustreError: 428451:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 425655:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 425655:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 425655, comm: ll_ost_io00_005 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 425655:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000b3b3b2c5/0x194c00ec09823a lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 425655 timeout: 0 lvb_type: 0

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 532236:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 532236:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 532236, comm: ll_ost_io00_027 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 532236:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 0000000071734462/0x82a60e4e5fbb18e3 lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 532236 timeout: 0 lvb_type: 0
LustreError: 532236:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 426359:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 426359:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 426359, comm: ll_ost_io00_007 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 426359:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000bd939b29/0xb7f3414fbe5c91b7 lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 426359 timeout: 0 lvb_type: 0
LustreError: 426359:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 520362:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 520362:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 520362, comm: ll_ost_io00_037 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 520362:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000c669f611/0x7f04a08476224321 lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 520362 timeout: 0 lvb_type: 0
LustreError: 520362:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 346697:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 346697:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 346697, comm: ll_ost_io00_001 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 346697:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000f28c48d7/0xa1da39f9670710cf lrc: 2/0,0 mode: --/PR res: [0x2400061c0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 346697 timeout: 0 lvb_type: 0
LustreError: 346697:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 3 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 428094:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 428094:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 428094, comm: ll_ost_io00_004 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 428094:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000f89eae78/0x3716b352abf58bad lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 428094 timeout: 0 lvb_type: 0
LustreError: 428094:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 18 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 444542:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 444542:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 444542, comm: ll_ost_io00_005 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 444542:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000003aed11cf/0xd539e375ebe0cfc lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 444542 timeout: 0 lvb_type: 0
LustreError: 444542:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 19 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 514287:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 514287:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 514287, comm: ll_ost_io00_011 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 514287:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000a8784226/0x59833df8485a48b4 lrc: 2/0,0 mode: --/PR res: [0x280007930:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 514287 timeout: 0 lvb_type: 0
LustreError: 514287:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 443967:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 443967:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 443967, comm: ll_ost_io00_004 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 443967:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 0000000007d61100/0x66d9b01a0debb54c lrc: 2/0,0 mode: --/PR res: [0x2400059f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 443967 timeout: 0 lvb_type: 0
LustreError: 443967:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 529435:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 529435:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 529435, comm: ll_ost_io00_025 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 529435:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000002db47c38/0xa38a85b2de487b1 lrc: 2/0,0 mode: --/PR res: [0x240007930:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 529435 timeout: 0 lvb_type: 0
LustreError: 529435:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 519701:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 519701:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 519701, comm: ll_ost_io00_036 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 519701:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000007d1b283b/0x4685884b111fb0dd lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 519701 timeout: 0 lvb_type: 0
LustreError: 519701:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 18 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 509325:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 509325:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 509325, comm: ll_ost_io00_035 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 509325:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000dbed1d76/0x78a75efea15ab55d lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 509325 timeout: 0 lvb_type: 0
LustreError: 509325:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 4 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 444440:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 444440:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 444440, comm: ll_ost_io00_009 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 444440:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000a6e38f67/0x2195157d94cfe760 lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 444440 timeout: 0 lvb_type: 0

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 346736:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 346736:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 346736, comm: ll_ost_io00_001 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 346736:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000c98e21eb/0x67d426b3d5afc380 lrc: 2/0,0 mode: --/PR res: [0x2400059f0:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 346736 timeout: 0 lvb_type: 0
LustreError: 346736:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 429635:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 429635:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 429635, comm: ll_ost_io00_006 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 429635:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 000000009d843aa9/0xcb557751506f65e0 lrc: 2/0,0 mode: --/PR res: [0x240006990:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 429635 timeout: 0 lvb_type: 0
LustreError: 429635:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 449633:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 449633:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 449633, comm: ll_ost_io00_009 4.18.0-477.27.1.el8_lustre.x86_64 #1 SMP Sat Dec 23 04:44:29 UTC 2023
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0xa0 [libcfs]
[<0>] lbug_with_loc+0x3f/0x70 [libcfs]
[<0>] ofd_ladvise_hdl+0x8d7/0x980 [ofd]
[<0>] tgt_request_handle+0xccd/0x1b10 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbe0 [ptlrpc]
[<0>] ptlrpc_main+0xc0f/0x1560 [ptlrpc]
[<0>] kthread+0x134/0x150
[<0>] ret_from_fork+0x35/0x40

LustreError: 449633:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -2) ns: filter-lustre-OST0000_UUID lock: 00000000f811cdf5/0xde19e6346f414624 lrc: 2/0,0 mode: --/PR res: [0x240007160:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 449633 timeout: 0 lvb_type: 0
LustreError: 449633:0:(ldlm_request.c:490:ldlm_cli_enqueue_local()) Skipped 20 previous similar messages

Link to test

sanity test 255b: check 'lfs ladvise -a dontneed'

LustreError: 630133:0:(dt_object.h:2644:dt_ladvise()) ASSERTION( dt->do_body_ops ) failed:
LustreError: 630133:0:(dt_object.h:2644:dt_ladvise()) LBUG
Pid: 630133, comm: ll_ost_io00_004 4.18.0-240.22.1.el8_lustre.x86_64 #1 SMP Mon Nov 15 17:17:07 UTC 2021
Call Trace TBD:
[<0>] libcfs_call_trace+0x6f/0x90 [libcfs]
[<0>] lbug_with_loc+0x43/0x80 [libcfs]
[<0>] ofd_ladvise_hdl+0x893/0x8d0 [ofd]
[<0>] tgt_request_handle+0xc93/0x1a00 [ptlrpc]
[<0>] ptlrpc_server_handle_request+0x323/0xbd0 [ptlrpc]
[<0>] ptlrpc_main+0xc06/0x1550 [ptlrpc]
[<0>] kthread+0x112/0x130
[<0>] ret_from_fork+0x35/0x40

LustreError: 630133:0:(ldlm_request.c:489:ldlm_cli_enqueue_local()) ### delayed lvb init failed (rc -11) ns: filter-lustre-OST0000_UUID lock: 000000002fa504d1/0xc96b7068d11efe65 lrc: 2/0,0 mode: --/PR res: [0x300000403:0x0:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 630133 timeout: 0 lvb_type: 0
LustreError: 630133:0:(ldlm_request.c:489:ldlm_cli_enqueue_local()) Skipped 6 previous similar messages

Externally reported by Unrecognized email message from maloo-prod@whamcloud.com

Return to new crashes list

Editing crashreport #8077

Added fields:

Failures list (last 100):