Editing crashreport #74955

ReasonCrashing FunctionWhere to cut BacktraceReports Count
ASSERTION( list_empty(&req->rq_list) ) failedptlrpc_send_new_reqptlrpc_send_new_req
ptlrpc_check_set
ptlrpcd_check
ptlrpcd
kthread
ret_from_fork
ret_from_fork_asm
3

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
replay-single test 117: DNE: cross MDT unlink, fail MDT1 and MDT2
LustreError: 3930:0:(client.c:1846:ptlrpc_send_new_req()) ASSERTION( list_empty(&req->rq_list) ) failed:
LustreError: 3930:0:(client.c:1846:ptlrpc_send_new_req()) LBUG
CPU: 0 UID: 0 PID: 3930 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
ptlrpc_send_new_req+0xb2b/0xc30 [ptlrpc]
ptlrpc_check_set+0x3da/0x20a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfbef5
? __timer_delete_sync+0x28/0x40
ptlrpcd_check+0x39b/0x5b0 [ptlrpc]
ptlrpcd+0x2f4/0x4b0 [ptlrpc]
? __pfx_woken_wake_function+0x10/0x10
? __pfx_ptlrpcd+0x10/0x10 [ptlrpc]
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0001
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0002
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0003
LustreError: 3930:0:(client.c:3436:ptlrpc_replay_interpret()) @@@ status 301, old was 0 req@ff3eaf8a819e1d40 x1865914439816064/t51539607660(51539607660) o101->lustre-MDT0002-mdc-ff3eaf8aa3f1f800@10.240.40.67@tcp:12/10 lens 648/608 e 0 to 0 dl 1779483658 ref 2 fl Interpret:RPQU/604/0 rc 301/301 job:'lfs.0' uid:0 gid:0 projid:0
LustreError: 3930:0:(client.c:3436:ptlrpc_replay_interpret()) Skipped 1 previous similar message
Link to test
replay-single test 112k: DNE: cross MDT rename, fail MDT1,MDT2,MDT3
LustreError: 3884:0:(client.c:1846:ptlrpc_send_new_req()) ASSERTION( list_empty(&req->rq_list) ) failed:
LustreError: 3884:0:(client.c:1846:ptlrpc_send_new_req()) LBUG
CPU: 0 UID: 0 PID: 3884 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
ptlrpc_send_new_req+0xb2b/0xc30 [ptlrpc]
ptlrpc_check_set+0x3da/0x20a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfbef5
? __timer_delete_sync+0x28/0x40
ptlrpcd_check+0x39b/0x5b0 [ptlrpc]
ptlrpcd+0x2f4/0x4b0 [ptlrpc]
? __pfx_woken_wake_function+0x10/0x10
? __pfx_ptlrpcd+0x10/0x10 [ptlrpc]
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0001
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0002
Link to test
replay-single test 112k: DNE: cross MDT rename, fail MDT1,MDT2,MDT3
LustreError: 3930:0:(client.c:1846:ptlrpc_send_new_req()) ASSERTION( list_empty(&req->rq_list) ) failed:
LustreError: 3930:0:(client.c:1846:ptlrpc_send_new_req()) LBUG
CPU: 0 UID: 0 PID: 3930 Comm: ptlrpcd_rcv Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
ptlrpc_send_new_req+0xb2b/0xc30 [ptlrpc]
ptlrpc_check_set+0x3da/0x20a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfbef5
? __timer_delete_sync+0x28/0x40
ptlrpcd_check+0x39b/0x5b0 [ptlrpc]
ptlrpcd+0x2f4/0x4b0 [ptlrpc]
? __pfx_woken_wake_function+0x10/0x10
? __pfx_ptlrpcd+0x10/0x10 [ptlrpc]
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0000
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0001
Lustre: DEBUG MARKER: mcreate /mnt/lustre/fsa-$(hostname); rm /mnt/lustre/fsa-$(hostname)
Lustre: DEBUG MARKER: if [ -d /mnt/lustre2 ]; then mcreate /mnt/lustre2/fsa-$(hostname); rm /mnt/lustre2/fsa-$(hostname); fi
Lustre: DEBUG MARKER: local REPLAY BARRIER on lustre-MDT0002
Link to test
Return to new crashes list