Editing crashreport #73713

ReasonCrashing FunctionWhere to cut BacktraceReports Count
BUG: unable to handle page fault range_lockll_file_io_generic
do_file_write_iter
do_iter_readv_writev
do_iter_write
nfsd_vfs_write
nfsd_write
nfsd3_proc_write
nfsd_dispatch
svc_process_common
svc_process
svc_handle_xprt
svc_recv
nfsd
kthread
ret_from_fork
13

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
parallel-scale-nfsv3 test iorfpp: iorfpp
BUG: unable to handle page fault for address: 0000000085007ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 1 PID: 72244 Comm: nfsd Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: cf ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 a9 f3 08 c3 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:fffface0876ffa20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000085007af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: fffface0876ffad8 RDI: ffff999c745c6fa0
RBP: fffface0876ffad8 R08: fffface0876ffad8 R09: ffff999d777d4f17
R10: ffff999c745c6f90 R11: 000000000000000f R12: ffff999c745c6fa0
R13: ffff999c745c6f90 R14: 00000000000000ff R15: 0000000000000080
FS: 0000000000000000(0000) GS:ffff999cffd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000085007ae8 CR3: 000000000572e001 CR4: 00000000000606f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? lprocfs_counter_add+0x117/0x180 [obdclass]
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl tls dm_flakey osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) ldiskfs(OE) libcfs(OE) dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common virtio_balloon pcspkr i2c_piix4 joydev drm fuse ext4 mbcache jbd2 ata_generic ata_piix crct10dif_pclmul crc32_pclmul crc32c_intel libata virtio_net ghash_clmulni_intel net_failover failover virtio_blk serio_raw [last unloaded: dm_flakey]
CR2: 0000000085007ae8
Link to test
parallel-scale-nfsv3 test iorfpp: iorfpp
BUG: unable to handle page fault for address: 0000000087d33ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 1 PID: 71951 Comm: nfsd Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: d2 ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 a9 03 19 f3 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffb0fb87d43a20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000087d33af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffb0fb87d43ad8 RDI: ffff907bd7ccf5a0
RBP: ffffb0fb87d43ad8 R08: ffffb0fb87d43ad8 R09: ffff907cee52390e
R10: ffff907bd7ccf590 R11: 000000000000000f R12: ffff907bd7ccf5a0
R13: ffff907bd7ccf590 R14: 000000000000017f R15: 0000000000000100
FS: 0000000000000000(0000) GS:ffff907c7fd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000087d33ae8 CR3: 0000000001926005 CR4: 00000000000606f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? lprocfs_counter_add+0x117/0x180 [obdclass]
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl tls dm_flakey osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) ldiskfs(OE) libcfs(OE) dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs sunrpc rfkill intel_rapl_msr intel_rapl_common joydev virtio_balloon i2c_piix4 pcspkr drm fuse ext4 mbcache jbd2 ata_generic crct10dif_pclmul crc32_pclmul crc32c_intel ata_piix libata ghash_clmulni_intel virtio_net virtio_blk net_failover failover serio_raw [last unloaded: dm_flakey]
CR2: 0000000087d33ae8
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 00000000c8193ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 0 PID: 72360 Comm: nfsd Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: d2 ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 99 69 6e e7 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffa222c818ba18 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 00000000c8193af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffa222c818bad8 RDI: ffff930b25fd5da0
RBP: ffffa222c818bad8 R08: ffffa222c818bad8 R09: 0000000000000001
R10: ffff930b25fd5d90 R11: 000000000000000f R12: ffff930b25fd5da0
R13: ffff930b25fd5d90 R14: 000000000000000a R15: 0000000000000009
FS: 0000000000000000(0000) GS:ffff930bbfc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000c8193ae8 CR3: 0000000003240004 CR4: 00000000000606f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0xd5c/0x12b0 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
? range_lock+0x37/0x2e0 [obdclass]
ll_file_io_generic+0xd5c/0x12b0 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl tls dm_flakey osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) ldiskfs(OE) libcfs(OE) dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs sunrpc rfkill intel_rapl_msr intel_rapl_common joydev virtio_balloon pcspkr i2c_piix4 drm fuse ext4 mbcache jbd2 ata_generic ata_piix libata crct10dif_pclmul crc32_pclmul crc32c_intel virtio_net ghash_clmulni_intel virtio_blk net_failover failover serio_raw [last unloaded: dm_flakey]
CR2: 00000000c8193ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 2 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 2 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 2 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 2 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 2 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 2 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 00000000c0903ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 0 PID: 1341416 Comm: nfsd Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: e2 ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 b5 5d ec 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffad33c090ba20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 00000000c0903af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffad33c090bad8 RDI: ffff91b4f59739a0
RBP: ffffad33c090bad8 R08: ffffad33c090bad8 R09: ffff91b58450df1f
R10: ffff91b4f5973990 R11: 000000000000000f R12: ffff91b4f59739a0
R13: ffff91b4f5973990 R14: 0000000000000007 R15: 0000000000000006
FS: 0000000000000000(0000) GS:ffff91b53fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000c0903ae8 CR3: 0000000005d14006 CR4: 00000000001706f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) osd_ldiskfs(OE) lquota(OE) ldiskfs(OE) lustre(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) ec(OE) tls dm_flakey rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common virtio_balloon i2c_piix4 pcspkr joydev fuse drm dm_mod ext4 mbcache jbd2 ata_generic ata_piix crct10dif_pclmul crc32_pclmul crc32c_intel libata virtio_net net_failover ghash_clmulni_intel virtio_blk failover serio_raw [last unloaded: libcfs(OE)]
CR2: 00000000c0903ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 000000000091fae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 0 PID: 416869 Comm: nfsd Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: d2 ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 d5 66 c1 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffa9f200927a20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 000000000091faf0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffa9f200927ad8 RDI: ffff8e1e112d33a0
RBP: ffffa9f200927ad8 R08: ffffa9f200927ad8 R09: ffff8e1ec658780c
R10: ffff8e1e112d3390 R11: 000000000000000f R12: ffff8e1e112d33a0
R13: ffff8e1e112d3390 R14: 0000000000000011 R15: 0000000000000010
FS: 0000000000000000(0000) GS:ffff8e1e7fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000091fae8 CR3: 00000000346ac003 CR4: 00000000001706f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl tls osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) ldiskfs(OE) libcfs(OE) dm_flakey rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common i2c_piix4 pcspkr virtio_balloon joydev drm fuse dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata crct10dif_pclmul crc32_pclmul crc32c_intel virtio_net ghash_clmulni_intel net_failover failover virtio_blk serio_raw
CR2: 000000000091fae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 00000000c0b03ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 1 PID: 1224030 Comm: nfsd Kdump: loaded Tainted: P W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: e2 ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 f5 08 fb 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffb05ac0b1ba20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 00000000c0b03af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffb05ac0b1bad8 RDI: ffff9496c2ced1a0
RBP: ffffb05ac0b1bad8 R08: ffffb05ac0b1bad8 R09: ffff9497768dfb2f
R10: ffff9496c2ced190 R11: 000000000000000f R12: ffff9496c2ced1a0
R13: ffff9496c2ced190 R14: 0000000000000004 R15: 0000000000000003
FS: 0000000000000000(0000) GS:ffff9496ffd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000c0b03ae8 CR3: 000000000220a006 CR4: 00000000000606f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) osd_zfs(POE) lquota(OE) lustre(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) ec(OE) tls rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc zfs(POE) spl(OE) intel_rapl_msr intel_rapl_common virtio_balloon pcspkr i2c_piix4 joydev dm_mod drm fuse ext4 mbcache jbd2 ata_generic ata_piix libata crct10dif_pclmul crc32_pclmul crc32c_intel virtio_net net_failover ghash_clmulni_intel virtio_blk failover serio_raw [last unloaded: libcfs(OE)]
CR2: 00000000c0b03ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 0000000000837ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 0 PID: 1287385 Comm: nfsd Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: e2 ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 95 2a dc 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffff9f7d0086ba20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000837af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffff9f7d0086bad8 RDI: ffff8b8d2f7589a0
RBP: ffff9f7d0086bad8 R08: ffff9f7d0086bad8 R09: ffff8b8e4613ccfe
R10: ffff8b8d2f758990 R11: 000000000000000f R12: ffff8b8d2f7589a0
R13: ffff8b8d2f758990 R14: 0000000000000007 R15: 0000000000000006
FS: 0000000000000000(0000) GS:ffff8b8dbfc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000837ae8 CR3: 00000000075fe004 CR4: 00000000000606f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) osd_ldiskfs(OE) lquota(OE) ldiskfs(OE) lustre(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) ec(OE) tls dm_flakey rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill intel_rapl_msr intel_rapl_common i2c_piix4 pcspkr virtio_balloon sunrpc joydev dm_mod drm fuse ext4 mbcache jbd2 ata_generic ata_piix libata crct10dif_pclmul crc32_pclmul crc32c_intel ghash_clmulni_intel virtio_net virtio_blk net_failover failover serio_raw [last unloaded: libcfs(OE)]
CR2: 0000000000837ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 00000000410e7ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 0 PID: 13923 Comm: nfsd Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: cf ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 f5 7a cf 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffac0e417a7a20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 00000000410e7af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffac0e417a7ad8 RDI: ffff99f23dadefa0
RBP: ffffac0e417a7ad8 R08: ffffac0e417a7ad8 R09: ffff99f327602679
R10: ffff99f23dadef90 R11: 000000000000000f R12: ffff99f23dadefa0
R13: ffff99f23dadef90 R14: 0000000000000007 R15: 0000000000000006
FS: 0000000000000000(0000) GS:ffff99f2bfc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00000000410e7ae8 CR3: 00000000043a0005 CR4: 00000000001706f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) ldiskfs(OE) libcfs(OE) dm_flakey rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common pcspkr virtio_balloon i2c_piix4 joydev drm fuse dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata crct10dif_pclmul crc32_pclmul crc32c_intel virtio_net ghash_clmulni_intel net_failover failover virtio_blk serio_raw
CR2: 00000000410e7ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 0000000040963ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 1 PID: 1244792 Comm: nfsd Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: e2 ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 25 46 ca 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffae6640943a20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000040963af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffae6640943ad8 RDI: ffff919f382c95a0
RBP: ffffae6640943ad8 R08: ffffae6640943ad8 R09: ffff91a0092d4f1f
R10: ffff919f382c9590 R11: 000000000000000f R12: ffff919f382c95a0
R13: ffff919f382c9590 R14: 0000000000000011 R15: 0000000000000010
FS: 0000000000000000(0000) GS:ffff919f3bd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000040963ae8 CR3: 0000000102712006 CR4: 00000000003706f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) osd_ldiskfs(OE) lquota(OE) ldiskfs(OE) lustre(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) ec(OE) tls dm_flakey rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common virtio_balloon pcspkr i2c_piix4 joydev drm fuse dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata crct10dif_pclmul crc32_pclmul crc32c_intel virtio_net virtio_blk net_failover ghash_clmulni_intel failover serio_raw [last unloaded: libcfs(OE)]
CR2: 0000000040963ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 0000000040a07ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 0 PID: 1312741 Comm: nfsd Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: e2 ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 55 02 cd 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffb18740a27a20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000040a07af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffb18740a27ad8 RDI: ffffa066876d4ba0
RBP: ffffb18740a27ad8 R08: ffffb18740a27ad8 R09: ffffa067a69681c0
R10: ffffa066876d4b90 R11: 000000000000000f R12: ffffa066876d4ba0
R13: ffffa066876d4b90 R14: 0000000000000004 R15: 0000000000000003
FS: 0000000000000000(0000) GS:ffffa0673fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000040a07ae8 CR3: 00000000363d0005 CR4: 00000000001706f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) osd_ldiskfs(OE) lquota(OE) ldiskfs(OE) lustre(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) ec(OE) tls dm_flakey rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common virtio_balloon pcspkr i2c_piix4 joydev drm fuse dm_mod ext4 mbcache jbd2 ata_generic ata_piix crct10dif_pclmul crc32_pclmul crc32c_intel libata virtio_net ghash_clmulni_intel net_failover failover virtio_blk serio_raw [last unloaded: libcfs(OE)]
CR2: 0000000040a07ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 0000000080927ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 1 PID: 240072 Comm: nfsd Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: cf ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 95 f7 cb 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffbbe78096fa20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000080927af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffbbe78096fad8 RDI: ffff99c57feca7a0
RBP: ffffbbe78096fad8 R08: ffffbbe78096fad8 R09: ffff99c667c8bcf7
R10: ffff99c57feca790 R11: 000000000000000f R12: ffff99c57feca7a0
R13: ffff99c57feca790 R14: 0000000000000007 R15: 0000000000000006
FS: 0000000000000000(0000) GS:ffff99c5ffd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000080927ae8 CR3: 00000000042e4001 CR4: 00000000000606f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl tls osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) ldiskfs(OE) libcfs(OE) dm_flakey rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs sunrpc rfkill intel_rapl_msr intel_rapl_common pcspkr i2c_piix4 virtio_balloon joydev dm_mod drm fuse ext4 mbcache jbd2 ata_generic crct10dif_pclmul ata_piix crc32_pclmul crc32c_intel virtio_net libata ghash_clmulni_intel net_failover failover virtio_blk serio_raw
CR2: 0000000080927ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 000000000092bae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 0 PID: 256638 Comm: nfsd Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: cf ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 59 85 0b d5 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffb4c400933a20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 000000000092baf0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffb4c400933ad8 RDI: ffff9b88f76739a0
RBP: ffffb4c400933ad8 R08: ffffb4c400933ad8 R09: ffff9b89e504f4fc
R10: ffff9b88f7673990 R11: 000000000000000f R12: ffff9b88f76739a0
R13: ffff9b88f7673990 R14: 000000000000000a R15: 0000000000000009
FS: 0000000000000000(0000) GS:ffff9b897fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000000000092bae8 CR3: 0000000003764005 CR4: 00000000001706f0
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? kernelmode_fixup_or_oops+0x84/0x110
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl tls osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) ldiskfs(OE) libcfs(OE) dm_flakey rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common virtio_balloon pcspkr i2c_piix4 joydev drm fuse dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata virtio_net crct10dif_pclmul crc32_pclmul crc32c_intel net_failover ghash_clmulni_intel failover virtio_blk serio_raw
CR2: 000000000092bae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 10 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 10 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
parallel-scale-nfsv3 test connectathon: connectathon
BUG: unable to handle page fault for address: 0000000004787ae8
#PF: supervisor read access in kernel mode
#PF: error_code(0x0000) - not-present page
PGD 0 P4D 0
Oops: 0000 [#1] PREEMPT SMP PTI
CPU: 1 PID: 71491 Comm: nfsd Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:range_lock+0x4c/0x2e0 [obdclass]
Code: cf ff 01 0f 85 f8 01 00 00 4d 8d 65 10 4c 89 e7 e8 09 89 df e7 49 8b 5d 00 4c 8b 75 08 4c 8b 7d 00 48 85 db 0f 84 5e 02 00 00 <4c> 3b 7b f8 0f 87 21 02 00 00 49 8b 45 08 4c 3b 70 e8 0f 82 13 02
RSP: 0018:ffffb5320479fa20 EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000004787af0 RCX: ffff0a00ffffff04
RDX: 0000000000000001 RSI: ffffb5320479fad8 RDI: ffff9995f50b95a0
RBP: ffffb5320479fad8 R08: ffffb5320479fad8 R09: ffff9997ee613d08
R10: ffff9995f50b9590 R11: 000000000000000f R12: ffff9995f50b95a0
R13: ffff9995f50b9590 R14: 0000000000000001 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff9996fbd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000004787ae8 CR3: 00000001065e4005 CR4: 00000000003706f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
<TASK>
? show_trace_log_lvl+0x1c4/0x2df
? show_trace_log_lvl+0x1c4/0x2df
? ll_file_io_generic+0x546/0x1090 [lustre]
? __die_body.cold+0x8/0xd
? page_fault_oops+0x134/0x170
? exc_page_fault+0x62/0x150
? asm_exc_page_fault+0x22/0x30
? range_lock+0x4c/0x2e0 [obdclass]
ll_file_io_generic+0x546/0x1090 [lustre]
? dequeue_task_fair+0xaa/0x370
do_file_write_iter+0x558/0x890 [lustre]
do_iter_readv_writev+0x127/0x190
do_iter_write+0x81/0x150
nfsd_vfs_write+0x191/0x620 [nfsd]
nfsd_write+0x87/0x170 [nfsd]
nfsd3_proc_write+0xd6/0x170 [nfsd]
nfsd_dispatch+0xe9/0x220 [nfsd]
svc_process_common+0x2e7/0x650 [sunrpc]
? __pfx_nfsd_dispatch+0x10/0x10 [nfsd]
svc_process+0x12d/0x170 [sunrpc]
svc_handle_xprt+0x448/0x580 [sunrpc]
svc_recv+0x17a/0x2c0 [sunrpc]
? __pfx_nfsd+0x10/0x10 [nfsd]
nfsd+0x84/0xb0 [nfsd]
kthread+0xe0/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x2c/0x50
</TASK>
Modules linked in: rpcrdma rdma_cm iw_cm ib_cm ib_core nfsd nfs_acl tls dm_flakey osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_ldiskfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) ldiskfs(OE) libcfs(OE) dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common pcspkr virtio_balloon i2c_piix4 joydev drm fuse ext4 mbcache jbd2 ata_generic ata_piix libata crct10dif_pclmul virtio_net crc32_pclmul crc32c_intel net_failover virtio_blk ghash_clmulni_intel failover serio_raw [last unloaded: dm_flakey]
CR2: 0000000004787ae8
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 2 -b -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 2 -b -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 2 -g -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 2 -g -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Lustre: DEBUG MARKER: /usr/sbin/lctl mark bash .\/runtests -N 2 -s -f \/mnt\/lustre\/d0.parallel-scale-nfs\/d0.connectathon
Lustre: DEBUG MARKER: bash ./runtests -N 2 -s -f /mnt/lustre/d0.parallel-scale-nfs/d0.connectathon
Link to test
Return to new crashes list