BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 0 PID: 1154172 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffff9fa3c297f920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff9fa3c297faa8
RBP: ffff9fa3c297fa00 R08: ffffffffc09bde30 R09: 0000000000000001
R10: ffff9fa3c297fa20 R11: ffffffffc09c2340 R12: ffff91cb48f56500
R13: 0000000000000000 R14: ffff91cb329e7800 R15: ffff91cb57298c00
FS: 0000000000000000(0000) GS:ffff91cb7fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 000000002b410004 CR4: 00000000000606f0
Call Trace:
? ttwu_do_wakeup+0x19/0x170
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev pcspkr virtio_balloon i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata virtio_net crc32c_intel virtio_blk serio_raw net_failover failover [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 1 PID: 1155526 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffb971c1787920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffb971c1787aa8
RBP: ffffb971c1787a00 R08: ffffffffc0aace30 R09: 0000000000000001
R10: ffffb971c1787a20 R11: ffffffffc0ab1340 R12: ffff8bb090d1c230
R13: 0000000000000000 R14: ffff8bb0d182aa00 R15: ffff8bb0d49f4a80
FS: 0000000000000000(0000) GS:ffff8bb0ffd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 0000000025810001 CR4: 00000000000606e0
Call Trace:
? ttwu_do_wakeup+0x19/0x170
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev pcspkr virtio_balloon i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata crc32c_intel virtio_net serio_raw virtio_blk net_failover failover [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0
Autotest: Test running for 205 minutes (lustre-master_rolling-upgrade-client1-zfs_4522.163)

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 0 PID: 1151591 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffa489c28ef920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa489c28efaa8
RBP: ffffa489c28efa00 R08: ffffffffc081ce30 R09: 0000000000000001
R10: ffffa489c28efa20 R11: ffffffffc0821340 R12: ffff89422ae4d3c0
R13: 0000000000000000 R14: ffff8942459f9200 R15: ffff89421f305380
FS: 0000000000000000(0000) GS:ffff89427fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 000000009d010004 CR4: 00000000000606f0
Call Trace:
? ttwu_do_wakeup+0x19/0x170
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcspkr joydev i2c_piix4 virtio_balloon sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix virtio_net libata crc32c_intel serio_raw net_failover failover virtio_blk [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 1 PID: 1136890 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffb14b4248b920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffb14b4248baa8
RBP: ffffb14b4248ba00 R08: ffffffffc0a7fe30 R09: 0000000000000001
R10: ffffb14b4248ba20 R11: ffffffffc0a84340 R12: ffff907e478fecd0
R13: 0000000000000000 R14: ffff907e72592c00 R15: ffff907e84deed80
FS: 0000000000000000(0000) GS:ffff907ebfd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 0000000045010004 CR4: 00000000001706e0
Call Trace:
? ttwu_do_wakeup+0x19/0x170
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev pcspkr virtio_balloon i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata virtio_net crc32c_intel serio_raw net_failover virtio_blk failover [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 1 PID: 980911 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffaced823af920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffaced823afaa8
RBP: ffffaced823afa00 R08: ffffffffc08ede30 R09: 0000000000000001
R10: ffffaced823afa20 R11: ffffffffc08f2340 R12: ffff9eb53d369370
R13: 0000000000000000 R14: ffff9eb528f20a00 R15: ffff9eb53263b500
FS: 0000000000000000(0000) GS:ffff9eb57cd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 00000000b0c10005 CR4: 00000000000606e0
Call Trace:
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev pcspkr virtio_balloon i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix crc32c_intel libata serio_raw virtio_net virtio_blk net_failover failover [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 0 PID: 982340 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffb56a424d3920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffb56a424d3aa8
RBP: ffffb56a424d3a00 R08: ffffffffc08e3e30 R09: 0000000000000001
R10: ffffb56a424d3a20 R11: ffffffffc08e8340 R12: ffff92730431d140
R13: 0000000000000000 R14: ffff9273034d3600 R15: ffff92739b796c00
FS: 0000000000000000(0000) GS:ffff9273bfc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 0000000008a10005 CR4: 00000000001706f0
Call Trace:
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 intel_rapl_msr dns_resolver nfs lockd grace fscache intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_balloon pcspkr joydev i2c_piix4 sunrpc dm_mod ata_generic ext4 mbcache jbd2 ata_piix libata virtio_net crc32c_intel net_failover failover serio_raw virtio_blk [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 0 PID: 991511 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffab6601c73920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffab6601c73aa8
RBP: ffffab6601c73a00 R08: ffffffffc0778e30 R09: 0000000000000001
R10: ffffab6601c73a20 R11: ffffffffc077d340 R12: ffff9bdfb7b907d0
R13: 0000000000000000 R14: ffff9bdfbf9a1e00 R15: ffff9bdfb21a1200
FS: 0000000000000000(0000) GS:ffff9bdfffc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 0000000010810003 CR4: 00000000001706f0
Call Trace:
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common joydev pcspkr crct10dif_pclmul crc32_pclmul ghash_clmulni_intel virtio_balloon i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix crc32c_intel virtio_net libata serio_raw net_failover virtio_blk failover [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 0 PID: 989187 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffac28028a3920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffac28028a3aa8
RBP: ffffac28028a3a00 R08: ffffffffc09c5e30 R09: 0000000000000001
R10: ffffac28028a3a20 R11: ffffffffc09ca340 R12: ffff98e6d6244c80
R13: 0000000000000000 R14: ffff98e6bd79fe00 R15: ffff98e6bd6ad980
FS: 0000000000000000(0000) GS:ffff98e6ffc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 0000000050410001 CR4: 00000000001706f0
Call Trace:
? ttwu_do_wakeup+0x19/0x170
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? update_load_avg+0x7e/0x710
? update_load_avg+0x7e/0x710
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev pcspkr virtio_balloon i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic crc32c_intel serio_raw ata_piix libata virtio_net virtio_blk net_failover failover [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 0 PID: 978083 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffa681422df920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa681422dfaa8
RBP: ffffa681422dfa00 R08: ffffffffc0aa5e30 R09: 0000000000000001
R10: ffffa681422dfa20 R11: ffffffffc0aaa340 R12: ffff9b6d6127e460
R13: 0000000000000000 R14: ffff9b6d469c6e00 R15: ffff9b6d32476780
FS: 0000000000000000(0000) GS:ffff9b6d7fc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 0000000075e10002 CR4: 00000000000606f0
Call Trace:
? ttwu_do_wakeup+0x19/0x170
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev virtio_balloon pcspkr i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata crc32c_intel serio_raw virtio_net net_failover failover virtio_blk [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 0 PID: 988439 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffa8db81a67920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa8db81a67aa8
RBP: ffffa8db81a67a00 R08: ffffffffc0ab8e30 R09: 0000000000000001
R10: ffffa8db81a67a20 R11: ffffffffc0abd340 R12: ffff9d9eb201c460
R13: 0000000000000000 R14: ffff9d9e6fe8da00 R15: ffff9d9e86baf800
FS: 0000000000000000(0000) GS:ffff9d9effc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 0000000061810006 CR4: 00000000001706f0
Call Trace:
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcspkr virtio_balloon joydev i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata crc32c_intel virtio_net net_failover serio_raw failover virtio_blk [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 1 PID: 982843 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.21.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffff99cd825bb920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff99cd825bbaa8
RBP: ffff99cd825bba00 R08: ffffffffc092ee30 R09: 0000000000000001
R10: ffff99cd825bba20 R11: ffffffffc0933340 R12: ffff88b7b1dbdc30
R13: 0000000000000000 R14: ffff88b7d8408e00 R15: ffff88b7b8d4a180
FS: 0000000000000000(0000) GS:ffff88b7ffd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 00000000bbe10002 CR4: 00000000000606e0
Call Trace:
? ttwu_do_wakeup+0x19/0x170
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev pcspkr virtio_balloon i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic virtio_net crc32c_intel ata_piix serio_raw libata net_failover failover virtio_blk [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 1 PID: 984256 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.15.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffff9cd042117920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff9cd042117aa8
RBP: ffff9cd042117a00 R08: ffffffffc099ce30 R09: 0000000000000001
R10: ffff9cd042117a20 R11: ffffffffc09a1340 R12: ffff9111ba548d70
R13: 0000000000000000 R14: ffff9111a96d5000 R15: ffff9111cf410600
FS: 0000000000000000(0000) GS:ffff9111ffd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 00000000a3610001 CR4: 00000000001706e0
Call Trace:
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev virtio_balloon pcspkr i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata crc32c_intel virtio_net serio_raw net_failover failover virtio_blk [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 1 PID: 846359 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.15.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffaaf401203920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffaaf401203aa8
RBP: ffffaaf401203a00 R08: ffffffffc0a8fe30 R09: 0000000000000001
R10: ffffaaf401203a20 R11: ffffffffc0a94340 R12: ffff9dc5ad8cb320
R13: 0000000000000000 R14: ffff9dc5de683e00 R15: ffff9dc5c927f980
FS: 0000000000000000(0000) GS:ffff9dc5ffd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 00000000a1610003 CR4: 00000000000606e0
Call Trace:
? ttwu_do_wakeup+0x19/0x170
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? update_load_avg+0x7e/0x710
? update_load_avg+0x7e/0x710
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcspkr virtio_balloon joydev i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic virtio_net crc32c_intel ata_piix virtio_blk serio_raw libata net_failover failover [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0

BUG: unable to handle kernel NULL pointer dereference at 0000000000000028
PGD 0 P4D 0
Oops: 0002 [#1] SMP PTI
CPU: 0 PID: 848219 Comm: dp_sync_taskq Kdump: loaded Tainted: P W OE --------- - - 4.18.0-477.15.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:arc_write+0xf5/0x460 [zfs]
Code: 28 48 89 55 a0 48 8b 50 30 48 89 55 a8 48 8b 50 38 48 89 55 b0 48 8b 50 40 48 8b 40 48 48 89 55 b8 48 89 45 c0 45 85 c9 74 04 <83> 4b 28 10 41 8b 44 24 48 a8 04 0f 84 46 02 00 00 b8 00 00 00 01
RSP: 0018:ffffb1ff81843920 EFLAGS: 00010202
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000000
RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffb1ff81843aa8
RBP: ffffb1ff81843a00 R08: ffffffffc0803e30 R09: 0000000000000001
R10: ffffb1ff81843a20 R11: ffffffffc0808340 R12: ffff9c3471496820
R13: 0000000000000000 R14: ffff9c342cd96200 R15: ffff9c34688ef080
FS: 0000000000000000(0000) GS:ffff9c34bfc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000000028 CR3: 0000000008410003 CR4: 00000000000606f0
Call Trace:
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
? dbuf_write+0x2ff/0x550 [zfs]
dbuf_write+0x2ff/0x550 [zfs]
? dmu_buf_unlock_parent+0x70/0x70 [zfs]
? dbuf_issue_final_prefetch+0xf0/0xf0 [zfs]
? dmu_buf_rele+0x10/0x10 [zfs]
dbuf_sync_leaf+0x137/0x660 [zfs]
? dnode_rele_and_unlock+0x64/0xd0 [zfs]
dbuf_sync_list+0xcf/0x120 [zfs]
dbuf_sync_indirect+0xe2/0x170 [zfs]
dbuf_sync_list+0xae/0x120 [zfs]
dnode_sync+0x365/0xa20 [zfs]
? _cond_resched+0x15/0x30
sync_dnodes_task+0x71/0xa0 [zfs]
taskq_thread+0x2e1/0x510 [spl]
? wake_up_q+0x70/0x70
? taskq_thread_spawn+0x50/0x50 [spl]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) mgc(OE) osd_zfs(OE) lquota(OE) lustre(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ksocklnd(OE) ptlrpc(OE) obdclass(OE) lnet(OE) libcfs(OE) zfs(POE) zunicode(POE) zzstd(OE) zlua(OE) zavl(POE) icp(POE) zcommon(POE) znvpair(POE) spl(OE) rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache intel_rapl_msr intel_rapl_common crct10dif_pclmul crc32_pclmul ghash_clmulni_intel joydev virtio_balloon pcspkr i2c_piix4 sunrpc dm_mod ext4 mbcache jbd2 ata_generic ata_piix libata crc32c_intel serio_raw virtio_net virtio_blk net_failover failover [last unloaded: llog_test]
CR2: 0000000000000028

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x131a fail_val=1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n debug
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=0