Editing crashreport #73686

ReasonCrashing FunctionWhere to cut BacktraceReports Count
general protection fault, spin_dumpdo_raw_spin_lock
_raw_spin_lock_irq
rwsem_down_write_slowpath
down_write
llog_cat_add_rec
llog_add
sub_updates_write
top_trans_stop
lod_trans_stop
mdd_trans_stop
mdd_unlink
mdt_reint_unlink
mdt_reint_rec
mdt_reint_internal
mdt_reint
tgt_handle_request0
tgt_request_handle
ptlrpc_server_handle_request
ptlrpc_main
kthread
ret_from_fork
3

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
sanityn test 12: test lock ordering (link, stat, unlink)
general protection fault, probably for non-canonical address 0x5a5a5a5a5a5a5a5a: 0000 [#1] SMP DEBUG_PAGEALLOC
CPU: 8 PID: 2346883 Comm: mdt00_002 Kdump: loaded Tainted: G W O -------- - - 4.18.0rocky8.10-debug #1
Hardware name: Red Hat KVM, BIOS 1.16.0-4.module+el8.9.0+1408+7b966129 04/01/2014
RIP: 0010:spin_dump.cold.3+0x3d/0x65
Code: 8b 55 04 48 89 ee 48 c7 c7 a0 61 98 96 e8 d8 63 01 00 48 83 05 58 99 dc 02 01 e8 34 ec de 00 48 83 05 53 99 dc 02 01 5b 5d c3 <44> 8b 83 38 08 00 00 48 83 05 21 99 dc 02 01 48 8d 8b 40 0a 00 00
RSP: 0018:ffffa027539a78e0 EFLAGS: 00010006
RAX: 0000000000000033 RBX: 5a5a5a5a5a5a5a5a RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff8b893241e5a8 RDI: ffff8b893241e5a8
RBP: ffff8b88609dfc18 R08: 0000000000000000 R09: 000000005a5a5a5a
R10: fffffffffff86980 R11: ffffa027539a76d8 R12: ffffa027539a7930
R13: ffffffff97f6bfa0 R14: ffff8b88609dfc00 R15: ffff8b88609dfc08
FS: 0000000000000000(0000) GS:ffff8b8932400000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fb55f57f860 CR3: 000000028433b000 CR4: 00000000000006e0
Call Trace:
? show_regs.cold.9+0x22/0x2f
? __die_body+0x22/0x90
? die_addr+0x50/0x90
? do_general_protection+0x208/0x420
? general_protection+0x1e/0x30
? spin_dump.cold.3+0x3d/0x65
do_raw_spin_lock+0xce/0x190
_raw_spin_lock_irq+0x40/0x50
rwsem_down_write_slowpath+0x612/0xa40
down_write+0x80/0xd0
llog_cat_add_rec+0xfd/0x1080 [obdclass]
llog_add+0x259/0x280 [obdclass]
sub_updates_write+0xa5d/0x18a0 [ptlrpc]
? top_trans_stop+0x3cd/0x1600 [ptlrpc]
top_trans_stop+0x3cd/0x1600 [ptlrpc]
? __might_sleep+0x59/0xc0
lod_trans_stop+0xe2/0x560 [lod]
mdd_trans_stop+0x29/0x1f0 [mdd]
mdd_unlink+0xbd1/0x1380 [mdd]
mdt_reint_unlink+0x14aa/0x1a30 [mdt]
mdt_reint_rec+0x139/0x2b0 [mdt]
mdt_reint_internal+0x6a0/0xdc0 [mdt]
mdt_reint+0x163/0x190 [mdt]
tgt_handle_request0+0x137/0xaf0 [ptlrpc]
tgt_request_handle+0x573/0x1e70 [ptlrpc]
ptlrpc_server_handle_request+0x443/0x13b0 [ptlrpc]
? lprocfs_counter_add+0x15b/0x210 [obdclass]
ptlrpc_main+0xd30/0x1450 [ptlrpc]
? ptlrpc_wait_event+0x980/0x980 [ptlrpc]
kthread+0x1d1/0x200
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) osd_zfs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) loop ec(O) crc32_generic zfs(O) spl(O) virtio_balloon i2c_piix4 pcspkr rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver ata_generic ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: libcfs]
Lustre: DEBUG MARKER: start dir: /mnt/lustre/lockdir=162129603815538692 file: /mnt/lustre/lockdir/lockfile=144115205306056732
Lustre: lustre-OST0001-osc-ffff8b870487a000: disconnect after 22s idle
BUG: spinlock bad magic on CPU#8, mdt00_002/2346883
Link to test
sanityn test 12: test lock ordering (link, stat, unlink)
general protection fault, probably for non-canonical address 0x5a5a5a5a5a5a5a5a: 0000 [#1] SMP DEBUG_PAGEALLOC
CPU: 8 PID: 1139226 Comm: mdt00_005 Kdump: loaded Tainted: G W O -------- - - 4.18.0rocky8.10-debug #1
Hardware name: Red Hat KVM, BIOS 1.16.0-4.module+el8.9.0+1408+7b966129 04/01/2014
RIP: 0010:spin_dump.cold.3+0x3d/0x65
Code: 8b 55 04 48 89 ee 48 c7 c7 a0 61 58 84 e8 d8 63 01 00 48 83 05 58 99 dc 02 01 e8 34 ec de 00 48 83 05 53 99 dc 02 01 5b 5d c3 <44> 8b 83 38 08 00 00 48 83 05 21 99 dc 02 01 48 8d 8b 40 0a 00 00
RSP: 0018:ffffa9c5fe3b38e0 EFLAGS: 00010006
RAX: 0000000000000033 RBX: 5a5a5a5a5a5a5a5a RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff9258b241e5a8 RDI: ffff9258b241e5a8
RBP: ffff925722d6b618 R08: 0000000000000000 R09: 000000005a5a5a5a
R10: 0000000000000001 R11: ffffa9c5fe3b36d8 R12: ffffa9c5fe3b3930
R13: ffffffff85b6bfa0 R14: ffff925722d6b600 R15: ffff925722d6b608
FS: 0000000000000000(0000) GS:ffff9258b2400000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe075a9e000 CR3: 000000011184d000 CR4: 00000000000006e0
Call Trace:
? show_regs.cold.9+0x22/0x2f
? __die_body+0x22/0x90
? die_addr+0x50/0x90
? do_general_protection+0x208/0x420
? general_protection+0x1e/0x30
? spin_dump.cold.3+0x3d/0x65
do_raw_spin_lock+0xce/0x190
_raw_spin_lock_irq+0x40/0x50
rwsem_down_write_slowpath+0x612/0xa40
? sub_updates_write+0x8d0/0x18a0 [ptlrpc]
down_write+0x80/0xd0
llog_cat_add_rec+0xfd/0x1080 [obdclass]
llog_add+0x259/0x280 [obdclass]
sub_updates_write+0xa5d/0x18a0 [ptlrpc]
? top_trans_stop+0x3c9/0x1600 [ptlrpc]
top_trans_stop+0x3c9/0x1600 [ptlrpc]
? __might_sleep+0x59/0xc0
lod_trans_stop+0xe2/0x560 [lod]
mdd_trans_stop+0x29/0x1f0 [mdd]
mdd_unlink+0xbd1/0x1380 [mdd]
mdt_reint_unlink+0x14aa/0x1a30 [mdt]
mdt_reint_rec+0x139/0x2b0 [mdt]
mdt_reint_internal+0x6a0/0xdc0 [mdt]
mdt_reint+0x163/0x190 [mdt]
tgt_handle_request0+0x137/0xaf0 [ptlrpc]
tgt_request_handle+0x351/0x1c00 [ptlrpc]
ptlrpc_server_handle_request+0x443/0x13b0 [ptlrpc]
? lprocfs_counter_add+0x15b/0x210 [obdclass]
ptlrpc_main+0xd30/0x1450 [ptlrpc]
? ptlrpc_wait_event+0x980/0x980 [ptlrpc]
kthread+0x1d1/0x200
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) osd_zfs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) loop ec(O) crc32_generic zfs(O) spl(O) i2c_piix4 virtio_balloon pcspkr rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver ata_generic ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: libcfs]
Lustre: DEBUG MARKER: start dir: /mnt/lustre/lockdir=162129603815538692 file: /mnt/lustre/lockdir/lockfile=144115205306056731
Lustre: lustre-OST0002-osc-ffff9257f8e50800: disconnect after 20s idle
BUG: spinlock bad magic on CPU#8, mdt00_005/1139226
Link to test
sanityn test 12: test lock ordering (link, stat, unlink)
general protection fault, probably for non-canonical address 0x5a5a5a5a5a5a5a5a: 0000 [#1] SMP DEBUG_PAGEALLOC
CPU: 0 PID: 3084672 Comm: mdt00_000 Kdump: loaded Tainted: G W O -------- - - 4.18.0rocky8.10-debug #1
Hardware name: Red Hat KVM, BIOS 1.16.0-4.module+el8.9.0+1408+7b966129 04/01/2014
RIP: 0010:spin_dump.cold.3+0x3d/0x65
Code: 8b 55 04 48 89 ee 48 c7 c7 a0 61 d8 b4 e8 d8 63 01 00 48 83 05 58 99 dc 02 01 e8 34 ec de 00 48 83 05 53 99 dc 02 01 5b 5d c3 <44> 8b 83 38 08 00 00 48 83 05 21 99 dc 02 01 48 8d 8b 40 0a 00 00
RSP: 0018:ffff999cd2d0b8e0 EFLAGS: 00010006
RAX: 0000000000000033 RBX: 5a5a5a5a5a5a5a5a RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff8912f221e5a8 RDI: ffff8912f221e5a8
RBP: ffff891275d42418 R08: 0000000000000000 R09: 000000005a5a5a5a
R10: 0000000000000001 R11: ffff999cd2d0b6d8 R12: ffff999cd2d0b930
R13: ffffffffb636bfa0 R14: ffff891275d42400 R15: ffff891275d42408
FS: 0000000000000000(0000) GS:ffff8912f2200000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f8ffa3ae3e0 CR3: 000000010514d000 CR4: 00000000000006f0
Call Trace:
? show_regs.cold.9+0x22/0x2f
? __die_body+0x22/0x90
? die_addr+0x50/0x90
? do_general_protection+0x208/0x420
? general_protection+0x1e/0x30
? spin_dump.cold.3+0x3d/0x65
do_raw_spin_lock+0xce/0x190
_raw_spin_lock_irq+0x40/0x50
rwsem_down_write_slowpath+0x612/0xa40
down_write+0x80/0xd0
llog_cat_add_rec+0xfd/0x1080 [obdclass]
llog_add+0x259/0x280 [obdclass]
sub_updates_write+0xa5d/0x18a0 [ptlrpc]
? top_trans_stop+0x3c9/0x1600 [ptlrpc]
top_trans_stop+0x3c9/0x1600 [ptlrpc]
? __might_sleep+0x59/0xc0
lod_trans_stop+0xe2/0x560 [lod]
mdd_trans_stop+0x29/0x1f0 [mdd]
mdd_unlink+0xbd1/0x1380 [mdd]
mdt_reint_unlink+0x14aa/0x1a30 [mdt]
mdt_reint_rec+0x139/0x2b0 [mdt]
mdt_reint_internal+0x6a0/0xdc0 [mdt]
mdt_reint+0x163/0x190 [mdt]
tgt_handle_request0+0x137/0xaf0 [ptlrpc]
tgt_request_handle+0x351/0x1c00 [ptlrpc]
ptlrpc_server_handle_request+0x443/0x13b0 [ptlrpc]
? lprocfs_counter_add+0x15b/0x210 [obdclass]
ptlrpc_main+0xd30/0x1450 [ptlrpc]
? ptlrpc_wait_event+0x980/0x980 [ptlrpc]
kthread+0x1d1/0x200
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
Modules linked in: lustre(O) osp(O) ofd(O) lod(O) mdt(O) mdd(O) mgs(O) osd_zfs(O) lquota(O) lfsck(O) obdecho(O) mgc(O) mdc(O) lov(O) osc(O) lmv(O) fid(O) fld(O) ptlrpc_gss(O) ptlrpc(O) obdclass(O) ksocklnd(O) lnet(O) libcfs(O) loop crc32_generic zfs(O) spl(O) virtio_balloon pcspkr i2c_piix4 rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver ata_generic ata_piix serio_raw libata dm_mirror dm_region_hash dm_log dm_mod sha512_ssse3 sha512_generic [last unloaded: libcfs]
Lustre: DEBUG MARKER: start dir: /mnt/lustre/lockdir=162129603815538692 file: /mnt/lustre/lockdir/lockfile=144115205306056731
Lustre: lustre-OST0000-osc-ffff8911bc156000: disconnect after 20s idle
BUG: spinlock bad magic on CPU#0, mdt00_000/3084672
Link to test
Return to new crashes list