Editing crashreport #73994

ReasonCrashing FunctionWhere to cut BacktraceReports Count
general protection fault, rb_first_postorderfree_rb_tree_fname
ldiskfs_dx_readdir
ldiskfs_readdir
iterate_dir
osd_check_lmv
osd_fid_lookup
osd_object_init
lu_object_start
lu_object_find_at
dt_locate_at
out_handle
tgt_handle_request0
tgt_request_handle
ptlrpc_server_handle_request
ptlrpc_main
kthread
ret_from_fork
1

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
sanity test 60g: transaction abort won't cause MDT hung
general protection fault, probably for non-canonical address 0x5a5a5a5a5a5a5a6a: 0000 [#1] PREEMPT SMP NOPTI
CPU: 1 PID: 33166 Comm: mdt_out00_003 Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.16.3-2.el9_5.1 04/01/2014
RIP: 0010:rb_first_postorder+0xb/0x30
Code: 10 48 85 c0 75 f4 eb e9 0f 1f 80 00 00 00 00 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 90 48 8b 07 48 85 c0 74 1d 49 89 c0 <48> 8b 40 10 48 85 c0 75 f4 49 8b 40 08 48 85 c0 75 eb 4c 89 c0 e9
RSP: 0018:ff73f51fc905b970 EFLAGS: 00010206
RAX: 5a5a5a5a5a5a5a5a RBX: ff2399496fcb7e40 RCX: 0000000000000000
RDX: 0000000004000400 RSI: 0000000000000000 RDI: ff2399496fcb7e40
RBP: ff23994971a540c8 R08: 5a5a5a5a5a5a5a5a R09: 0000000000000000
R10: 0000000000020000 R11: 000000000000008c R12: ff2399496fcb7e40
R13: 0000000000000000 R14: ff23994943598620 R15: ff2399496a0b0800
FS: 0000000000000000(0000) GS:ff2399497bb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe42a6884e0 CR3: 00000000bd610003 CR4: 0000000000771ef0
PKRU: 55555554
Call Trace:
<TASK>
? srso_alias_return_thunk+0x5/0xfbef5
? show_trace_log_lvl+0x26e/0x2df
? show_trace_log_lvl+0x26e/0x2df
? free_rb_tree_fname+0x11/0x70 [ldiskfs]
? __die_body.cold+0x8/0xd
? die_addr+0x39/0x60
? exc_general_protection+0x1c8/0x420
? asm_exc_general_protection+0x22/0x30
? rb_first_postorder+0xb/0x30
free_rb_tree_fname+0x11/0x70 [ldiskfs]
ldiskfs_dx_readdir+0x171/0x360 [ldiskfs]
ldiskfs_readdir+0x63c/0x740 [ldiskfs]
? srso_alias_return_thunk+0x5/0xfbef5
? ldiskfs_xattr_get+0xd8/0x220 [ldiskfs]
iterate_dir+0x179/0x1c0
osd_check_lmv+0x2be/0x740 [osd_ldiskfs]
? __pfx_osd_stripe_dir_filldir+0x10/0x10 [osd_ldiskfs]
? osd_check_lma+0x11c/0x5d0 [osd_ldiskfs]
osd_fid_lookup+0xa2e/0x17c0 [osd_ldiskfs]
osd_object_init+0x93/0x1a0 [osd_ldiskfs]
lu_object_start+0x6e/0x110 [obdclass]
lu_object_find_at+0x36d/0x8a0 [obdclass]
dt_locate_at+0x18/0xa0 [obdclass]
out_handle+0x1284/0x1f50 [ptlrpc]
tgt_handle_request0+0x147/0x770 [ptlrpc]
tgt_request_handle+0x3fd/0xd00 [ptlrpc]
ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfbef5
ptlrpc_main+0x9e3/0xed0 [ptlrpc]
? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc]
kthread+0xdd/0x100
? __pfx_kthread+0x10/0x10
ret_from_fork+0x29/0x50
</TASK>
Modules linked in: osp(OE) mdd(OE) lod(OE) mdt(OE) lfsck(OE) mgs(OE) osd_ldiskfs(OE) lquota(OE) ldiskfs(OE) lustre(OE) obdecho(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) ec(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) dm_flakey dm_mod rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs rfkill sunrpc intel_rapl_msr intel_rapl_common kvm_amd ccp kvm i2c_piix4 pcspkr virtio_balloon joydev fuse drm ext4 mbcache jbd2 ata_generic crct10dif_pclmul ata_piix crc32_pclmul crc32c_intel virtio_net libata ghash_clmulni_intel net_failover virtio_blk failover serio_raw [last unloaded: llog_test(OE)]
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: *** cfs_fail_loc=19a, val=0***
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: *** cfs_fail_loc=19a, val=0***
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: *** cfs_fail_loc=19a, val=0***
Lustre: Skipped 1 previous similar message
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: *** cfs_fail_loc=19a, val=0***
Lustre: Skipped 2 previous similar messages
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: *** cfs_fail_loc=19a, val=0***
Lustre: Skipped 5 previous similar messages
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: *** cfs_fail_loc=19a, val=0***
Lustre: Skipped 11 previous similar messages
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: *** cfs_fail_loc=19a, val=0***
Lustre: Skipped 22 previous similar messages
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x8000019a
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0
Lustre: DEBUG MARKER: /usr/sbin/lctl lfsck_start -M lustre-MDT0000 -A -C -t namespace
Link to test
Return to new crashes list