Editing crashreport #73745

ReasonCrashing FunctionWhere to cut BacktraceReports Count
ASSERTION( !old ) failedlu_env_add_tasklu_env_add_task
ldlm_revoke_export_locks
nm_member_revoke_locks_always
nm_member_revoke_all
nodemap_activate
server_iocontrol_nodemap
mgs_iocontrol_nodemap
mgs_iocontrol
class_handle_ioctl
obd_class_ioctl
do_vfs_ioctl
ksys_ioctl
__x64_sys_ioctl
do_syscall_64
entry_SYSCALL_64_after_hwframe
3

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
sanity-selinux test 21a: Send sepol at connect
LustreError: 35192:0:(lu_object.c:1915:lu_env_add_task()) ASSERTION( !old ) failed:
LustreError: 35192:0:(lu_object.c:1915:lu_env_add_task()) LBUG
CPU: 1 PID: 35192 Comm: lctl Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lu_env_add_task+0x25b/0x370 [obdclass]
ldlm_revoke_export_locks+0x1e3/0x390 [ptlrpc]
nm_member_revoke_locks_always+0x43/0x70 [ptlrpc]
nm_member_revoke_all+0x6f/0xc0 [ptlrpc]
nodemap_activate+0x48/0xb0 [ptlrpc]
server_iocontrol_nodemap+0xe6e/0x1720 [ptlrpc]
? lu_env_add_task+0x38/0x370 [obdclass]
? kmem_cache_alloc_trace+0x142/0x280
mgs_iocontrol_nodemap+0x6d/0x7b0 [mgs]
mgs_iocontrol+0x7a8/0xf80 [mgs]
class_handle_ioctl+0xe4e/0x1c30 [obdclass]
? bpf_lsm_capset+0x10/0x10
? security_capable+0x38/0x60
obd_class_ioctl+0x13b/0x190 [obdclass]
do_vfs_ioctl+0xa4/0x690
? syscall_trace_enter+0x1ff/0x2d0
ksys_ioctl+0x64/0xa0
__x64_sys_ioctl+0x16/0x20
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fe876c7722b
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_activate 1
Link to test
sanity-sec test 15: test id mapping
LustreError: 170097:0:(lu_object.c:1915:lu_env_add_task()) ASSERTION( !old ) failed:
LustreError: 170097:0:(lu_object.c:1915:lu_env_add_task()) LBUG
CPU: 0 PID: 170097 Comm: lctl Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lu_env_add_task+0x25b/0x370 [obdclass]
ldlm_revoke_export_locks+0x1e3/0x390 [ptlrpc]
nm_member_revoke_locks_always+0x43/0x70 [ptlrpc]
nm_member_revoke_all+0x6f/0xc0 [ptlrpc]
nodemap_activate+0x48/0xb0 [ptlrpc]
server_iocontrol_nodemap+0xa5b/0x1720 [ptlrpc]
? lu_env_add_task+0x38/0x370 [obdclass]
? kmem_cache_alloc_trace+0x142/0x280
mgs_iocontrol_nodemap+0x6d/0x7b0 [mgs]
mgs_iocontrol+0x7a8/0xf80 [mgs]
class_handle_ioctl+0xe4e/0x1c30 [obdclass]
? bpf_lsm_capset+0x10/0x10
? security_capable+0x38/0x60
obd_class_ioctl+0x13b/0x190 [obdclass]
do_vfs_ioctl+0xa4/0x690
? syscall_trace_enter+0x1ff/0x2d0
ksys_ioctl+0x64/0xa0
__x64_sys_ioctl+0x16/0x20
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7feb0687b22b
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap modify --property squash_uid --name default --value 65534
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.squash_uid
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap modify --property squash_gid --name default --value 65534
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.squash_gid
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add 41572_0
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.41572_0.id 2>/dev/null | grep -c 41572_0 || true
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add 41572_1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.41572_1.id 2>/dev/null | grep -c 41572_1 || true
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add 41572_2
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.41572_2.id 2>/dev/null | grep -c 41572_2 || true
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.41572_0.id
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.41572_1.id
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.41572_2.id
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name 41572_0 --property admin --value 0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name 41572_0 --property trusted --value 0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name 41572_1 --property admin --value 0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name 41572_1 --property trusted --value 0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name 41572_2 --property admin --value 0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name 41572_2 --property trusted --value 0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_range --name 41572_0 --range 73.0.0.[1-253]@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_range --name 41572_0 --range 73.0.1.[1-253]@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_range --name 41572_1 --range 73.1.0.[1-253]@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_range --name 41572_1 --range 73.1.1.[1-253]@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_range --name 41572_2 --range 73.2.0.[1-253]@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_range --name 41572_2 --range 73.2.1.[1-253]@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype uid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype gid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype projid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype uid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype gid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype projid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype uid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype gid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_0 --idtype projid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype uid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype gid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype projid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype uid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype gid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype projid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype uid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype gid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_1 --idtype projid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype uid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype gid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype projid --idmap 500:501
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype uid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype gid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype projid --idmap 501:502
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype uid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype gid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap add_idmap --name 41572_2 --idtype projid --idmap 502:503
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap activate 0
Link to test
sanity-quota test 1j: Enable project quota enforcement for root
LustreError: 62576:0:(lu_object.c:1915:lu_env_add_task()) ASSERTION( !old ) failed:
LustreError: 62576:0:(lu_object.c:1915:lu_env_add_task()) LBUG
CPU: 0 PID: 62576 Comm: lctl Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lu_env_add_task+0x25b/0x370 [obdclass]
ldlm_revoke_export_locks+0x1e3/0x390 [ptlrpc]
nm_member_revoke_locks_always+0x43/0x70 [ptlrpc]
nm_member_revoke_all+0x6f/0xc0 [ptlrpc]
nodemap_activate+0x48/0xb0 [ptlrpc]
server_iocontrol_nodemap+0xe6e/0x1720 [ptlrpc]
? lu_env_add_task+0x38/0x370 [obdclass]
mgs_iocontrol_nodemap+0x6d/0x7b0 [mgs]
mgs_iocontrol+0x7a8/0xf80 [mgs]
class_handle_ioctl+0xe4e/0x1c30 [obdclass]
? bpf_lsm_capset+0x10/0x10
? security_capable+0x38/0x60
obd_class_ioctl+0x13b/0x190 [obdclass]
do_vfs_ioctl+0xa4/0x690
? syscall_trace_enter+0x1ff/0x2d0
ksys_ioctl+0x64/0xa0
__x64_sys_ioctl+0x16/0x20
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7efe478ee22b
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osp.*.destroys_in_flight
Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0
Lustre: DEBUG MARKER: /usr/sbin/lctl conf_param lustre.quota.ost=ugp
Lustre: DEBUG MARKER: /usr/sbin/lctl mark --------------------------------------
Lustre: DEBUG MARKER: --------------------------------------
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Project quota \(block hardlimit:40 mb\)
Lustre: DEBUG MARKER: Project quota (block hardlimit:40 mb)
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.default.admin_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.default.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add test_1j
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name test_1j --range 10.240.26.76@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name test_1j --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name test_1j --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name test_1j --property rbac --value file_perms,dne_ops,quota_ops,byfid_ops,chlg_ops
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_activate 1
Link to test
Return to new crashes list