Editing crashreport #73751

ReasonCrashing FunctionWhere to cut BacktraceReports Count
ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failedll_flushll_flush
filp_close
__x64_sys_close
do_syscall_64
entry_SYSCALL_64_after_hwframe
8

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
sanity-lfsck test 3: LFSCK can verify multiple-linked objects
LustreError: 197602:0:(file.c:4961:ll_flush()) ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failed:
LustreError: 197602:0:(file.c:4961:ll_flush()) LBUG
CPU: 0 PID: 197602 Comm: rm Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
ll_flush+0x99/0xa0 [lustre]
filp_close+0x31/0x70
__x64_sys_close+0xe/0x40
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f1e0ea946cb
Link to test
sanity-sec test 54: Encryption policies with fscrypt
LustreError: 510784:0:(file.c:4961:ll_flush()) ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failed:
LustreError: 510784:0:(file.c:4961:ll_flush()) LBUG
CPU: 1 PID: 510784 Comm: ls Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
ll_flush+0x99/0xa0 [lustre]
filp_close+0x31/0x70
__x64_sys_close+0xe/0x40
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7ff456ebc6cb
Lustre: 509725:0:(policy.c:345:llcrypt_ioctl_set_policy()) inode 198158702774059009: forcing policy filenames_encryption_mode to null
Lustre: 509730:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) inode 198158702774059009: returning policy filenames_encryption_mode as 4, but is in fact null
Lustre: 509845:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) inode 198158702774059009: returning policy filenames_encryption_mode as 4, but is in fact null
Lustre: 509845:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) Skipped 2 previous similar messages
Lustre: 510063:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) inode 198158702774059009: returning policy filenames_encryption_mode as 4, but is in fact null
Lustre: DEBUG MARKER: grep -c /mnt/lustre' ' /proc/mounts
Lustre: DEBUG MARKER: lsof -t /mnt/lustre
Lustre: DEBUG MARKER: umount /mnt/lustre 2>&1
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock trevis-36vm6@tcp:/lustre /mnt/lustre
Lustre: DEBUG MARKER: lctl get_param -n mdc.lustre-MDT0000*.import
Lustre: DEBUG MARKER: ! grep -q /mnt/lustre' ' /proc/mounts ||
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock trevis-36vm6@tcp:/lustre/d54.sanity-sec /mnt/lustre
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n llite.*.enable_filename_encryption | head -n1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n llite.*.enable_filename_encryption | head -n1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n llite.*.enable_filename_encryption | head -n1
Lustre: DEBUG MARKER: grep -c /mnt/lustre' ' /proc/mounts
Lustre: DEBUG MARKER: lsof -t /mnt/lustre
Lustre: DEBUG MARKER: umount /mnt/lustre 2>&1
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock trevis-36vm6@tcp:/lustre /mnt/lustre
Lustre: DEBUG MARKER: lctl get_param -n mdc.lustre-MDT0000*.import
Lustre: DEBUG MARKER: ! grep -q /mnt/lustre' ' /proc/mounts ||
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock trevis-36vm6@tcp:/lustre/d54.sanity-sec/vault /mnt/lustre
Lustre: DEBUG MARKER: grep -c /mnt/lustre' ' /proc/mounts
Lustre: DEBUG MARKER: lsof -t /mnt/lustre
Lustre: DEBUG MARKER: umount /mnt/lustre 2>&1
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock trevis-36vm6@tcp:/lustre /mnt/lustre
Link to test
sanity-lipe test 3: lipe_find -fid works
LustreError: 369961:0:(file.c:4961:ll_flush()) ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failed:
LustreError: 369961:0:(file.c:4961:ll_flush()) LBUG
CPU: 1 PID: 369961 Comm: ls Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
ll_flush+0x99/0xa0 [lustre]
filp_close+0x31/0x70
__x64_sys_close+0xe/0x40
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f92c1e196cb
Link to test
hot-pools test 2: lamigo: start with configuration file
LustreError: 47979:0:(file.c:4961:ll_flush()) ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failed:
LustreError: 47979:0:(file.c:4961:ll_flush()) LBUG
CPU: 0 PID: 47979 Comm: lfs Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
ll_flush+0x99/0xa0 [lustre]
filp_close+0x31/0x70
__x64_sys_close+0xe/0x40
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fa7cd7387c5
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.fast 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.fast | sort -u | tr '\n' ' '
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.slow 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.slow | sort -u | tr '\n' ' '
Link to test
sanity-sec test 54: Encryption policies with fscrypt
LustreError: 796372:0:(file.c:4961:ll_flush()) ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failed:
LustreError: 796372:0:(file.c:4961:ll_flush()) LBUG
CPU: 1 PID: 796372 Comm: ls Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
ll_flush+0x99/0xa0 [lustre]
filp_close+0x31/0x70
__x64_sys_close+0xe/0x40
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f99db50f6cb
Lustre: 793099:0:(policy.c:345:llcrypt_ioctl_set_policy()) inode 198158602228203521: forcing policy filenames_encryption_mode to null
Lustre: 793165:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) inode 198158602228203521: returning policy filenames_encryption_mode as 4, but is in fact null
Lustre: 793282:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) inode 198158602228203521: returning policy filenames_encryption_mode as 4, but is in fact null
Lustre: 793282:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) Skipped 2 previous similar messages
Lustre: 793295:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) inode 198158602228203521: returning policy filenames_encryption_mode as 4, but is in fact null
Lustre: 793295:0:(policy.c:473:llcrypt_ioctl_get_policy_ex()) Skipped 1 previous similar message
Lustre: DEBUG MARKER: grep -c /mnt/lustre' ' /proc/mounts
Lustre: DEBUG MARKER: lsof -t /mnt/lustre
Lustre: DEBUG MARKER: umount /mnt/lustre 2>&1
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock,skpath=/tmp/test-framework-keys trevis-98vm1@tcp:/lustre /mnt/lustre
Lustre: DEBUG MARKER: lctl get_param -n mdc.lustre-MDT0000*.import
Lustre: DEBUG MARKER: ! grep -q /mnt/lustre' ' /proc/mounts ||
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock,skpath=/tmp/test-framework-keys trevis-98vm1@tcp:/lustre/d54.sanity-sec /mnt/lustre
LustreError: 793411:0:(gss_cli_upcall.c:267:gss_do_ctx_init_rpc()) lustre-OST0001-osc-ffff99b345b09000: no such obd: rc = -22
LustreError: 793411:0:(gss_cli_upcall.c:267:gss_do_ctx_init_rpc()) Skipped 4 previous similar messages
Lustre: DEBUG MARKER: cat /proc/mounts
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-*-mdc-*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-MDT*-mdc-*.srpc_contexts
Lustre: DEBUG MARKER: cat /proc/mounts
Lustre: DEBUG MARKER: lctl set_param osc.*.idle_connect=1
Lustre: DEBUG MARKER: lctl get_param -n osc.*OST*-osc-[^M][^D][^T]*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n osc.*OST*-osc-[^M][^D][^T]*.srpc_contexts
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n llite.*.enable_filename_encryption | head -n1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n llite.*.enable_filename_encryption | head -n1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n llite.*.enable_filename_encryption | head -n1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n llite.*.enable_filename_encryption | head -n1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n llite.*.enable_filename_encryption | head -n1
Lustre: DEBUG MARKER: grep -c /mnt/lustre' ' /proc/mounts
Lustre: DEBUG MARKER: lsof -t /mnt/lustre
Lustre: DEBUG MARKER: umount /mnt/lustre 2>&1
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock,skpath=/tmp/test-framework-keys trevis-98vm1@tcp:/lustre /mnt/lustre
Lustre: DEBUG MARKER: lctl get_param -n mdc.lustre-MDT0000*.import
Lustre: DEBUG MARKER: ! grep -q /mnt/lustre' ' /proc/mounts ||
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock,skpath=/tmp/test-framework-keys trevis-98vm1@tcp:/lustre/d54.sanity-sec/vault /mnt/lustre
Lustre: DEBUG MARKER: cat /proc/mounts
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-*-mdc-*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-MDT*-mdc-*.srpc_contexts
Lustre: DEBUG MARKER: cat /proc/mounts
Lustre: DEBUG MARKER: lctl set_param osc.*.idle_connect=1
Lustre: DEBUG MARKER: lctl get_param -n osc.*OST*-osc-[^M][^D][^T]*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n osc.*OST*-osc-[^M][^D][^T]*.srpc_contexts
Lustre: DEBUG MARKER: grep -c /mnt/lustre' ' /proc/mounts
Lustre: DEBUG MARKER: lsof -t /mnt/lustre
Lustre: DEBUG MARKER: umount /mnt/lustre 2>&1
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock,skpath=/tmp/test-framework-keys trevis-98vm1@tcp:/lustre /mnt/lustre
Lustre: DEBUG MARKER: cat /proc/mounts
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-*-mdc-*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-MDT*-mdc-*.srpc_contexts
Lustre: DEBUG MARKER: cat /proc/mounts
Lustre: DEBUG MARKER: lctl set_param osc.*.idle_connect=1
Lustre: DEBUG MARKER: lctl get_param -n osc.*OST*-osc-[^M][^D][^T]*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n osc.*OST*-osc-[^M][^D][^T]*.srpc_contexts
Link to test
sanityn test 102: Test open by handle of unlinked file
LustreError: 746564:0:(file.c:4961:ll_flush()) ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failed:
LustreError: 746564:0:(file.c:4961:ll_flush()) LBUG
CPU: 1 PID: 746564 Comm: lfs Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
ll_flush+0x99/0xa0 [lustre]
filp_close+0x31/0x70
__x64_sys_close+0xe/0x40
do_syscall_64+0x5b/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd2b44227c5
Link to test
sanity-lipe-scan3 test 12: --client-mount is handled correctly
LustreError: 19075:0:(file.c:4961:ll_flush()) ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failed:
LustreError: 19075:0:(file.c:4961:ll_flush()) LBUG
CPU: 0 PID: 19075 Comm: find Kdump: loaded Tainted: G OE N 5.14.21-150500.55.73-default #1 SLE15-SP5 fc1a4bbca9a564948b2766e2916ea63844b7cf3f
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
<TASK>
dump_stack_lvl+0x58/0x7b
lbug_with_loc+0x3a/0x70 [libcfs 5a5848a4a311b928679513cc7ec5f1d5a8f321b8]
ll_flush+0x99/0xa0 [lustre c357459b9ade7e66a2522b48e5006e190da07cfb]
filp_close+0x2a/0x80
__x64_sys_close+0xe/0x40
do_syscall_64+0x5b/0x80
? do_syscall_64+0x67/0x80
? exc_page_fault+0x67/0x150
entry_SYSCALL_64_after_hwframe+0x6b/0xd5
RIP: 0033:0x7f323edc94d7
Link to test
sanity-lipe-find3 test 90: lipe_find3 on an empty FS
LustreError: 28873:0:(file.c:4961:ll_flush()) ASSERTION( !(((inode->i_mode) & 00170000) == 0040000) ) failed:
LustreError: 28873:0:(file.c:4961:ll_flush()) LBUG
CPU: 0 PID: 28873 Comm: find Kdump: loaded Tainted: G OE N 5.14.21-150500.55.73-default #1 SLE15-SP5 fc1a4bbca9a564948b2766e2916ea63844b7cf3f
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
<TASK>
dump_stack_lvl+0x58/0x7b
lbug_with_loc+0x3a/0x70 [libcfs 5a5848a4a311b928679513cc7ec5f1d5a8f321b8]
ll_flush+0x99/0xa0 [lustre c357459b9ade7e66a2522b48e5006e190da07cfb]
filp_close+0x2a/0x80
__x64_sys_close+0xe/0x40
do_syscall_64+0x5b/0x80
? __x64_sys_getdents64+0x10a/0x120
? verify_dirent_name+0x40/0x40
? syscall_exit_to_user_mode+0x1f/0x40
? do_syscall_64+0x67/0x80
? exc_page_fault+0x67/0x150
entry_SYSCALL_64_after_hwframe+0x6b/0xd5
RIP: 0033:0x7f18dffc94d7
Link to test
Return to new crashes list