Edit new crash report

Reason	Crashing Function	Where to cut Backtrace	Reports Count
ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed	class_import_put	class_import_put client_obd_cleanup osc_cleanup_common mdc_device_free mdc_device_alloc obd_setup class_setup class_process_config class_config_llog_handler llog_process_thread llog_process_thread_daemonize kthread ret_from_fork	7

Failing Test	Full Crash	Messages before crash	Comment
recovery-small test 164d: GSSIAM keeps permissions after network reconnect without umount (repeat 10/ iter, 7/30 min)	LustreError: 69160:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed: LustreError: 69160:0:(genops.c:1240:class_import_put()) LBUG CPU: 0 PID: 69160 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 lbug_with_loc.cold.7+0x5/0x43 [libcfs] class_import_put+0x1d2/0x260 [obdclass] client_obd_cleanup+0x87/0x4f0 [ptlrpc] osc_cleanup_common+0x116/0x1e0 [osc] mdc_device_free+0x82/0x160 [mdc] mdc_device_alloc+0x1f8/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40	Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug=+all Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x1205 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param sptlrpc.gssiam.gssiam_upcall=/usr/sbin/l_gssiam_upcall Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-*.srpc_info Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff21992cd63d6000' CPU: 0 PID: 69160 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 sysfs_warn_dup.cold.4+0x17/0x2a sysfs_create_dir_ns+0xb3/0xe0 kobject_add_internal+0xc2/0x290 kobject_init_and_add+0x71/0xa0 ? srso_alias_return_thunk+0x5/0xfcdfd ? lprocfs_counter_init_units+0x72/0x3b0 [obdclass] ? lprocfs_stats_alloc+0x33a/0x680 [obdclass] ldlm_namespace_new+0x759/0xba0 [ptlrpc] client_obd_setup+0x8e3/0x1960 [ptlrpc] osc_setup_common+0xdc/0x2b0 [osc] mdc_setup+0x2c/0x5b0 [mdc] mdc_device_alloc+0xf5/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40 kobject_add_internal failed for lustre-MDT0000-mdc-ff21992cd63d6000 with -EEXIST, don't try to register things with the same name in the same directory. LustreError: 69160:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff21992cd63d6000: cannot initialize ns sysfs: rc = -17 LustreError: 69160:0:(ldlm_lib.c:599:client_obd_setup()) lustre-MDT0000-mdc-ff21992cd63d6000: unable to create client namespace: rc = -17	Link to test
recovery-small test 164d: GSSIAM keeps permissions after network reconnect without umount (repeat 30/ iter, 24/30 min)	LustreError: 168621:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed: LustreError: 168621:0:(genops.c:1240:class_import_put()) LBUG CPU: 0 PID: 168621 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 lbug_with_loc.cold.7+0x5/0x43 [libcfs] class_import_put+0x1d2/0x260 [obdclass] client_obd_cleanup+0x87/0x4f0 [ptlrpc] osc_cleanup_common+0x116/0x1e0 [osc] mdc_device_free+0x82/0x160 [mdc] mdc_device_alloc+0x1f8/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40	Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug=+all Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x1205 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param sptlrpc.gssiam.gssiam_upcall=/usr/sbin/l_gssiam_upcall Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-*.srpc_info Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff4102b54485c000' CPU: 0 PID: 168621 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 sysfs_warn_dup.cold.4+0x17/0x2a sysfs_create_dir_ns+0xb3/0xe0 kobject_add_internal+0xc2/0x290 kobject_init_and_add+0x71/0xa0 ? srso_alias_return_thunk+0x5/0xfcdfd ? lprocfs_counter_init_units+0x72/0x3b0 [obdclass] ? lprocfs_stats_alloc+0x33a/0x680 [obdclass] ldlm_namespace_new+0x759/0xba0 [ptlrpc] client_obd_setup+0x8e3/0x1960 [ptlrpc] osc_setup_common+0xdc/0x2b0 [osc] mdc_setup+0x2c/0x5b0 [mdc] mdc_device_alloc+0xf5/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40 kobject_add_internal failed for lustre-MDT0000-mdc-ff4102b54485c000 with -EEXIST, don't try to register things with the same name in the same directory. LustreError: 168621:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff4102b54485c000: cannot initialize ns sysfs: rc = -17 LustreError: 168621:0:(ldlm_lib.c:599:client_obd_setup()) lustre-MDT0000-mdc-ff4102b54485c000: unable to create client namespace: rc = -17	Link to test
recovery-small test 164d: GSSIAM keeps permissions after network reconnect without umount (repeat 15/ iter, 11/30 min)	LustreError: 93879:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed: LustreError: 93879:0:(genops.c:1240:class_import_put()) LBUG CPU: 1 PID: 93879 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 lbug_with_loc.cold.7+0x5/0x43 [libcfs] class_import_put+0x1d2/0x260 [obdclass] client_obd_cleanup+0x87/0x4f0 [ptlrpc] osc_cleanup_common+0x116/0x1e0 [osc] mdc_device_free+0x82/0x160 [mdc] mdc_device_alloc+0x1f8/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40	Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug=+all Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x1205 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param sptlrpc.gssiam.gssiam_upcall=/usr/sbin/l_gssiam_upcall Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-*.srpc_info Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff2f83d70dace800' CPU: 1 PID: 93879 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 sysfs_warn_dup.cold.4+0x17/0x2a sysfs_create_dir_ns+0xb3/0xe0 kobject_add_internal+0xc2/0x290 kobject_init_and_add+0x71/0xa0 ? srso_alias_return_thunk+0x5/0xfcdfd ? lprocfs_counter_init_units+0x72/0x3b0 [obdclass] ? lprocfs_stats_alloc+0x33a/0x680 [obdclass] ldlm_namespace_new+0x759/0xba0 [ptlrpc] client_obd_setup+0x8e3/0x1960 [ptlrpc] osc_setup_common+0xdc/0x2b0 [osc] mdc_setup+0x2c/0x5b0 [mdc] mdc_device_alloc+0xf5/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40 kobject_add_internal failed for lustre-MDT0000-mdc-ff2f83d70dace800 with -EEXIST, don't try to register things with the same name in the same directory. LustreError: 93879:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff2f83d70dace800: cannot initialize ns sysfs: rc = -17 LustreError: 93879:0:(ldlm_lib.c:599:client_obd_setup()) lustre-MDT0000-mdc-ff2f83d70dace800: unable to create client namespace: rc = -17	Link to test
recovery-small test 164a: GSSIAM keeps user principal permission after eviction (repeat 13/ iter, 11/30 min)	LustreError: 85107:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed: LustreError: 85107:0:(genops.c:1240:class_import_put()) LBUG CPU: 0 PID: 85107 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 lbug_with_loc.cold.7+0x5/0x43 [libcfs] class_import_put+0x1d2/0x260 [obdclass] client_obd_cleanup+0x87/0x4f0 [ptlrpc] osc_cleanup_common+0x116/0x1e0 [osc] mdc_device_free+0x82/0x160 [mdc] mdc_device_alloc+0x1f8/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40	Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug=+all Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x1205 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param sptlrpc.gssiam.gssiam_upcall=/usr/sbin/l_gssiam_upcall Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-*.srpc_info Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff1dd1b7b1593800' CPU: 0 PID: 85107 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 sysfs_warn_dup.cold.4+0x17/0x2a sysfs_create_dir_ns+0xb3/0xe0 kobject_add_internal+0xc2/0x290 kobject_init_and_add+0x71/0xa0 ? srso_alias_return_thunk+0x5/0xfcdfd ? lprocfs_counter_init_units+0x72/0x3b0 [obdclass] ? lprocfs_stats_alloc+0x33a/0x680 [obdclass] ldlm_namespace_new+0x759/0xba0 [ptlrpc] client_obd_setup+0x8e3/0x1960 [ptlrpc] osc_setup_common+0xdc/0x2b0 [osc] mdc_setup+0x2c/0x5b0 [mdc] mdc_device_alloc+0xf5/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40 kobject_add_internal failed for lustre-MDT0000-mdc-ff1dd1b7b1593800 with -EEXIST, don't try to register things with the same name in the same directory. LustreError: 85107:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff1dd1b7b1593800: cannot initialize ns sysfs: rc = -17 LustreError: 85107:0:(ldlm_lib.c:599:client_obd_setup()) lustre-MDT0000-mdc-ff1dd1b7b1593800: unable to create client namespace: rc = -17	Link to test
recovery-small test 164a: GSSIAM keeps user principal permission after eviction (repeat 24/ iter, 22/30 min)	LustreError: 140480:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed: LustreError: 140480:0:(genops.c:1240:class_import_put()) LBUG CPU: 1 PID: 140480 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 lbug_with_loc.cold.7+0x5/0x43 [libcfs] class_import_put+0x1d2/0x260 [obdclass] client_obd_cleanup+0x87/0x4f0 [ptlrpc] osc_cleanup_common+0x116/0x1e0 [osc] mdc_device_free+0x82/0x160 [mdc] mdc_device_alloc+0x1f8/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40	Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug=+all Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x1205 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param sptlrpc.gssiam.gssiam_upcall=/usr/sbin/l_gssiam_upcall Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-*.srpc_info Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: Lustre: DEBUG MARKER: mount \| grep /mnt/lustre' ' Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff36bf8cc2ba5800' CPU: 1 PID: 140480 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 sysfs_warn_dup.cold.4+0x17/0x2a sysfs_create_dir_ns+0xb3/0xe0 kobject_add_internal+0xc2/0x290 kobject_init_and_add+0x71/0xa0 ? srso_alias_return_thunk+0x5/0xfcdfd ? lprocfs_counter_init_units+0x72/0x3b0 [obdclass] ? lprocfs_stats_alloc+0x33a/0x680 [obdclass] ldlm_namespace_new+0x759/0xba0 [ptlrpc] client_obd_setup+0x8e3/0x1960 [ptlrpc] osc_setup_common+0xdc/0x2b0 [osc] mdc_setup+0x2c/0x5b0 [mdc] mdc_device_alloc+0xf5/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40 kobject_add_internal failed for lustre-MDT0000-mdc-ff36bf8cc2ba5800 with -EEXIST, don't try to register things with the same name in the same directory. LustreError: 140480:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff36bf8cc2ba5800: cannot initialize ns sysfs: rc = -17 LustreError: 140480:0:(ldlm_lib.c:599:client_obd_setup()) lustre-MDT0000-mdc-ff36bf8cc2ba5800: unable to create client namespace: rc = -17	Link to test
recovery-small test 164d: GSSIAM keeps permissions after network reconnect without umount (repeat 7/ iter, 5/30 min)	LustreError: 55338:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed: LustreError: 55338:0:(genops.c:1240:class_import_put()) LBUG CPU: 0 PID: 55338 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 lbug_with_loc.cold.7+0x5/0x43 [libcfs] class_import_put+0x1d2/0x260 [obdclass] client_obd_cleanup+0x87/0x4f0 [ptlrpc] osc_cleanup_common+0x116/0x1e0 [osc] mdc_device_free+0x82/0x160 [mdc] mdc_device_alloc+0x1f8/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40	Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug=+all Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x1205 Lustre: DEBUG MARKER: /usr/sbin/lctl set_param sptlrpc.gssiam.gssiam_upcall=/usr/sbin/l_gssiam_upcall Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam Lustre: DEBUG MARKER: cat /proc/mounts Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: lctl get_param -n mdc.--mdc-.srpc_info Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: Lustre: DEBUG MARKER: mount \| grep /mnt/lustre' ' Lustre: lustre-MDT0000-mdc-ff322d5fc79b7800: Connection to lustre-MDT0000 (at 10.240.46.232@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: DEBUG MARKER: /usr/bin/lfs df /mnt/lustre > /dev/null 2>&1 \|\| true Lustre: 4308:0:(sec_gssiam.c:386:gssiam_ctx_verify()) lustre-MDT0000-mdc-ff322d5fc79b7800: ctxt from 10.240.46.232@tcp (uid 0) unknown, retrying LustreError: 4308:0:(client.c:1618:after_reply()) @@@ unwrap reply failed: rc = -11 req@ff322d5fc3aaf0c0 x1865747386344064/t0(0) o38->lustre-MDT0000-mdc-ff322d5fc79b7800@10.240.46.232@tcp:12/10 lens 520/544 e 0 to 0 dl 1779315890 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'lctl.0' uid:0 gid:0 projid:4294967295 Lustre: lustre-MDT0000-mdc-ff322d5fc79b7800: Connection restored to 10.240.46.232@tcp (at 10.240.46.232@tcp) Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-156vm127.trevis.whamcloud.com: executing wait_import_state_mount \(FULL\\|IDLE\) mdc.lustre-MDT0000-mdc-\.mds_server_uuid Lustre: DEBUG MARKER: trevis-156vm127.trevis.whamcloud.com: executing wait_import_state_mount (FULL\|IDLE) mdc.lustre-MDT0000-mdc-.mds_server_uuid Lustre: DEBUG MARKER: lctl get_param -n at_max Lustre: DEBUG MARKER: /usr/sbin/lctl mark mdc.lustre-MDT0000-mdc-\.mds_server_uuid in FULL state after 0 sec Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff322d5fc4351800' CPU: 0 PID: 55338 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 sysfs_warn_dup.cold.4+0x17/0x2a sysfs_create_dir_ns+0xb3/0xe0 kobject_add_internal+0xc2/0x290 kobject_init_and_add+0x71/0xa0 ? srso_alias_return_thunk+0x5/0xfcdfd ? lprocfs_counter_init_units+0x72/0x3b0 [obdclass] ? lprocfs_stats_alloc+0x33a/0x680 [obdclass] ldlm_namespace_new+0x759/0xba0 [ptlrpc] client_obd_setup+0x8e3/0x1960 [ptlrpc] osc_setup_common+0xdc/0x2b0 [osc] mdc_setup+0x2c/0x5b0 [mdc] mdc_device_alloc+0xf5/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40 kobject_add_internal failed for lustre-MDT0000-mdc-ff322d5fc4351800 with -EEXIST, don't try to register things with the same name in the same directory. LustreError: 55338:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff322d5fc4351800: cannot initialize ns sysfs: rc = -17 LustreError: 55338:0:(ldlm_lib.c:599:client_obd_setup()) lustre-MDT0000-mdc-ff322d5fc4351800: unable to create client namespace: rc = -17	Link to test
sanity-sec test complete, duration 6719 sec	LustreError: 861116:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed: LustreError: 861116:0:(genops.c:1240:class_import_put()) LBUG CPU: 1 PID: 861116 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 lbug_with_loc.cold.7+0x5/0x43 [libcfs] class_import_put+0x1d2/0x260 [obdclass] client_obd_cleanup+0x87/0x4f0 [ptlrpc] osc_cleanup_common+0x116/0x1e0 [osc] mdc_device_free+0x82/0x160 [mdc] mdc_device_alloc+0x1f8/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40	Lustre: DEBUG MARKER: /usr/sbin/lctl mark === sanity-sec: start cleanup 12:18:34 \(1778761114\) === Lustre: DEBUG MARKER: === sanity-sec: start cleanup 12:18:34 (1778761114) === Lustre: DEBUG MARKER: /usr/sbin/lctl mark === sanity-sec: finish cleanup 12:18:35 \(1778761115\) === Lustre: DEBUG MARKER: === sanity-sec: finish cleanup 12:18:35 (1778761115) === Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: sanity-selinux ============----- Thu May 14 12:18:35 UTC 2026 Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-selinux ============----- Thu May 14 12:18:35 UTC 2026 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n version 2>/dev/null Lustre: DEBUG MARKER: cat /etc/system-release Lustre: DEBUG MARKER: test -r /etc/os-release Lustre: DEBUG MARKER: cat /etc/os-release Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: Lustre: DEBUG MARKER: excepting tests: Lustre: DEBUG MARKER: /usr/sbin/lctl mark skipping tests SLOW=no: xxx Lustre: DEBUG MARKER: skipping tests SLOW=no: xxx Lustre: DEBUG MARKER: /usr/sbin/lctl mark === sanity-selinux: start setup 12:18:41 \(1778761121\) === Lustre: DEBUG MARKER: === sanity-selinux: start setup 12:18:41 (1778761121) === Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre2' ' /proc/mounts); Lustre: DEBUG MARKER: keyctl show \| grep lustre \| cut -c1-11 \| Lustre: DEBUG MARKER: mkdir -p /mnt/lustre Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock,skpath=/tmp/test-framework-keys 10.240.40.64@tcp:/lustre /mnt/lustre sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff394351844cd000' CPU: 1 PID: 861116 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 sysfs_warn_dup.cold.4+0x17/0x2a sysfs_create_dir_ns+0xb3/0xe0 kobject_add_internal+0xc2/0x290 kobject_init_and_add+0x71/0xa0 ? srso_alias_return_thunk+0x5/0xfcdfd ? lprocfs_counter_init_units+0x72/0x3b0 [obdclass] ? lprocfs_stats_alloc+0x33a/0x680 [obdclass] ldlm_namespace_new+0x759/0xba0 [ptlrpc] client_obd_setup+0x8e3/0x1980 [ptlrpc] ? xa_find_after+0x90/0x110 osc_setup_common+0xdc/0x2b0 [osc] mdc_setup+0x2c/0x5b0 [mdc] mdc_device_alloc+0xf5/0x240 [mdc] obd_setup+0x220/0x3f0 [obdclass] class_setup+0x483/0x5c0 [obdclass] class_process_config+0x11c3/0x2450 [obdclass] class_config_llog_handler+0x812/0x11b0 [obdclass] llog_process_thread+0xd79/0x1b30 [obdclass] ? llog_validate+0x370/0x370 [obdclass] llog_process_thread_daemonize+0x70/0x90 [obdclass] kthread+0x134/0x150 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x1f/0x40 kobject_add_internal failed for lustre-MDT0000-mdc-ff394351844cd000 with -EEXIST, don't try to register things with the same name in the same directory. LustreError: 861116:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff394351844cd000: cannot initialize ns sysfs: rc = -17 LustreError: 861116:0:(ldlm_lib.c:601:client_obd_setup()) lustre-MDT0000-mdc-ff394351844cd000: unable to create client namespace: rc = -17	Link to test

Failing Test

Full Crash

Messages before crash

Comment

recovery-small test 164d: GSSIAM keeps permissions after network reconnect without umount (repeat 10/ iter, 7/30 min)

LustreError: 69160:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed:
LustreError: 69160:0:(genops.c:1240:class_import_put()) LBUG
CPU: 0 PID: 69160 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.7+0x5/0x43 [libcfs]
class_import_put+0x1d2/0x260 [obdclass]
client_obd_cleanup+0x87/0x4f0 [ptlrpc]
osc_cleanup_common+0x116/0x1e0 [osc]
mdc_device_free+0x82/0x160 [mdc]
mdc_device_alloc+0x1f8/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40

Link to test

recovery-small test 164d: GSSIAM keeps permissions after network reconnect without umount (repeat 30/ iter, 24/30 min)

LustreError: 168621:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed:
LustreError: 168621:0:(genops.c:1240:class_import_put()) LBUG
CPU: 0 PID: 168621 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.7+0x5/0x43 [libcfs]
class_import_put+0x1d2/0x260 [obdclass]
client_obd_cleanup+0x87/0x4f0 [ptlrpc]
osc_cleanup_common+0x116/0x1e0 [osc]
mdc_device_free+0x82/0x160 [mdc]
mdc_device_alloc+0x1f8/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40

Link to test

recovery-small test 164d: GSSIAM keeps permissions after network reconnect without umount (repeat 15/ iter, 11/30 min)

LustreError: 93879:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed:
LustreError: 93879:0:(genops.c:1240:class_import_put()) LBUG
CPU: 1 PID: 93879 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.7+0x5/0x43 [libcfs]
class_import_put+0x1d2/0x260 [obdclass]
client_obd_cleanup+0x87/0x4f0 [ptlrpc]
osc_cleanup_common+0x116/0x1e0 [osc]
mdc_device_free+0x82/0x160 [mdc]
mdc_device_alloc+0x1f8/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40

Link to test

recovery-small test 164a: GSSIAM keeps user principal permission after eviction (repeat 13/ iter, 11/30 min)

LustreError: 85107:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed:
LustreError: 85107:0:(genops.c:1240:class_import_put()) LBUG
CPU: 0 PID: 85107 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.7+0x5/0x43 [libcfs]
class_import_put+0x1d2/0x260 [obdclass]
client_obd_cleanup+0x87/0x4f0 [ptlrpc]
osc_cleanup_common+0x116/0x1e0 [osc]
mdc_device_free+0x82/0x160 [mdc]
mdc_device_alloc+0x1f8/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40

Link to test

recovery-small test 164a: GSSIAM keeps user principal permission after eviction (repeat 24/ iter, 22/30 min)

LustreError: 140480:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed:
LustreError: 140480:0:(genops.c:1240:class_import_put()) LBUG
CPU: 1 PID: 140480 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.7+0x5/0x43 [libcfs]
class_import_put+0x1d2/0x260 [obdclass]
client_obd_cleanup+0x87/0x4f0 [ptlrpc]
osc_cleanup_common+0x116/0x1e0 [osc]
mdc_device_free+0x82/0x160 [mdc]
mdc_device_alloc+0x1f8/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40

Link to test

recovery-small test 164d: GSSIAM keeps permissions after network reconnect without umount (repeat 7/ iter, 5/30 min)

LustreError: 55338:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed:
LustreError: 55338:0:(genops.c:1240:class_import_put()) LBUG
CPU: 0 PID: 55338 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.7+0x5/0x43 [libcfs]
class_import_put+0x1d2/0x260 [obdclass]
client_obd_cleanup+0x87/0x4f0 [ptlrpc]
osc_cleanup_common+0x116/0x1e0 [osc]
mdc_device_free+0x82/0x160 [mdc]
mdc_device_alloc+0x1f8/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40

Lustre: DEBUG MARKER: /usr/sbin/lctl set_param debug=+all
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param fail_loc=0x1205
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param sptlrpc.gssiam.gssiam_upcall=/usr/sbin/l_gssiam_upcall
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam
Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2mdt=gssiam
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam
Lustre: DEBUG MARKER: Setting sptlrpc rule: lustre.srpc.flavor.default.cli2ost=gssiam
Lustre: DEBUG MARKER: cat /proc/mounts
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-*-mdc-*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-*-mdc-*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-*-mdc-*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-*-mdc-*.srpc_info
Lustre: DEBUG MARKER: lctl get_param -n mdc.*-*-mdc-*.srpc_info
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts);
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER:
Lustre: DEBUG MARKER: mount | grep /mnt/lustre' '
Lustre: lustre-MDT0000-mdc-ff322d5fc79b7800: Connection to lustre-MDT0000 (at 10.240.46.232@tcp) was lost; in progress operations using this service will wait for recovery to complete
Lustre: DEBUG MARKER: /usr/bin/lfs df /mnt/lustre > /dev/null 2>&1 || true
Lustre: 4308:0:(sec_gssiam.c:386:gssiam_ctx_verify()) lustre-MDT0000-mdc-ff322d5fc79b7800: ctxt from 10.240.46.232@tcp (uid 0) unknown, retrying
LustreError: 4308:0:(client.c:1618:after_reply()) @@@ unwrap reply failed: rc = -11 req@ff322d5fc3aaf0c0 x1865747386344064/t0(0) o38->lustre-MDT0000-mdc-ff322d5fc79b7800@10.240.46.232@tcp:12/10 lens 520/544 e 0 to 0 dl 1779315890 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'lctl.0' uid:0 gid:0 projid:4294967295
Lustre: lustre-MDT0000-mdc-ff322d5fc79b7800: Connection restored to 10.240.46.232@tcp (at 10.240.46.232@tcp)
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-156vm127.trevis.whamcloud.com: executing wait_import_state_mount $FULL\|IDLE$ mdc.lustre-MDT0000-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: trevis-156vm127.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: lctl get_param -n at_max
Lustre: DEBUG MARKER: /usr/sbin/lctl mark mdc.lustre-MDT0000-mdc-\*.mds_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts);
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER:
sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff322d5fc4351800'
CPU: 0 PID: 55338 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
sysfs_warn_dup.cold.4+0x17/0x2a
sysfs_create_dir_ns+0xb3/0xe0
kobject_add_internal+0xc2/0x290
kobject_init_and_add+0x71/0xa0
? srso_alias_return_thunk+0x5/0xfcdfd
? lprocfs_counter_init_units+0x72/0x3b0 [obdclass]
? lprocfs_stats_alloc+0x33a/0x680 [obdclass]
ldlm_namespace_new+0x759/0xba0 [ptlrpc]
client_obd_setup+0x8e3/0x1960 [ptlrpc]
osc_setup_common+0xdc/0x2b0 [osc]
mdc_setup+0x2c/0x5b0 [mdc]
mdc_device_alloc+0xf5/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40
kobject_add_internal failed for lustre-MDT0000-mdc-ff322d5fc4351800 with -EEXIST, don't try to register things with the same name in the same directory.
LustreError: 55338:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff322d5fc4351800: cannot initialize ns sysfs: rc = -17
LustreError: 55338:0:(ldlm_lib.c:599:client_obd_setup()) lustre-MDT0000-mdc-ff322d5fc4351800: unable to create client namespace: rc = -17

Link to test

sanity-sec test complete, duration 6719 sec

LustreError: 861116:0:(genops.c:1240:class_import_put()) ASSERTION( refcount_read(&imp->imp_refcount) > 0 ) failed:
LustreError: 861116:0:(genops.c:1240:class_import_put()) LBUG
CPU: 1 PID: 861116 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.7+0x5/0x43 [libcfs]
class_import_put+0x1d2/0x260 [obdclass]
client_obd_cleanup+0x87/0x4f0 [ptlrpc]
osc_cleanup_common+0x116/0x1e0 [osc]
mdc_device_free+0x82/0x160 [mdc]
mdc_device_alloc+0x1f8/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40

Lustre: DEBUG MARKER: /usr/sbin/lctl mark === sanity-sec: start cleanup 12:18:34 $1778761114$ ===
Lustre: DEBUG MARKER: === sanity-sec: start cleanup 12:18:34 (1778761114) ===
Lustre: DEBUG MARKER: /usr/sbin/lctl mark === sanity-sec: finish cleanup 12:18:35 $1778761115$ ===
Lustre: DEBUG MARKER: === sanity-sec: finish cleanup 12:18:35 (1778761115) ===
Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: sanity-selinux ============----- Thu May 14 12:18:35 UTC 2026
Lustre: DEBUG MARKER: -----============= acceptance-small: sanity-selinux ============----- Thu May 14 12:18:35 UTC 2026
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n version 2>/dev/null
Lustre: DEBUG MARKER: cat /etc/system-release
Lustre: DEBUG MARKER: test -r /etc/os-release
Lustre: DEBUG MARKER: cat /etc/os-release
Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests:
Lustre: DEBUG MARKER: excepting tests:
Lustre: DEBUG MARKER: /usr/sbin/lctl mark skipping tests SLOW=no: xxx
Lustre: DEBUG MARKER: skipping tests SLOW=no: xxx
Lustre: DEBUG MARKER: /usr/sbin/lctl mark === sanity-selinux: start setup 12:18:41 $1778761121$ ===
Lustre: DEBUG MARKER: === sanity-selinux: start setup 12:18:41 (1778761121) ===
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre' ' /proc/mounts);
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre2' ' /proc/mounts);
Lustre: DEBUG MARKER: keyctl show | grep lustre | cut -c1-11 |
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre
Lustre: DEBUG MARKER: mount -t lustre -o user_xattr,flock,skpath=/tmp/test-framework-keys 10.240.40.64@tcp:/lustre /mnt/lustre
sysfs: cannot create duplicate filename '/fs/lustre/ldlm/namespaces/lustre-MDT0000-mdc-ff394351844cd000'
CPU: 1 PID: 861116 Comm: llog_process_th Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.117.1.el8_10.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
sysfs_warn_dup.cold.4+0x17/0x2a
sysfs_create_dir_ns+0xb3/0xe0
kobject_add_internal+0xc2/0x290
kobject_init_and_add+0x71/0xa0
? srso_alias_return_thunk+0x5/0xfcdfd
? lprocfs_counter_init_units+0x72/0x3b0 [obdclass]
? lprocfs_stats_alloc+0x33a/0x680 [obdclass]
ldlm_namespace_new+0x759/0xba0 [ptlrpc]
client_obd_setup+0x8e3/0x1980 [ptlrpc]
? xa_find_after+0x90/0x110
osc_setup_common+0xdc/0x2b0 [osc]
mdc_setup+0x2c/0x5b0 [mdc]
mdc_device_alloc+0xf5/0x240 [mdc]
obd_setup+0x220/0x3f0 [obdclass]
class_setup+0x483/0x5c0 [obdclass]
class_process_config+0x11c3/0x2450 [obdclass]
class_config_llog_handler+0x812/0x11b0 [obdclass]
llog_process_thread+0xd79/0x1b30 [obdclass]
? llog_validate+0x370/0x370 [obdclass]
llog_process_thread_daemonize+0x70/0x90 [obdclass]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x1f/0x40
kobject_add_internal failed for lustre-MDT0000-mdc-ff394351844cd000 with -EEXIST, don't try to register things with the same name in the same directory.
LustreError: 861116:0:(ldlm_resource.c:1038:ldlm_namespace_new()) lustre-MDT0000-mdc-ff394351844cd000: cannot initialize ns sysfs: rc = -17
LustreError: 861116:0:(ldlm_lib.c:601:client_obd_setup()) lustre-MDT0000-mdc-ff394351844cd000: unable to create client namespace: rc = -17

Link to test

Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below):
Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below):
Limit to a test: (Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Editing crashreport #74898

Added fields:

Failures list (last 100):