Editing crashreport #73735

ReasonCrashing FunctionWhere to cut BacktraceReports Count
ASSERTION( lod_comp->llc_stripe_count ) failedlod_qos_prep_createlod_qos_prep_create
lod_prepare_create
lod_declare_striped_create
lod_declare_xattr_set
mdd_create_data
mdt_mfd_open
mdt_finish_open
mdt_open_by_fid_lock
mdt_reint_open
mdt_reint_rec
mdt_reint_internal
mdt_intent_open
mdt_intent_opc
mdt_intent_policy
ldlm_lock_enqueue
ldlm_handle_enqueue
tgt_enqueue
tgt_request_handle
ptlrpc_server_handle_request
ptlrpc_main
kthread
ret_from_fork
34

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
sanity-pfl test 6: Migrate composite file
LustreError: 353168:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 353168:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 353168 Comm: mdt00_004 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: 353168:0:(lod_object.c:1104:lod_adjust_stripe_size()) Component end 8026032953089089887 is not a multiple of min size 65536
Lustre: 353168:0:(lod_object.c:1115:lod_adjust_stripe_size()) Component end 8026032953089130496 is not aligned by the stripe size 131072
Link to test
sanity-sec test 27d: test multiple filesets mounting rules (rw)
LustreError: 380520:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 380520:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 380520 Comm: mdt00_003 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? sptlrpc_svc_alloc_rs+0x63/0x350 [ptlrpc]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x4e/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param mdt.*.identity_upcall=NONE
Lustre: 416274:0:(mdt_lproc.c:311:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS"
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c0 --range 10.240.43.3@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype uid --idmap 60003:60000
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype gid --idmap 60003:60000
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype uid --idmap 60004:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype gid --idmap 60004:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c1 --range 10.240.43.4@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype uid --idmap 60005:60001
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype gid --idmap 60005:60001
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype uid --idmap 60006:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype gid --idmap 60006:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_activate 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.admin_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.c0.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Autotest: Test running for 55 minutes (lustre-reviews_review-dne-part-2_115677.27)
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Link to test
sanity-lfsck test 45: LFSCK should fix UID/GID/PROJID of OST object
LustreError: 269538:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 269538:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 269538 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: lustre-MDT0000: Recovery over after 0:05, of 5 clients 5 recovered and 0 were evicted.
Lustre: Skipped 1 previous similar message
Link to test
replay-dual test 25: replay|resend
LustreError: 16766:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 16766:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 16766 Comm: mdt00_003 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
replay-dual test 25: replay|resend
LustreError: 12492:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 12492:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 12492 Comm: mdt00_002 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
? _cond_resched+0x15/0x30
? down_read+0xe/0xa0
? osd_attr_get+0x23b/0x4b0 [osd_zfs]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
parallel-scale test cascading_rw: cascading_rw
LustreError: 12906:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 12906:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 12906 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
sanity-benchmark test fsx: fsx
LustreError: 31943:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 31943:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 31943 Comm: mdt00_001 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
sanity-quota test 1a: Block hard limit (normal use and out of quota)
LustreError: 12506:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 12506:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 12506 Comm: mdt00_002 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0xbfb/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
? _cond_resched+0x15/0x30
? down_read+0xe/0xa0
? osd_attr_get+0x23b/0x4b0 [osd_zfs]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osp.*.destroys_in_flight
Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0
Lustre: DEBUG MARKER: /usr/sbin/lctl conf_param lustre.quota.ost=ugp
Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:10 MB\)
Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
Lustre: DEBUG MARKER: lctl set_param -n os[cd]*.*MDT*.force_sync=1
Link to test
conf-sanity test 50g: deactivated OST should not cause panic
LustreError: 963500:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 963500:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 963500 Comm: mdt00_001 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1
Lustre: DEBUG MARKER: modprobe dm-flakey;
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey >/dev/null 2>&1
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey 2>&1
Lustre: DEBUG MARKER: test -b /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1; mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1
LDISKFS-fs (dm-4): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
Lustre: MGS: Logs for fs lustre were removed by user request. All servers must be restarted in order to regenerate the logs: rc = 0
Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
Lustre: Skipped 9 previous similar messages
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm13.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm13.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: onyx-81vm13.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: onyx-81vm13.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}'
Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey 2>/dev/null
Lustre: MGS: Regenerating lustre-MDT0001 log by user request: rc = 0
Lustre: Skipped 1 previous similar message
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm14.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: onyx-81vm14.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds3
Lustre: DEBUG MARKER: modprobe dm-flakey;
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds3_flakey >/dev/null 2>&1
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds3_flakey 2>&1
Lustre: DEBUG MARKER: test -b /dev/mapper/mds3_flakey
Lustre: DEBUG MARKER: e2label /dev/mapper/mds3_flakey
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds3; mount -t lustre -o localrecov /dev/mapper/mds3_flakey /mnt/lustre-mds3
LDISKFS-fs (dm-5): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm13.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm13.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: onyx-81vm13.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: onyx-81vm13.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: e2label /dev/mapper/mds3_flakey 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}'
Lustre: DEBUG MARKER: e2label /dev/mapper/mds3_flakey 2>/dev/null
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm14.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: onyx-81vm14.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0002-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0002-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0002-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0002-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0003-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0003-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0003-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0003-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm6.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: onyx-81vm6.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount \(FULL\|IDLE\) osc.lustre-OST0000-osc-[-0-9a-f]\*.ost_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount \(FULL\|IDLE\) osc.lustre-OST0000-osc-[-0-9a-f]\*.ost_server_uuid
Lustre: DEBUG MARKER: onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
Lustre: DEBUG MARKER: onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
Lustre: MGS: Regenerating lustre-OST0001 log by user request: rc = 0
Lustre: Skipped 3 previous similar messages
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm6.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: onyx-81vm6.onyx.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount \(FULL\|IDLE\) osc.lustre-OST0001-osc-[-0-9a-f]\*.ost_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount \(FULL\|IDLE\) osc.lustre-OST0001-osc-[-0-9a-f]\*.ost_server_uuid
Lustre: DEBUG MARKER: onyx-81vm4.onyx.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid
Lustre: DEBUG MARKER: onyx-81vm5.onyx.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark osc.lustre-OST0001-osc-[-0-9a-f]\*.ost_server_uuid in FULL state after 5 sec
Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 5 sec
Lustre: DEBUG MARKER: lctl get_param -n at_min
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm13.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm13.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50
Lustre: DEBUG MARKER: onyx-81vm13.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50
Lustre: DEBUG MARKER: onyx-81vm13.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm14.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50
Lustre: DEBUG MARKER: onyx-81vm14.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: lctl get_param -n at_min
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm13.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm13.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid 50
Lustre: DEBUG MARKER: onyx-81vm13.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid 50
Lustre: DEBUG MARKER: onyx-81vm13.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm14.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0003.ost_server_uuid 50
Lustre: DEBUG MARKER: onyx-81vm14.onyx.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0003.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0003.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0003.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: hostname -I
Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-81vm4.onyx.whamcloud.com: executing wait_import_state \(FULL\|IDLE\) osc.lustre-OST0001-osc-ffff9fc8449fa800.ost_server_uuid 50
Lustre: DEBUG MARKER: onyx-81vm4.onyx.whamcloud.com: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff9fc8449fa800.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark osc.lustre-OST0001-osc-ffff9fc8449fa800.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff9fc8449fa800.ost_server_uuid in FULL state after 0 sec
Link to test
sanity-hsm test 1a: mmap
LustreError: 13018:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 13018:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 13018 Comm: mdt00_000 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n mdt.lustre-MDT0000.hsm.actions | awk '/'0x200000405:0x2:0x0'.*action='ARCHIVE'/ {print $13}' | cut -f2 -d=
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n mdt.lustre-MDT0000.hsm.actions | awk '/'0x200000405:0x2:0x0'.*action='ARCHIVE'/ {print $13}' | cut -f2 -d=
Lustre: 13018:0:(lod_object.c:1104:lod_adjust_stripe_size()) Component end 8026032953089089887 is not a multiple of min size 65536
Lustre: 13018:0:(lod_object.c:1115:lod_adjust_stripe_size()) Component end 8026032953089130496 is not aligned by the stripe size 4194304
Link to test
sanity-quota test 1a: Block hard limit (normal use and out of quota)
LustreError: 13023:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 13023:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 13023 Comm: mdt00_000 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0xbfb/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osp.*.destroys_in_flight
Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0
Lustre: DEBUG MARKER: /usr/sbin/lctl conf_param lustre.quota.ost=ugp
Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:10 MB\)
Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
Lustre: DEBUG MARKER: lctl set_param -n os[cd]*.*MDT*.force_sync=1
Link to test
sanity test 39r: lazy atime update on OST
LustreError: 13029:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 13029:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 13029 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
replay-ost-single test 9: Verify that no req deadline happened during recovery
LustreError: 108921:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 108921:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 108921 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
conf-sanity test 50g: deactivated OST should not cause panic
LustreError: 903688:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 903688:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 903688 Comm: mdt00_003 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
? _cond_resched+0x15/0x30
? down_read+0xe/0xa0
? osd_attr_get+0x23b/0x4b0 [osd_zfs]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1
Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs;
Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt1/mdt1
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1; mount -t lustre -o localrecov lustre-mdt1/mdt1 /mnt/lustre-mds1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm15.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm15.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: trevis-107vm15.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: trevis-107vm15.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt1/mdt1 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}'
Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt1/mdt1 2>/dev/null
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm16.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: trevis-107vm16.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds3
Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs;
Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt3/mdt3
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds3; mount -t lustre -o localrecov lustre-mdt3/mdt3 /mnt/lustre-mds3
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm15.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm15.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: trevis-107vm15.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: trevis-107vm15.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt3/mdt3 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}'
Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt3/mdt3 2>/dev/null
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm16.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: trevis-107vm16.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-\*.mds_server_uuid
Autotest: Test running for 165 minutes (lustre-reviews_review-dne-zfs-part-3_115677.37)
Lustre: DEBUG MARKER: trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0000-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0001-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0002-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0002-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0002-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0002-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0003-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0003-mdc-\*.mds_server_uuid
Lustre: DEBUG MARKER: trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0003-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount FULL mdc.lustre-MDT0003-mdc-*.mds_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-59vm5.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: trevis-59vm5.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount \(FULL\|IDLE\) osc.lustre-OST0000-osc-[-0-9a-f]\*.ost_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount \(FULL\|IDLE\) osc.lustre-OST0000-osc-[-0-9a-f]\*.ost_server_uuid
Lustre: DEBUG MARKER: trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
Lustre: DEBUG MARKER: trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0000-osc-[-0-9a-f]*.ost_server_uuid
Lustre: lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x340000403
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-59vm5.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: trevis-59vm5.trevis.whamcloud.com: executing set_default_debug -1 all
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount \(FULL\|IDLE\) osc.lustre-OST0001-osc-[-0-9a-f]\*.ost_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount \(FULL\|IDLE\) osc.lustre-OST0001-osc-[-0-9a-f]\*.ost_server_uuid
Lustre: DEBUG MARKER: trevis-32vm4.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid
Lustre: DEBUG MARKER: trevis-32vm5.trevis.whamcloud.com: executing wait_import_state_mount (FULL|IDLE) osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid
Lustre: DEBUG MARKER: /usr/sbin/lctl mark osc.lustre-OST0001-osc-[-0-9a-f]\*.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-[-0-9a-f]*.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: lctl get_param -n at_min
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm15.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm15.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50
Lustre: DEBUG MARKER: trevis-107vm15.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50
Lustre: DEBUG MARKER: trevis-107vm15.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0000.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm16.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50
Lustre: DEBUG MARKER: trevis-107vm16.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0001.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: lctl get_param -n at_min
Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm15.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm15.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid 50
Lustre: DEBUG MARKER: trevis-107vm15.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid 50
Lustre: DEBUG MARKER: trevis-107vm15.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0002.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-107vm16.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0003.ost_server_uuid 50
Lustre: DEBUG MARKER: trevis-107vm16.trevis.whamcloud.com: executing wait_import_state FULL os[cp].lustre-OST0001-osc-MDT0003.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark os[cp].lustre-OST0001-osc-MDT0003.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: os[cp].lustre-OST0001-osc-MDT0003.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: hostname -I
Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-32vm4.trevis.whamcloud.com: executing wait_import_state \(FULL\|IDLE\) osc.lustre-OST0001-osc-ffff926d833d0800.ost_server_uuid 50
Lustre: DEBUG MARKER: trevis-32vm4.trevis.whamcloud.com: executing wait_import_state (FULL|IDLE) osc.lustre-OST0001-osc-ffff926d833d0800.ost_server_uuid 50
Lustre: DEBUG MARKER: /usr/sbin/lctl mark osc.lustre-OST0001-osc-ffff926d833d0800.ost_server_uuid in FULL state after 0 sec
Lustre: DEBUG MARKER: osc.lustre-OST0001-osc-ffff926d833d0800.ost_server_uuid in FULL state after 0 sec
Link to test
sanity-selinux test 21b: Send sepol for metadata ops
LustreError: 13673:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 13673:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 13673 Comm: mdt00_000 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? groups_alloc+0x1d/0x60
? __kmalloc+0x113/0x250
? ucred_set_audit_enabled.isra.19+0x4e/0x50 [mdt]
? new_init_ucred+0x558/0xd80 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_activate 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c0 --range 10.240.29.14@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.c0.admin_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.c0.admin_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.c0.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.c0.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -P nodemap.c0.sepol=1:targeted:31:90b7f361dfa9fd3d9c3295071f92a0b70a28ddcd2ddbf14c1132dd571261b308
Lustre: Modifying parameter general.nodemap.c0.sepol=1:targeted:31:90b7f361dfa9fd3d9c3295071f92a0b70a28ddcd2ddbf14c1132dd571261b308 in log params
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.c0.sepol
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.c0.sepol
Lustre: DEBUG MARKER: /usr/sbin/lgss_sk -t server -l /tmp/test-framework-keys/nodemap/c0.key
Lustre: DEBUG MARKER: keyctl show | grep lustre | cut -c1-11 |
LustreError: 13673:0:(mdt_handler.c:3205:mdt_reint_internal()) Can't unpack reint, rc -13
Link to test
sanity-sec test 27d: test multiple filesets mounting rules (rw)
LustreError: 362456:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 362456:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 362456 Comm: mdt00_000 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? groups_alloc+0x1d/0x60
? __kmalloc+0x113/0x250
? ucred_set_audit_enabled.isra.19+0x4e/0x50 [mdt]
? new_init_ucred+0x558/0xd80 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param mdt.*.identity_upcall=NONE
Lustre: 401627:0:(mdt_lproc.c:311:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS"
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c0 --range 10.240.29.14@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype uid --idmap 60003:60000
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype gid --idmap 60003:60000
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype uid --idmap 60004:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype gid --idmap 60004:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c1 --range 10.240.29.15@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype uid --idmap 60005:60001
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype gid --idmap 60005:60001
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype uid --idmap 60006:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype gid --idmap 60006:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_activate 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.admin_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.c0.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lgss_sk -t server -l /tmp/test-framework-keys/nodemap/c0.key
Lustre: DEBUG MARKER: keyctl show | grep lustre | cut -c1-11 |
Lustre: DEBUG MARKER: keyctl show
Lustre: 251867:0:(gss_svc_upcall.c:704:gss_svc_searchbyctx()) ctx hdl 0x2601fb136775609d does not have mech ctx: rc = -2
Lustre: 251867:0:(gss_svc_upcall.c:704:gss_svc_searchbyctx()) ctx hdl 0x2601fb13677560a2 does not have mech ctx: rc = -2
Lustre: 251867:0:(gss_svc_upcall.c:704:gss_svc_searchbyctx()) Skipped 3 previous similar messages
Link to test
recovery-small test 10d: test failed blocking ast
LustreError: 13643:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 13643:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 13643 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: 9:0:(gss_svc_upcall.c:704:gss_svc_searchbyctx()) ctx hdl 0x6d5d9a343a903bb8 does not have mech ctx: rc = -2
Link to test
sanity-quota test 1a: Block hard limit (normal use and out of quota)
LustreError: 12553:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 12553:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 12553 Comm: mdt00_003 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0xbfb/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
? _cond_resched+0x15/0x30
? down_read+0xe/0xa0
? osd_attr_get+0x23b/0x4b0 [osd_zfs]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osc.*MDT*.sync_*
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osp.*.destroys_in_flight
Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0
Lustre: DEBUG MARKER: /usr/sbin/lctl conf_param lustre.quota.ost=ugp
Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:10 MB\)
Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
Lustre: DEBUG MARKER: lctl set_param -n os[cd]*.*MDT*.force_sync=1
Link to test
sanity test 24u: create stripe file
LustreError: 47423:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 47423:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 47423 Comm: mdt00_000 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
sanity-sec test 27d: test multiple filesets mounting rules (rw)
LustreError: 551024:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 551024:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 551024 Comm: mdt00_001 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? sptlrpc_svc_alloc_rs+0x63/0x350 [ptlrpc]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x4e/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param mdt.*.identity_upcall=NONE
Lustre: 591554:0:(mdt_lproc.c:311:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS"
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c0 --range 10.240.28.250@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype uid --idmap 60003:60000
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype gid --idmap 60003:60000
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype uid --idmap 60004:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype gid --idmap 60004:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c1 --range 10.240.28.251@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype uid --idmap 60005:60001
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype gid --idmap 60005:60001
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype uid --idmap 60006:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype gid --idmap 60006:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_activate 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.admin_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.c0.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Link to test
sanity test 24u: create stripe file
LustreError: 47930:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 47930:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 47930 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
sanity-sec test 27d: test multiple filesets mounting rules (rw)
LustreError: 549069:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 549069:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 549069 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? sptlrpc_svc_alloc_rs+0x63/0x350 [ptlrpc]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x4e/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param mdt.*.identity_upcall=NONE
Lustre: 589582:0:(mdt_lproc.c:311:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS"
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c0
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c0 --range 10.240.41.195@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype uid --idmap 60003:60000
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype gid --idmap 60003:60000
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype uid --idmap 60004:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c0 --idtype gid --idmap 60004:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add c1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_range --name c1 --range 10.240.41.196@tcp
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype uid --idmap 60005:60001
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype gid --idmap 60005:60001
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype uid --idmap 60006:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_add_idmap --name c1 --idtype gid --idmap 60006:60002
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_activate 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.admin_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name default --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.default.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property admin --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl nodemap_modify --name c0 --property trusted --value 1
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n nodemap.active
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param nodemap.c0.trusted_nodemap
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Lustre: DEBUG MARKER: /usr/sbin/lctl list_nids | grep -w tcp | cut -f 1 -d @
Link to test
sanityn test 9b: append to striped sparse file
LustreError: 12894:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 12894:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 12894 Comm: mdt00_001 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: 12894:0:(lod_object.c:1104:lod_adjust_stripe_size()) Component end 8026032953089089887 is not a multiple of min size 65536
Lustre: 12894:0:(lod_object.c:1115:lod_adjust_stripe_size()) Component end 8026032953089130496 is not aligned by the stripe size 1048576
Link to test
lustre-rsync-test test 7: lustre_rsync stripesize
LustreError: 11205:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 11205:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 11205 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param mdd.lustre-MDT0001.changelog_mask -n
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param mdd.lustre-MDT0001.changelog_mask=+hsm
Lustre: DEBUG MARKER: /usr/sbin/lctl --device lustre-MDT0001 changelog register -n
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param mdd.lustre-MDT0003.changelog_mask -n
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param mdd.lustre-MDT0003.changelog_mask=+hsm
Lustre: DEBUG MARKER: /usr/sbin/lctl --device lustre-MDT0003 changelog register -n
Lustre: 11205:0:(lod_object.c:1104:lod_adjust_stripe_size()) Component end 8026032953089089887 is not a multiple of min size 65536
Lustre: 11205:0:(lod_object.c:1115:lod_adjust_stripe_size()) Component end 8026032953089130496 is not aligned by the stripe size 4194304
Link to test
recovery-small test 10d: test failed blocking ast
LustreError: 28845:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 28845:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 28845 Comm: mdt00_004 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
recovery-small test 10d: test failed blocking ast
LustreError: 27844:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 27844:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 27844 Comm: mdt00_004 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
? _cond_resched+0x15/0x30
? down_read+0xe/0xa0
? osd_attr_get+0x23b/0x4b0 [osd_zfs]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
replay-dual test 25: replay|resend
LustreError: 29731:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 29731:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 29731 Comm: mdt00_004 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
sanity test 24u: create stripe file
LustreError: 44346:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 44346:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 44346 Comm: mdt00_003 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
sanity test 24u: create stripe file
LustreError: 43903:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 43903:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 43903 Comm: mdt00_002 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
sanity test 24u: create stripe file
LustreError: 47577:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 47577:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 47577 Comm: mdt00_001 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
replay-single test 2c: setstripe replay
LustreError: 16982:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 16982:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 16982 Comm: mdt00_003 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: sync; sync; sync
Lustre: DEBUG MARKER: /usr/sbin/lctl --device lustre-MDT0000 notransno
Lustre: DEBUG MARKER: modprobe dm-flakey;
Lustre: DEBUG MARKER: dmsetup table /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: dmsetup suspend --nolockfs --noflush /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: dmsetup load /dev/mapper/mds1_flakey --table "0 3964928 flakey 252:0 0 0 1800 1 drop_writes"
Lustre: DEBUG MARKER: dmsetup resume /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: /usr/sbin/lctl mark mds1 REPLAY BARRIER on lustre-MDT0000
Lustre: DEBUG MARKER: mds1 REPLAY BARRIER on lustre-MDT0000
Link to test
ost-pools test 6: getstripe/setstripe
LustreError: 16376:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 16376:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 16376 Comm: mdt00_003 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
? lod_qos_parse_config+0x6be/0x1120 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
? lustre_msg_add_version+0x21/0xa0 [ptlrpc]
? lustre_pack_reply_v2+0x1eb/0x280 [ptlrpc]
? ucred_set_audit_enabled.isra.19+0x20/0x50 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_bd_add_locked+0x1f/0x90 [obdclass]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: lctl pool_new lustre.testpool
Lustre: DEBUG MARKER: lctl get_param -n lod.lustre-MDT0000-mdtlov.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lod.lustre-MDT0002-mdtlov.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl pool_list lustre
Lustre: DEBUG MARKER: lctl pool_add lustre.testpool lustre-OST[0000-0007/1]
Lustre: DEBUG MARKER: lctl get_param -n lod.lustre-MDT0000-mdtlov.pools.testpool |
Lustre: DEBUG MARKER: lctl get_param -n lod.lustre-MDT0002-mdtlov.pools.testpool |
Link to test
sanity test 24u: create stripe file
LustreError: 13827:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 13827:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 0 PID: 13827 Comm: mdt00_001 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
sanity test 24u: create stripe file
LustreError: 12895:0:(lod_qos.c:2999:lod_qos_prep_create()) ASSERTION( lod_comp->llc_stripe_count ) failed:
LustreError: 12895:0:(lod_qos.c:2999:lod_qos_prep_create()) LBUG
CPU: 1 PID: 12895 Comm: mdt00_000 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.58.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
lod_qos_prep_create+0xef9/0x1840 [lod]
lod_prepare_create+0x237/0x330 [lod]
lod_declare_striped_create+0x1d2/0x970 [lod]
lod_declare_xattr_set+0x509/0x1190 [lod]
mdd_create_data+0x420/0x740 [mdd]
mdt_mfd_open+0xf8c/0x1110 [mdt]
mdt_finish_open+0x708/0x9f0 [mdt]
mdt_open_by_fid_lock+0x7ca/0xc80 [mdt]
mdt_reint_open+0x880/0x2a90 [mdt]
mdt_reint_rec+0x123/0x270 [mdt]
mdt_reint_internal+0x4d2/0x980 [mdt]
mdt_intent_open+0x13b/0x420 [mdt]
? mdt_intent_fixup_resent+0x220/0x220 [mdt]
mdt_intent_opc.constprop.83+0x125/0xc50 [mdt]
? lprocfs_counter_add+0x117/0x180 [obdclass]
mdt_intent_policy+0xfb/0x470 [mdt]
ldlm_lock_enqueue+0x3e7/0x8f0 [ptlrpc]
? cfs_hash_multi_bd_lock+0xa0/0xa0 [obdclass]
ldlm_handle_enqueue+0x4ea/0x1630 [ptlrpc]
tgt_enqueue+0xa8/0x230 [ptlrpc]
tgt_request_handle+0x3f4/0x1b60 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xbc2/0x1490 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Link to test
Return to new crashes list