LustreError: 3204537:0:(statahead.c:1729:ll_deauthorize_statahead()) ASSERTION( lli->lli_opendir_key == key ) failed:
LustreError: 3204537:0:(statahead.c:1729:ll_deauthorize_statahead()) LBUG
CPU: 10 PID: 3204537 Comm: ls Kdump: loaded Tainted: G O -------- - - 4.18.0rocky8.10-debug #2
Hardware name: Red Hat KVM, BIOS 1.16.0-4.module+el8.9.0+1408+7b966129 04/01/2014
Call Trace:
dump_stack+0x99/0xca
lbug_with_loc.cold.4+0xd/0x86 [libcfs]
ll_deauthorize_statahead+0x471/0x570 [lustre]
ll_file_release+0x4d0/0xcb0 [lustre]
ll_dir_release+0x124/0x140 [lustre]
__fput+0x112/0x440
____fput+0x16/0x20
task_work_run+0xd2/0x120
exit_to_usermode_loop+0x1e4/0x200
do_syscall_64+0x3de/0x3f0
entry_SYSCALL_64_after_hwframe+0x49/0xae
RIP: 0033:0x7fe1a5b997ab

Lustre: 2605317:0:(mdt_recovery.c:102:mdt_req_from_lrd()) @@@ restoring transno req@ffff9c6575389180 x1875412632869120/t4294978444(0) o101->fc42303c-5f8a-4c86-a619-21fc36bfc700@0@lo:610/0 lens 376/816 e 0 to 0 dl 1788532945 ref 1 fl Interpret:H/602/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0
Lustre: 2602222:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0001: opcode 7: before 516 < left 597, rollback = 7
Lustre: 2602222:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2602222:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2602222:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/597/0, punch: 0/0/0, quota 1/3/0
Lustre: 2602222:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2602222:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2605911:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0003: opcode 7: before 516 < left 615, rollback = 7
Lustre: 2605911:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
Lustre: 2605911:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2605911:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2605911:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2605911:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2605911:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 4/150/0
Lustre: 2605911:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2605911:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2605911:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2605911:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2605911:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 1 previous similar message
1[2621076]: segfault at 8 ip 00007f4001468875 sp 00007ffec1d24320 error 4 in ld-2.28.so[7f4001447000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2604261:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0003: opcode 7: before 516 < left 615, rollback = 7
Lustre: 2604261:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
Lustre: 2604261:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2604261:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2604261:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2604261:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2604261:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 4/150/0
Lustre: 2604261:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2604261:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2604261:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2604261:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2604261:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 1 previous similar message
traps: 2[2622635] trap invalid opcode ip:56487d440ce8 sp:7ffee1d28da0 error:0 in 2[56487d43c000+7000]
1[2623248]: segfault at 8 ip 00007f5750d65875 sp 00007ffc048ca9f0 error 4 in ld-2.28.so[7f5750d44000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
3[2625108]: segfault at 8 ip 00007f1788887875 sp 00007ffe81ddcde0 error 4 in ld-2.28.so[7f1788866000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2614680:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0003: opcode 7: before 515 < left 615, rollback = 7
Lustre: 2614680:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
Lustre: 2614680:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2614680:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2614680:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/15/0
Lustre: 2614680:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2614680:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 1/3/0
Lustre: 2614680:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2614680:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2614680:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2614680:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2614680:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2621692:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0001: opcode 7: before 516 < left 615, rollback = 7
Lustre: 2621692:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
Lustre: 2621692:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2621692:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2621692:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2621692:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2621692:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 4/150/0
Lustre: 2621692:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2621692:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2621692:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: 2621692:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2621692:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 1 previous similar message
Lustre: mdt00_011: service thread pid 2604401 was inactive for 40.122 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
Lustre: mdt00_006: service thread pid 2604179 was inactive for 41.135 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
task:mdt00_011 state:I
task:mdt_out00_003 state:I stack:0 pid:2604305 ppid:2 flags:0x80004080
Call Trace:
task:mdt_out00_002 state:I stack:0 pid:2604220 ppid:2 flags:0x80004080
Call Trace:
__schedule+0x351/0xcb0
schedule+0xc4/0x180
schedule_timeout+0xb1/0x190
? __next_timer_interrupt+0x170/0x170
? do_raw_spin_unlock+0x79/0x190
ldlm_completion_ast+0xc26/0x12b0 [ptlrpc]
? woken_wake_function+0x40/0x40
ldlm_cli_enqueue_local+0x5b4/0xb70 [ptlrpc]
? snprintf+0x51/0x70
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
__schedule+0x351/0xcb0
schedule+0xc4/0x180
schedule_timeout+0xb1/0x190
? __next_timer_interrupt+0x170/0x170
? do_raw_spin_unlock+0x79/0x190
? mdt_object_put+0x130/0x130 [mdt]
ldlm_completion_ast+0xc26/0x12b0 [ptlrpc]
mdt_object_pdo_lock+0x54d/0x930 [mdt]
? mdt_object_put+0x130/0x130 [mdt]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
mdt_parent_lock+0x93/0x370 [mdt]
? lu_name_is_valid_len+0x65/0x80 [mdt]
mdt_getattr_name_lock+0x2693/0x32e0 [mdt]
? woken_wake_function+0x40/0x40
mdt_intent_getattr+0x301/0x650 [mdt]
mdt_intent_opc.constprop.47+0x153/0xfa0 [mdt]
ldlm_cli_enqueue_local+0x5b4/0xb70 [ptlrpc]
? mdt_getattr_name_lock+0x32e0/0x32e0 [mdt]
mdt_intent_policy+0x151/0x680 [mdt]
? snprintf+0x51/0x70
ldlm_lock_enqueue+0x449/0xcf0 [ptlrpc]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
? cfs_hash_rw_unlock+0x15/0x40 [obdclass]
? mdt_object_put+0x130/0x130 [mdt]
mdt_object_pdo_lock+0x54d/0x930 [mdt]
? mdt_object_put+0x130/0x130 [mdt]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
mdt_parent_lock+0x93/0x370 [mdt]
? lu_name_is_valid_len+0x65/0x80 [mdt]
mdt_getattr_name_lock+0x2693/0x32e0 [mdt]
mdt_intent_getattr+0x301/0x650 [mdt]
mdt_intent_opc.constprop.47+0x153/0xfa0 [mdt]
? mdt_getattr_name_lock+0x32e0/0x32e0 [mdt]
? cfs_hash_add+0xf6/0x2a0 [obdclass]
mdt_intent_policy+0x151/0x680 [mdt]
ldlm_lock_enqueue+0x449/0xcf0 [ptlrpc]
ldlm_handle_enqueue+0xcac/0x2260 [ptlrpc]
? lustre_msg_buf+0x1f/0x70 [ptlrpc]
mdt_batch_getattr+0xfa/0x200 [mdt]
mdt_batch+0x802/0x1e17 [mdt]
? tgt_check_lookup_req+0x60/0x2e0 [ptlrpc]
tgt_handle_request0+0x139/0xb00 [ptlrpc]
tgt_request_handle+0x59b/0x2010 [ptlrpc]
ptlrpc_server_handle_request+0x443/0x13c0 [ptlrpc]
ptlrpc_main+0xcfc/0x1410 [ptlrpc]
? cfs_hash_rw_unlock+0x15/0x40 [obdclass]
? ptlrpc_wait_event+0x6d0/0x6d0 [ptlrpc]
kthread+0x1de/0x210
? cfs_hash_add+0xf6/0x2a0 [obdclass]
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
ldlm_handle_enqueue+0xcac/0x2260 [ptlrpc]
? lustre_msg_buf+0x1f/0x70 [ptlrpc]
mdt_batch_getattr+0xfa/0x200 [mdt]
mdt_batch+0x802/0x1e17 [mdt]
? tgt_check_lookup_req+0x60/0x2e0 [ptlrpc]
tgt_handle_request0+0x139/0xb00 [ptlrpc]
tgt_request_handle+0x59b/0x2010 [ptlrpc]
ptlrpc_server_handle_request+0x443/0x13c0 [ptlrpc]
ptlrpc_main+0xcfc/0x1410 [ptlrpc]
? ptlrpc_wait_event+0x6d0/0x6d0 [ptlrpc]
kthread+0x1de/0x210
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
Lustre: Skipped 1 previous similar message
stack:0 pid:2604401 ppid:2 flags:0x80004080
Call Trace:
__schedule+0x351/0xcb0
schedule+0xc4/0x180
schedule_timeout+0xb1/0x190
? __next_timer_interrupt+0x170/0x170
? do_raw_spin_unlock+0x79/0x190
ldlm_completion_ast+0xc26/0x12b0 [ptlrpc]
? woken_wake_function+0x40/0x40
ldlm_cli_enqueue_local+0x5b4/0xb70 [ptlrpc]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
? mdt_object_put+0x130/0x130 [mdt]
mdt_object_lock_internal+0x219/0x5b0 [mdt]
? mdt_object_put+0x130/0x130 [mdt]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
mdt_object_lock+0xa1/0x250 [mdt]
mdt_getattr_name_lock+0x26e1/0x32e0 [mdt]
mdt_intent_getattr+0x301/0x650 [mdt]
mdt_intent_opc.constprop.47+0x153/0xfa0 [mdt]
? mdt_getattr_name_lock+0x32e0/0x32e0 [mdt]
mdt_intent_policy+0x151/0x680 [mdt]
ldlm_lock_enqueue+0x449/0xcf0 [ptlrpc]
? cfs_hash_rw_unlock+0x15/0x40 [obdclass]
? cfs_hash_add+0xf6/0x2a0 [obdclass]
ldlm_handle_enqueue+0xcac/0x2260 [ptlrpc]
? lustre_swab_ldlm_lock_desc+0x90/0x90 [ptlrpc]
tgt_enqueue+0xd7/0x320 [ptlrpc]
tgt_handle_request0+0x139/0xb00 [ptlrpc]
tgt_request_handle+0x59b/0x2010 [ptlrpc]
ptlrpc_server_handle_request+0x443/0x13c0 [ptlrpc]
ptlrpc_main+0xcfc/0x1410 [ptlrpc]
? ptlrpc_wait_event+0x6d0/0x6d0 [ptlrpc]
kthread+0x1de/0x210
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
Lustre: mdt00_003: service thread pid 2603236 was inactive for 44.043 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Lustre: Skipped 5 previous similar messages
LustreError: 2601937:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 102s: evicting client at 0@lo ns: mdt-lustre-MDT0000_UUID lock: ffff9c654d02ae00/0x736e7a2a6f47ad68 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x711:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 0@lo remote: 0x736e7a2a6f47acce expref: 317 pid: 2604305 timeout: 11672 lvb_type: 0 lru_score: 0 lru_type: 0
Lustre: mdt00_011: service thread pid 2604401 completed after 101.571s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt00_005: service thread pid 2604158 completed after 102.562s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt_io00_002: service thread pid 2601962 completed after 102.611s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt00_006: service thread pid 2604179 completed after 102.588s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt00_002: service thread pid 2601949 completed after 101.399s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt_out00_003: service thread pid 2604305 completed after 102.606s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt00_001: service thread pid 2601948 completed after 101.400s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt00_016: service thread pid 2606675 completed after 101.400s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt_out00_002: service thread pid 2604220 completed after 102.589s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: mdt00_003: service thread pid 2603236 completed after 101.402s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
LustreError: 2604292:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788533078 with bad export cookie 8317719884472960823
Lustre: lustre-MDT0000-mdc-ffff9c6569484000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
LustreError: lustre-MDT0000-mdc-ffff9c6569484000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
Lustre: mdt00_007: service thread pid 2604180 completed after 101.413s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
LustreError: 2629025:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6569484000: inode [0x200000401:0x71e:0x0] mdc close failed: rc = -108
LustreError: 2628338:0:(file.c:6167:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000402:0x706:0x0] error: rc = -108
Lustre: lustre-MDT0000-mdc-ffff9c6569484000: Connection restored to 0@lo (at 0@lo)
Lustre: 2604409:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0002: opcode 7: before 516 < left 615, rollback = 7
Lustre: 2604409:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 5 previous similar messages
Lustre: 2604409:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2604409:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 5 previous similar messages
Lustre: 2604409:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2604409:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 5 previous similar messages
Lustre: 2604409:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 1/3/0
Lustre: 2604409:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 5 previous similar messages
Lustre: 2604409:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2604409:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 5 previous similar messages
Lustre: 2604409:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2604409:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 5 previous similar messages
Lustre: 2604326:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 516 < left 520, rollback = 2
Lustre: 2601960:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 513 < left 520, rollback = 2
Lustre: 2601960:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0000: opcode 7: before 516 < left 615, rollback = 7
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 21 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 24 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 24 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 1/3/0
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 24 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 24 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 24 previous similar messages
13[2636210]: segfault at 8 ip 00007fee6bf87875 sp 00007fff8148ede0 error 4 in ld-2.28.so[7fee6bf66000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
3[2636256]: segfault at 8 ip 00007faf9e4be875 sp 00007ffeb280bd00 error 4 in ld-2.28.so[7faf9e49d000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
0[2641469]: segfault at 0 ip 000055d6eac75b47 sp 00007fff0750dc70 error 6 in 0[55d6eac71000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
Lustre: 2604326:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 514 < left 520, rollback = 2
2[2642065]: segfault at 8 ip 00007f81db238875 sp 00007fffccdeccc0 error 4 in ld-2.28.so[7f81db217000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
11[2641735]: segfault at 0 ip 000055eee9010b47 sp 00007fff22e62010 error 6 in 11[55eee900c000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
Lustre: 2601962:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 514 < left 520, rollback = 2
Lustre: 2601962:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
Lustre: 2621701:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0001: opcode 7: before 516 < left 615, rollback = 7
Lustre: 2621701:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 37 previous similar messages
Lustre: 2621701:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2621701:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 41 previous similar messages
Lustre: 2621701:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2621701:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 41 previous similar messages
Lustre: 2621701:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 4/150/0
Lustre: 2621701:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 41 previous similar messages
Lustre: 2621701:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2621701:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 41 previous similar messages
Lustre: 2621701:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2621701:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 41 previous similar messages
2[2649835]: segfault at 0 ip 0000563aa095b454 sp 00007ffd91ef1b98 error 6 in 2[563aa0955000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 28 00 00 00 <8c> 03 00 00 e8 d3 ff ff 3a 00 00 00 00 46 0e 10 8c 02 41 0e 18 86
Lustre: 2601961:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 516 < left 520, rollback = 2
Lustre: 2601961:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
Lustre: 2602221:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0001: opcode 7: before 516 < left 615, rollback = 7
Lustre: 2602221:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 25 previous similar messages
Lustre: 2602221:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2602221:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 26 previous similar messages
Lustre: 2602221:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2602221:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 26 previous similar messages
Lustre: 2602221:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 4/78/0
Lustre: 2602221:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 26 previous similar messages
Lustre: 2602221:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2602221:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 26 previous similar messages
Lustre: 2602221:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2602221:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 26 previous similar messages
LustreError: 2665962:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6537bcf000: inode [0x200000403:0xbe3:0x0] mdc close failed: rc = -13
LustreError: 2665962:0:(file.c:251:ll_close_inode_openhandle()) Skipped 7 previous similar messages
4[2671700]: segfault at 8 ip 00007f118c125875 sp 00007ffc00b90b00 error 4 in ld-2.28.so[7f118c104000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
3[2671806]: segfault at 0 ip 00005598a3b3d920 sp 00007ffec49cba60 error 6 in 3[5598a3b39000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 48 83
12[2673681]: segfault at 0 ip 0000560dea77ab47 sp 00007ffdb0150210 error 6 in 12[560dea776000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
6[2675196]: segfault at 0 ip 000055c81299eb47 sp 00007ffee6d78fa0 error 6 in 6 (deleted)[55c81299a000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2[2678384]: segfault at 8 ip 00007fc70cdff875 sp 00007fffdd818950 error 4 in ld-2.28.so[7fc70cdde000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
LustreError: 2686150:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6537bcf000: inode [0x200000401:0x1a51:0x0] mdc close failed: rc = -13
12[2688239]: segfault at 7f5581d657f3 ip 0000558be87f0f0e sp 00007ffeda1c5168 error 6 in 12[558be87ec000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 90 f3 0f 1e fa 48 8b 15 45 2c 20 00 31 f6 e9 ae c8 ff ff 00 00
Lustre: 2601960:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 514 < left 520, rollback = 2
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0003: opcode 7: before 516 < left 549, rollback = 7
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 119 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 121 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 121 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/549/0, punch: 0/0/0, quota 1/3/0
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 121 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 121 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 121 previous similar messages
6[2703386]: segfault at 8 ip 00007f0422405875 sp 00007fff20a36a60 error 4 in ld-2.28.so[7f04223e4000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
18[2707454]: segfault at 0 ip 0000564fdf4b5200 sp 00007fff823a2468 error 6 in 18[564fdf4b3000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
LustreError: 2708373:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6569484000: inode [0x200000403:0x1a27:0x0] mdc close failed: rc = -13
LustreError: 2713653:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6569484000: inode [0x200000403:0x1bf0:0x0] mdc close failed: rc = -13
7[2716254]: segfault at 0 ip 00005588d0650b47 sp 00007ffef48cf520 error 6 in 1[5588d064c000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
19[2732722]: segfault at 0 ip 0000556454528b47 sp 00007fffafcf6fc0 error 6 in 0[556454524000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0[2736011]: segfault at 0 ip 0000563f992acb47 sp 00007ffd76dbfe10 error 6 in 0[563f992a8000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
3[2738951]: segfault at 8 ip 00007f6eba0ab875 sp 00007ffd49aa90a0 error 4 in ld-2.28.so[7f6eba08a000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
2[2741609]: segfault at 8 ip 00007fd5492a9875 sp 00007ffe430908f0 error 4 in ld-2.28.so[7fd549288000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
traps: 19[2748819] trap invalid opcode ip:55e5176c8080 sp:7ffc4ba25400 error:0 in 19[55e5176c2000+7000]
traps: 13[2757623] trap invalid opcode ip:55743a410faa sp:7ffe55fb57f8 error:0 in 13[55743a40b000+7000]
8[2759147]: segfault at 8 ip 00007faebc971875 sp 00007ffdda3e0ff0 error 4 in ld-2.28.so[7faebc950000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
2[2762215]: segfault at 8 ip 00007f9d0d969875 sp 00007ffd93bf7040 error 4 in ld-2.28.so[7f9d0d948000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
5[2763036]: segfault at 8 ip 00007f547c3af875 sp 00007ffefdc24830 error 4 in ld-2.28.so[7f547c38e000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
18[2772925]: segfault at 0 ip 0000562f302c0920 sp 00007ffea95abcc0 error 6 in 18[562f302bc000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
15[2773450]: segfault at 8 ip 00007fb97d56a875 sp 00007ffe4722be40 error 4 in ld-2.28.so[7fb97d549000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
14[2780285]: segfault at 8 ip 00007fe569667875 sp 00007ffcd2bc60d0 error 4 in ld-2.28.so[7fe569646000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
3[2780619]: segfault at 8 ip 00007f3bb3965875 sp 00007ffd9ea78120 error 4 in ld-2.28.so[7f3bb3944000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2601960:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 516 < left 520, rollback = 2
Lustre: 2601960:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
traps: 18[2783151] trap invalid opcode ip:562006211eb2 sp:7ffd8e5f26f8 error:0 in 18[56200620c000+7000]
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0003: opcode 7: before 516 < left 603, rollback = 7
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 255 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 257 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 257 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/603/0, punch: 0/0/0, quota 1/3/0
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 257 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 257 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 257 previous similar messages
5[2790133]: segfault at 8 ip 00007fae7a901875 sp 00007ffd2ee1ef20 error 4 in ld-2.28.so[7fae7a8e0000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
18[2793644]: segfault at 2 ip 0000000000000002 sp 00007fff3298c0d8 error 14 in 18[564a7b0b8000+7000]
Code: Unable to access opcode bytes at RIP 0xffffffffffffffd8.
traps: 0[2795964] trap invalid opcode ip:56507f48e8e4 sp:7fff68ce19a0 error:0 in 12[56507f488000+7000]
Lustre: 2604326:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 516 < left 520, rollback = 2
Lustre: 2604326:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
3[2814763]: segfault at 8 ip 00007f7d57f37875 sp 00007ffc278d1c60 error 4 in ld-2.28.so[7f7d57f16000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
15[2823206]: segfault at 0 ip 000055616c8ca036 sp 00007ffd4b9d12d0 error 6 in 15[55616c8c8000+7000]
Code: 16 e8 ae f5 ff ff 80 3d 77 60 20 00 00 48 89 c3 74 1f 83 38 20 75 1a 48 8b 05 be 5f 20 00 48 8b 38 e8 4e 2b 00 00 85 c0 75 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
LustreError: 2824998:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6537bcf000: inode [0x200000401:0x49a9:0x0] mdc close failed: rc = -13
Lustre: 2604326:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 514 < left 520, rollback = 2
Lustre: 2604326:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
10[2829981]: segfault at 8 ip 00007f24fd391875 sp 00007ffc95e36060 error 4 in ld-2.28.so[7f24fd370000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
LustreError: 2830523:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6569484000: inode [0x200000401:0x4b6c:0x0] mdc close failed: rc = -13
4[2831730]: segfault at 8 ip 00007f2ec6509875 sp 00007ffc8871f270 error 4 in ld-2.28.so[7f2ec64e8000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
LustreError: 2839250:0:(statahead.c:2464:start_statahead_thread()) lustre: unsupported statahead pattern 0X0.
LustreError: 2844184:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6569484000: inode [0x200000403:0x4953:0x0] mdc close failed: rc = -13
2[2850390]: segfault at 8 ip 00007f160e8b9875 sp 00007ffedd7d7530 error 4 in ld-2.28.so[7f160e898000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
4[2853867]: segfault at 8 ip 00007f792040e875 sp 00007ffcfa370730 error 4 in ld-2.28.so[7f79203ed000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
4[2854470]: segfault at 8 ip 00007f66a7c41875 sp 00007fff70945700 error 4 in ld-2.28.so[7f66a7c20000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
LustreError: 2601937:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 103s: evicting client at 0@lo ns: filter-lustre-OST0002_UUID lock: 0000000036a912b3/0x736e7a2a6fd8740e lrc: 3/0,0 mode: PW/PW res: [0x2c0000400:0x585:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 0@lo remote: 0x736e7a2a6fd87407 expref: 31 pid: 2635639 timeout: 12490 lvb_type: 0 lru_score: 0 lru_type: 0
LustreError: lustre-OST0002-osc-ffff9c6569484000: operation ldlm_enqueue to node 0@lo failed: rc = -107
Lustre: lustre-OST0002-osc-ffff9c6569484000: Connection to lustre-OST0002 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
LustreError: lustre-OST0002-osc-ffff9c6569484000: This client was evicted by lustre-OST0002; in progress operations using this service will fail.
5[2863145]: segfault at 8 ip 00007f64b2f05875 sp 00007fff71cbd9d0 error 4 in ld-2.28.so[7f64b2ee4000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2599406:0:(llite_lib.c:4343:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.123.62@tcp:/lustre/fid: [0x200000403:0x4750:0x0]// may get corrupted (rc -108)
Lustre: 2599400:0:(llite_lib.c:4343:ll_dirty_page_discard_warn()) lustre: dirty page discard: 192.168.123.62@tcp:/lustre/fid: [0x200000403:0x4e67:0x0]/ may get corrupted (rc -108)
Lustre: lustre-OST0002-osc-ffff9c6569484000: Connection restored to 0@lo (at 0@lo)
LustreError: 2868150:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6537bcf000: inode [0x200000401:0x5778:0x0] mdc close failed: rc = -13
13[2879905]: segfault at 8 ip 00007f0c457e0875 sp 00007ffe5345de50 error 4 in ld-2.28.so[7f0c457bf000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
0[2884658]: segfault at 8 ip 00007fa80500c875 sp 00007ffe0950a090 error 4 in ld-2.28.so[7fa804feb000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
18[2887357]: segfault at 8 ip 00007f9ef2a79875 sp 00007ffd2676c830 error 4 in ld-2.28.so[7f9ef2a58000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
18[2889931]: segfault at 0 ip 0000555f60603b47 sp 00007fff2365b2b0 error 6 in 18[555f605ff000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
traps: 1[2893675] general protection fault ip:559810fd17ac sp:7ffdf283ea28 error:0 in 1[559810fcb000+7000]
11[2894101]: segfault at 0 ip 000055a21f205a88 sp 00007ffc0ceb0c10 error 6 in 11[55a21f204000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
traps: 12[2894966] trap invalid opcode ip:55d3e6a2d08a sp:7ffd27cb9178 error:0 in 16[55d3e6a27000+7000]
11[2900543]: segfault at 8 ip 00007f98f8478875 sp 00007fff7f75feb0 error 4 in ld-2.28.so[7f98f8457000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
14[2903187]: segfault at 8 ip 00007fc90ead7875 sp 00007ffc81bc9950 error 4 in ld-2.28.so[7fc90eab6000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
14[2903231]: segfault at 8 ip 00007f79dcfd4875 sp 00007ffc6fc61a40 error 4 in ld-2.28.so[7f79dcfb3000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
1[2905760]: segfault at 8 ip 00007fa8a661d875 sp 00007ffc2b32d310 error 4 in ld-2.28.so[7fa8a65fc000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2602222:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0000: opcode 7: before 515 < left 615, rollback = 7
Lustre: 2602222:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 301 previous similar messages
Lustre: 2602222:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2602222:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 305 previous similar messages
Lustre: 2602222:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/15/0
Lustre: 2602222:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 305 previous similar messages
Lustre: 2602222:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 1/3/0
Lustre: 2602222:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 305 previous similar messages
Lustre: 2602222:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2602222:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 305 previous similar messages
Lustre: 2602222:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2602222:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 305 previous similar messages
6[2918633]: segfault at 8 ip 00007f3c51a85875 sp 00007fffe5cc7fe0 error 4 in ld-2.28.so[7f3c51a64000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2601961:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 514 < left 520, rollback = 2
Lustre: 2601961:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 1 previous similar message
0[2924973]: segfault at 0 ip 000055df0a1edb47 sp 00007ffc02e16d30 error 6 in 0[55df0a1e9000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
15[2938872]: segfault at 0 ip 00005596504a9b47 sp 00007ffd04d5a160 error 6 in 15[5596504a5000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
4[2942855]: segfault at 8 ip 00007f22cb75c875 sp 00007ffddce4e5d0 error 4 in ld-2.28.so[7f22cb73b000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
LustreError: 2948481:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6569484000: inode [0x200000403:0x6d9b:0x0] mdc close failed: rc = -13
LustreError: 2948481:0:(file.c:251:ll_close_inode_openhandle()) Skipped 1 previous similar message
11[2953547]: segfault at 8 ip 00007fd2794ba875 sp 00007ffe6e6f4160 error 4 in ld-2.28.so[7fd279499000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
1[2957125]: segfault at 0 ip 000055c13fd14a88 sp 00007ffea50dbf70 error 6 in 9[55c13fd13000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
ptlrpc_watchdog_fire: 6 callbacks suppressed
Lustre: mdt00_009: service thread pid 2604377 was inactive for 43.556 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Lustre: mdt_io00_000: service thread pid 2601960 was inactive for 43.613 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
task:ll_ost_out00_00 state:I stack:0 pid:2871046 ppid:2 flags:0x80004080
Call Trace:
task:mdt00_007 state:I stack:0 pid:2604180 ppid:2 flags:0x80004080
Call Trace:
__schedule+0x351/0xcb0
schedule+0xc4/0x180
schedule_timeout+0xb1/0x190
? __next_timer_interrupt+0x170/0x170
? do_raw_spin_unlock+0x79/0x190
ldlm_completion_ast+0xc26/0x12b0 [ptlrpc]
? woken_wake_function+0x40/0x40
ldlm_cli_enqueue_local+0x5b4/0xb70 [ptlrpc]
? osd_xattr_get+0x503/0x930 [osd_ldiskfs]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
__schedule+0x351/0xcb0
schedule+0xc4/0x180
schedule_timeout+0xb1/0x190
? __next_timer_interrupt+0x170/0x170
? do_raw_spin_unlock+0x79/0x190
ldlm_completion_ast+0xc26/0x12b0 [ptlrpc]
? woken_wake_function+0x40/0x40
ldlm_cli_enqueue_local+0x5b4/0xb70 [ptlrpc]
? snprintf+0x51/0x70
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
? mdt_object_put+0x130/0x130 [mdt]
mdt_object_pdo_lock+0x54d/0x930 [mdt]
? mdt_object_put+0x130/0x130 [mdt]
Lustre: Skipped 4 previous similar messages
task:mdt_io00_000 state:I stack:0 pid:2601960 ppid:2 flags:0x80004080
Call Trace:
__schedule+0x351/0xcb0
schedule+0xc4/0x180
schedule_timeout+0xb1/0x190
? __next_timer_interrupt+0x170/0x170
? do_raw_spin_unlock+0x79/0x190
ldlm_completion_ast+0xc26/0x12b0 [ptlrpc]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
? woken_wake_function+0x40/0x40
ldlm_cli_enqueue_local+0x5b4/0xb70 [ptlrpc]
mdt_parent_lock+0x93/0x370 [mdt]
? lu_name_is_valid_len+0x65/0x80 [mdt]
mdt_getattr_name_lock+0x2693/0x32e0 [mdt]
mdt_intent_getattr+0x301/0x650 [mdt]
mdt_intent_opc.constprop.47+0x153/0xfa0 [mdt]
? mdt_getattr_name_lock+0x32e0/0x32e0 [mdt]
mdt_intent_policy+0x151/0x680 [mdt]
ldlm_lock_enqueue+0x449/0xcf0 [ptlrpc]
? cfs_hash_rw_unlock+0x15/0x40 [obdclass]
? cfs_hash_add+0xf6/0x2a0 [obdclass]
ldlm_handle_enqueue+0xcac/0x2260 [ptlrpc]
? lustre_msg_buf+0x1f/0x70 [ptlrpc]
mdt_batch_getattr+0xfa/0x200 [mdt]
mdt_batch+0x802/0x1e17 [mdt]
? tgt_check_lookup_req+0x60/0x2e0 [ptlrpc]
tgt_handle_request0+0x139/0xb00 [ptlrpc]
tgt_request_handle+0x59b/0x2010 [ptlrpc]
ptlrpc_server_handle_request+0x443/0x13c0 [ptlrpc]
? mdt_object_put+0x130/0x130 [mdt]
ptlrpc_main+0xcfc/0x1410 [ptlrpc]
? ptlrpc_wait_event+0x6d0/0x6d0 [ptlrpc]
kthread+0x1de/0x210
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
mdt_object_lock_internal+0x219/0x5b0 [mdt]
? mdt_object_put+0x130/0x130 [mdt]
? mdt_object_put+0x130/0x130 [mdt]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
mdt_object_lock+0xa1/0x250 [mdt]
mdt_object_stripes_lock+0x29c/0x690 [mdt]
mdt_reint_setattr+0xff8/0x2020 [mdt]
? old_init_ucred_common+0x1a1/0x830 [mdt]
mdt_reint_rec+0x144/0x2c0 [mdt]
mdt_reint_internal+0x6a0/0xdd0 [mdt]
mdt_reint+0x16c/0x190 [mdt]
tgt_handle_request0+0x139/0xb00 [ptlrpc]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
tgt_request_handle+0x59b/0x2010 [ptlrpc]
? mdt_object_put+0x130/0x130 [mdt]
ptlrpc_server_handle_request+0x443/0x13c0 [ptlrpc]
mdt_object_lock_internal+0x219/0x5b0 [mdt]
? mdt_object_put+0x130/0x130 [mdt]
ptlrpc_main+0xcfc/0x1410 [ptlrpc]
? ptlrpc_wait_event+0x6d0/0x6d0 [ptlrpc]
? ldlm_cli_enqueue_local+0xb70/0xb70 [ptlrpc]
kthread+0x1de/0x210
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
mdt_object_check_lock+0x24b/0x4c0 [mdt]
mdt_reint_rename+0x17f7/0x34a0 [mdt]
mdt_reint_rec+0x144/0x2c0 [mdt]
mdt_reint_internal+0x6a0/0xdd0 [mdt]
mdt_reint+0x16c/0x190 [mdt]
tgt_handle_request0+0x139/0xb00 [ptlrpc]
tgt_request_handle+0x59b/0x2010 [ptlrpc]
ptlrpc_server_handle_request+0x443/0x13c0 [ptlrpc]
ptlrpc_main+0xcfc/0x1410 [ptlrpc]
? ptlrpc_wait_event+0x6d0/0x6d0 [ptlrpc]
kthread+0x1de/0x210
? set_kthread_struct+0x70/0x70
ret_from_fork+0x1f/0x30
Lustre: ll_ost_out00_00: service thread pid 2602227 was inactive for 73.214 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Lustre: Skipped 1 previous similar message
LustreError: 2601937:0:(ldlm_lockd.c:255:expired_lock_main()) ### lock callback timer expired after 101s: evicting client at 0@lo ns: mdt-lustre-MDT0000_UUID lock: ffff9c65728c1200/0x736e7a2a70302133 lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x71d4:0x0].0x0 bits 0x13/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 0@lo remote: 0x736e7a2a703020ca expref: 1364 pid: 2871046 timeout: 12992 lvb_type: 0 lru_score: 0 lru_type: 0
Lustre: mdt00_007: service thread pid 2604180 completed after 98.676s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: ll_ost_out00_00: service thread pid 2630374 was inactive for 74.750 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
Lustre: mdt_io00_000: service thread pid 2601960 completed after 100.988s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
LustreError: 2608144:0:(ldlm_lockd.c:1453:ldlm_handle_enqueue()) ### lock on destroyed export 00000000f3dd33e2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c65b0246800/0x736e7a2a70302cee lrc: 3/0,0 mode: PR/PR res: [0x200000403:0x71d4:0x0].0x0 bits 0x13/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000000 nid: 0@lo remote: 0x736e7a2a70302435 expref: 495 pid: 2608144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
Lustre: ll_ost_out00_00: service thread pid 2871046 completed after 100.986s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: lustre-MDT0000-mdc-ffff9c6569484000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
LustreError: lustre-MDT0000-mdc-ffff9c6569484000: This client was evicted by lustre-MDT0000; in progress operations using this service will fail.
Lustre: mdt00_009: service thread pid 2604377 completed after 100.938s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
LustreError: 2608144:0:(ldlm_lockd.c:1453:ldlm_handle_enqueue()) Skipped 1 previous similar message
Lustre: ll_ost_out00_00: service thread pid 2630374 completed after 74.789s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: ll_ost_out00_00: service thread pid 2602227 completed after 77.359s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
LustreError: 2607797:0:(client.c:1394:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff9c657d56e580 x1875412872132224/t0(0) o104->lustre-MDT0000@0@lo:15/16 lens 328/224 e 0 to 0 dl 0 ref 1 fl Rpc:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
LustreError: 2963149:0:(file.c:6167:ll_inode_revalidate_fini()) lustre: revalidate FID [0x200000401:0x77b0:0x0] error: rc = -5
Lustre: mdt00_019: service thread pid 2608144 completed after 100.956s. This likely indicates the system was overloaded (too many service threads, or not enough hardware resources).
Lustre: lustre-MDT0000-mdc-ffff9c6569484000: Connection restored to 0@lo (at 0@lo)
19[2966330]: segfault at 77 ip 00005649e3bf50fe sp 00007fff665c9148 error 6 in 19[5649e3bf0000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 6f 75 72 73 20 6f 72 20 27 64 27 20 66 6f 72 20 64 61 79 73 2e
13[2966650]: segfault at 0 ip 0000557756baab47 sp 00007ffcbcb01ee0 error 6 in 13[557756ba6000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
18[2971755]: segfault at 0 ip 0000555fb5feab47 sp 00007fffdcd4b130 error 6 in 18[555fb5fe6000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
7[2981921]: segfault at 8 ip 00007f57fc72a875 sp 00007ffc98204b90 error 4 in ld-2.28.so[7f57fc709000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
10[2983545]: segfault at 8 ip 00007f619edc1875 sp 00007fffd8195ed0 error 4 in ld-2.28.so[7f619eda0000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
14[2985246]: segfault at 8 ip 00007f85d3870875 sp 00007ffca71dfc40 error 4 in ld-2.28.so[7f85d384f000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
3[2989710]: segfault at 8 ip 00007f4b87b91875 sp 00007fff9b29de00 error 4 in ld-2.28.so[7f4b87b70000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2604326:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 514 < left 520, rollback = 2
Lustre: 2604326:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 2 previous similar messages
13[2991055]: segfault at 55a4abe18000 ip 000055a4abe18000 sp 00007fff0668b758 error 14 in 19[55a4ac018000+1000]
Code: Unable to access opcode bytes at RIP 0x55a4abe17fd6.
13[2991644]: segfault at 0 ip 000055755921eb47 sp 00007ffc3a4f1da0 error 6 in 13[55755921a000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
14[3001659]: segfault at 8 ip 00007f0082919875 sp 00007ffcf8b605a0 error 4 in ld-2.28.so[7f00828f8000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
16[3013039]: segfault at 8 ip 00007f8fbc6f0875 sp 00007ffe94eda240 error 4 in ld-2.28.so[7f8fbc6cf000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
19[3013279]: segfault at 8 ip 00007fcab1c41875 sp 00007ffe382a6ed0 error 4 in ld-2.28.so[7fcab1c20000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
8[3018746]: segfault at 8 ip 00007f745352d875 sp 00007ffcd3854c60 error 4 in ld-2.28.so[7f745350c000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
18[3020354]: segfault at 0 ip 0000563e6a34fb47 sp 00007ffd89102cc0 error 6 in 18[563e6a34b000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
9[3023277]: segfault at 8 ip 00007f190a489875 sp 00007ffffe215dd0 error 4 in ld-2.28.so[7f190a468000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
17[3033242]: segfault at 8 ip 00007fbad3e19875 sp 00007ffde807a670 error 4 in ld-2.28.so[7fbad3df8000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
8[3042052]: segfault at ee717cfe ip 00005562d7e0902a sp 00007ffee15656b8 error 4 in 8[5562d7e07000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 48 8b 05 be 5f 20 00 <48> 8b 38 e8 4e 2b 00 00 85 c0 75 46 48 83 c4 08 5b 5d c3 31 ff ba
6[3043733]: segfault at 55e9b0de1000 ip 000055e9b0de1000 sp 00007ffe619cc5a8 error 14 in 10[55e9b0fe1000+1000]
Code: Unable to access opcode bytes at RIP 0x55e9b0de0fd6.
18[3046681]: segfault at 0 ip 00005625f402fb47 sp 00007ffc2ea7b3a0 error 6 in 18[5625f402b000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
8[3053103]: segfault at 8 ip 00007fc01db2f875 sp 00007ffeff270650 error 4 in ld-2.28.so[7fc01db0e000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0000: opcode 7: before 516 < left 615, rollback = 7
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 437 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 446 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/0, xattr_set: 2/15/0
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 446 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 4/150/0
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 446 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 446 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 446 previous similar messages
14[3057379]: segfault at 56163134a000 ip 000056163134a000 sp 00007ffcd786d618 error 14 in 14[56163154a000+1000]
Code: Unable to access opcode bytes at RIP 0x561631349fd6.
LustreError: 3059919:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6537bcf000: inode [0x200000404:0x1f10:0x0] mdc close failed: rc = -13
LustreError: 3059919:0:(file.c:251:ll_close_inode_openhandle()) Skipped 6 previous similar messages
0[3059851]: segfault at 0 ip 000055c98046bb47 sp 00007ffffacd8cb0 error 6 in 0[55c980467000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
1[3061920]: segfault at 8 ip 00007f900b1e4875 sp 00007fff53c2bd30 error 4 in ld-2.28.so[7f900b1c3000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
1[3071996]: segfault at 55a788ed93e7 ip 000055a788c2936e sp 00007fff25f361d8 error 6 in 1[55a788c24000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 3a <20> 25 73 00 2b 00 68 65 6c 70 00 76 65 72 73 69 6f 6e 00 00 00 00
9[3079640]: segfault at 8 ip 00007fd9476a5875 sp 00007ffc1e3069e0 error 4 in ld-2.28.so[7fd947684000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
5[3081138]: segfault at 8 ip 00007f832f715875 sp 00007ffecff3f7e0 error 4 in ld-2.28.so[7f832f6f4000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
5[3081216]: segfault at 8 ip 00007fe0fd7d2875 sp 00007fff408ea3e0 error 4 in ld-2.28.so[7fe0fd7b1000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
10[3084409]: segfault at 8 ip 00007f9797c37875 sp 00007ffdfe1e52a0 error 4 in ld-2.28.so[7f9797c16000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
10[3084587]: segfault at 8 ip 00007fe10bff2875 sp 00007ffe31dde9f0 error 4 in ld-2.28.so[7fe10bfd1000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
13[3085202]: segfault at 8 ip 00007f55ae1fc875 sp 00007ffe8a4a18a0 error 4 in ld-2.28.so[7f55ae1db000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
14[3100676]: segfault at 8 ip 00007f4874e02875 sp 00007ffdedf1a7c0 error 4 in ld-2.28.so[7f4874de1000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
19[3103607]: segfault at 8 ip 00007f211845f875 sp 00007ffe04788640 error 4 in ld-2.28.so[7f211843e000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
7[3111209]: segfault at 8 ip 00007f760c3ae875 sp 00007ffff07e2460 error 4 in ld-2.28.so[7f760c38d000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
14[3111446]: segfault at 8 ip 00007f96663b9875 sp 00007ffc510034f0 error 4 in ld-2.28.so[7f9666398000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
2[3131647]: segfault at 8 ip 00007f204fa10875 sp 00007ffdc5e64aa0 error 4 in ld-2.28.so[7f204f9ef000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
6[3134479]: segfault at 1 ip 000055cfa2185950 sp 00007ffdf8259808 error 6 in 6[55cfa2181000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
6[3134879]: segfault at 0 ip 000055cba7966200 sp 00007ffd8a492d38 error 6 in 6[55cba7964000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
Lustre: 2737722:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-MDT0000: opcode 2: before 516 < left 520, rollback = 2
Lustre: 2737722:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 6 previous similar messages
11[3140206]: segfault at 0 ip 0000562da6d5ab47 sp 00007ffd1e7a4050 error 6 in 11[562da6d56000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
16[3146545]: segfault at 8 ip 00007fee34097875 sp 00007fffaf88f510 error 4 in ld-2.28.so[7fee34076000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
8[3150080]: segfault at 0 ip 000055d6d9220a88 sp 00007ffef3b50590 error 6 in 16[55d6d921f000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
19[3151391]: segfault at 0 ip 0000565305135b47 sp 00007ffc7aeb03f0 error 6 in 19[565305131000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
6[3164112]: segfault at 0 ip 000055c790dc6b47 sp 00007ffd5b067830 error 6 in 6[55c790dc2000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
0[3168978]: segfault at 0 ip 000055c18a5c3b47 sp 00007ffd5aeaba40 error 6 in 0[55c18a5bf000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
18[3169564]: segfault at 8 ip 00007fde7d19c875 sp 00007ffe741ef0e0 error 4 in ld-2.28.so[7fde7d17b000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
18[3169621]: segfault at 8 ip 00007f780975b875 sp 00007ffc3955c0b0 error 4 in ld-2.28.so[7f780973a000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
16[3180971]: segfault at 8 ip 00007f723bc9c875 sp 00007fff8f18e930 error 4 in ld-2.28.so[7f723bc7b000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
17[3187428]: segfault at 8 ip 00007fc93fce0875 sp 00007ffd12221d40 error 4 in ld-2.28.so[7fc93fcbf000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
LustreError: 3188918:0:(file.c:251:ll_close_inode_openhandle()) lustre-clilmv-ffff9c6569484000: inode [0x200000401:0xc1cd:0x0] mdc close failed: rc = -13
LustreError: 3188918:0:(file.c:251:ll_close_inode_openhandle()) Skipped 3 previous similar messages
8[3189517]: segfault at 8 ip 00007f37e66f9875 sp 00007ffc17e72a10 error 4 in ld-2.28.so[7f37e66d8000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) lustre-OST0003: opcode 7: before 515 < left 615, rollback = 7
Lustre: 2602223:0:(osd_internal.h:1462:osd_trans_exec_op()) Skipped 353 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) create: 0/0/0, destroy: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2092:osd_trans_dump_creds()) Skipped 355 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) attr_set: 1/1/1, xattr_set: 2/15/0
Lustre: 2602223:0:(osd_handler.c:2099:osd_trans_dump_creds()) Skipped 355 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) write: 2/615/0, punch: 0/0/0, quota 1/3/0
Lustre: 2602223:0:(osd_handler.c:2109:osd_trans_dump_creds()) Skipped 355 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) insert: 0/0/0, delete: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2116:osd_trans_dump_creds()) Skipped 355 previous similar messages
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) ref_add: 0/0/0, ref_del: 0/0/0
Lustre: 2602223:0:(osd_handler.c:2123:osd_trans_dump_creds()) Skipped 355 previous similar messages
17[3195375]: segfault at 0 ip 000056503b6ccb47 sp 00007ffe622b1560 error 6 in 17[56503b6c8000+7000]
Code: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <00> 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
6[3204393]: segfault at 8 ip 00007f2efff0e875 sp 00007ffd054e0af0 error 4 in ld-2.28.so[7f2effeed000+2f000]
Code: 81 39 52 e5 74 64 0f 84 99 09 00 00 48 85 c0 75 e4 48 83 3d 24 f6 20 00 00 0f 85 aa 09 00 00 49 8b 47 68 49 8b 97 68 02 00 00 <48> 8b 40 08 48 85 d2 74 23 48 8b 72 08 48 01 c6 80 3e 00 74 17 48