| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Comment |
|---|---|---|---|
| sanity test 17n: run e2fsck against master/slave MDT which contains remote dir | LustreError: 363:0:(lu_object.c:1221:lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 6 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a80d4eab LustreError: 363:0:(lu_object.c:1221:lu_device_fini()) LBUG LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a64ebb83[0x4, 1, [0x440000401:0x63:0x0] hash]{ CPU: 0 PID: 363 Comm: kworker/u4:3 Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.53.1.el8_lustre.x86_64 #1 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000fc68b77bosp-object@00000000a64ebb83 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Workqueue: obd_zombid obd_zombie_imp_cull [obdclass] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a64ebb83 Call Trace: dump_stack+0x41/0x60 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000003502e90b[0x4, 1, [0x400000403:0x64:0x0] hash]{ lbug_with_loc.cold.8+0x5/0x43 [libcfs] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000c2a054ecosp-object@000000003502e90b lu_device_fini+0x81/0xc0 [obdclass] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000003502e90b osp_device_free+0x73/0x160 [osp] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000041a7c9a3[0x4, 1, [0x480000402:0x62:0x0] hash]{ class_free_dev+0x5d5/0x710 [obdclass] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000006b4f274bosp-object@0000000041a7c9a3 obd_zombie_imp_cull+0x40b/0x5c0 [obdclass] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000041a7c9a3 process_one_work+0x1d3/0x390 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000004d4cc852[0x4, 1, [0x380000403:0x63:0x0] hash]{ ? process_one_work+0x390/0x390 worker_thread+0x30/0x390 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000ec680218osp-object@000000004d4cc852 ? process_one_work+0x390/0x390 kthread+0x134/0x150 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000004d4cc852 ? set_kthread_struct+0x50/0x50 ret_from_fork+0x35/0x40 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000003468cdbd[0x4, 1, [0x440000401:0x64:0x0] hash]{ | Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 10.240.39.29@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 2 previous similar messages LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 10.240.39.29@tcp failed: rc = -107 LustreError: MGC10.240.39.29@tcp: Connection to MGS (at 10.240.39.29@tcp) was lost; in progress operations using this service will fail Lustre: lustre-MDT0000-lwp-MDT0001: Connection restored to 10.240.39.29@tcp (at 10.240.39.29@tcp) Lustre: Evicted from MGS (at 10.240.39.29@tcp) after server handle changed from 0x2ce746534027da0 to 0x2ce7465340404ea Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-34vm6.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: trevis-34vm6.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds2' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds2 Lustre: Failing over lustre-MDT0001 LustreError: 11141:0:(import.c:699:ptlrpc_connect_import_locked()) can't connect to a closed import LustreError: 32415:0:(osp_object.c:617:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000405:0x1:0x0]: rc = -5 LustreError: 32415:0:(client.c:1375:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@ffff8ebea7369380 x1835383199807360/t0(0) o1000->lustre-MDT0000-osp-MDT0001@10.240.39.29@tcp:24/4 lens 264/4320 e 0 to 0 dl 0 ref 2 fl Rpc:QU/200/ffffffff rc 0/-1 job:'dist_txn-1.0' uid:0 gid:0 projid:4294967295 LustreError: 33861:0:(obd_class.h:479:obd_check_dev()) Device 31 not setup LustreError: 33861:0:(obd_class.h:479:obd_check_dev()) Skipped 23 previous similar messages Lustre: server umount lustre-MDT0001 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && LustreError: 11261:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0001: not available for connect from 10.240.39.24@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: 11261:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 5 previous similar messages Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: e2fsck -h Lustre: DEBUG MARKER: e2fsck -d -v -t -t -f -n /dev/mapper/mds2_flakey -m8 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: modprobe dm-flakey; LustreError: 14511:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0001: not available for connect from 10.240.39.29@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: 14511:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 1 previous similar message Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc Lustre: lustre-MDT0001-osp-MDT0003: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: lustre-MDT0000-osp-MDT0003: Connection restored to 10.240.39.29@tcp (at 10.240.39.29@tcp) Lustre: Skipped 2 previous similar messages Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 5 clients reconnect Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-97vm7.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-97vm7.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: trevis-97vm7.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: trevis-97vm7.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}' Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey 2>/dev/null Lustre: lustre-MDT0001-osp-MDT0003: Connection restored to 10.240.43.250@tcp (at 0@lo) Lustre: lustre-MDT0001: Recovery over after 0:04, of 5 clients 5 recovered and 0 were evicted. Lustre: Skipped 1 previous similar message LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 10.240.39.29@tcp failed: rc = -107 Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 10.240.39.29@tcp) was lost; in progress operations using this service will wait for recovery to complete LustreError: MGC10.240.39.29@tcp: Connection to MGS (at 10.240.39.29@tcp) was lost; in progress operations using this service will fail Lustre: Evicted from MGS (at 10.240.39.29@tcp) after server handle changed from 0x2ce7465340404ea to 0x2ce7465340412d5 Lustre: MGC10.240.39.29@tcp: Connection restored to (at 10.240.39.29@tcp) Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-34vm6.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: trevis-34vm6.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds2' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds2 Lustre: Failing over lustre-MDT0001 LustreError: 36172:0:(obd_class.h:479:obd_check_dev()) Device 31 not setup LustreError: 36172:0:(obd_class.h:479:obd_check_dev()) Skipped 23 previous similar messages Lustre: server umount lustre-MDT0001 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && LustreError: 11262:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-MDT0001: not available for connect from 10.240.39.25@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: e2fsck -h Lustre: DEBUG MARKER: e2fsck -d -v -t -t -f -n /dev/mapper/mds2_flakey -m8 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc Lustre: lustre-MDT0001-osp-MDT0003: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 3 previous similar messages Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/usr/lib64/lustre/u Lustre: lustre-MDT0001: Will be in recovery for at least 1:00, or until 5 clients reconnect Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-97vm7.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-97vm7.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: trevis-97vm7.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: trevis-97vm7.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}' Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey 2>/dev/null Lustre: lustre-MDT0001: Recovery over after 0:04, of 5 clients 5 recovered and 0 were evicted. Lustre: lustre-MDT0001-osp-MDT0003: Connection restored to 10.240.43.250@tcp (at 0@lo) Lustre: Skipped 4 previous similar messages LustreError: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 10.240.39.29@tcp failed: rc = -107 LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 10.240.39.29@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: DEBUG MARKER: /usr/sbin/lctl mark trevis-34vm6.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: trevis-34vm6.trevis.whamcloud.com: executing set_default_debug all all Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds2' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds2 Lustre: Failing over lustre-MDT0001 LustreError: MGC10.240.39.29@tcp: Connection to MGS (at 10.240.39.29@tcp) was lost; in progress operations using this service will fail Lustre: Evicted from MGS (at 10.240.39.29@tcp) after server handle changed from 0x2ce7465340412d5 to 0x2ce7465340436fb LustreError: 38474:0:(obd_class.h:479:obd_check_dev()) Device 31 not setup LustreError: 38474:0:(obd_class.h:479:obd_check_dev()) Skipped 23 previous similar messages LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000ca9314a5[0x4, 1, [0x440000401:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000007549806cosp-object@00000000ca9314a5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000ca9314a5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000e619492b[0x4, 1, [0x3c0000403:0x62:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000ca9314a5[0x4, 1, [0x440000401:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000b0db4d7aosp-object@00000000e619492b LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000007549806cosp-object@00000000ca9314a5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000e619492b LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000c86dcef5[0x5, 1, [0x280000404:0x38c:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000009e370529mdt-object@00000000c86dcef5( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000047931294mdd-object@0000000047931294(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000ca9314a5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000db7b1a60lod-object@00000000db7b1a60 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000e619492b[0x4, 1, [0x3c0000403:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f8b32db4osp-object@000000007e2f4d38 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000b0db4d7aosp-object@00000000e619492b LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000c86dcef5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000e619492b LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000020f0d8e6[0x4, 1, [0x240000404:0x380:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000c86dcef5[0x5, 1, [0x280000404:0x38c:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000aeec5e7fmdt-object@0000000020f0d8e6( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000009e370529mdt-object@00000000c86dcef5( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000428d20d2mdd-object@00000000428d20d2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000047931294mdd-object@0000000047931294(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000db7b1a60lod-object@00000000db7b1a60 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f8b32db4osp-object@000000007e2f4d38 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000c86dcef5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000020f0d8e6[0x4, 1, [0x240000404:0x380:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000aeec5e7fmdt-object@0000000020f0d8e6( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000e628a17flod-object@00000000e628a17f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000428d20d2mdd-object@00000000428d20d2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009cb5a4f7osd-ldiskfs-object@000000009cb5a4f7(i:0000000031e97ce7:323/2507253940)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000e628a17flod-object@00000000e628a17f LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000020f0d8e6 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000003550d946[0x4, 1, [0x240000404:0x3a4:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000ea0136eemdt-object@000000003550d946( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000e26466b8mdd-object@00000000e26466b8(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000c84143f5lod-object@00000000c84143f5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000006f8cbeaaosd-ldiskfs-object@000000006f8cbeaa(i:000000005c215dd1:357/1787005000)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009cb5a4f7osd-ldiskfs-object@000000009cb5a4f7(i:0000000031e97ce7:323/2507253940)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000003550d946 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000020f0d8e6 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000031da1b5b[0x4, 1, [0x4c0000401:0x65:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000003550d946[0x4, 1, [0x240000404:0x3a4:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000009aeb5a35osp-object@0000000031da1b5b LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000ea0136eemdt-object@000000003550d946( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000031da1b5b LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000e26466b8mdd-object@00000000e26466b8(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000097adc675[0x4, 1, [0x240000404:0x365:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000c84143f5lod-object@00000000c84143f5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000ecf3de58mdt-object@0000000097adc675( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000006f8cbeaaosd-ldiskfs-object@000000006f8cbeaa(i:000000005c215dd1:357/1787005000)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000ef1048a2mdd-object@00000000ef1048a2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000003550d946 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000002bb3276lod-object@0000000002bb3276 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000031da1b5b[0x4, 1, [0x4c0000401:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009424b1efosd-ldiskfs-object@000000009424b1ef(i:00000000f2d034a7:318/1560094896)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000009aeb5a35osp-object@0000000031da1b5b LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000097adc675 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000004c2b83fd[0x4, 1, [0x240000404:0x3e3:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000031da1b5b LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000a76db0b5mdt-object@000000004c2b83fd( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000097adc675[0x4, 1, [0x240000404:0x365:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000001b3ad54bmdd-object@000000001b3ad54b(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000ecf3de58mdt-object@0000000097adc675( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000087acf6felod-object@0000000087acf6fe LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000ef1048a2mdd-object@00000000ef1048a2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000090130fb6osd-ldiskfs-object@0000000090130fb6(i:00000000f769179e:386/791880293)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000002bb3276lod-object@0000000002bb3276 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000004c2b83fd LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009424b1efosd-ldiskfs-object@000000009424b1ef(i:00000000f2d034a7:318/1560094896)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000020faa2ac[0x4, 1, [0x380000403:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000097adc675 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000cf23a64fosp-object@0000000020faa2ac LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000004c2b83fd[0x4, 1, [0x240000404:0x3e3:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000020faa2ac LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000a76db0b5mdt-object@000000004c2b83fd( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000009dc005d0[0x4, 1, [0x240000404:0x388:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000001b3ad54bmdd-object@000000001b3ad54b(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000494be083mdt-object@000000009dc005d0( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000b1c59cd9mdd-object@00000000b1c59cd9(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000087acf6felod-object@0000000087acf6fe LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000091a42521lod-object@0000000091a42521 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000090130fb6osd-ldiskfs-object@0000000090130fb6(i:00000000f769179e:386/791880293)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000c4b3cbefosd-ldiskfs-object@00000000c4b3cbef(i:0000000015f287ca:341/2503964260)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000004c2b83fd LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000009dc005d0 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000020faa2ac[0x4, 1, [0x380000403:0x66:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000007488c1aa[0x4, 1, [0x400000403:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000cf23a64fosp-object@0000000020faa2ac LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000000dee8929osp-object@000000007488c1aa LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000020faa2ac LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000009dc005d0[0x4, 1, [0x240000404:0x388:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000494be083mdt-object@000000009dc005d0( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000b1c59cd9mdd-object@00000000b1c59cd9(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000091a42521lod-object@0000000091a42521 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000c4b3cbefosd-ldiskfs-object@00000000c4b3cbef(i:0000000015f287ca:341/2503964260)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000007488c1aa LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000009dc005d0 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000007488c1aa[0x4, 1, [0x400000403:0x66:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000000e7fce2[0x4, 1, [0x240000404:0x35f:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000000dee8929osp-object@000000007488c1aa LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000008b2ba3eemdt-object@0000000000e7fce2( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000007488c1aa LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000005f7b5267mdd-object@000000005f7b5267(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000000e7fce2[0x4, 1, [0x240000404:0x35f:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000091a0099lod-object@00000000091a0099 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000008b2ba3eemdt-object@0000000000e7fce2( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000008cdcd651osd-ldiskfs-object@000000008cdcd651(i:00000000bfa6a86d:261/1923027489)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000005f7b5267mdd-object@000000005f7b5267(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000000e7fce2 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000091a0099lod-object@00000000091a0099 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000d2225dd9[0x4, 1, [0x240000404:0x3ea:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000008cdcd651osd-ldiskfs-object@000000008cdcd651(i:00000000bfa6a86d:261/1923027489)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000515be107mdt-object@00000000d2225dd9( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000000e7fce2 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000d2225dd9[0x4, 1, [0x240000404:0x3ea:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000c2c4a097mdd-object@00000000c2c4a097(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000515be107mdt-object@00000000d2225dd9( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000027769f2clod-object@0000000027769f2c LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000c2c4a097mdd-object@00000000c2c4a097(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009e940527osd-ldiskfs-object@000000009e940527(i:000000002f7655f0:403/2968696111)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000027769f2clod-object@0000000027769f2c LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000d2225dd9 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009e940527osd-ldiskfs-object@000000009e940527(i:000000002f7655f0:403/2968696111)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000d32ef93f[0x4, 1, [0x340000401:0x64:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000d2225dd9 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000000d54752osp-object@00000000d32ef93f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000d32ef93f[0x4, 1, [0x340000401:0x64:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000d32ef93f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000000d54752osp-object@00000000d32ef93f LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000db0e3394[0x4, 1, [0x240000404:0x3ab:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000d32ef93f LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000d0b10accmdt-object@00000000db0e3394( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000db0e3394[0x4, 1, [0x240000404:0x3ab:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000de85e31fmdd-object@00000000de85e31f(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000d0b10accmdt-object@00000000db0e3394( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000005e0a4bedlod-object@000000005e0a4bed LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000de85e31fmdd-object@00000000de85e31f(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000f9c39469osd-ldiskfs-object@00000000f9c39469(i:00000000f86ec4f6:364/3653876643)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000005e0a4bedlod-object@000000005e0a4bed LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000db0e3394 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000f9c39469osd-ldiskfs-object@00000000f9c39469(i:00000000f86ec4f6:364/3653876643)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000c2c5608f[0x4, 1, [0x240000404:0x366:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000db0e3394 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000a135d810mdt-object@00000000c2c5608f( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000c2c5608f[0x4, 1, [0x240000404:0x366:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000001227dee0mdd-object@000000001227dee0(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000a135d810mdt-object@00000000c2c5608f( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000af32aa55lod-object@00000000af32aa55 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000001227dee0mdd-object@000000001227dee0(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000005d24ef95osd-ldiskfs-object@000000005d24ef95(i:0000000020366785:319/3041194691)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000af32aa55lod-object@00000000af32aa55 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000c2c5608f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000005d24ef95osd-ldiskfs-object@000000005d24ef95(i:0000000020366785:319/3041194691)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000072107a7a[0x4, 1, [0x340000401:0x63:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000c2c5608f LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000e82303eaosp-object@0000000072107a7a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000072107a7a[0x4, 1, [0x340000401:0x63:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000072107a7a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000e82303eaosp-object@0000000072107a7a LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000008d3541f[0x4, 1, [0x4c0000401:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000072107a7a LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000fc7d9a95osp-object@0000000008d3541f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000008d3541f[0x4, 1, [0x4c0000401:0x66:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000008d3541f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000fc7d9a95osp-object@0000000008d3541f LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000029a56e14[0x4, 1, [0x240000404:0x3e4:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000008d3541f LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000031f61cbdmdt-object@0000000029a56e14( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000029a56e14[0x4, 1, [0x240000404:0x3e4:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000eaddea59mdd-object@00000000eaddea59(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000031f61cbdmdt-object@0000000029a56e14( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000d3b4ce89lod-object@00000000d3b4ce89 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000eaddea59mdd-object@00000000eaddea59(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000aa5e298aosd-ldiskfs-object@00000000aa5e298a(i:000000005c93e90d:397/3371046807)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000d3b4ce89lod-object@00000000d3b4ce89 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000029a56e14 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000aa5e298aosd-ldiskfs-object@00000000aa5e298a(i:000000005c93e90d:397/3371046807)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000056d2ae31[0x4, 1, [0x240000404:0x381:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000029a56e14 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000bda23f86mdt-object@0000000056d2ae31( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000056d2ae31[0x4, 1, [0x240000404:0x381:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000bec87fe5mdd-object@00000000bec87fe5(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000bda23f86mdt-object@0000000056d2ae31( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000d6e0fa6flod-object@00000000d6e0fa6f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000bec87fe5mdd-object@00000000bec87fe5(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000d2ac9884osd-ldiskfs-object@00000000d2ac9884(i:00000000c91d588c:334/268340251)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000d6e0fa6flod-object@00000000d6e0fa6f LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000056d2ae31 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000d2ac9884osd-ldiskfs-object@00000000d2ac9884(i:00000000c91d588c:334/268340251)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000008a1facb2[0x4, 1, [0x440000401:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000056d2ae31 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000008a1facb2[0x4, 1, [0x440000401:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000006b982e16osp-object@000000008a1facb2 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000006b982e16osp-object@000000008a1facb2 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000008a1facb2 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000cc4e6f1f[0x4, 1, [0x240000404:0x3a5:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000009bf0b3e5mdt-object@00000000cc4e6f1f( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000a1404da3mdd-object@00000000a1404da3(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000008a1facb2 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000ac50b658lod-object@00000000ac50b658 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000cc4e6f1f[0x4, 1, [0x240000404:0x3a5:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000b8ec8a76osd-ldiskfs-object@00000000b8ec8a76(i:000000009f11b8eb:358/1561212690)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000009bf0b3e5mdt-object@00000000cc4e6f1f( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000cc4e6f1f LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000a1404da3mdd-object@00000000a1404da3(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000000f73a5b5[0x4, 1, [0x3c0000403:0x68:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000ac50b658lod-object@00000000ac50b658 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000017f07d15osp-object@000000000f73a5b5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000b8ec8a76osd-ldiskfs-object@00000000b8ec8a76(i:000000009f11b8eb:358/1561212690)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000cc4e6f1f LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000000f73a5b5[0x4, 1, [0x3c0000403:0x68:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000000f73a5b5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000017f07d15osp-object@000000000f73a5b5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a66f0beb[0x4, 1, [0x240000404:0x3c8:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000000f73a5b5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000cf7885e1mdt-object@00000000a66f0beb( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a66f0beb[0x4, 1, [0x240000404:0x3c8:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000009c7f7444mdd-object@000000009c7f7444(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000cf7885e1mdt-object@00000000a66f0beb( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000166629b1lod-object@00000000166629b1 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000009c7f7444mdd-object@000000009c7f7444(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000003f874c5aosd-ldiskfs-object@000000003f874c5a(i:00000000d0a2f8c0:381/3087328348)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000166629b1lod-object@00000000166629b1 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a66f0beb LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000003f874c5aosd-ldiskfs-object@000000003f874c5a(i:00000000d0a2f8c0:381/3087328348)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000ed1b37e5[0x4, 1, [0x240000404:0x3ec:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a66f0beb LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000ed1b37e5[0x4, 1, [0x240000404:0x3ec:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000068ca892cmdt-object@00000000ed1b37e5( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000068ca892cmdt-object@00000000ed1b37e5( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000008df0b0a9mdd-object@000000008df0b0a9(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000008df0b0a9mdd-object@000000008df0b0a9(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000009100cd58lod-object@000000009100cd58 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000009100cd58lod-object@000000009100cd58 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000399abd9fosd-ldiskfs-object@00000000399abd9f(i:0000000028b4155a:405/895141030)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000399abd9fosd-ldiskfs-object@00000000399abd9f(i:0000000028b4155a:405/895141030)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000ed1b37e5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000ed1b37e5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000001c7889cb[0x4, 1, [0x300000401:0x67:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000001c7889cb[0x4, 1, [0x300000401:0x67:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000039178e91osp-object@000000001c7889cb LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000039178e91osp-object@000000001c7889cb LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000001c7889cb LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000001c7889cb LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000bce95876[0x4, 1, [0x400000403:0x65:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000bce95876[0x4, 1, [0x400000403:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f9a8f190osp-object@00000000bce95876 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f9a8f190osp-object@00000000bce95876 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000bce95876 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000bce95876 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000d70255c4[0x4, 1, [0x240000404:0x3eb:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000d70255c4[0x4, 1, [0x240000404:0x3eb:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000dd453751mdt-object@00000000d70255c4( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000dd453751mdt-object@00000000d70255c4( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000dbc43562mdd-object@00000000dbc43562(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000dbc43562mdd-object@00000000dbc43562(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000006e8c7fbalod-object@000000006e8c7fba LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000006e8c7fbalod-object@000000006e8c7fba LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000f1ac2df6osd-ldiskfs-object@00000000f1ac2df6(i:000000002339eb9c:404/2217442743)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000f1ac2df6osd-ldiskfs-object@00000000f1ac2df6(i:000000002339eb9c:404/2217442743)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000d70255c4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000d70255c4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000002e72ecfa[0x4, 1, [0x380000403:0x65:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000002e72ecfa[0x4, 1, [0x380000403:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000089496f66osp-object@000000002e72ecfa LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000089496f66osp-object@000000002e72ecfa LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000002e72ecfa LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000004ac4aba7[0x4, 1, [0x4c0000401:0x67:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000002e72ecfa LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f4125924osp-object@000000004ac4aba7 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000004ac4aba7 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000003890d596[0x4, 1, [0x240000404:0x382:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000071467931mdt-object@000000003890d596( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000061c7cab0mdd-object@0000000061c7cab0(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000a16220e0lod-object@00000000a16220e0 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009865380dosd-ldiskfs-object@000000009865380d(i:000000001534552f:335/1192108376)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000004ac4aba7[0x4, 1, [0x4c0000401:0x67:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000003890d596 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f4125924osp-object@000000004ac4aba7 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000fccc3131[0x4, 1, [0x240000404:0x3a6:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000004ac4aba7 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000001cfc7092mdt-object@00000000fccc3131( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000003890d596[0x4, 1, [0x240000404:0x382:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000ad05ae19mdd-object@00000000ad05ae19(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000071467931mdt-object@000000003890d596( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000061c7cab0mdd-object@0000000061c7cab0(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000eb66621elod-object@00000000eb66621e LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000a16220e0lod-object@00000000a16220e0 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000a329c44bosd-ldiskfs-object@00000000a329c44b(i:000000000b92c9d6:359/1827094231)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009865380dosd-ldiskfs-object@000000009865380d(i:000000001534552f:335/1192108376)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000fccc3131 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000003890d596 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000b72b10f5[0x4, 1, [0x240000404:0x367:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000fccc3131[0x4, 1, [0x240000404:0x3a6:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000ff37ee8amdt-object@00000000b72b10f5( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000001cfc7092mdt-object@00000000fccc3131( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000006514f948mdd-object@000000006514f948(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000a167fb06lod-object@00000000a167fb06 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000006f7dbf33osd-ldiskfs-object@000000006f7dbf33(i:00000000d0a1a805:320/928532227)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000b72b10f5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000ad05ae19mdd-object@00000000ad05ae19(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000029bdd563[0x4, 1, [0x340000401:0x62:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000eb66621elod-object@00000000eb66621e LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000529c4cebosp-object@0000000029bdd563 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000a329c44bosd-ldiskfs-object@00000000a329c44b(i:000000000b92c9d6:359/1827094231)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000029bdd563 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000fccc3131 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000007dc9e30[0x4, 1, [0x240000404:0x389:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000b72b10f5[0x4, 1, [0x240000404:0x367:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000004c07f2d5mdt-object@0000000007dc9e30( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000ff37ee8amdt-object@00000000b72b10f5( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000023ec5905mdd-object@0000000023ec5905(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000006514f948mdd-object@000000006514f948(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000b534bcc0lod-object@00000000b534bcc0 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000a167fb06lod-object@00000000a167fb06 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009edc6122osd-ldiskfs-object@000000009edc6122(i:000000000bee96f9:342/3843195104)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000006f7dbf33osd-ldiskfs-object@000000006f7dbf33(i:00000000d0a1a805:320/928532227)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000007dc9e30 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a96b92d3[0x4, 1, [0x480000402:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000b72b10f5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000008b02d0feosp-object@00000000a96b92d3 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000029bdd563[0x4, 1, [0x340000401:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a96b92d3 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000529c4cebosp-object@0000000029bdd563 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000e47772ba[0x4, 1, [0x240000404:0x3e5:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000029bdd563 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000002c5a852cmdt-object@00000000e47772ba( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000007dc9e30[0x4, 1, [0x240000404:0x389:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000018668cbmdd-object@00000000018668cb(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000004c07f2d5mdt-object@0000000007dc9e30( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000cd6d80cclod-object@00000000cd6d80cc LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000023ec5905mdd-object@0000000023ec5905(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000076af2246osd-ldiskfs-object@0000000076af2246(i:00000000f7f1248b:398/161387897)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000b534bcc0lod-object@00000000b534bcc0 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000e47772ba LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009edc6122osd-ldiskfs-object@000000009edc6122(i:000000000bee96f9:342/3843195104)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000d81f35fa[0x4, 1, [0x300000401:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000007dc9e30 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a96b92d3[0x4, 1, [0x480000402:0x66:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000006d3d0264osp-object@00000000d81f35fa LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000008b02d0feosp-object@00000000a96b92d3 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000d81f35fa LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a96b92d3 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000024d83fcc[0x4, 1, [0x3c0000403:0x64:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000e47772ba[0x4, 1, [0x240000404:0x3e5:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000007e5fdfb7osp-object@0000000024d83fcc LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000002c5a852cmdt-object@00000000e47772ba( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000024d83fcc LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000018668cbmdd-object@00000000018668cb(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a620e337[0x4, 1, [0x240000404:0x3c2:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000cd6d80cclod-object@00000000cd6d80cc LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000ef010c95mdt-object@00000000a620e337( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000076af2246osd-ldiskfs-object@0000000076af2246(i:00000000f7f1248b:398/161387897)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000b7cea4e5mdd-object@00000000b7cea4e5(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000e47772ba LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000003e383140lod-object@000000003e383140 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000d81f35fa[0x4, 1, [0x300000401:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000006d3d0264osp-object@00000000d81f35fa LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000dc6a42daosd-ldiskfs-object@00000000dc6a42da(i:00000000c14e5f2b:365/865046524)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a620e337 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000001cac289e[0x4, 1, [0x480000402:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000030585b1aosp-object@000000001cac289e LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000001cac289e LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000007280aab6[0x4, 1, [0x240000404:0x383:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000d81f35fa LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000004b0b7562mdt-object@000000007280aab6( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000024d83fcc[0x4, 1, [0x3c0000403:0x64:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000325e8a9amdd-object@00000000325e8a9a(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000007e5fdfb7osp-object@0000000024d83fcc LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000968dadc3lod-object@00000000968dadc3 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000024d83fcc LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000002a53cd8eosd-ldiskfs-object@000000002a53cd8e(i:000000004c774373:336/1904336716)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a620e337[0x4, 1, [0x240000404:0x3c2:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000007280aab6 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000ef010c95mdt-object@00000000a620e337( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000039eee26d[0x4, 1, [0x240000404:0x3e6:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000b7cea4e5mdd-object@00000000b7cea4e5(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000007b25b064mdt-object@0000000039eee26d( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000003e383140lod-object@000000003e383140 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000007a90adc5mdd-object@000000007a90adc5(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000dc6a42daosd-ldiskfs-object@00000000dc6a42da(i:00000000c14e5f2b:365/865046524)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000096c20897lod-object@0000000096c20897 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a620e337 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000006d30d88osd-ldiskfs-object@0000000006d30d88(i:00000000851d6c35:399/3954240418)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000001cac289e[0x4, 1, [0x480000402:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000039eee26d LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000030585b1aosp-object@000000001cac289e LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000008dc4030[0x4, 1, [0x240000404:0x3a7:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000185313c6mdt-object@0000000008dc4030( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000e8a83297mdd-object@00000000e8a83297(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000074e04f5elod-object@0000000074e04f5e LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000ffb127f9osd-ldiskfs-object@00000000ffb127f9(i:00000000ccbbc56a:360/3103342838)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000008dc4030 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000002f96562c[0x4, 1, [0x3c0000403:0x63:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000dda880c4osp-object@000000002f96562c LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000001cac289e LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000002f96562c LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000007280aab6[0x4, 1, [0x240000404:0x383:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000823c226b[0x4, 1, [0x240000404:0x3c9:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000004b0b7562mdt-object@000000007280aab6( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000325e8a9amdd-object@00000000325e8a9a(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000be693c9dmdt-object@00000000823c226b( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000968dadc3lod-object@00000000968dadc3 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000038ad0248mdd-object@0000000038ad0248(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000002a53cd8eosd-ldiskfs-object@000000002a53cd8e(i:000000004c774373:336/1904336716)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000002443698dlod-object@000000002443698d LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000007280aab6 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000098b69e54osd-ldiskfs-object@0000000098b69e54(i:00000000e98935ad:382/2891174137)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000039eee26d[0x4, 1, [0x240000404:0x3e6:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000823c226b LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000007b25b064mdt-object@0000000039eee26d( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000dbe7e5c6[0x4, 1, [0x240000404:0x3ed:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000007a90adc5mdd-object@000000007a90adc5(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000060cde0d6mdt-object@00000000dbe7e5c6( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000096c20897lod-object@0000000096c20897 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000189c7c60mdd-object@00000000189c7c60(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000006d30d88osd-ldiskfs-object@0000000006d30d88(i:00000000851d6c35:399/3954240418)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000008a913303lod-object@000000008a913303 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000039eee26d LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000086768263osd-ldiskfs-object@0000000086768263(i:0000000065102ea4:406/3461732761)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000008dc4030[0x4, 1, [0x240000404:0x3a7:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000dbe7e5c6 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000185313c6mdt-object@0000000008dc4030( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000004d9ab64[0x4, 1, [0x240000404:0x38a:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000e8a83297mdd-object@00000000e8a83297(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000b6abac9bmdt-object@0000000004d9ab64( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000074e04f5elod-object@0000000074e04f5e LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000007cdf9c0dmdd-object@000000007cdf9c0d(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000ffb127f9osd-ldiskfs-object@00000000ffb127f9(i:00000000ccbbc56a:360/3103342838)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000002bd3f547lod-object@000000002bd3f547 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000f301e81bosd-ldiskfs-object@00000000f301e81b(i:000000006e1693d6:343/3449575273)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000008dc4030 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000004d9ab64 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000002f96562c[0x4, 1, [0x3c0000403:0x63:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000022bba974[0x4, 1, [0x340000401:0x68:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000dda880c4osp-object@000000002f96562c LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f2daa7d5osp-object@0000000022bba974 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000002f96562c LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000022bba974 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000823c226b[0x4, 1, [0x240000404:0x3c9:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000035a348b4[0x4, 1, [0x400000403:0x67:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000be693c9dmdt-object@00000000823c226b( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000e69700e2osp-object@0000000035a348b4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000038ad0248mdd-object@0000000038ad0248(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000035a348b4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000002443698dlod-object@000000002443698d LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000dbf89c2e[0x4, 1, [0x380000403:0x67:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000098b69e54osd-ldiskfs-object@0000000098b69e54(i:00000000e98935ad:382/2891174137)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000070261b53osp-object@00000000dbf89c2e LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000823c226b LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000dbf89c2e LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000dbe7e5c6[0x4, 1, [0x240000404:0x3ed:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000019661c57[0x4, 1, [0x240000404:0x360:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000060cde0d6mdt-object@00000000dbe7e5c6( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000074ef85b8mdt-object@0000000019661c57( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000189c7c60mdd-object@00000000189c7c60(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000054a042a2mdd-object@0000000054a042a2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000008a913303lod-object@000000008a913303 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000680b114clod-object@00000000680b114c LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000086768263osd-ldiskfs-object@0000000086768263(i:0000000065102ea4:406/3461732761)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000b657525fosd-ldiskfs-object@00000000b657525f(i:000000004ad515d3:313/2019711610)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000dbe7e5c6 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000019661c57 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000004d9ab64[0x4, 1, [0x240000404:0x38a:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000021425589[0x4, 1, [0x240000404:0x384:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000b6abac9bmdt-object@0000000004d9ab64( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000003f33d97emdt-object@0000000021425589( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000007cdf9c0dmdd-object@000000007cdf9c0d(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000097569c63mdd-object@0000000097569c63(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000002bd3f547lod-object@000000002bd3f547 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000c13263bflod-object@00000000c13263bf LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000f301e81bosd-ldiskfs-object@00000000f301e81b(i:000000006e1693d6:343/3449575273)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000000cea41aosd-ldiskfs-object@0000000000cea41a(i:0000000091eac37b:337/3019708290)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000004d9ab64 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000021425589 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000022bba974[0x4, 1, [0x340000401:0x68:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000bb4a0821[0x5, 1, [0x280000404:0x36b:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f2daa7d5osp-object@0000000022bba974 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000b7b607d9mdt-object@00000000bb4a0821( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000022bba974 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000001926594mdd-object@0000000001926594(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000035a348b4[0x4, 1, [0x400000403:0x67:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000b0c5857flod-object@00000000b0c5857f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000e69700e2osp-object@0000000035a348b4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000007470565cosp-object@0000000055233f44 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000035a348b4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000bb4a0821 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000dbf89c2e[0x4, 1, [0x380000403:0x67:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000007683a51c[0x4, 1, [0x300000401:0x65:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000070261b53osp-object@00000000dbf89c2e LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f2e6356aosp-object@000000007683a51c LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000dbf89c2e LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000007683a51c LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000019661c57[0x4, 1, [0x240000404:0x360:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000d43697d4[0x4, 1, [0x380000403:0x62:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000074ef85b8mdt-object@0000000019661c57( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000048de7df0osp-object@00000000d43697d4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000054a042a2mdd-object@0000000054a042a2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000d43697d4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000680b114clod-object@00000000680b114c LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000f7610f33[0x4, 1, [0x240000404:0x3c3:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000b657525fosd-ldiskfs-object@00000000b657525f(i:000000004ad515d3:313/2019711610)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000035ddd79amdt-object@00000000f7610f33( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000019661c57 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000c58af15fmdd-object@00000000c58af15f(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000021425589[0x4, 1, [0x240000404:0x384:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000031a6b063lod-object@0000000031a6b063 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000059d30b0eosd-ldiskfs-object@0000000059d30b0e(i:00000000c1cee9e7:376/2955672554)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000003f33d97emdt-object@0000000021425589( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000f7610f33 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000097569c63mdd-object@0000000097569c63(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000005a9e74e9[0x4, 1, [0x240000404:0x368:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000c13263bflod-object@00000000c13263bf LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000000a1ff750mdt-object@000000005a9e74e9( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000006b9207aamdd-object@000000006b9207aa(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000d784cd40lod-object@00000000d784cd40 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000002bb4ac5eosd-ldiskfs-object@000000002bb4ac5e(i:000000007f713747:321/2116570361)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000005a9e74e9 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000027495c72[0x4, 1, [0x480000402:0x64:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000bb6fdfe1osp-object@0000000027495c72 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000000cea41aosd-ldiskfs-object@0000000000cea41a(i:0000000091eac37b:337/3019708290)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000027495c72 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000021425589 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000065ddf5a5[0x4, 1, [0x240000404:0x3e7:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000bb4a0821[0x5, 1, [0x280000404:0x36b:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000029921235mdt-object@0000000065ddf5a5( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000b7b607d9mdt-object@00000000bb4a0821( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000008931376mdd-object@0000000008931376(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000001926594mdd-object@0000000001926594(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000b0c5857flod-object@00000000b0c5857f LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000c15f8fb4lod-object@00000000c15f8fb4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000007470565cosp-object@0000000055233f44 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000005d950f9dosd-ldiskfs-object@000000005d950f9d(i:00000000d22afd65:400/1612826475)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000bb4a0821 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000065ddf5a5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000007683a51c[0x4, 1, [0x300000401:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000c405c36a[0x4, 1, [0x400000403:0x62:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f2e6356aosp-object@000000007683a51c LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000b2717750osp-object@00000000c405c36a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000007683a51c LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000c405c36a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000d43697d4[0x4, 1, [0x380000403:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000035628826[0x4, 1, [0x240000404:0x3ca:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000048de7df0osp-object@00000000d43697d4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000078b0dd4bmdt-object@0000000035628826( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000d43697d4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000000c2ead28mdd-object@000000000c2ead28(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000f7610f33[0x4, 1, [0x240000404:0x3c3:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000008ff6e01alod-object@000000008ff6e01a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000035ddd79amdt-object@00000000f7610f33( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000c0a648dbosd-ldiskfs-object@00000000c0a648db(i:0000000087a1213d:383/2712255130)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000c58af15fmdd-object@00000000c58af15f(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000035628826 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000031a6b063lod-object@0000000031a6b063 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000049cbdabe[0x4, 1, [0x3c0000403:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000059d30b0eosd-ldiskfs-object@0000000059d30b0e(i:00000000c1cee9e7:376/2955672554)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000002c3ffe2osp-object@0000000049cbdabe LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000f7610f33 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000049cbdabe LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000005a9e74e9[0x4, 1, [0x240000404:0x368:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000bca5b3d4[0x4, 1, [0x300000401:0x64:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000000a1ff750mdt-object@000000005a9e74e9( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000a50c17c3osp-object@00000000bca5b3d4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000006b9207aamdd-object@000000006b9207aa(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000bca5b3d4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000d784cd40lod-object@00000000d784cd40 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000bdcfdd87[0x4, 1, [0x240000404:0x3c4:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000002bb4ac5eosd-ldiskfs-object@000000002bb4ac5e(i:000000007f713747:321/2116570361)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000005afd21ecmdt-object@00000000bdcfdd87( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000005a9e74e9 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000000f328cbcmdd-object@000000000f328cbc(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000027495c72[0x4, 1, [0x480000402:0x64:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000005fc8500blod-object@000000005fc8500b LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000bb6fdfe1osp-object@0000000027495c72 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000430146d6osd-ldiskfs-object@00000000430146d6(i:000000001cb63b78:377/1669604754)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000027495c72 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000bdcfdd87 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000065ddf5a5[0x4, 1, [0x240000404:0x3e7:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000001475bc80[0x4, 1, [0x240000404:0x361:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000029921235mdt-object@0000000065ddf5a5( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000009f1f6334mdt-object@000000001475bc80( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000008931376mdd-object@0000000008931376(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000f8b70c62mdd-object@00000000f8b70c62(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000c15f8fb4lod-object@00000000c15f8fb4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000d42a7b1dlod-object@00000000d42a7b1d LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000005d950f9dosd-ldiskfs-object@000000005d950f9d(i:00000000d22afd65:400/1612826475)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000ce7d513aosd-ldiskfs-object@00000000ce7d513a(i:0000000064920fd5:314/427074979)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000065ddf5a5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000001475bc80 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000c405c36a[0x4, 1, [0x400000403:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000bd436829[0x4, 1, [0x240000404:0x385:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000b2717750osp-object@00000000c405c36a LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000d92ccf38mdt-object@00000000bd436829( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000c405c36a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000035628826[0x4, 1, [0x240000404:0x3ca:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000001de1d8b9mdd-object@000000001de1d8b9(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000078b0dd4bmdt-object@0000000035628826( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000017a725e6lod-object@0000000017a725e6 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000000c2ead28mdd-object@000000000c2ead28(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000eef2b0c3osd-ldiskfs-object@00000000eef2b0c3(i:000000005c123ae4:338/146317077)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000008ff6e01alod-object@000000008ff6e01a LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000bd436829 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000c0a648dbosd-ldiskfs-object@00000000c0a648db(i:0000000087a1213d:383/2712255130)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000cf0060d7[0x4, 1, [0x300000401:0x63:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000035628826 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000b937de1cosp-object@00000000cf0060d7 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000049cbdabe[0x4, 1, [0x3c0000403:0x66:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000cf0060d7 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000002c3ffe2osp-object@0000000049cbdabe LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000001e7112a1[0x4, 1, [0x240000404:0x3a8:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000049cbdabe LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000b7a899ccmdt-object@000000001e7112a1( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000bca5b3d4[0x4, 1, [0x300000401:0x64:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000c947db33mdd-object@00000000c947db33(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000a50c17c3osp-object@00000000bca5b3d4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000006229bab0lod-object@000000006229bab0 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000bca5b3d4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000002828c075osd-ldiskfs-object@000000002828c075(i:000000001162ba8f:361/3461280239)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000bdcfdd87[0x4, 1, [0x240000404:0x3c4:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000001e7112a1 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000038e468a1[0x4, 1, [0x240000404:0x3cc:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000005afd21ecmdt-object@00000000bdcfdd87( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000005916baamdt-object@0000000038e468a1( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000000f328cbcmdd-object@000000000f328cbc(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000006a0b6773mdd-object@000000006a0b6773(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000005fc8500blod-object@000000005fc8500b LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000001b3108aelod-object@000000001b3108ae LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000430146d6osd-ldiskfs-object@00000000430146d6(i:000000001cb63b78:377/1669604754)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000002851bce2osd-ldiskfs-object@000000002851bce2(i:0000000045db2868:385/714486275)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000bdcfdd87 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000038e468a1 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000001475bc80[0x4, 1, [0x240000404:0x361:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000f38063a4[0x4, 1, [0x240000404:0x3cb:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000009f1f6334mdt-object@000000001475bc80( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000002dca13d3mdt-object@00000000f38063a4( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000e26908eemdd-object@00000000e26908ee(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000505eb6delod-object@00000000505eb6de LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000cf5e504bosd-ldiskfs-object@00000000cf5e504b(i:0000000068a3d6e4:384/1272545755)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000f8b70c62mdd-object@00000000f8b70c62(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000f38063a4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000d42a7b1dlod-object@00000000d42a7b1d LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000f4b0ea45[0x5, 1, [0x280000404:0x381:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000ce7d513aosd-ldiskfs-object@00000000ce7d513a(i:0000000064920fd5:314/427074979)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000d5c9b016mdt-object@00000000f4b0ea45( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000001475bc80 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000a7b3e59dmdd-object@00000000a7b3e59d(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000bd436829[0x4, 1, [0x240000404:0x385:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000f24c28d5lod-object@00000000f24c28d5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000015970019osp-object@0000000056db9de1 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000f4b0ea45 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000d92ccf38mdt-object@00000000bd436829( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000005c4122e[0x4, 1, [0x340000401:0x67:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000001de1d8b9mdd-object@000000001de1d8b9(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000009ff50bedosp-object@0000000005c4122e LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000005c4122e LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000001a88200f[0x4, 1, [0x240000404:0x362:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000894e49c4mdt-object@000000001a88200f( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000094a72d50mdd-object@0000000094a72d50(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000002c888171lod-object@000000002c888171 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000007b45d11osd-ldiskfs-object@0000000007b45d11(i:0000000035eba0b2:315/2471076569)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000001a88200f LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000d603e98e[0x4, 1, [0x240000404:0x386:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000017a725e6lod-object@0000000017a725e6 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000001b9e74cdmdt-object@00000000d603e98e( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000070f966c6mdd-object@0000000070f966c6(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000553d19fdlod-object@00000000553d19fd LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000eef2b0c3osd-ldiskfs-object@00000000eef2b0c3(i:000000005c123ae4:338/146317077)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000003d699a14osd-ldiskfs-object@000000003d699a14(i:00000000112932f3:339/265585816)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000bd436829 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000d603e98e LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000cf0060d7[0x4, 1, [0x300000401:0x63:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000312e693e[0x4, 1, [0x400000403:0x68:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000b937de1cosp-object@00000000cf0060d7 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000440491d2osp-object@00000000312e693e LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000312e693e LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000d7ac0cb2[0x4, 1, [0x4c0000401:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000e0f41fb7osp-object@00000000d7ac0cb2 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000cf0060d7 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000d7ac0cb2 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000001e7112a1[0x4, 1, [0x240000404:0x3a8:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000008fc22cbe[0x4, 1, [0x240000404:0x369:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000b7a899ccmdt-object@000000001e7112a1( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000fdc1e1a0mdt-object@000000008fc22cbe( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000c947db33mdd-object@00000000c947db33(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000005dcba079mdd-object@000000005dcba079(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000006229bab0lod-object@000000006229bab0 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000b5b537a1lod-object@00000000b5b537a1 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000002828c075osd-ldiskfs-object@000000002828c075(i:000000001162ba8f:361/3461280239)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000000625a767osd-ldiskfs-object@000000000625a767(i:00000000f5811d3b:322/914639276)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000001e7112a1 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000008fc22cbe LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000038e468a1[0x4, 1, [0x240000404:0x3cc:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a4bee57a[0x4, 1, [0x3c0000403:0x65:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000005916baamdt-object@0000000038e468a1( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000b0a75f7aosp-object@00000000a4bee57a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000006a0b6773mdd-object@000000006a0b6773(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a4bee57a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000001b3108aelod-object@000000001b3108ae LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000002851bce2osd-ldiskfs-object@000000002851bce2(i:0000000045db2868:385/714486275)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000038e468a1 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000003eaf6bd3[0x4, 1, [0x480000402:0x63:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000f38063a4[0x4, 1, [0x240000404:0x3cb:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000002793bd51osp-object@000000003eaf6bd3 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000002dca13d3mdt-object@00000000f38063a4( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000003eaf6bd3 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000e26908eemdd-object@00000000e26908ee(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000f39e0cdb[0x4, 1, [0x240000404:0x3a1:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000505eb6delod-object@00000000505eb6de LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000034c36d3bmdt-object@00000000f39e0cdb( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000cf5e504bosd-ldiskfs-object@00000000cf5e504b(i:0000000068a3d6e4:384/1272545755)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000a4bc31efmdd-object@00000000a4bc31ef(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000f38063a4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000024cb4eb6lod-object@0000000024cb4eb6 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000f4b0ea45[0x5, 1, [0x280000404:0x381:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000b3588c0aosd-ldiskfs-object@00000000b3588c0a(i:00000000b9d06882:344/80147743)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000d5c9b016mdt-object@00000000f4b0ea45( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000f39e0cdb LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000a7b3e59dmdd-object@00000000a7b3e59d(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000b454754f[0x4, 1, [0x440000401:0x62:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000f24c28d5lod-object@00000000f24c28d5 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000002ecc3512osp-object@00000000b454754f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000015970019osp-object@0000000056db9de1 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000b454754f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000f4b0ea45 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a37abbd0[0x4, 1, [0x240000404:0x3c5:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000005c4122e[0x4, 1, [0x340000401:0x67:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000000f9b9b88mdt-object@00000000a37abbd0( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000009ff50bedosp-object@0000000005c4122e LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000351eb390mdd-object@00000000351eb390(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000005c4122e LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000019c3f881lod-object@0000000019c3f881 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000001a88200f[0x4, 1, [0x240000404:0x362:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000f79850dbosd-ldiskfs-object@00000000f79850db(i:00000000808365c3:378/529852003)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000894e49c4mdt-object@000000001a88200f( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a37abbd0 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000094a72d50mdd-object@0000000094a72d50(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000db8ab45d[0x4, 1, [0x300000401:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000099bcec0cosp-object@00000000db8ab45d LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000db8ab45d LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000bdeaa10e[0x4, 1, [0x240000404:0x3e8:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000cae43113mdt-object@00000000bdeaa10e( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000f6cc55b7mdd-object@00000000f6cc55b7(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000044636494lod-object@0000000044636494 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000271c244cosd-ldiskfs-object@00000000271c244c(i:00000000ba4c3bca:401/771609543)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000bdeaa10e LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000002c888171lod-object@000000002c888171 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000001f1ec6bb[0x4, 1, [0x240000404:0x3a2:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000007b45d11osd-ldiskfs-object@0000000007b45d11(i:0000000035eba0b2:315/2471076569)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000000be12a47mdt-object@000000001f1ec6bb( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000001a88200f LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000005fc5558fmdd-object@000000005fc5558f(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000d603e98e[0x4, 1, [0x240000404:0x386:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000027684752lod-object@0000000027684752 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000026896efdosd-ldiskfs-object@0000000026896efd(i:00000000dc58a8b1:355/2502930232)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000001b9e74cdmdt-object@00000000d603e98e( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000001f1ec6bb LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000070f966c6mdd-object@0000000070f966c6(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000000ef421[0x4, 1, [0x240000404:0x363:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000553d19fdlod-object@00000000553d19fd LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000062affafdmdt-object@00000000000ef421( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000003d699a14osd-ldiskfs-object@000000003d699a14(i:00000000112932f3:339/265585816)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000003945154emdd-object@000000003945154e(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000d603e98e LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000006980acd4lod-object@000000006980acd4 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000312e693e[0x4, 1, [0x400000403:0x68:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000d99e6a5aosd-ldiskfs-object@00000000d99e6a5a(i:0000000029a3c44d:316/1777562791)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000440491d2osp-object@00000000312e693e LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000000ef421 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000312e693e LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a085ae42[0x4, 1, [0x240000404:0x3c6:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000d7ac0cb2[0x4, 1, [0x4c0000401:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000001e79f924mdt-object@00000000a085ae42( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000e0f41fb7osp-object@00000000d7ac0cb2 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000025f96ad1mdd-object@0000000025f96ad1(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000d7ac0cb2 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000002b4f005flod-object@000000002b4f005f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000008fc22cbe[0x4, 1, [0x240000404:0x369:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000006a53a8b7osd-ldiskfs-object@000000006a53a8b7(i:000000001f538b03:379/3916140946)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000fdc1e1a0mdt-object@000000008fc22cbe( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a085ae42 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000005dcba079mdd-object@000000005dcba079(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a1ceeb54[0x4, 1, [0x240000404:0x387:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000b5b537a1lod-object@00000000b5b537a1 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000002b8c8e97mdt-object@00000000a1ceeb54( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000000625a767osd-ldiskfs-object@000000000625a767(i:00000000f5811d3b:322/914639276)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000008fc22cbe LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000e988837dmdd-object@00000000e988837d(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a4bee57a[0x4, 1, [0x3c0000403:0x65:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000004779e33dlod-object@000000004779e33d LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000b0a75f7aosp-object@00000000a4bee57a LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009b8ece9aosd-ldiskfs-object@000000009b8ece9a(i:000000001ce88ab3:340/778299125)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a4bee57a LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a1ceeb54 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000003eaf6bd3[0x4, 1, [0x480000402:0x63:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000006aae995[0x4, 1, [0x4c0000401:0x63:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000001e5fd4d7osp-object@0000000006aae995 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000002793bd51osp-object@000000003eaf6bd3 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000006aae995 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000003eaf6bd3 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000002bfe1b1c[0x4, 1, [0x340000401:0x66:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000f39e0cdb[0x4, 1, [0x240000404:0x3a1:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f79fb9a7osp-object@000000002bfe1b1c LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000034c36d3bmdt-object@00000000f39e0cdb( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000002bfe1b1c LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000a4bc31efmdd-object@00000000a4bc31ef(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000ce102417[0x4, 1, [0x240000404:0x3a9:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000024cb4eb6lod-object@0000000024cb4eb6 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000014ca8c89mdt-object@00000000ce102417( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000b3588c0aosd-ldiskfs-object@00000000b3588c0a(i:00000000b9d06882:344/80147743)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000b3cef5b7mdd-object@00000000b3cef5b7(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000f39e0cdb LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000bc2e90fflod-object@00000000bc2e90ff LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000c279c035osd-ldiskfs-object@00000000c279c035(i:00000000258e62b8:362/346834275)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000ce102417 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a80d4eab[0x4, 1, [0x380000403:0x64:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@0000000098acbbfdosp-object@00000000a80d4eab LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a80d4eab LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000a64ebb83[0x4, 1, [0x440000401:0x63:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000fc68b77bosp-object@00000000a64ebb83 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000b454754f[0x4, 1, [0x440000401:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000a64ebb83 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000002ecc3512osp-object@00000000b454754f LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000003502e90b[0x4, 1, [0x400000403:0x64:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000b454754f LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000c2a054ecosp-object@000000003502e90b LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a37abbd0[0x4, 1, [0x240000404:0x3c5:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000003502e90b LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000000f9b9b88mdt-object@00000000a37abbd0( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000041a7c9a3[0x4, 1, [0x480000402:0x62:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000351eb390mdd-object@00000000351eb390(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000006b4f274bosp-object@0000000041a7c9a3 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000019c3f881lod-object@0000000019c3f881 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000f79850dbosd-ldiskfs-object@00000000f79850db(i:00000000808365c3:378/529852003)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000041a7c9a3 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a37abbd0 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000004d4cc852[0x4, 1, [0x380000403:0x63:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000db8ab45d[0x4, 1, [0x300000401:0x62:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000ec680218osp-object@000000004d4cc852 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000099bcec0cosp-object@00000000db8ab45d LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000004d4cc852 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000db8ab45d LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000003468cdbd[0x4, 1, [0x440000401:0x64:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000bdeaa10e[0x4, 1, [0x240000404:0x3e8:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000950edef1osp-object@000000003468cdbd LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000cae43113mdt-object@00000000bdeaa10e( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000003468cdbd LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000f6cc55b7mdd-object@00000000f6cc55b7(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000dbc69ec9[0x4, 1, [0x400000403:0x63:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000044636494lod-object@0000000044636494 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000eefb1063osp-object@00000000dbc69ec9 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000271c244cosd-ldiskfs-object@00000000271c244c(i:00000000ba4c3bca:401/771609543)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000dbc69ec9 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000003892ec31[0x5, 1, [0x280000404:0x376:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000063f4ad1dmdt-object@000000003892ec31( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000bf160ae6mdd-object@00000000bf160ae6(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000003479ce6elod-object@000000003479ce6e LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000dee88058osp-object@0000000049881bf5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000bdeaa10e LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000003892ec31 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000001f1ec6bb[0x4, 1, [0x240000404:0x3a2:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000c74ce4c5[0x4, 1, [0x240000404:0x364:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000000be12a47mdt-object@000000001f1ec6bb( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000c6d14608mdt-object@00000000c74ce4c5( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000005fc5558fmdd-object@000000005fc5558f(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000ec1a8954mdd-object@00000000ec1a8954(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@0000000027684752lod-object@0000000027684752 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000424c1e47lod-object@00000000424c1e47 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000026896efdosd-ldiskfs-object@0000000026896efd(i:00000000dc58a8b1:355/2502930232)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000a0ba9a3dosd-ldiskfs-object@00000000a0ba9a3d(i:000000006c34bf88:317/1670963266)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000001f1ec6bb LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000c74ce4c5 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000000ef421[0x4, 1, [0x240000404:0x363:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000048992e54[0x4, 1, [0x4c0000401:0x64:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000062affafdmdt-object@00000000000ef421( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000003f066e3cosp-object@0000000048992e54 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@000000003945154emdd-object@000000003945154e(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000048992e54 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000006980acd4lod-object@000000006980acd4 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000d44bd1bc[0x4, 1, [0x3c0000403:0x67:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000d99e6a5aosd-ldiskfs-object@00000000d99e6a5a(i:0000000029a3c44d:316/1777562791)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000004398b68dosp-object@00000000d44bd1bc LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000000ef421 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000d44bd1bc LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a085ae42[0x4, 1, [0x240000404:0x3c6:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000fab4f135[0x4, 1, [0x240000404:0x3a3:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000001e79f924mdt-object@00000000a085ae42( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000007d1bdd51mdt-object@00000000fab4f135( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000025f96ad1mdd-object@0000000025f96ad1(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@0000000068452f87mdd-object@0000000068452f87(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000002b4f005flod-object@000000002b4f005f LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@0000000015bf06a0lod-object@0000000015bf06a0 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000006a53a8b7osd-ldiskfs-object@000000006a53a8b7(i:000000001f538b03:379/3916140946)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000c6ea6dbdosd-ldiskfs-object@00000000c6ea6dbd(i:000000006ca61e8b:356/1397117591)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000fab4f135 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@00000000f864c746[0x4, 1, [0x240000404:0x3c7:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000f3f46c46mdt-object@00000000f864c746( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000d29f3b00mdd-object@00000000d29f3b00(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a085ae42 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000003633ee1alod-object@000000003633ee1a LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a1ceeb54[0x4, 1, [0x240000404:0x387:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000067682f3eosd-ldiskfs-object@0000000067682f3e(i:00000000a2760a91:380/2925090622)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@000000002b8c8e97mdt-object@00000000a1ceeb54( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@00000000f864c746 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000006779ffc2[0x4, 1, [0x300000401:0x68:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f8ddcc36osp-object@000000006779ffc2 LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000006779ffc2 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000007ab43439[0x4, 1, [0x240000404:0x3e9:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000e988837dmdd-object@00000000e988837d(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000dd44b644mdt-object@000000007ab43439( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@000000004779e33dlod-object@000000004779e33d LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000567de33fmdd-object@00000000567de33f(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@000000009b8ece9aosd-ldiskfs-object@000000009b8ece9a(i:000000001ce88ab3:340/778299125)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@00000000b4555e33lod-object@00000000b4555e33 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000a1ceeb54 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000c132bab4osd-ldiskfs-object@00000000c132bab4(i:000000003752160d:402/4193375622)[plain] LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@0000000006aae995[0x4, 1, [0x4c0000401:0x63:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000007ab43439 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@000000001e5fd4d7osp-object@0000000006aae995 LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000007649ee55[0x5, 1, [0x280000404:0x360:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@0000000006aae995 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@000000005332d446mdt-object@000000007649ee55( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@000000002bfe1b1c[0x4, 1, [0x340000401:0x66:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000bc293bbdmdd-object@00000000bc293bbd(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@00000000f79fb9a7osp-object@000000002bfe1b1c LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000002ef211eblod-object@000000002ef211eb LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@000000002bfe1b1c LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000003e96493dosp-object@000000003ada1179 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000ce102417[0x4, 1, [0x240000404:0x3a9:0x0] hash exist]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000007649ee55 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdt@0000000014ca8c89mdt-object@00000000ce102417( , writecount=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@000000008c26fc8f[0x4, 1, [0x340000401:0x65:0x0] hash]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....mdd@00000000b3cef5b7mdd-object@00000000b3cef5b7(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osp@000000006501640eosp-object@000000008c26fc8f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....lod@00000000bc2e90fflod-object@00000000bc2e90ff LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@000000008c26fc8f LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@00000000c279c035osd-ldiskfs-object@00000000c279c035(i:00000000258e62b8:362/346834275)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) header@0000000013a31872[0x4, 1, [0x240000404:0x3aa:0x0] hash exist]{ LustreError: 38474:0:(lu_object.c:984:lu_site_print()) } header@00000000ce102417 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdt@00000000503d8e30mdt-object@0000000013a31872( , writecount=0) LustreError: 38474:0:(lu_object.c:984:lu_site_print()) header@00000000a80d4eab[0x4, 1, [0x380000403:0x64:0x0] hash]{ LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....mdd@000000005ff587d8mdd-object@000000005ff587d8(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....lod@000000007737e866lod-object@000000007737e866 LustreError: 363:0:(lu_object.c:984:lu_site_print()) ....osd-ldiskfs@0000000025c4890eosd-ldiskfs-object@0000000025c4890e(i:0000000061a62da9:363/3550617924)[plain] LustreError: 363:0:(lu_object.c:984:lu_site_print()) } header@0000000013a31872 LustreError: 38474:0:(lu_object.c:984:lu_site_print()) ....osp@0000000098acbbfdosp-object@00000000a80d4eab | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | LustreError: 308091:0:(lu_object.c:1297:lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 3 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@00000000a3033aed[0x4, 1, [0x280000bd2:0x16:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1297:lu_device_fini()) LBUG Pid: 308091, comm: kworker/u4:2 4.18.0-240.22.1.el8_lustre.x86_64 #1 SMP Mon Nov 15 17:17:07 UTC 2021 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0x90 [libcfs] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000a6c10e45mdt-object@00000000a3033aed( , writecount=0) [<0>] lbug_with_loc+0x43/0x80 [libcfs] [<0>] lu_device_fini+0x7d/0xb0 [obdclass] [<0>] osp_device_free+0x73/0x180 [osp] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000084c53291mdd-object@0000000084c53291(open_count=0, valid=0, cltime=0ns, flags=0) [<0>] class_free_dev+0x2e7/0x5e0 [obdclass] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@000000004bb7baf0lod-object@000000004bb7baf0 [<0>] obd_zombie_imp_cull+0x40a/0x5f0 [obdclass] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000018cdcdd1osp-object@00000000cd9e7207 [<0>] process_one_work+0x1a7/0x360 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@00000000a3033aed [<0>] worker_thread+0x30/0x390 [<0>] kthread+0x112/0x130 [<0>] ret_from_fork+0x35/0x40 | Lustre: 17153:0:(sec_gss.c:2326:gss_svc_handle_destroy()) destroy svc ctx 000000004036a728 idx 0x2749fe9cc242058d (0->10.240.22.80@tcp) Lustre: 17153:0:(sec_gss.c:2326:gss_svc_handle_destroy()) Skipped 1 previous similar message Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1 Lustre: 306736:0:(sec_gss.c:1224:gss_cli_ctx_fini_common()) reverse sec 0000000027facaf9: destroy ctx 000000003f821932 LustreError: 323313:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items LustreError: 323313:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 45 previous similar messages LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000afdb7099[0x4, 1, [0x280000bd2:0x42:0x0] hash]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@00000000afdb7099[0x4, 1, [0x280000bd2:0x42:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000eefb1f5dmdt-object@00000000afdb7099( , writecount=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000eefb1f5dmdt-object@00000000afdb7099( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@000000007dacfce9mdd-object@000000007dacfce9(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@000000007dacfce9mdd-object@000000007dacfce9(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000bd67e033lod-object@00000000bd67e033 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000bd67e033lod-object@00000000bd67e033 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000075b91884osp-object@000000008f37fe98 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000075b91884osp-object@000000008f37fe98 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000afdb7099 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@00000000afdb7099 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@000000001fa422ce[0x4, 1, [0x2c0000408:0x16:0x0] hash]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@000000001fa422ce[0x4, 1, [0x2c0000408:0x16:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000738dc907mdt-object@000000001fa422ce( , writecount=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000738dc907mdt-object@000000001fa422ce( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@000000004cdab507mdd-object@000000004cdab507(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@000000004cdab507mdd-object@000000004cdab507(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@000000003eda46f5lod-object@000000003eda46f5 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@000000003eda46f5lod-object@000000003eda46f5 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000056e007b5osp-object@00000000063b38f2 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000056e007b5osp-object@00000000063b38f2 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@000000001fa422ce LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@000000001fa422ce LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@0000000052699b62[0x5, 1, [0x200000001:0x1017:0x0] hash exist]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@0000000052699b62[0x5, 1, [0x200000001:0x1017:0x0] hash exist]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....local_storage@0000000040e992e7 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....local_storage@0000000040e992e7 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@0000000042d53952osd-ldiskfs-object@0000000042d53952(i:00000000d8dd535b:13/3850554529)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@0000000052699b62 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@0000000036443baf[0x4, 1, [0x200002b10:0x14:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000d43b1addmdt-object@0000000036443baf( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000e01219f2mdd-object@00000000e01219f2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@0000000091295e1elod-object@0000000091295e1e LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000457fc634osd-ldiskfs-object@00000000457fc634(i:0000000050b1328d:0/0)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@0000000036443baf LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@000000008050116e[0x4, 1, [0x280000bd2:0x13:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@000000006b156623mdt-object@000000008050116e( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000b5a3d6famdd-object@00000000b5a3d6fa(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@0000000057c3068alod-object@0000000057c3068a LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@00000000569d5796osp-object@0000000023531f51 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@000000008050116e LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@000000000bfd78ee[0x4, 1, [0x240002b13:0x14:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@0000000006282c8amdt-object@000000000bfd78ee( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000052ac63damdd-object@0000000052ac63da(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@000000009be2e1cflod-object@000000009be2e1cf LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@000000002b4f18d4osp-object@000000009226af15 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@000000000bfd78ee LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@000000000b8726fe[0x4, 1, [0x200002b10:0x43:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@000000002be2cdbamdt-object@000000000b8726fe( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000aa004c7dmdd-object@00000000aa004c7d(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000cabfb3c2lod-object@00000000cabfb3c2 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000002dbfbbaeosd-ldiskfs-object@000000002dbfbbae(i:0000000050b1328d:0/0)[plain] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@0000000042d53952osd-ldiskfs-object@0000000042d53952(i:00000000d8dd535b:13/3850554529)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@000000000b8726fe LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@0000000052699b62 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000213dda42[0x4, 1, [0xa:0x0:0x0] hash exist]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@0000000036443baf[0x4, 1, [0x200002b10:0x14:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000002bd57614 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000d43b1addmdt-object@0000000036443baf( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000d7f1f48bosd-ldiskfs-object@00000000d7f1f48b(i:00000000b9802d61:186/759204394)[plain] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000e01219f2mdd-object@00000000e01219f2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000213dda42 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@0000000091295e1elod-object@0000000091295e1e LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000547fb05d[0x4, 1, [0x200000003:0x0:0x0] hash exist]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000ac64d262 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000f0e5cab3osd-ldiskfs-object@00000000f0e5cab3(i:0000000092e899b0:116/2837595563)[plain] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000457fc634osd-ldiskfs-object@00000000457fc634(i:0000000050b1328d:0/0)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000547fb05d LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@0000000036443baf LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@0000000086cb30f9[0x4, 1, [0x2c0000408:0x13:0x0] hash]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@000000008050116e[0x4, 1, [0x280000bd2:0x13:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000185eac80mdt-object@0000000086cb30f9( , writecount=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@000000006b156623mdt-object@000000008050116e( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000ca073897mdd-object@00000000ca073897(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000b5a3d6famdd-object@00000000b5a3d6fa(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@0000000045485f73lod-object@0000000045485f73 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@0000000057c3068alod-object@0000000057c3068a LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@000000000a69c830osp-object@000000007a79cb8a LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osp@00000000569d5796osp-object@0000000023531f51 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@0000000086cb30f9 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@000000008050116e LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000cd813470[0x4, 1, [0x240002b13:0x43:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@000000002ced75a2mdt-object@00000000cd813470( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000007c4d528mdd-object@0000000007c4d528(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@000000003f58d868lod-object@000000003f58d868 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@000000000bfd78ee[0x4, 1, [0x240002b13:0x14:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000007a1bca5osp-object@000000009f868554 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@0000000006282c8amdt-object@000000000bfd78ee( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000cd813470 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000052ac63damdd-object@0000000052ac63da(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000a3033aed[0x4, 1, [0x280000bd2:0x16:0x0] hash]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@000000009be2e1cflod-object@000000009be2e1cf LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000a6c10e45mdt-object@00000000a3033aed( , writecount=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osp@000000002b4f18d4osp-object@000000009226af15 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000084c53291mdd-object@0000000084c53291(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@000000000bfd78ee LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@000000004bb7baf0lod-object@000000004bb7baf0 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@000000000b8726fe[0x4, 1, [0x200002b10:0x43:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000018cdcdd1osp-object@00000000cd9e7207 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@000000002be2cdbamdt-object@000000000b8726fe( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000a3033aed LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000aa004c7dmdd-object@00000000aa004c7d(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000e0c9b1aa[0x4, 1, [0x200002b10:0x17:0x0] hash]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000cabfb3c2lod-object@00000000cabfb3c2 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@0000000086f03093mdt-object@00000000e0c9b1aa( , writecount=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000002dbfbbaeosd-ldiskfs-object@000000002dbfbbae(i:0000000050b1328d:0/0)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000bf2a957bmdd-object@00000000bf2a957b(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@000000000b8726fe LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@000000006c506e70lod-object@000000006c506e70 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@00000000213dda42[0x4, 1, [0xa:0x0:0x0] hash exist]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000b29d5e71osd-ldiskfs-object@00000000b29d5e71(i:0000000050b1328d:0/0)[plain] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000002bd57614 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000e0c9b1aa LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000d7f1f48bosd-ldiskfs-object@00000000d7f1f48b(i:00000000b9802d61:186/759204394)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@000000003ec9fc36[0x4, 1, [0x200000003:0x3:0x0] hash exist]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@00000000213dda42 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000006406e63d LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000bcee0e28osd-ldiskfs-object@00000000bcee0e28(i:00000000e361d018:118/2134281897)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@000000003ec9fc36 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000ada47f31[0x4, 1, [0x1:0x0:0x0] hash exist]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000ee182291 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000009bb7bae7osd-ldiskfs-object@000000009bb7bae7(i:000000004fe100d9:152/995911742)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000ada47f31 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@00000000547fb05d[0x4, 1, [0x200000003:0x0:0x0] hash exist]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000f441874a[0x4, 1, [0x200000003:0x2:0x0] hash exist]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000ac64d262 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000003e052818 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000f0e5cab3osd-ldiskfs-object@00000000f0e5cab3(i:0000000092e899b0:116/2837595563)[plain] LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@0000000093dbc740osd-ldiskfs-object@0000000093dbc740(i:0000000033813325:117/2330541459)[lfix] LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@00000000547fb05d LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000f441874a LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@0000000086cb30f9[0x4, 1, [0x2c0000408:0x13:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000e33b223e[0x4, 1, [0x240002b13:0x17:0x0] hash]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000185eac80mdt-object@0000000086cb30f9( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000a4e0175emdt-object@00000000e33b223e( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000133a7203mdd-object@00000000133a7203(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000ca073897mdd-object@00000000ca073897(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000a03f0673lod-object@00000000a03f0673 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@0000000045485f73lod-object@0000000045485f73 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@000000000b31d024osp-object@00000000e7040d3d LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osp@000000000a69c830osp-object@000000007a79cb8a LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000e33b223e LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@0000000086cb30f9 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) header@00000000cb547ac5[0x4, 1, [0x2c0000408:0x42:0x0] hash]{ LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) header@00000000cd813470[0x4, 1, [0x240002b13:0x43:0x0] hash]{ LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000688bc497mdt-object@00000000cb547ac5( , writecount=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdt@000000002ced75a2mdt-object@00000000cd813470( , writecount=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....mdd@000000004a0d54c2mdd-object@000000004a0d54c2(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000007c4d528mdd-object@0000000007c4d528(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....lod@000000009d8fdc05lod-object@000000009d8fdc05 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....lod@000000003f58d868lod-object@000000003f58d868 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) ....osp@00000000121459acosp-object@000000000d03eca0 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000007a1bca5osp-object@000000009f868554 LustreError: 308091:0:(lu_object.c:1027:lu_site_print()) } header@00000000cb547ac5 LustreError: 323313:0:(lu_object.c:1027:lu_site_print()) } header@00000000cd813470 | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | LustreError: 238267:0:(lu_object.c:1297:lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 2 LustreError: 243758:0:(lod_dev.c:1850:lod_device_free()) ASSERTION( atomic_read(&lu->ld_ref) == 0 ) failed: lu is 00000000e53f3fcb LustreError: 238267:0:(lu_object.c:1297:lu_device_fini()) LBUG LustreError: 243758:0:(lod_dev.c:1850:lod_device_free()) LBUG Pid: 238267, comm: kworker/u4:0 4.18.0-240.22.1.el8_lustre.x86_64 #1 SMP Mon Nov 15 17:17:07 UTC 2021 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0x90 [libcfs] [<0>] lbug_with_loc+0x43/0x80 [libcfs] [<0>] lu_device_fini+0x7d/0xb0 [obdclass] [<0>] osp_device_free+0x73/0x180 [osp] [<0>] class_free_dev+0x2e7/0x5e0 [obdclass] [<0>] obd_zombie_imp_cull+0x40a/0x5f0 [obdclass] [<0>] process_one_work+0x1a7/0x360 [<0>] worker_thread+0x30/0x390 [<0>] kthread+0x112/0x130 [<0>] ret_from_fork+0x35/0x40 Pid: 243758, comm: umount 4.18.0-240.22.1.el8_lustre.x86_64 #1 SMP Mon Nov 15 17:17:07 UTC 2021 | Lustre: 137120:0:(sec_gss.c:2326:gss_svc_handle_destroy()) destroy svc ctx 0000000088036c25 idx 0x64488d66333cecd3 (0->10.240.30.101@tcp) Lustre: 137120:0:(sec_gss.c:2326:gss_svc_handle_destroy()) Skipped 1 previous similar message LustreError: 11-0: lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 10.240.30.104@tcp failed: rc = -107 Lustre: lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 10.240.30.104@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message LustreError: 11-0: lustre-MDT0000-osp-MDT0003: operation mds_statfs to node 10.240.30.104@tcp failed: rc = -107 Lustre: lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 10.240.30.104@tcp) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: 238695:0:(sec_gss.c:1224:gss_cli_ctx_fini_common()) reverse sec 00000000fade7bbc: destroy ctx 00000000156457ec Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds2' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds2 LustreError: 166-1: MGC10.240.30.104@tcp: Connection to MGS (at 10.240.30.104@tcp) was lost; in progress operations using this service will fail LustreError: 10395:0:(client.c:1256:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@00000000fd9109e0 x1718046886948160/t0(0) o41->lustre-MDT0002-osp-MDT0001@10.240.30.104@tcp:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/0/ffffffff rc 0/-1 job:'osp-pre-2-1.0' Lustre: lustre-MDT0001: Not available for connect from 10.240.30.104@tcp (stopping) LustreError: 10395:0:(client.c:1256:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@0000000053e449a1 x1718046886948544/t0(0) o41->lustre-MDT0003-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/0/ffffffff rc 0/-1 job:'osp-pre-3-1.0' Lustre: lustre-MDT0001-osp-MDT0003: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: lustre-MDT0001: Not available for connect from 0@lo (stopping) Lustre: lustre-MDT0001: Not available for connect from 10.240.30.104@tcp (stopping) LustreError: 243758:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items LustreError: 243758:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 1 previous similar message LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) header@00000000fef828f4[0x4, 1, [0x280000409:0x41:0x0] hash]{ LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) header@00000000fef828f4[0x4, 1, [0x280000409:0x41:0x0] hash]{ LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000163a0cc1mdt-object@00000000fef828f4( , writecount=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000163a0cc1mdt-object@00000000fef828f4( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000003596acamdd-object@0000000003596aca(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000003596acamdd-object@0000000003596aca(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....lod@000000001ee6231elod-object@000000001ee6231e LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....lod@000000001ee6231elod-object@000000001ee6231e LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....osp@000000001ea0cae2osp-object@00000000622a543f LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....osp@000000001ea0cae2osp-object@00000000622a543f LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) } header@00000000fef828f4 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) } header@00000000fef828f4 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) header@0000000081bb8077[0x4, 1, [0x240002b10:0x48:0x0] hash]{ LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) header@0000000081bb8077[0x4, 1, [0x240002b10:0x48:0x0] hash]{ LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdt@0000000015d9b09cmdt-object@0000000081bb8077( , writecount=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdt@0000000015d9b09cmdt-object@0000000081bb8077( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000094f6e51cmdd-object@0000000094f6e51c(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000094f6e51cmdd-object@0000000094f6e51c(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....lod@000000007cb287bclod-object@000000007cb287bc LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....lod@000000007cb287bclod-object@000000007cb287bc LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000000a3b99d6osd-ldiskfs-object@000000000a3b99d6(i:00000000434d1229:0/0)[plain] LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000000a3b99d6osd-ldiskfs-object@000000000a3b99d6(i:00000000434d1229:0/0)[plain] LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) } header@0000000081bb8077 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) } header@0000000081bb8077 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) header@000000002a1103a1[0x4, 1, [0x200002341:0x38:0x0] hash]{ LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) header@000000002a1103a1[0x4, 1, [0x200002341:0x38:0x0] hash]{ LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdt@0000000019155b68mdt-object@000000002a1103a1( , writecount=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdt@0000000019155b68mdt-object@000000002a1103a1( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdd@000000002fcd39b5mdd-object@000000002fcd39b5(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdd@000000002fcd39b5mdd-object@000000002fcd39b5(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000900422c4lod-object@00000000900422c4 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000900422c4lod-object@00000000900422c4 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....osp@00000000a576c004osp-object@00000000c28c16c4 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....osp@00000000a576c004osp-object@00000000c28c16c4 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) } header@000000002a1103a1 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) } header@000000002a1103a1 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) header@00000000dbd360cd[0x4, 1, [0x200002341:0x34:0x0] hash]{ LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) header@00000000dbd360cd[0x4, 1, [0x200002341:0x34:0x0] hash]{ LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000a0d3507bmdt-object@00000000dbd360cd( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000a0d3507bmdt-object@00000000dbd360cd( , writecount=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000680da921mdd-object@00000000680da921(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000680da921mdd-object@00000000680da921(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000d6720745lod-object@00000000d6720745 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000d6720745lod-object@00000000d6720745 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....osp@000000007c06936fosp-object@000000000453c4c2 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....osp@000000007c06936fosp-object@000000000453c4c2 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) } header@00000000dbd360cd LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) } header@00000000dbd360cd LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) header@00000000f1c4a38e[0x4, 1, [0x2c0000407:0x38:0x0] hash]{ LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) header@00000000f1c4a38e[0x4, 1, [0x2c0000407:0x38:0x0] hash]{ LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdt@000000001f1c85e9mdt-object@00000000f1c4a38e( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdt@000000001f1c85e9mdt-object@00000000f1c4a38e( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000292a744bmdd-object@00000000292a744b(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000292a744bmdd-object@00000000292a744b(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000305b3beflod-object@00000000305b3bef LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000305b3beflod-object@00000000305b3bef LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....osp@000000006cf0ed97osp-object@000000000cdc31ae LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....osp@000000006cf0ed97osp-object@000000000cdc31ae LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) } header@00000000f1c4a38e LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) } header@00000000f1c4a38e LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) header@000000008de136ef[0x4, 1, [0x2c0000407:0x34:0x0] hash]{ LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) header@000000008de136ef[0x4, 1, [0x2c0000407:0x34:0x0] hash]{ LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000a1de6564mdt-object@000000008de136ef( , writecount=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000a1de6564mdt-object@000000008de136ef( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000068b4888amdd-object@0000000068b4888a(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000068b4888amdd-object@0000000068b4888a(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000fda737ddlod-object@00000000fda737dd LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000fda737ddlod-object@00000000fda737dd LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....osp@000000008383cc29osp-object@00000000040a98ba LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....osp@000000008383cc29osp-object@00000000040a98ba LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) } header@000000008de136ef LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) } header@000000008de136ef LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) header@000000006b822f43[0x4, 1, [0x280000409:0x45:0x0] hash]{ LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) header@000000006b822f43[0x4, 1, [0x280000409:0x45:0x0] hash]{ LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000d8c672demdt-object@000000006b822f43( , writecount=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000d8c672demdt-object@000000006b822f43( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000012307287mdd-object@0000000012307287(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdd@0000000012307287mdd-object@0000000012307287(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000a8fec337lod-object@00000000a8fec337 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....lod@00000000a8fec337lod-object@00000000a8fec337 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000068f8fd4aosp-object@00000000597eb525 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....osp@0000000068f8fd4aosp-object@00000000597eb525 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) } header@000000006b822f43 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) } header@000000006b822f43 LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) header@00000000a6084935[0x4, 1, [0x240002b10:0x4c:0x0] hash]{ LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) header@00000000a6084935[0x4, 1, [0x240002b10:0x4c:0x0] hash]{ LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000e88deee8mdt-object@00000000a6084935( , writecount=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdt@00000000e88deee8mdt-object@00000000a6084935( , writecount=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000581b2545mdd-object@00000000581b2545(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....mdd@00000000581b2545mdd-object@00000000581b2545(open_count=0, valid=0, cltime=0ns, flags=0) LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....lod@000000009a286d2elod-object@000000009a286d2e LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....lod@000000009a286d2elod-object@000000009a286d2e LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@0000000000ff8768osd-ldiskfs-object@0000000000ff8768(i:00000000434d1229:0/0)[plain] LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@0000000000ff8768osd-ldiskfs-object@0000000000ff8768(i:00000000434d1229:0/0)[plain] LustreError: 238267:0:(lu_object.c:1027:lu_site_print()) } header@00000000a6084935 LustreError: 243758:0:(lu_object.c:1027:lu_site_print()) } header@00000000a6084935 | Link to test |
| sanity-quota test complete, duration 10038 sec | LustreError: 534249:0:(lu_object.c:1297:lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 2 LustreError: 534249:0:(lu_object.c:1297:lu_device_fini()) LBUG Pid: 534249, comm: kworker/u4:3 4.18.0-240.22.1.el8_lustre.x86_64 #1 SMP Mon Nov 8 22:25:55 UTC 2021 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0x90 [libcfs] [<0>] lbug_with_loc+0x43/0x80 [libcfs] [<0>] lu_device_fini+0x7d/0xb0 [obdclass] [<0>] osp_device_free+0x73/0x180 [osp] [<0>] class_free_dev+0x2e7/0x5e0 [obdclass] [<0>] obd_zombie_imp_cull+0x40a/0x5f0 [obdclass] [<0>] process_one_work+0x1a7/0x360 [<0>] worker_thread+0x30/0x390 [<0>] kthread+0x112/0x130 [<0>] ret_from_fork+0x35/0x40 | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1 LustreError: 13190:0:(client.c:1256:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@00000000d22972cc x1717842976901440/t0(0) o41->lustre-MDT0003-osp-MDT0000@10.240.26.40@tcp:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/0/ffffffff rc 0/-1 job:'osp-pre-3-0.0' Lustre: lustre-MDT0000: Not available for connect from 10.240.26.40@tcp (stopping) Lustre: Skipped 33 previous similar messages LustreError: 13190:0:(client.c:1256:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@00000000c984f416 x1717842976902208/t0(0) o41->lustre-MDT0002-osp-MDT0000@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/0/ffffffff rc 0/-1 job:'osp-pre-2-0.0' Lustre: lustre-MDT0000-osp-MDT0002: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete LustreError: 13190:0:(client.c:1256:ptlrpc_import_delay_req()) Skipped 1 previous similar message LustreError: 11-0: lustre-MDT0000-osp-MDT0002: operation mds_statfs to node 0@lo failed: rc = -107 Lustre: Skipped 2 previous similar messages LustreError: 799404:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items LustreError: 799404:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 1 previous similar message LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@0000000081bdd8d5[0x5, 1, [0x100010000:0x885:0x0] hash]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osp@000000001f4806b8osp-object@0000000081bdd8d5 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@0000000081bdd8d5 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@00000000099205f7[0x5, 1, [0x100000000:0x8e8:0x0] hash]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osp@00000000b3e37954osp-object@00000000099205f7 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@00000000099205f7 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@0000000067e540ef[0x4, 1, [0x200000003:0x3:0x0] hash exist]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....local_storage@0000000079f5fd81 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000d62d8b8cosd-ldiskfs-object@00000000d62d8b8c(i:000000008047234b:118/3627739815)[plain] LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@0000000067e540ef LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@00000000aebb0cfc[0x4, 1, [0xa:0x0:0x0] hash exist]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000f3717ce1 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000c3827e4dosd-ldiskfs-object@00000000c3827e4d(i:000000009c7bfc20:186/2680217139)[plain] LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@00000000aebb0cfc LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@0000000089b84cd0[0x5, 1, [0x200000001:0x1017:0x0] hash exist]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000002ac84417 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000d7ac2bb8osd-ldiskfs-object@00000000d7ac2bb8(i:00000000f7dee76f:13/258605648)[plain] LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@0000000089b84cd0 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@00000000e600b39f[0x4, 1, [0x1:0x0:0x0] hash exist]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000b8e4f3c5 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000015c0201osd-ldiskfs-object@00000000015c0201(i:000000004dc1952a:152/2311176344)[plain] LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@00000000e600b39f LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@000000006c9cd267[0x5, 1, [0x100000000:0x8e7:0x0] hash]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osp@000000009dc2d50fosp-object@000000006c9cd267 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@000000006c9cd267 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@00000000c72bea35[0x5, 1, [0x100010000:0x884:0x0] hash]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osp@000000009d4948adosp-object@00000000c72bea35 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@00000000c72bea35 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@00000000529eb974[0x4, 1, [0x200000003:0x0:0x0] hash exist]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000e31e9e1a LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@0000000017a44d4bosd-ldiskfs-object@0000000017a44d4b(i:00000000bbbf06ca:116/1902437926)[plain] LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@00000000529eb974 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@00000000c4bfe773[0x4, 1, [0x200000003:0x2:0x0] hash exist]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000d839592c LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@0000000088c57190osd-ldiskfs-object@0000000088c57190(i:00000000b399255b:117/3957435625)[lfix] LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@00000000c4bfe773 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) header@0000000081bdd8d5[0x5, 1, [0x100010000:0x885:0x0] hash]{ LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) ....osp@000000001f4806b8osp-object@0000000081bdd8d5 LustreError: 534249:0:(lu_object.c:1027:lu_site_print()) } header@0000000081bdd8d5 | Link to test |
| sanity test 60a: llog_test run from kernel module and test llog_reader | LustreError: 415:0:(lu_object.c:1297:lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1 LustreError: 415:0:(lu_object.c:1297:lu_device_fini()) LBUG Pid: 415, comm: kworker/u4:3 4.18.0-240.22.1.el8_lustre.x86_64 #1 SMP Mon Nov 8 22:25:55 UTC 2021 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0x90 [libcfs] [<0>] lbug_with_loc+0x43/0x80 [libcfs] [<0>] lu_device_fini+0x7d/0xb0 [obdclass] [<0>] osp_device_free+0x73/0x180 [osp] [<0>] class_free_dev+0x2e7/0x5e0 [obdclass] [<0>] obd_zombie_imp_cull+0x40a/0x5f0 [obdclass] [<0>] process_one_work+0x1a7/0x360 [<0>] worker_thread+0x30/0x390 [<0>] kthread+0x112/0x130 [<0>] ret_from_fork+0x35/0x40 | Lustre: DEBUG MARKER: ! which run-llog.sh &> /dev/null Lustre: DEBUG MARKER: /usr/sbin/lctl mark test_60 run 24423 - from kernel mode Lustre: DEBUG MARKER: test_60 run 24423 - from kernel mode Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /dev/null Lustre: DEBUG MARKER: bash run-llog.sh Lustre: 201712:0:(llog_test.c:2230:llog_test_setup()) Setup llog-test device over MGS device Lustre: 201712:0:(llog_test.c:112:llog_test_1()) 1a: create a log with name: 42bba0b7 Lustre: 201712:0:(llog_test.c:129:llog_test_1()) 1b: close newly-created log Lustre: 201712:0:(llog_test.c:160:llog_test_2()) 2a: re-open a log with name: 42bba0b7 Lustre: 201712:0:(llog_test.c:180:llog_test_2()) 2b: create a log without specified NAME & LOGID Lustre: 201712:0:(llog_test.c:198:llog_test_2()) 2b: write 1 llog records, check llh_count Lustre: 201712:0:(llog_test.c:211:llog_test_2()) 2c: re-open the log by LOGID and verify llh_count Lustre: 201712:0:(llog_test.c:258:llog_test_2()) 2d: destroy this log Lustre: 201712:0:(llog_test.c:417:llog_test_3()) 3a: write 1023 fixed-size llog records Lustre: 201712:0:(llog_test.c:382:llog_test3_process()) test3: processing records from index 501 to the end Lustre: 201712:0:(llog_test.c:391:llog_test3_process()) test3: total 525 records processed with 0 paddings Lustre: 201712:0:(llog_test.c:473:llog_test_3()) 3b: write 566 variable size llog records Lustre: 201712:0:(llog_test.c:545:llog_test_3()) 3c: write records with variable size until BITMAP_SIZE, return -ENOSPC Lustre: 201712:0:(llog_test.c:568:llog_test_3()) 3c: wrote 63962 more records before end of llog is reached Lustre: 201712:0:(llog_test.c:597:llog_test_4()) 4a: create a catalog log with name: 42bba0b8 Lustre: 201712:0:(llog_test.c:612:llog_test_4()) 4b: write 1 record into the catalog Lustre: 201712:0:(llog_test.c:639:llog_test_4()) 4c: cancel 1 log record Lustre: 201712:0:(llog_test.c:651:llog_test_4()) 4d: write 64767 more log records Lustre: 201712:0:(llog_test.c:667:llog_test_4()) 4e: add 5 large records, one record per block Lustre: 201712:0:(llog_test.c:687:llog_test_4()) 4f: put newly-created catalog Lustre: 201712:0:(llog_test.c:785:llog_test_5()) 5a: re-open catalog by id Lustre: 201712:0:(llog_test.c:798:llog_test_5()) 5b: print the catalog entries.. we expect 2 Lustre: 201718:0:(llog_test.c:716:cat_print_cb()) seeing record at index 1 - [0x1:0x34:0x0] in log [0xa:0x10:0x0] Lustre: 201712:0:(llog_test.c:810:llog_test_5()) 5c: Cancel 64767 records, see one log zapped Lustre: 201712:0:(llog_test.c:818:llog_test_5()) 5c: print the catalog entries.. we expect 1 Lustre: 201719:0:(llog_test.c:716:cat_print_cb()) seeing record at index 2 - [0x1:0x35:0x0] in log [0xa:0x10:0x0] Lustre: 201719:0:(llog_test.c:716:cat_print_cb()) Skipped 1 previous similar message Lustre: 201712:0:(llog_test.c:830:llog_test_5()) 5d: add 1 record to the log with many canceled empty pages Lustre: 201712:0:(llog_test.c:838:llog_test_5()) 5e: print plain log entries.. expect 6 Lustre: 201712:0:(llog_test.c:850:llog_test_5()) 5f: print plain log entries reversely.. expect 6 Lustre: 201712:0:(llog_test.c:864:llog_test_5()) 5g: close re-opened catalog Lustre: 201712:0:(llog_test.c:894:llog_test_6()) 6a: re-open log 42bba0b7 using client API Lustre: MGS: non-config logname received: 42bba0b7 Lustre: 201712:0:(llog_test.c:926:llog_test_6()) 6b: process log 42bba0b7 using client API Lustre: 201712:0:(llog_test.c:930:llog_test_6()) 6b: processed 63962 records Lustre: 201712:0:(llog_test.c:937:llog_test_6()) 6c: process log 42bba0b7 reversely using client API Lustre: 201712:0:(llog_test.c:941:llog_test_6()) 6c: processed 63962 records Lustre: 201712:0:(llog_test.c:1088:llog_test_7()) 7a: test llog_logid_rec Lustre: 201712:0:(llog_test.c:1099:llog_test_7()) 7b: test llog_unlink64_rec Lustre: 201712:0:(llog_test.c:1110:llog_test_7()) 7c: test llog_setattr64_rec Lustre: 201712:0:(llog_test.c:1121:llog_test_7()) 7d: test llog_size_change_rec Lustre: 201712:0:(llog_test.c:1132:llog_test_7()) 7e: test llog_changelog_rec Lustre: 201712:0:(llog_test.c:1039:llog_test_7_sub()) 7_sub: records are not aligned, written 64071 from 64767 Lustre: 201712:0:(llog_test.c:1144:llog_test_7()) 7f: test llog_changelog_user_rec2 Lustre: 201712:0:(llog_test.c:1039:llog_test_7_sub()) 7_sub: records are not aligned, written 64139 from 64767 Lustre: 201712:0:(llog_test.c:1155:llog_test_7()) 7g: test llog_gen_rec Lustre: 201712:0:(llog_test.c:1166:llog_test_7()) 7h: test llog_setattr64_rec_v2 Lustre: 201712:0:(llog_test.c:1039:llog_test_7_sub()) 7_sub: records are not aligned, written 64071 from 64767 Lustre: 201712:0:(llog_test.c:1206:llog_test_8()) 8a: fill the first plain llog Lustre: 201712:0:(llog_test.c:1239:llog_test_8()) 8a: pin llog [0x1:0x41:0x0] Lustre: 201712:0:(llog_test.c:1249:llog_test_8()) 8b: fill the second plain llog Lustre: 201712:0:(llog_test.c:1270:llog_test_8()) 8b: second llog [0x1:0x43:0x0] Lustre: 201712:0:(llog_test.c:1285:llog_test_8()) 8d: count survived records Lustre: 201712:0:(llog_test.c:1312:llog_test_8()) 8d: close re-opened catalog Lustre: 201712:0:(llog_test.c:1375:llog_test_9()) 9a: test llog_logid_rec Lustre: 201712:0:(llog_test.c:1359:llog_test_9_sub()) 9_sub: record type 1064553b in log 0x1:0x45:0x0 Lustre: 201712:0:(llog_test.c:1386:llog_test_9()) 9b: test llog_obd_cfg_rec Lustre: 201712:0:(llog_test.c:1397:llog_test_9()) 9c: test llog_changelog_rec Lustre: 201712:0:(llog_test.c:1409:llog_test_9()) 9d: test llog_changelog_user_rec2 Lustre: 201712:0:(llog_test.c:1509:llog_test_10()) 10a: create a catalog log with name: 42bba0b9 Lustre: 201712:0:(llog_test.c:1539:llog_test_10()) 10b: write 64767 log records Lustre: 201712:0:(llog_test.c:1565:llog_test_10()) 10c: write 129534 more log records Lustre: 201712:0:(llog_test.c:1597:llog_test_10()) 10c: write 64767 more log records Lustre: 201712:0:(llog_cat.c:105:llog_cat_new_log()) MGS: there are no more free slots in catalog 42bba0b9 Lustre: 201712:0:(llog_test.c:1624:llog_test_10()) 10c: wrote 64011 records then 756 failed with ENOSPC Lustre: 201712:0:(llog_test.c:1643:llog_test_10()) 10d: Cancel 64767 records, see one log zapped Lustre: 201712:0:(llog_test.c:1657:llog_test_10()) 10d: print the catalog entries.. we expect 3 Lustre: 201733:0:(llog_test.c:716:cat_print_cb()) seeing record at index 2 - [0x1:0x4a:0x0] in log [0xa:0x11:0x0] Lustre: 201712:0:(llog_test.c:1687:llog_test_10()) 10e: write 64767 more log records Lustre: 201712:0:(llog_cat.c:105:llog_cat_new_log()) MGS: there are no more free slots in catalog 42bba0b9 Lustre: 201712:0:(llog_cat.c:105:llog_cat_new_log()) Skipped 755 previous similar messages Lustre: 201712:0:(llog_test.c:1714:llog_test_10()) 10e: wrote 64578 records then 189 failed with ENOSPC Lustre: 201712:0:(llog_test.c:1716:llog_test_10()) 10e: print the catalog entries.. we expect 4 Lustre: 201712:0:(llog_cat.c:925:llog_cat_process_or_fork()) MGS: catlog [0x11:0xa:0x0] crosses index zero Lustre: 201712:0:(llog_test.c:716:cat_print_cb()) seeing record at index 2 - [0x1:0x4a:0x0] in log [0xa:0x11:0x0] Lustre: 201712:0:(llog_test.c:716:cat_print_cb()) Skipped 2 previous similar messages Lustre: 201712:0:(llog_test.c:1753:llog_test_10()) 10e: catalog successfully wrap around, last_idx 1, first 1 Lustre: 201712:0:(llog_test.c:1770:llog_test_10()) 10f: Cancel 64767 records, see one log zapped Lustre: 201712:0:(llog_test.c:1784:llog_test_10()) 10f: print the catalog entries.. we expect 3 Lustre: 201712:0:(llog_cat.c:925:llog_cat_process_or_fork()) MGS: catlog [0x11:0xa:0x0] crosses index zero Lustre: 201712:0:(llog_cat.c:925:llog_cat_process_or_fork()) Skipped 1 previous similar message Lustre: 201712:0:(llog_test.c:1815:llog_test_10()) 10f: write 64767 more log records Lustre: 201712:0:(llog_cat.c:105:llog_cat_new_log()) MGS: there are no more free slots in catalog 42bba0b9 Lustre: 201712:0:(llog_cat.c:105:llog_cat_new_log()) Skipped 188 previous similar messages Lustre: 201712:0:(llog_test.c:1842:llog_test_10()) 10f: wrote 64578 records then 189 failed with ENOSPC Lustre: 201712:0:(llog_test.c:1889:llog_test_10()) 10g: Cancel 64767 records, see one log zapped Lustre: 201712:0:(llog_cat.c:925:llog_cat_process_or_fork()) MGS: catlog [0x11:0xa:0x0] crosses index zero Lustre: 201712:0:(llog_test.c:1901:llog_test_10()) 10g: print the catalog entries.. we expect 3 Lustre: 201712:0:(llog_cat.c:925:llog_cat_process_or_fork()) MGS: catlog [0x11:0xa:0x0] crosses index zero Lustre: 201712:0:(llog_test.c:716:cat_print_cb()) seeing record at index 4 - [0x1:0x4c:0x0] in log [0xa:0x11:0x0] Lustre: 201712:0:(llog_test.c:716:cat_print_cb()) Skipped 6 previous similar messages Lustre: 201712:0:(llog_test.c:1931:llog_test_10()) 10g: Cancel 64767 records, see one log zapped Lustre: 201712:0:(llog_test.c:1945:llog_test_10()) 10g: print the catalog entries.. we expect 2 Lustre: 201712:0:(llog_test.c:1983:llog_test_10()) 10g: Cancel 64767 records, see one log zapped Lustre: 201712:0:(llog_test.c:1997:llog_test_10()) 10g: print the catalog entries.. we expect 1 Lustre: 201712:0:(llog_test.c:2023:llog_test_10()) 10g: llh_cat_idx has also successfully wrapped! Lustre: 201737:0:(llog_test.c:1469:cat_check_old_cb()) seeing record at index 2 - [0x1:0x400:0x0] in log [0xa:0x11:0x0] Lustre: 201712:0:(llog_test.c:2047:llog_test_10()) 10h: write 64767 more log records LustreError: 201712:0:(libcfs_fail.h:169:cfs_race()) cfs_race id 1317 sleeping LustreError: 201737:0:(libcfs_fail.h:174:cfs_race()) cfs_fail_race id 1317 waking LustreError: 201712:0:(libcfs_fail.h:172:cfs_race()) cfs_fail_race id 1317 awake: rc=0 LustreError: 201737:0:(libcfs_fail.h:174:cfs_race()) cfs_fail_race id 1317 waking Lustre: 201737:0:(llog_test.c:1469:cat_check_old_cb()) seeing record at index 3 - [0x1:0x4be:0x0] in log [0xa:0x11:0x0] LustreError: 201712:0:(libcfs_fail.h:174:cfs_race()) cfs_fail_race id 1317 waking Lustre: 201712:0:(llog_test.c:2074:llog_test_10()) 10h: wrote 64767 records then 0 failed with ENOSPC Lustre: 201712:0:(llog_test.c:2087:llog_test_10()) 10: put newly-created catalog Lustre: DEBUG MARKER: /usr/sbin/lctl dk Lustre: DEBUG MARKER: which llog_reader 2> /dev/null Lustre: DEBUG MARKER: ls -d /usr/sbin/llog_reader Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 Lustre: lustre-MDT0000: Not available for connect from 10.240.24.229@tcp (stopping) Lustre: lustre-MDT0000: Not available for connect from 10.240.24.228@tcp (stopping) LustreError: 202391:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items LustreError: 202391:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 6 previous similar messages LustreError: 415:0:(lu_object.c:1027:lu_site_print()) header@00000000c1087d34[0x4, 1, [0x200000003:0x0:0x0] hash exist]{ LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....local_storage@0000000049152e7b LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000f683b011osd-ldiskfs-object@00000000f683b011(i:000000003a6818a0:116/3586842786)[plain] LustreError: 415:0:(lu_object.c:1027:lu_site_print()) } header@00000000c1087d34 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) header@0000000029aed8d4[0x4, 1, [0x200000003:0x3:0x0] hash exist]{ LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000004118cc45 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000ad23bd6cosd-ldiskfs-object@00000000ad23bd6c(i:000000007fcbe0c4:118/2725055530)[plain] LustreError: 415:0:(lu_object.c:1027:lu_site_print()) } header@0000000029aed8d4 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) header@00000000992642da[0x5, 1, [0x200000001:0x1017:0x0] hash exist]{ LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000008c1a5406 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000c545bb65osd-ldiskfs-object@00000000c545bb65(i:00000000e24c3a11:13/1519081397)[plain] LustreError: 415:0:(lu_object.c:1027:lu_site_print()) } header@00000000992642da LustreError: 415:0:(lu_object.c:1027:lu_site_print()) header@00000000e7f6e911[0x4, 1, [0xa:0x0:0x0] hash exist]{ LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....local_storage@0000000029e494b2 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000958e7eb5osd-ldiskfs-object@00000000958e7eb5(i:000000006bc977eb:186/186458793)[plain] LustreError: 415:0:(lu_object.c:1027:lu_site_print()) } header@00000000e7f6e911 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) header@00000000922b2805[0x5, 1, [0x100050000:0x250:0x0] hash]{ LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....osp@00000000e6467b2fosp-object@00000000922b2805 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) } header@00000000922b2805 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) header@000000001b8c7c54[0x4, 1, [0x1:0x0:0x0] hash exist]{ LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000f7fadd18 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000f0ca19abosd-ldiskfs-object@00000000f0ca19ab(i:00000000f72d965f:152/3782521649)[plain] LustreError: 415:0:(lu_object.c:1027:lu_site_print()) } header@000000001b8c7c54 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) header@0000000068458096[0x4, 1, [0x200000003:0x2:0x0] hash exist]{ LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000006b021ac4 LustreError: 415:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000001f66ab5cosd-ldiskfs-object@000000001f66ab5c(i:00000000cfca9b24:117/2602200711)[lfix] LustreError: 415:0:(lu_object.c:1027:lu_site_print()) } header@0000000068458096 | Link to test |
| sanity test 60a: llog_test run from kernel module and test llog_reader | LustreError: 147877:0:(lu_object.c:1297:lu_device_fini()) ASSERTION( atomic_read(&d->ld_ref) == 0 ) failed: Refcount is 1 LustreError: 147877:0:(lu_object.c:1297:lu_device_fini()) LBUG LustreError: Skipped 10 previous similar messages Pid: 147877, comm: kworker/u4:0 4.18.0-240.22.1.el8_lustre.x86_64 #1 SMP Mon Nov 8 22:25:55 UTC 2021 Call Trace TBD: [<0>] libcfs_call_trace+0x6f/0x90 [libcfs] [<0>] lbug_with_loc+0x43/0x80 [libcfs] [<0>] lu_device_fini+0x7d/0xb0 [obdclass] [<0>] osp_device_free+0x73/0x180 [osp] [<0>] class_free_dev+0x2e7/0x5e0 [obdclass] [<0>] obd_zombie_imp_cull+0x40a/0x5f0 [obdclass] [<0>] process_one_work+0x1a7/0x360 [<0>] worker_thread+0x30/0x390 [<0>] kthread+0x112/0x130 [<0>] ret_from_fork+0x35/0x40 | Lustre: DEBUG MARKER: ! which run-llog.sh &> /dev/null Lustre: DEBUG MARKER: /usr/sbin/lctl mark test_60 run 269 - from kernel mode Lustre: DEBUG MARKER: test_60 run 269 - from kernel mode Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /dev/null Lustre: DEBUG MARKER: bash run-llog.sh Lustre: 170337:0:(llog_test.c:2230:llog_test_setup()) Setup llog-test device over MGS device Lustre: 170337:0:(llog_test.c:112:llog_test_1()) 1a: create a log with name: 2d3a33a7 Lustre: 170337:0:(llog_test.c:129:llog_test_1()) 1b: close newly-created log Lustre: 170337:0:(llog_test.c:160:llog_test_2()) 2a: re-open a log with name: 2d3a33a7 Lustre: 170337:0:(llog_test.c:180:llog_test_2()) 2b: create a log without specified NAME & LOGID Lustre: 170337:0:(llog_test.c:198:llog_test_2()) 2b: write 1 llog records, check llh_count Lustre: 170337:0:(llog_test.c:211:llog_test_2()) 2c: re-open the log by LOGID and verify llh_count Lustre: 170337:0:(llog_test.c:258:llog_test_2()) 2d: destroy this log Lustre: 170337:0:(llog_test.c:417:llog_test_3()) 3a: write 1023 fixed-size llog records Lustre: 170337:0:(llog_test.c:382:llog_test3_process()) test3: processing records from index 501 to the end Lustre: 170337:0:(llog_test.c:391:llog_test3_process()) test3: total 525 records processed with 0 paddings Lustre: 170337:0:(llog_test.c:473:llog_test_3()) 3b: write 566 variable size llog records Lustre: 170337:0:(llog_test.c:545:llog_test_3()) 3c: write records with variable size until BITMAP_SIZE, return -ENOSPC Lustre: 170337:0:(llog_test.c:568:llog_test_3()) 3c: wrote 63962 more records before end of llog is reached Lustre: 170337:0:(llog_test.c:597:llog_test_4()) 4a: create a catalog log with name: 2d3a33a8 Lustre: 170337:0:(llog_test.c:612:llog_test_4()) 4b: write 1 record into the catalog Lustre: 170337:0:(llog_test.c:639:llog_test_4()) 4c: cancel 1 log record Lustre: 170337:0:(llog_test.c:651:llog_test_4()) 4d: write 64767 more log records Lustre: 170337:0:(llog_test.c:667:llog_test_4()) 4e: add 5 large records, one record per block Lustre: 170337:0:(llog_test.c:687:llog_test_4()) 4f: put newly-created catalog Lustre: 170337:0:(llog_test.c:785:llog_test_5()) 5a: re-open catalog by id Lustre: 170337:0:(llog_test.c:798:llog_test_5()) 5b: print the catalog entries.. we expect 2 Lustre: 170343:0:(llog_test.c:716:cat_print_cb()) seeing record at index 1 - [0x1:0x5b:0x0] in log [0xa:0x15:0x0] Lustre: 170337:0:(llog_test.c:810:llog_test_5()) 5c: Cancel 64767 records, see one log zapped Lustre: 170337:0:(llog_test.c:818:llog_test_5()) 5c: print the catalog entries.. we expect 1 Lustre: 170344:0:(llog_test.c:716:cat_print_cb()) seeing record at index 2 - [0x1:0x5c:0x0] in log [0xa:0x15:0x0] Lustre: 170344:0:(llog_test.c:716:cat_print_cb()) Skipped 1 previous similar message Lustre: 170337:0:(llog_test.c:830:llog_test_5()) 5d: add 1 record to the log with many canceled empty pages Lustre: 170337:0:(llog_test.c:838:llog_test_5()) 5e: print plain log entries.. expect 6 Lustre: 170337:0:(llog_test.c:850:llog_test_5()) 5f: print plain log entries reversely.. expect 6 Lustre: 170337:0:(llog_test.c:864:llog_test_5()) 5g: close re-opened catalog Lustre: 170337:0:(llog_test.c:894:llog_test_6()) 6a: re-open log 2d3a33a7 using client API Lustre: MGS: non-config logname received: 2d3a33a7 Lustre: 170337:0:(llog_test.c:926:llog_test_6()) 6b: process log 2d3a33a7 using client API Lustre: 170337:0:(llog_test.c:930:llog_test_6()) 6b: processed 63962 records Lustre: 170337:0:(llog_test.c:937:llog_test_6()) 6c: process log 2d3a33a7 reversely using client API Lustre: 170337:0:(llog_test.c:941:llog_test_6()) 6c: processed 63962 records Lustre: 170337:0:(llog_test.c:1088:llog_test_7()) 7a: test llog_logid_rec Lustre: 170337:0:(llog_test.c:1099:llog_test_7()) 7b: test llog_unlink64_rec Lustre: 170337:0:(llog_test.c:1110:llog_test_7()) 7c: test llog_setattr64_rec Lustre: 170337:0:(llog_test.c:1121:llog_test_7()) 7d: test llog_size_change_rec Lustre: 170337:0:(llog_test.c:1132:llog_test_7()) 7e: test llog_changelog_rec Lustre: 170337:0:(llog_test.c:1039:llog_test_7_sub()) 7_sub: records are not aligned, written 64071 from 64767 Lustre: 170337:0:(llog_test.c:1144:llog_test_7()) 7f: test llog_changelog_user_rec2 Lustre: 170337:0:(llog_test.c:1039:llog_test_7_sub()) 7_sub: records are not aligned, written 64139 from 64767 Lustre: 170337:0:(llog_test.c:1155:llog_test_7()) 7g: test llog_gen_rec Lustre: 170337:0:(llog_test.c:1166:llog_test_7()) 7h: test llog_setattr64_rec_v2 Lustre: 170337:0:(llog_test.c:1039:llog_test_7_sub()) 7_sub: records are not aligned, written 64071 from 64767 Lustre: 170337:0:(llog_test.c:1206:llog_test_8()) 8a: fill the first plain llog Lustre: 170337:0:(llog_test.c:1239:llog_test_8()) 8a: pin llog [0x1:0x68:0x0] Lustre: 170337:0:(llog_test.c:1249:llog_test_8()) 8b: fill the second plain llog Lustre: 170337:0:(llog_test.c:1270:llog_test_8()) 8b: second llog [0x1:0x6a:0x0] Lustre: 170337:0:(llog_test.c:1285:llog_test_8()) 8d: count survived records Lustre: 170337:0:(llog_test.c:1312:llog_test_8()) 8d: close re-opened catalog Lustre: 170337:0:(llog_test.c:1375:llog_test_9()) 9a: test llog_logid_rec Lustre: 170337:0:(llog_test.c:1359:llog_test_9_sub()) 9_sub: record type 1064553b in log 0x1:0x6c:0x0 Lustre: 170337:0:(llog_test.c:1386:llog_test_9()) 9b: test llog_obd_cfg_rec Lustre: 170337:0:(llog_test.c:1397:llog_test_9()) 9c: test llog_changelog_rec Lustre: 170337:0:(llog_test.c:1409:llog_test_9()) 9d: test llog_changelog_user_rec2 Lustre: 170337:0:(llog_test.c:1509:llog_test_10()) 10a: create a catalog log with name: 2d3a33a9 Lustre: 170337:0:(llog_test.c:1539:llog_test_10()) 10b: write 64767 log records Lustre: 170337:0:(llog_test.c:1565:llog_test_10()) 10c: write 129534 more log records Lustre: 170337:0:(llog_test.c:1597:llog_test_10()) 10c: write 64767 more log records Lustre: 170337:0:(llog_cat.c:105:llog_cat_new_log()) MGS: there are no more free slots in catalog 2d3a33a9 Lustre: 170337:0:(llog_test.c:1624:llog_test_10()) 10c: wrote 64011 records then 756 failed with ENOSPC Lustre: 170337:0:(llog_test.c:1643:llog_test_10()) 10d: Cancel 64767 records, see one log zapped Lustre: 170337:0:(llog_test.c:1657:llog_test_10()) 10d: print the catalog entries.. we expect 3 Lustre: 170358:0:(llog_test.c:716:cat_print_cb()) seeing record at index 2 - [0x1:0x71:0x0] in log [0xa:0x16:0x0] Lustre: 170337:0:(llog_test.c:1687:llog_test_10()) 10e: write 64767 more log records Lustre: 170337:0:(llog_cat.c:105:llog_cat_new_log()) MGS: there are no more free slots in catalog 2d3a33a9 Lustre: 170337:0:(llog_cat.c:105:llog_cat_new_log()) Skipped 755 previous similar messages Lustre: 170337:0:(llog_test.c:1714:llog_test_10()) 10e: wrote 64578 records then 189 failed with ENOSPC Lustre: 170337:0:(llog_test.c:1716:llog_test_10()) 10e: print the catalog entries.. we expect 4 Lustre: 170337:0:(llog_cat.c:925:llog_cat_process_or_fork()) MGS: catlog [0x16:0xa:0x0] crosses index zero Lustre: 170337:0:(llog_test.c:716:cat_print_cb()) seeing record at index 2 - [0x1:0x71:0x0] in log [0xa:0x16:0x0] Lustre: 170337:0:(llog_test.c:716:cat_print_cb()) Skipped 2 previous similar messages Lustre: 170337:0:(llog_test.c:1753:llog_test_10()) 10e: catalog successfully wrap around, last_idx 1, first 1 Lustre: 170337:0:(llog_test.c:1770:llog_test_10()) 10f: Cancel 64767 records, see one log zapped Lustre: 170337:0:(llog_test.c:1784:llog_test_10()) 10f: print the catalog entries.. we expect 3 Lustre: 170337:0:(llog_cat.c:925:llog_cat_process_or_fork()) MGS: catlog [0x16:0xa:0x0] crosses index zero Lustre: 170337:0:(llog_cat.c:925:llog_cat_process_or_fork()) Skipped 1 previous similar message Lustre: 170337:0:(llog_test.c:1815:llog_test_10()) 10f: write 64767 more log records Lustre: 170337:0:(llog_cat.c:105:llog_cat_new_log()) MGS: there are no more free slots in catalog 2d3a33a9 Lustre: 170337:0:(llog_cat.c:105:llog_cat_new_log()) Skipped 188 previous similar messages Lustre: 170337:0:(llog_test.c:1842:llog_test_10()) 10f: wrote 64578 records then 189 failed with ENOSPC Lustre: 170337:0:(llog_test.c:1889:llog_test_10()) 10g: Cancel 64767 records, see one log zapped Lustre: 170337:0:(llog_cat.c:925:llog_cat_process_or_fork()) MGS: catlog [0x16:0xa:0x0] crosses index zero Lustre: 170337:0:(llog_test.c:1901:llog_test_10()) 10g: print the catalog entries.. we expect 3 Lustre: 170337:0:(llog_cat.c:925:llog_cat_process_or_fork()) MGS: catlog [0x16:0xa:0x0] crosses index zero Lustre: 170337:0:(llog_test.c:716:cat_print_cb()) seeing record at index 4 - [0x1:0x73:0x0] in log [0xa:0x16:0x0] Lustre: 170337:0:(llog_test.c:716:cat_print_cb()) Skipped 6 previous similar messages Lustre: 170337:0:(llog_test.c:1931:llog_test_10()) 10g: Cancel 64767 records, see one log zapped Lustre: 170337:0:(llog_test.c:1945:llog_test_10()) 10g: print the catalog entries.. we expect 2 Lustre: 170337:0:(llog_test.c:1983:llog_test_10()) 10g: Cancel 64767 records, see one log zapped Lustre: 170337:0:(llog_test.c:1997:llog_test_10()) 10g: print the catalog entries.. we expect 1 Lustre: 170337:0:(llog_test.c:2023:llog_test_10()) 10g: llh_cat_idx has also successfully wrapped! Lustre: 170361:0:(llog_test.c:1469:cat_check_old_cb()) seeing record at index 2 - [0x1:0x427:0x0] in log [0xa:0x16:0x0] Lustre: 170337:0:(llog_test.c:2047:llog_test_10()) 10h: write 64767 more log records LustreError: 170337:0:(libcfs_fail.h:169:cfs_race()) cfs_race id 1317 sleeping LustreError: 170361:0:(libcfs_fail.h:174:cfs_race()) cfs_fail_race id 1317 waking LustreError: 170337:0:(libcfs_fail.h:172:cfs_race()) cfs_fail_race id 1317 awake: rc=0 LustreError: 170361:0:(libcfs_fail.h:174:cfs_race()) cfs_fail_race id 1317 waking Lustre: 170361:0:(llog_test.c:1469:cat_check_old_cb()) seeing record at index 3 - [0x1:0x4e5:0x0] in log [0xa:0x16:0x0] LustreError: 170337:0:(libcfs_fail.h:174:cfs_race()) cfs_fail_race id 1317 waking Lustre: 170337:0:(llog_test.c:2074:llog_test_10()) 10h: wrote 64767 records then 0 failed with ENOSPC Lustre: 170337:0:(llog_test.c:2087:llog_test_10()) 10: put newly-created catalog Lustre: DEBUG MARKER: /usr/sbin/lctl dk Lustre: DEBUG MARKER: which llog_reader 2> /dev/null Lustre: DEBUG MARKER: ls -d /usr/sbin/llog_reader Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 Lustre: 157072:0:(sec_gss.c:1224:gss_cli_ctx_fini_common()) reverse sec 00000000b732da5a: destroy ctx 000000009321843e Lustre: 157072:0:(sec_gss.c:1224:gss_cli_ctx_fini_common()) Skipped 1 previous similar message Lustre: lustre-MDT0000: Not available for connect from 10.240.23.148@tcp (stopping) Lustre: Skipped 1 previous similar message LustreError: 12329:0:(client.c:1256:ptlrpc_import_delay_req()) @@@ IMP_CLOSED req@000000002d62a63b x1717838888741120/t0(0) o41->lustre-MDT0003-osp-MDT0000@10.240.23.148@tcp:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:QU/0/ffffffff rc 0/-1 job:'osp-pre-3-0.0' LustreError: 11-0: lustre-MDT0000-osp-MDT0002: operation mds_statfs to node 0@lo failed: rc = -107 LustreError: Skipped 1 previous similar message Lustre: lustre-MDT0000-osp-MDT0002: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 15 previous similar messages Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: Skipped 3 previous similar messages Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) LustreError: 170827:0:(lprocfs_jobstats.c:137:job_stat_exit()) should not have any items LustreError: 170827:0:(lprocfs_jobstats.c:137:job_stat_exit()) Skipped 1 previous similar message LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) header@0000000058f1024e[0x4, 1, [0x200000003:0x2:0x0] hash exist]{ LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000dbeec1af LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000f02da4bfosd-ldiskfs-object@00000000f02da4bf(i:00000000dd7871f1:117/158573497)[lfix] LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) } header@0000000058f1024e LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) header@00000000bd1739c7[0x4, 1, [0x200000003:0x0:0x0] hash exist]{ LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000004622b262 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000008d1cb862osd-ldiskfs-object@000000008d1cb862(i:00000000312a39f6:116/1138751628)[plain] LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) } header@00000000bd1739c7 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) header@00000000c001f7ed[0x4, 1, [0x200000003:0x3:0x0] hash exist]{ LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000008be2c8c9 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000005021a737osd-ldiskfs-object@000000005021a737(i:00000000bdef3da0:118/4286075880)[plain] LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) } header@00000000c001f7ed LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) header@000000009e4010dc[0x5, 1, [0x200000001:0x1017:0x0] hash exist]{ LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....local_storage@0000000021003d49 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000008b2d3952osd-ldiskfs-object@000000008b2d3952(i:00000000e6e9e58a:13/2284583761)[plain] LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) } header@000000009e4010dc LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) header@00000000c3147096[0x4, 1, [0xa:0x0:0x0] hash exist]{ LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....local_storage@000000006c314e68 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000386e5653osd-ldiskfs-object@00000000386e5653(i:00000000f19616db:186/4185705000)[plain] LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) } header@00000000c3147096 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) header@0000000047e374cb[0x4, 1, [0x1:0x0:0x0] hash exist]{ LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000089f8e68 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@000000003523ca0aosd-ldiskfs-object@000000003523ca0a(i:00000000f0db136c:152/976897052)[plain] LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) } header@0000000047e374cb LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) header@000000002960a8e5[0x5, 1, [0x100070000:0x10a:0x0] hash]{ LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....osp@00000000fc6cd9b7osp-object@000000002960a8e5 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) } header@000000002960a8e5 LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) header@0000000058f1024e[0x4, 1, [0x200000003:0x2:0x0] hash exist]{ LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....local_storage@00000000dbeec1af LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) ....osd-ldiskfs@00000000f02da4bfosd-ldiskfs-object@00000000f02da4bf(i:00000000dd7871f1:117/158573497)[lfix] LustreError: 137-5: lustre-MDT0000_UUID: not available for connect from 10.240.23.145@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: 147877:0:(lu_object.c:1027:lu_site_print()) } header@0000000058f1024e | Link to test |