| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Comment |
|---|---|---|---|
| sanity-lnet test complete, duration 1365 sec | LustreError: 1280030:0:(client.c:2837:__ptlrpc_req_put()) ASSERTION( request->rq_pill.rc_reqmsg != ((void *)0x5a5a5a5a5a5a5a5aL) ) failed: LustreError: 1280030:0:(client.c:2837:__ptlrpc_req_put()) LBUG CPU: 0 UID: 0 PID: 1280030 Comm: lod0003_rec0001 Kdump: loaded Tainted: G OE ------- --- 6.12.0-55.37.1_lustre.el10.x86_64 #1 Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x42 [libcfs] __ptlrpc_req_put.isra.0+0x2ca/0x2d0 [ptlrpc] fld_client_rpc+0x33d/0x680 [fld] fld_server_lookup+0x217/0x390 [fld] lod_fld_lookup+0x2e1/0x550 [lod] lod_object_init+0xb3/0x470 [lod] lu_object_start+0x6c/0x100 [obdclass] lu_object_find_at+0x23d/0x800 [obdclass] ? srso_alias_return_thunk+0x5/0xfbef5 ? osp_md_read+0x5ac/0xe90 [osp] dt_locate_at+0x1e/0xc0 [obdclass] llog_osd_open+0x14a/0x10c0 [obdclass] llog_open+0x3bb/0x480 [obdclass] ? lodname2mdt_index+0xc0/0x2e0 [lod] lod_sub_prep_llog+0x3f7/0xa70 [lod] lod_sub_recovery_thread+0xaf/0xc00 [lod] ? __schedule+0x261/0x640 ? __pfx_lod_sub_recovery_thread+0x10/0x10 [lod] kthread+0xcf/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds2' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds4' ' /proc/mounts); IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:07:8a:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ce:a8:37 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! LNet: 11138:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11138:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11138:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm52.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! Lustre: DEBUG MARKER: onyx-155vm52.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ce:a8:37 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: test -b /dev/vg_Role_MDS/mdt2 Lustre: DEBUG MARKER: blockdev --getsz /dev/vg_Role_MDS/mdt2 2>/dev/null Lustre: DEBUG MARKER: dmsetup create mds2_flakey --table "0 6291456 linear /dev/vg_Role_MDS/mdt2 0" Lustre: DEBUG MARKER: dmsetup mknodes >/dev/null 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 LDISKFS-fs (dm-3): mounted filesystem 0b4688f4-6a98-4021-a4b7-561e19b13613 r/w with ordered data mode. Quota mode: journalled. Autotest: Test running for 535 minutes (lustre-reviews_full-dne-part-1_117330.1003) IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:90:ae:8f detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:38:ce:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:94:6d:09 detected! LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:07:8a:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:07:8a:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! LustreError: 1277573:0:(mgc_request.c:232:do_config_log_add()) MGC10.240.31.56@tcp: failed processing log, type 4: rc = -110 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! LustreError: Failed to get MGS log lustre-mdtir and no local copy. Lustre: 1277573:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -2 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:90:ae:8f detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! LustreError: Failed to get MGS log lustre-mdtir and no local copy. Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -2 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:42:85:b2 detected! Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 Lustre: Skipped 5 previous similar messages Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/us LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm53.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm53.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm53.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm53.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}' IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:42:85:b2 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey 2>/dev/null IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:42:85:b2 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:38:ce:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:42:85:b2 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:42:85:b2 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:07:8a:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:42:85:b2 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:07:8a:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:9d:e7:af detected! LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 LNetError: 11135:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.56 LNetError: 11135:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Skipped 2 previous similar messages LNetError: Connection to 10.240.31.56@tcp at host 10.240.31.56:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.56@tcp one of its NIDs? LNetError: Skipped 2 previous similar messages IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:07:8a:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:42:85:b2 detected! Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -110 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ce:a8:37 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm52.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! Lustre: DEBUG MARKER: onyx-155vm52.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds4_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: test -b /dev/vg_Role_MDS/mdt4 Lustre: DEBUG MARKER: blockdev --getsz /dev/vg_Role_MDS/mdt4 2>/dev/null Lustre: DEBUG MARKER: dmsetup create mds4_flakey --table "0 6291456 linear /dev/vg_Role_MDS/mdt4 0" LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 Lustre: DEBUG MARKER: dmsetup mknodes >/dev/null 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds4_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds4_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4; mount -t lustre -o localrecov /dev/mapper/mds4_flakey /mnt/lustre-mds4 LDISKFS-fs (dm-4): mounted filesystem e1348590-5657-4641-a543-61367cb10a94 r/w with ordered data mode. Quota mode: journalled. IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:90:ae:8f detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:f3:0b:b7 detected! LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:42:85:b2 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! LNet: 11139:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11139:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11139:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! LustreError: Failed to get MGS log lustre-mdtir and no local copy. Lustre: 1279993:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -2 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:42:85:b2 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:90:ae:8f detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! Lustre: lustre-MDT0003: Imperative Recovery not enabled, recovery window 60-180 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/us LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm53.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm53.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm53.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm53.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: e2label /dev/mapper/mds4_flakey 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}' Lustre: DEBUG MARKER: e2label /dev/mapper/mds4_flakey 2>/dev/null IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:38:ce:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:f3:0b:b7 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ce:a8:37 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:94:6d:09 detected! Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:df:bc:dd detected! Autotest: Test running for 540 minutes (lustre-reviews_full-dne-part-1_117330.1003) Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm51.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm51.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) Skipped 2 previous similar messages Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm51.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm51.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:38:ce:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! LNet: 11138:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11138:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11138:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! LNetError: 11136:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.56 LNetError: 11136:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Skipped 4 previous similar messages LNetError: Connection to 10.240.31.56@tcp at host 10.240.31.56:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.56@tcp one of its NIDs? LNetError: Skipped 4 previous similar messages IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) Skipped 4 previous similar messages IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:38:ce:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! Autotest: Test running for 545 minutes (lustre-reviews_full-dne-part-1_117330.1003) IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:df:bc:dd detected! LNet: 11139:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11139:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11139:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:70:d2:ad detected! LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:b0:a4:14 detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: [ -f /sys/module/mgc/parameters/mgc_requeue_timeout_min ] && echo 1 > /sys/module/mgc/parameters/mgc_requeue_timeout_min; exit 0 Lustre: DEBUG MARKER: sysctl --values kernel/kptr_restrict Lustre: DEBUG MARKER: sysctl -wq kernel/kptr_restrict=1 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: pjdfstest ============----- Sat Oct 11 07:28:46 AM UTC 2025 IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! Lustre: DEBUG MARKER: -----============= acceptance-small: pjdfstest ============----- Sat Oct 11 07:28:46 AM UTC 2025 Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: chown_00 utimensat_08 Lustre: DEBUG MARKER: excepting tests: chown_00 utimensat_08 Lustre: DEBUG MARKER: /usr/sbin/lctl mark === run_pjdfstest: start setup 07:28:55 \(1760167735\) === Lustre: DEBUG MARKER: === run_pjdfstest: start setup 07:28:55 (1760167735) === IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds2' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds4' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds4_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds4_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds4_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds4_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4; mount -t lustre -o localrecov /dev/mapper/mds4_flakey /mnt/lustre-mds4 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) Skipped 8 previous similar messages IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:38:ce:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! LNet: 11138:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11138:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11138:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! Autotest: Test running for 550 minutes (lustre-reviews_full-dne-part-1_117330.1003) IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! LNetError: 1259546:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.56 LNetError: 1259546:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Skipped 8 previous similar messages LNetError: Connection to 10.240.31.56@tcp at host 10.240.31.56:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.56@tcp one of its NIDs? LNetError: Skipped 8 previous similar messages IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c2:03:ed detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 LNet: 11139:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11139:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11139:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 Lustre: DEBUG MARKER: [ -f /sys/module/mgc/parameters/mgc_requeue_timeout_min ] && echo 1 > /sys/module/mgc/parameters/mgc_requeue_timeout_min; exit 0 Lustre: DEBUG MARKER: sysctl --values kernel/kptr_restrict Lustre: DEBUG MARKER: sysctl -wq kernel/kptr_restrict=1 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c2:03:ed detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark run_pjdfstest : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: run_pjdfstest : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-1/2025-10-10/lustre-reviews_full-dne-part-1_117330_1003_e5e324fe-a1fa-4b51-a3fd-aaf262875576//run_pjdfstest..debug_log.$(hostname -s).1760168099.log; Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: ost-pools ============----- Sat Oct 11 07:35:00 AM UTC 2025 Lustre: DEBUG MARKER: -----============= acceptance-small: ost-pools ============----- Sat Oct 11 07:35:00 AM UTC 2025 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! Lustre: DEBUG MARKER: excepting tests: Lustre: DEBUG MARKER: /usr/sbin/lctl mark === ost-pools: start setup 07:35:08 \(1760168108\) === Lustre: DEBUG MARKER: === ost-pools: start setup 07:35:08 (1760168108) === Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds2' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds4' ' /proc/mounts); LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds4_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds4_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds4_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds4_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4; mount -t lustre -o localrecov /dev/mapper/mds4_flakey /mnt/lustre-mds4 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! Autotest: Test running for 555 minutes (lustre-reviews_full-dne-part-1_117330.1003) IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:94:6d:09 detected! Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.56@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 Lustre: 1277586:0:(mgc_request.c:1909:mgc_process_log()) Skipped 2 previous similar messages LNet: 11139:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11139:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11139:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1277586:0:(mgc_request.c:614:do_requeue()) Skipped 16 previous similar messages IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ab:0b:1d detected! LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ab:0b:1d detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: [ -f /sys/module/mgc/parameters/mgc_requeue_timeout_min ] && echo 1 > /sys/module/mgc/parameters/mgc_requeue_timeout_min; exit 0 Lustre: DEBUG MARKER: sysctl --values kernel/kptr_restrict Lustre: DEBUG MARKER: sysctl -wq kernel/kptr_restrict=1 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:0a:ea:38 detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark ost-pools : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: ost-pools : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-1/2025-10-10/lustre-reviews_full-dne-part-1_117330_1003_e5e324fe-a1fa-4b51-a3fd-aaf262875576//ost-pools..debug_log.$(hostname -s).1760168472.log; Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: recovery-small ============----- Sat Oct 11 07:41:13 AM UTC 2025 Lustre: DEBUG MARKER: -----============= acceptance-small: recovery-small ============----- Sat Oct 11 07:41:13 AM UTC 2025 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6a:9b:e8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:8e:de:c8 detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: Lustre: DEBUG MARKER: excepting tests: Lustre: DEBUG MARKER: /usr/sbin/lctl mark === recovery-small: start setup 07:41:20 \(1760168480\) === Lustre: DEBUG MARKER: === recovery-small: start setup 07:41:20 (1760168480) === Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds2' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds4' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey >/dev/null 2>&1 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov /dev/mapper/mds2_flakey /mnt/lustre-mds2 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds4_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds4_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds4_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds4_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4; mount -t lustre -o localrecov /dev/mapper/mds4_flakey /mnt/lustre-mds4 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:67:f7:87 detected! Autotest: Test running for 560 minutes (lustre-reviews_full-dne-part-1_117330.1003) LNet: 11138:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11138:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11138:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:df:bc:dd detected! LNetError: 11135:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.56 LNetError: 11135:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Skipped 9 previous similar messages LNetError: Connection to 10.240.31.56@tcp at host 10.240.31.56:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.56@tcp one of its NIDs? LNetError: Skipped 9 previous similar messages IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:1c:b7:bd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:38:ce:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:1c:78:56 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:9d:e7:af detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:94:6d:09 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! LNet: 1 peer NIs in recovery (showing 1): 10.240.31.54@tcp IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:bd:ee:d0 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:96:0d:d7 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! LNet: 11139:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.55@tcp. Attempting to find an alternative route. LNetError: 11139:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.57@tcp to 10.240.31.56@tcp1 - Route table may be misconfigured LNetError: 11139:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.57@tcp: Unable to send REPLY for GET from 12345-10.240.31.56@tcp1: -113 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:df:bc:dd detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:0a:ea:38 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:8e:de:c8 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:6f:26:66 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:ab:0b:1d detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:62:83:ca detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: [ -f /sys/module/mgc/parameters/mgc_requeue_timeout_min ] && echo 1 > /sys/module/mgc/parameters/mgc_requeue_timeout_min; exit 0 Autotest: Test running for 565 minutes (lustre-reviews_full-dne-part-1_117330.1003) Lustre: DEBUG MARKER: sysctl --values kernel/kptr_restrict Lustre: DEBUG MARKER: sysctl -wq kernel/kptr_restrict=1 IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:be:0e:4b detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:0a:ea:38 detected! Lustre: DEBUG MARKER: /usr/sbin/lctl mark recovery-small : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: recovery-small : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-1/2025-10-10/lustre-reviews_full-dne-part-1_117330_1003_e5e324fe-a1fa-4b51-a3fd-aaf262875576//recovery-small..debug_log.$(hostname -s).1760168844.log; Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds2' ' /proc/mounts || true IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:67:f7:87 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:67:f7:87 detected! Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds2 IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:cc:8b:05 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:5a:08:f7 detected! LustreError: 1277671:0:(osp_object.c:615:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000009:0x0:0x0]: rc = -5 LustreError: 1277671:0:(lod_sub_object.c:916:lod_sub_prep_llog()) lustre-MDT0001-mdtlov: can't get id from catalogs: rc = -5 LustreError: 1277671:0:(lod_dev.c:508:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001: get update log duration 1766, retries 0, failed: rc = -5 LustreError: 1277671:0:(lod_dev.c:508:lod_sub_recovery_thread()) Skipped 2 previous similar messages Lustre: lustre-MDT0001: Not available for connect from 10.240.31.55@tcp (stopping) Lustre: Skipped 8 previous similar messages Lustre: lustre-MDT0001-osp-MDT0003: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 25 previous similar messages LustreError: 1291410:0:(obd_class.h:478:obd_check_dev()) Device 6 not setup LustreError: 1291410:0:(obd_class.h:478:obd_check_dev()) Skipped 101 previous similar messages LDISKFS-fs (dm-3): unmounting filesystem 0b4688f4-6a98-4021-a4b7-561e19b13613. Lustre: server umount lustre-MDT0001 complete LustreError: 1281294:0:(ldlm_lib.c:1176:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: 1281294:0:(ldlm_lib.c:1176:target_handle_connect()) Skipped 45 previous similar messages Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds2_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup table /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: dmsetup remove /dev/mapper/mds2_flakey Lustre: DEBUG MARKER: dmsetup mknodes >/dev/null 2>&1 Lustre: DEBUG MARKER: modprobe -r dm-flakey IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:70:d2:ad detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:e7:e8:9e detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:ef:b9:9d detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::a54:2e6:bd0d:d0c5 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::8baa:a02:b1f6:f72d used by 52:54:00:c9:db:05 detected! IPv6: eth0: IPv6 duplicate address fe80::194a:e2fd:b72e:b661 used by 52:54:00:c2:03:ed detected! IPv6: eth0: IPv6 duplicate address fe80::2d8b:44d9:a914:a976 used by 52:54:00:6f:67:58 detected! IPv6: eth0: IPv6 duplicate address fe80::201:7204:228b:bddd used by 52:54:00:b0:a4:14 detected! IPv6: eth0: IPv6 duplicate address fe80::5a2a:afa3:69c:8b6a used by 52:54:00:ef:b9:9d detected! Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds4' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds4 LustreError: 1280029:0:(osp_object.c:615:osp_attr_get()) lustre-MDT0000-osp-MDT0003: osp_attr_get update error [0x200000009:0x0:0x0]: rc = -5 LustreError: 1280029:0:(lod_sub_object.c:916:lod_sub_prep_llog()) lustre-MDT0003-mdtlov: can't get id from catalogs: rc = -5 LustreError: 1280029:0:(lod_dev.c:508:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0003: get update log duration 1596, retries 0, failed: rc = -5 | Link to test |
| sanity-lnet test complete, duration 1200 sec | LustreError: 1010285:0:(client.c:2837:__ptlrpc_req_put()) ASSERTION( request->rq_pill.rc_reqmsg != ((void *)0x5a5a5a5a5a5a5a5aL) ) failed: LustreError: 1010285:0:(client.c:2837:__ptlrpc_req_put()) LBUG CPU: 1 UID: 0 PID: 1010285 Comm: lod0003_rec0001 Kdump: loaded Tainted: P W OE ------- --- 6.12.0-55.37.1_lustre.el10.x86_64 #1 Tainted: [P]=PROPRIETARY_MODULE, [W]=WARN, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x42 [libcfs] __ptlrpc_req_put.isra.0+0x2ca/0x2d0 [ptlrpc] fld_client_rpc+0x33d/0x680 [fld] fld_server_lookup+0x217/0x390 [fld] lod_fld_lookup+0x2e1/0x550 [lod] lod_object_init+0xb3/0x470 [lod] lu_object_start+0x6c/0x100 [obdclass] lu_object_find_at+0x23d/0x800 [obdclass] ? srso_alias_return_thunk+0x5/0xfbef5 ? osp_md_read+0x5ac/0xe90 [osp] dt_locate_at+0x1e/0xc0 [obdclass] llog_osd_open+0x14a/0x10c0 [obdclass] llog_open+0x3bb/0x480 [obdclass] ? lodname2mdt_index+0xc0/0x2e0 [lod] lod_sub_prep_llog+0x3f7/0xa70 [lod] lod_sub_recovery_thread+0xaf/0xc00 [lod] ? __schedule+0x261/0x640 ? __pfx_lod_sub_recovery_thread+0x10/0x10 [lod] kthread+0xcf/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds2' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds4' ' /proc/mounts); Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm67.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm67.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs; Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt2/mdt2 LNet: 10601:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10601:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10601:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 LNetError: 10596:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LNetError: 10597:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LNetError: 10598:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LustreError: Failed to get MGS log lustre-sptlrpc and no local copy. LNetError: 10599:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LustreError: 1008477:0:(mgc_request.c:232:do_config_log_add()) MGC10.240.31.71@tcp: failed processing log, type 4: rc = -110 LNetError: 10596:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LustreError: Failed to get MGS log lustre-mdtir and no local copy. Lustre: 1008477:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -2 LNetError: 10597:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LustreError: Failed to get MGS log lustre-mdtir and no local copy. Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -2 Lustre: lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 Lustre: Skipped 4 previous similar messages Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/us LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm68.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm68.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm68.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm68.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt2/mdt2 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}' Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt2/mdt2 2>/dev/null LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 LNetError: 10598:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -110 Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -110 Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm67.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm67.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4 Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs; Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt4/mdt4 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4; mount -t lustre -o localrecov lustre-mdt4/mdt4 /mnt/lustre-mds4 LustreError: 1010214:0:(ldlm_resource.c:978:ldlm_resource_complain()) MGC10.240.31.71@tcp: namespace resource [0x65727473756c:0x0:0x0].0x0 (ff3cd39a810d0840) refcount nonzero (1) after lock cleanup; forcing cleanup. LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 LNetError: 10599:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? Autotest: Test running for 460 minutes (lustre-reviews_full-dne-zfs-part-1_117330.1006) LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LNet: 10601:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10601:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10601:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -5 LustreError: Failed to get MGS log lustre-mdtir and no local copy. Lustre: 1010214:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -2 LustreError: Failed to get MGS log lustre-mdtir and no local copy. Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -2 Lustre: lustre-MDT0003: Imperative Recovery not enabled, recovery window 60-180 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check Lustre: DEBUG MARKER: PATH=/usr/lib64/lustre/tests:/usr/lib/lustre/tests:/usr/lib64/lustre/tests:/opt/iozone/bin:/opt/iozone/bin:/opt/iozone/bin:/usr/lib64/lustre/tests/mpi:/usr/lib64/lustre/tests/racer:/usr/lib64/lustre/../lustre-iokit/sgpdd-survey:/usr/lib64/lustre/tests:/us Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm68.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm68.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) Skipped 1 previous similar message Lustre: DEBUG MARKER: onyx-155vm68.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm68.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt4/mdt4 2>/dev/null | grep -E ':[a-zA-Z]{3}[0-9]{4}' Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt4/mdt4 2>/dev/null LNetError: 10597:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: 10597:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Skipped 1 previous similar message LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LNetError: Skipped 1 previous similar message Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm66.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm66.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 Lustre: DEBUG MARKER: /usr/sbin/lctl mark onyx-155vm66.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all Lustre: DEBUG MARKER: onyx-155vm66.onyx.whamcloud.com: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) Skipped 2 previous similar messages LNet: 10602:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10602:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10602:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 Autotest: Test running for 465 minutes (lustre-reviews_full-dne-zfs-part-1_117330.1006) LNetError: 10599:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: 10599:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Skipped 2 previous similar messages LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LNetError: Skipped 2 previous similar messages Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) Skipped 4 previous similar messages Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 LNet: 10602:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10602:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10602:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: [ -f /sys/module/mgc/parameters/mgc_requeue_timeout_min ] && echo 1 > /sys/module/mgc/parameters/mgc_requeue_timeout_min; exit 0 Lustre: DEBUG MARKER: sysctl --values kernel/kptr_restrict Lustre: DEBUG MARKER: sysctl -wq kernel/kptr_restrict=1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: pjdfstest ============----- Sat Oct 11 06:14:21 AM UTC 2025 Lustre: DEBUG MARKER: -----============= acceptance-small: pjdfstest ============----- Sat Oct 11 06:14:21 AM UTC 2025 Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: chown_00 utimensat_08 Lustre: DEBUG MARKER: excepting tests: chown_00 utimensat_08 Lustre: DEBUG MARKER: /usr/sbin/lctl mark === run_pjdfstest: start setup 06:14:31 \(1760163271\) === Lustre: DEBUG MARKER: === run_pjdfstest: start setup 06:14:31 (1760163271) === Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds2' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds4' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs; Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt2/mdt2 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4 Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs; Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt4/mdt4 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4; mount -t lustre -o localrecov lustre-mdt4/mdt4 /mnt/lustre-mds4 Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 Autotest: Test running for 470 minutes (lustre-reviews_full-dne-zfs-part-1_117330.1006) LNetError: 10596:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: 10596:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Skipped 4 previous similar messages LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LNetError: Skipped 4 previous similar messages LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) Skipped 8 previous similar messages LNet: 10602:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10602:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10602:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) Skipped 1 previous similar message LNet: 10602:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10602:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10602:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: [ -f /sys/module/mgc/parameters/mgc_requeue_timeout_min ] && echo 1 > /sys/module/mgc/parameters/mgc_requeue_timeout_min; exit 0 Autotest: Test running for 475 minutes (lustre-reviews_full-dne-zfs-part-1_117330.1006) Lustre: DEBUG MARKER: sysctl --values kernel/kptr_restrict Lustre: DEBUG MARKER: sysctl -wq kernel/kptr_restrict=1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark run_pjdfstest : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: run_pjdfstest : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-1/2025-10-10/lustre-reviews_full-dne-zfs-part-1_117330_1006_f35a1e40-6442-43d0-a289-144a4257bb66//run_pjdfstest..debug_log.$(hostname -s).1760163627.log; Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: ost-pools ============----- Sat Oct 11 06:20:28 AM UTC 2025 Lustre: DEBUG MARKER: -----============= acceptance-small: ost-pools ============----- Sat Oct 11 06:20:28 AM UTC 2025 Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: Lustre: DEBUG MARKER: excepting tests: Lustre: DEBUG MARKER: /usr/sbin/lctl mark === ost-pools: start setup 06:20:36 \(1760163636\) === Lustre: DEBUG MARKER: === ost-pools: start setup 06:20:36 (1760163636) === Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds2' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds4' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs; Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt2/mdt2 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4 Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs; Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt4/mdt4 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4; mount -t lustre -o localrecov lustre-mdt4/mdt4 /mnt/lustre-mds4 LNet: 10601:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10601:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10601:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) failed processing log: -108 LustreError: 1008486:0:(mgc_request.c:614:do_requeue()) Skipped 16 previous similar messages LNetError: 10597:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Error -104 reading HELLO from 10.240.31.71 LNetError: 10597:0:(socklnd_cb.c:1794:ksocknal_recv_hello()) Skipped 8 previous similar messages LNetError: Connection to 10.240.31.71@tcp at host 10.240.31.71:7988 was reset: is it running a compatible version of Lustre and is 10.240.31.71@tcp one of its NIDs? LNetError: Skipped 8 previous similar messages Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) MGC10.240.31.71@tcp: IR log lustre-mdtir failed, not fatal: rc = -108 Lustre: 1008486:0:(mgc_request.c:1909:mgc_process_log()) Skipped 2 previous similar messages Autotest: Test running for 480 minutes (lustre-reviews_full-dne-zfs-part-1_117330.1006) Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: [ -f /sys/module/mgc/parameters/mgc_requeue_timeout_min ] && echo 1 > /sys/module/mgc/parameters/mgc_requeue_timeout_min; exit 0 Lustre: DEBUG MARKER: sysctl --values kernel/kptr_restrict Lustre: DEBUG MARKER: sysctl -wq kernel/kptr_restrict=1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark ost-pools : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: ost-pools : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-1/2025-10-10/lustre-reviews_full-dne-zfs-part-1_117330_1006_f35a1e40-6442-43d0-a289-144a4257bb66//ost-pools..debug_log.$(hostname -s).1760163991.log; Lustre: DEBUG MARKER: /usr/sbin/lctl mark -----============= acceptance-small: recovery-small ============----- Sat Oct 11 06:26:32 AM UTC 2025 Lustre: DEBUG MARKER: -----============= acceptance-small: recovery-small ============----- Sat Oct 11 06:26:32 AM UTC 2025 Lustre: DEBUG MARKER: /usr/sbin/lctl mark excepting tests: Lustre: DEBUG MARKER: excepting tests: Lustre: DEBUG MARKER: /usr/sbin/lctl mark === recovery-small: start setup 06:26:40 \(1760164000\) === Lustre: DEBUG MARKER: === recovery-small: start setup 06:26:40 (1760164000) === Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds2' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds4' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2 Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs; Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt2/mdt2 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds2; mount -t lustre -o localrecov lustre-mdt2/mdt2 /mnt/lustre-mds2 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4 Lustre: DEBUG MARKER: lsmod | grep zfs >&/dev/null || modprobe zfs; Lustre: DEBUG MARKER: zfs get -H -o value lustre:svname lustre-mdt4/mdt4 Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds4; mount -t lustre -o localrecov lustre-mdt4/mdt4 /mnt/lustre-mds4 LNet: 10602:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10602:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10602:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 Autotest: Test running for 485 minutes (lustre-reviews_full-dne-zfs-part-1_117330.1006) LNet: 10602:0:(lib-move.c:2246:lnet_handle_find_routed_path()) No peer NI for gateway 10.240.31.69@tcp. Attempting to find an alternative route. LNetError: 10602:0:(lib-move.c:2260:lnet_handle_find_routed_path()) Unable to send message from 10.240.31.72@tcp to 10.240.31.71@tcp1 - Route table may be misconfigured LNetError: 10602:0:(lib-move.c:4572:lnet_parse_get()) 10.240.31.72@tcp: Unable to send REPLY for GET from 12345-10.240.31.71@tcp1: -113 Lustre: DEBUG MARKER: /usr/sbin/lctl mark Using TIMEOUT=20 Lustre: DEBUG MARKER: Using TIMEOUT=20 Lustre: DEBUG MARKER: [ -f /sys/module/mgc/parameters/mgc_requeue_timeout_min ] && echo 1 > /sys/module/mgc/parameters/mgc_requeue_timeout_min; exit 0 Lustre: DEBUG MARKER: sysctl --values kernel/kptr_restrict Lustre: DEBUG MARKER: sysctl -wq kernel/kptr_restrict=1 Lustre: DEBUG MARKER: /usr/sbin/lctl mark recovery-small : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: recovery-small : @@@@@@ FAIL: NAME=autotest_config not mounted Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-1/2025-10-10/lustre-reviews_full-dne-zfs-part-1_117330_1006_f35a1e40-6442-43d0-a289-144a4257bb66//recovery-small..debug_log.$(hostname -s).1760164355.log; Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds2' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds2 LustreError: 1008520:0:(osp_object.c:615:osp_attr_get()) lustre-MDT0000-osp-MDT0001: osp_attr_get update error [0x200000009:0x0:0x0]: rc = -5 LustreError: 1008520:0:(osp_object.c:615:osp_attr_get()) Skipped 1 previous similar message LustreError: 1008520:0:(lod_sub_object.c:916:lod_sub_prep_llog()) lustre-MDT0001-mdtlov: can't get id from catalogs: rc = -5 LustreError: 1008520:0:(lod_sub_object.c:916:lod_sub_prep_llog()) Skipped 1 previous similar message LustreError: 1008520:0:(lod_dev.c:508:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001: get update log duration 1725, retries 0, failed: rc = -5 LustreError: 1008520:0:(lod_dev.c:508:lod_sub_recovery_thread()) Skipped 1 previous similar message Lustre: lustre-MDT0001: Not available for connect from 10.240.31.70@tcp (stopping) Lustre: Skipped 15 previous similar messages Lustre: lustre-MDT0001-osp-MDT0003: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 32 previous similar messages LustreError: 1019495:0:(obd_class.h:478:obd_check_dev()) Device 6 not setup LustreError: 1019495:0:(obd_class.h:478:obd_check_dev()) Skipped 77 previous similar messages Lustre: server umount lustre-MDT0001 complete Lustre: DEBUG MARKER: lsmod | grep lnet > /dev/null && LustreError: 1008487:0:(ldlm_lib.c:1176:target_handle_connect()) lustre-MDT0001: not available for connect from 10.240.31.70@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. LustreError: 1008487:0:(ldlm_lib.c:1176:target_handle_connect()) Skipped 16 previous similar messages Lustre: DEBUG MARKER: ! zpool list -H lustre-mdt2 >/dev/null 2>&1 || Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds4' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds4 LustreError: 1010284:0:(osp_object.c:615:osp_attr_get()) lustre-MDT0000-osp-MDT0003: osp_attr_get update error [0x200000009:0x0:0x0]: rc = -5 LustreError: 1010284:0:(lod_sub_object.c:916:lod_sub_prep_llog()) lustre-MDT0003-mdtlov: can't get id from catalogs: rc = -5 LustreError: 1010284:0:(lod_dev.c:508:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0003: get update log duration 1574, retries 0, failed: rc = -5 | Link to test |