| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Comment |
|---|---|---|---|
| mmp test complete, duration 1901 sec | kernel BUG at /tmp/rpmbuild-lustre-jenkins-Ui9P732t/BUILD/lustre-2.17.51_23_gb36f204/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP PTI CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ffffbf09c56279f8 EFLAGS: 00010293 RAX: ffff9f23aaa01858 RBX: ffff9f23a9c89720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ffff9f23fbc1e698 RDI: ffff9f23fbc1e698 RBP: ffff9f23a9c89000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ffffbf09c5627810 R12: ffff9f23a9c89720 R13: ffff9f2395f29800 R14: ffffffffc13fcc70 R15: ffff9f23c23b8520 FS: 00007f1685a95080(0000) GS:ffff9f23fbc00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000055a1bc589ee8 CR3: 0000000128e6a004 CR4: 0000000000170ef0 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb | Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds3' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds1_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1; mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 Lustre: Skipped 13 previous similar messages LDISKFS-fs error (device dm-3): mb_free_blocks:1962: group 10, block 225360:freeing already freed block (bit 16880); block bitmap corrupt. Aborting journal on device dm-3-8. LDISKFS-fs (dm-3): Remounting filesystem read-only LDISKFS-fs warning (device dm-3): ldiskfs_mb_generate_buddy:1239: group 10: block bitmap and bg descriptor inconsistent: 3466 vs 3468 free clusters 3946 in gd, 1 pa's LDISKFS-fs error (device dm-3) in osd_trans_stop:2340: IO failure LustreError: 178024:0:(osd_handler.c:2343:osd_trans_stop()) lustre-MDT0000: failed to stop transaction: rc = -5 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check LustreError: 178198:0:(obd_sysfs.c:269:health_check_show()) lustre-MDT0000-osd: device reported unhealthy Lustre: DEBUG MARKER: /usr/sbin/lctl mark mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: \'NOT HEALTHY\' Lustre: DEBUG MARKER: mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: 'NOT HEALTHY' Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-2/2026-03-27/lustre-reviews_review-dne-subtest-change_122939_104_1853660e-67b8-4caf-b360-19cdfc75c178//mmp.test_10.debug_log.$(hostname -s).1774591669.log; Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1 LustreError: 178640:0:(osd_handler.c:2455:osd_drop_preallocated_space()) lustre-MDT0000: can't truncate: rc=-30 LDISKFS-fs (dm-3): Inode 576 (00000000b61feaea): orphan list check failed! 00000000b61feaea: 0001f30a 00000004 00000000 00000000 ................ 00000000c47bbf7a: 00000004 000372df 00000000 00000000 .....r.......... 000000004b81bf7e: 00000000 00000000 00000000 00000000 ................ 000000004cb5791f: 00000000 00000000 00000000 00000000 ................ 000000000ad436a0: 00000000 00000000 00000000 00000001 ................ 00000000dc8415cc: 8e31a190 ffff9f23 8e31a190 ffff9f23 ..1.#.....1.#... 00000000a32605fa: 00000000 00000000 00084000 80000004 .........@...... 000000006623e314: 00000000 00000000 8e31a1b8 ffff9f23 ..........1.#... 0000000031c8a6f8: 8e31a1b8 ffff9f23 00000000 00000000 ..1.#........... 000000004e07ff5f: 00000000 00000000 a9c89720 ffff9f23 ........ ...#... 00000000f56cda9e: 8e318098 ffff9f23 00002040 00000000 ..1.#...@ ...... 00000000c4845bc1: 00000000 00000000 8e31a1f8 ffff9f23 ..........1.#... 00000000c0177230: 8e31a1f8 ffff9f23 00000000 00000000 ..1.#........... 000000006f069fd0: 00000000 00000000 00000000 00000000 ................ 00000000cdba2807: 8e31a220 ffff9f23 8e31a220 ffff9f23 .1.#... .1.#... 000000002843d953: 00000000 00000000 00000000 00000000 ................ 000000009cc4214f: 000881a4 00000000 00000000 00000280 ................ 0000000096186928: 00000000 00000000 00000000 00000000 ................ 000000004d626c5c: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#... 00000000904b5e4f: 8e31a3b8 ffff9f23 842a0c40 ffff9f23 ..1.#...@.*.#... 000000001f00f164: 00000240 00000000 00000001 00000000 @............... 000000008aec56b5: 00002040 00000000 69c61eb5 00000000 @ .........i.... 000000003843a0c6: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000a50d4b1e: 00000000 00000000 69c61eb5 00000000 ...........i.... 0000000037f8beca: 00000000 00000000 00000000 00000000 ................ 00000000066cdeeb: 0000000c 00000000 00000020 00000000 ........ ....... 00000000524b57c6: 00000060 00000000 00000000 00000000 `............... 00000000c4dd3772: 8e31a2f0 ffff9f23 8e31a2f0 ffff9f23 ..1.#.....1.#... 000000004753a2b9: 00000000 00000000 00000000 00000000 ................ 00000000b576e37b: 001c0e13 00000001 00000000 00000000 ................ 000000000be5cff9: 00000000 00000000 00000000 00000000 ................ 00000000f59eaae6: 8e31a330 ffff9f23 8e31a330 ffff9f23 0.1.#...0.1.#... 00000000700cc572: 00000000 00000000 00000000 00000000 ................ 000000003541bb38: 8e31a350 ffff9f23 8e31a350 ffff9f23 P.1.#...P.1.#... 0000000067e7c0a6: 8e31a360 ffff9f23 8e31a360 ffff9f23 `.1.#...`.1.#... 00000000f14a41b5: 8e31a370 ffff9f23 8e31a370 ffff9f23 p.1.#...p.1.#... 000000007a1fc688: 00000000 00000000 00000000 00000000 ................ 00000000275a4b7f: 00000002 00000000 00000000 00000000 ................ 000000009a1323a5: 00000000 00000000 c13f6580 ffffffff .........e?..... 00000000067619b9: 00000000 00000000 8e31a240 ffff9f23 ........@.1.#... 00000000061cb1af: 00000000 00000021 00000000 00000000 ....!........... 0000000089f90a79: 00000000 00000000 00000000 00000000 ................ 000000000491997f: 00000000 00000000 00000000 00000000 ................ 000000004f82a63a: 00000000 00000000 8e31a3f8 ffff9f23 ..........1.#... 0000000061e0d28a: 8e31a3f8 ffff9f23 00000000 00000000 ..1.#........... 00000000705e47d8: 00000000 00000000 00000000 00000000 ................ 000000006fd6d0a5: 00000000 00000000 00000000 00000000 ................ 0000000046be4182: c13f38e0 ffffffff 00000010 00000000 .8?............. 00000000e57394b1: 00000000 006200ca 8e31a448 ffff9f23 ......b.H.1.#... 00000000e8d89389: 8e31a448 ffff9f23 00000000 00000000 H.1.#........... 000000006298b813: 00000000 00000000 00000000 00000000 ................ 0000000060fdb4ef: 00000000 00000000 00000000 00000000 ................ 0000000063dfa033: 00000000 00000000 8e31a488 ffff9f23 ..........1.#... 00000000fc16d167: 8e31a488 ffff9f23 00000000 00000000 ..1.#........... 00000000c3d13f8f: 274d6518 00000000 00000000 00000000 .eM'............ 0000000026f3a660: 00000000 00000000 00000000 00000000 ................ 000000006524348d: 00000000 00000000 00000000 00000000 ................ 0000000068be0756: 00000000 00000000 69c61eb5 00000000 ...........i.... 000000007bcc9711: 0efdee22 00000000 00000000 00000000 "............... 00000000e024a0fe: 8e31a4f0 ffff9f23 8e31a4f0 ffff9f23 ..1.#.....1.#... 00000000403bb030: 00000000 ffff9f23 00000000 00000000 ....#........... 00000000114e0c44: 00000000 00000000 00000000 00000000 ................ 00000000f0186abd: 8e31a520 ffff9f23 8e31a520 ffff9f23 .1.#... .1.#... 0000000054594e1b: 00000000 00000000 00000000 ffffffff ................ 000000009fd42c39: 00000000 ffffffff 00000000 00000000 ................ 00000000d2bf4e50: 00000020 ffff9f23 00000000 00000000 ...#........... 00000000b30e0f8a: 00000000 00000000 8e31a568 ffff9f23 ........h.1.#... 000000000be735b9: 8e31a568 ffff9f23 ffffffe0 0000000f h.1.#........... 0000000035d2f7ed: 8e31a580 ffff9f23 8e31a580 ffff9f23 ..1.#.....1.#... 00000000bd560a75: c13e3500 ffffffff 69c61bcc 00000000 .5>........i.... 00000000d30fc6c5: 10cedc09 00000000 00000000 00000000 ................ 000000004f83854b: 0000000c 00000000 00000000 00000000 ................ 00000000f31671bc: 000001f3 000001f3 00000000 00000000 ................ 00000000bcbfcc2d: 00000000 00000000 00000000 00000000 ................ 000000000654ba7f: 00000000 00000000 00000000 00000000 ................ 00000000f1946104: 00000000 00000000 ........ CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50 RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0 R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50 R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 577 (00000000efae7cf6): orphan list check failed! 00000000efae7cf6: 0001f30a 00000004 00000000 00000000 ................ 00000000b7980af8: 00000004 000372e3 00000000 00000000 .....r.......... 0000000033305509: 00000000 00000000 00000000 00000000 ................ 00000000e985dbca: 00000000 00000000 00000000 00000240 ............@... 00000000e8c20942: 00000000 00000000 00000000 00000001 ................ 00000000b3d075f0: 8e318050 ffff9f23 8e318050 ffff9f23 P.1.#...P.1.#... 00000000af5fc306: 00000000 00000000 00084000 80000004 .........@...... 00000000fc56082a: 00000000 00000000 8e318078 ffff9f23 ........x.1.#... 0000000071284652: 8e318078 ffff9f23 00000000 00000000 x.1.#........... 0000000020a57267: 00000000 00000000 8e31a1d8 ffff9f23 ..........1.#... 000000008fe34a81: 8e319858 ffff9f23 00002040 00000000 X.1.#...@ ...... 00000000c0a46cef: 00000000 00000000 8e3180b8 ffff9f23 ..........1.#... 00000000bdf20e04: 8e3180b8 ffff9f23 00000000 00000000 ..1.#........... 0000000034f13dd5: 00000000 00000000 00000000 00000000 ................ 00000000d84bee65: 8e3180e0 ffff9f23 8e3180e0 ffff9f23 ..1.#.....1.#... 00000000dd8984f6: 00000000 00000000 00000000 00000000 ................ 000000000c18ec88: 000881a4 00000000 00000000 00000280 ................ 0000000011533763: 00000000 00000000 00000000 00000000 ................ 0000000085c4bed4: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#... 00000000ba37ec51: 8e318278 ffff9f23 842a0200 ffff9f23 x.1.#.....*.#... 00000000508967a0: 00000241 00000000 00000001 00000000 A............... 000000004efe87fe: 00002040 00000000 69c61eb5 00000000 @ .........i.... 0000000037ec5641: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000996c1bdf: 00000000 00000000 69c61eb5 00000000 ...........i.... 000000000d1fadf0: 00000000 00000000 00000000 00000000 ................ 000000002eba089c: 0000000c 00000000 00000020 00000000 ........ ....... 000000008c1cc977: 00000060 00000000 00000000 00000000 `............... 0000000025569576: 8e3181b0 ffff9f23 8e3181b0 ffff9f23 ..1.#.....1.#... 00000000713941f5: 00000000 00000000 00000000 00000000 ................ 000000003892fc72: 001c0e15 00000001 00000000 00000000 ................ 000000003c74535e: 00000000 00000000 00000000 00000000 ................ 000000005452cd0b: 8e3181f0 ffff9f23 8e3181f0 ffff9f23 ..1.#.....1.#... 0000000040a48a43: 00000000 00000000 00000000 00000000 ................ 00000000e3fdd6d8: 8e318210 ffff9f23 8e318210 ffff9f23 ..1.#.....1.#... 000000003f52e3e2: 8e318220 ffff9f23 8e318220 ffff9f23 .1.#... .1.#... 0000000041712585: 8e318230 ffff9f23 8e318230 ffff9f23 0.1.#...0.1.#... 00000000ac8285f4: 00000000 00000000 00000000 00000000 ................ 0000000040d3d541: 00000002 00000000 00000000 00000000 ................ 00000000fb45c44e: 00000000 00000000 c13f6580 ffffffff .........e?..... 00000000c1eac0d9: 00000000 00000000 8e318100 ffff9f23 ..........1.#... 0000000003572ee2: 00000000 00000021 00000000 00000000 ....!........... 0000000001977719: 00000000 00000000 00000000 00000000 ................ 0000000051192341: 00000000 00000000 00000000 00000000 ................ 000000001f6286d2: 00000000 00000000 8e3182b8 ffff9f23 ..........1.#... 000000002cf37804: 8e3182b8 ffff9f23 00000000 00000000 ..1.#........... 00000000adad12b1: 00000000 00000000 00000000 00000000 ................ 00000000fd7f2f49: 00000000 00000000 00000000 00000000 ................ 000000001195caac: c13f38e0 ffffffff 00000010 00000000 .8?............. 00000000c2a5afde: 00000000 006200ca 8e318308 ffff9f23 ......b...1.#... 000000004c4f3201: 8e318308 ffff9f23 00000000 00000000 ..1.#........... 0000000065e4c9b7: 00000000 00000000 00000000 00000000 ................ 000000001ea64da4: 00000000 00000000 00000000 00000000 ................ 00000000e2108748: 00000000 00000000 8e318348 ffff9f23 ........H.1.#... 0000000026c6be1b: 8e318348 ffff9f23 00000000 00000000 H.1.#........... 00000000d55506e0: 42d3ea40 00000000 00000000 00000000 @..B............ 00000000d70682dd: 00000000 00000000 00000000 00000000 ................ 00000000c57c0312: 00000000 00000000 00000000 00000000 ................ 00000000a853c50f: 00000000 00000000 69c61eb5 00000000 ...........i.... 0000000099727151: 0f1c729f 00000000 00000000 ffff9f23 .r..........#... 00000000c679a8b4: 8e3183b0 ffff9f23 8e3183b0 ffff9f23 ..1.#.....1.#... 00000000fb7ed445: 00000000 ffff9f23 00000000 00000000 ....#........... 000000006c6d0442: 00000000 00000000 00000000 00000000 ................ 00000000c9348b3d: 8e3183e0 ffff9f23 8e3183e0 ffff9f23 ..1.#.....1.#... 000000000c9aa24d: 00000000 00000000 00000000 ffffffff ................ 00000000f771ff84: 00000000 00000000 00000000 00000000 ................ 000000004b4c579d: 00000020 00000021 00000000 00000000 ...!........... 00000000ea27a427: 00000000 00000000 8e318428 ffff9f23 ........(.1.#... 00000000dc42589d: 8e318428 ffff9f23 ffffffe0 0000000f (.1.#........... 000000006104aba4: 8e318440 ffff9f23 8e318440 ffff9f23 @.1.#...@.1.#... 000000000f1c1a43: c13e3500 ffffffff 00000000 00000000 .5>............. 0000000026688276: 00000000 00000000 00000000 00000000 ................ 000000008ec1ddcb: 00000000 00000000 00000000 00000000 ................ 00000000487c4d3a: 000001f3 000001f3 00000000 00000000 ................ 000000008bb9edec: 00000000 00000000 00000000 00000000 ................ 000000004422f116: 00000000 00000000 00000000 00000000 ................ 00000000f0100613: 00000000 00000000 ........ CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50 RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0 R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50 R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 578 (00000000e337e33d): orphan list check failed! 00000000e337e33d: 0001f30a 00000004 00000000 00000000 ................ 000000000fa89e6b: 00000004 000372e7 00000000 00000000 .....r.......... 0000000011277dad: 00000000 00000000 00000000 00000000 ................ 000000001e3ac533: 00000000 00000000 00000000 00000241 ............A... 00000000bcebc335: 00000000 00000000 00000000 00000001 ................ 000000009beee06e: 8e319810 ffff9f23 8e319810 ffff9f23 ..1.#.....1.#... 000000004aa76898: 00000000 00000000 00084000 80000004 .........@...... 0000000014309ea0: 00000000 00000000 8e319838 ffff9f23 ........8.1.#... 000000003535017a: 8e319838 ffff9f23 00000000 00000000 8.1.#........... 00000000554c656f: 00000000 00000000 8e318098 ffff9f23 ..........1.#... 00000000f954f12e: 8e31ab58 ffff9f23 00002040 00000000 X.1.#...@ ...... 0000000032fd6d32: 00000000 00000000 8e319878 ffff9f23 ........x.1.#... 0000000015c3fe30: 8e319878 ffff9f23 00000000 00000000 x.1.#........... 000000005473c8bf: 00000000 00000000 00000000 00000000 ................ 000000004b0672e6: 8e3198a0 ffff9f23 8e3198a0 ffff9f23 ..1.#.....1.#... 00000000020b8208: 00000000 00000000 00000000 00000000 ................ 00000000df14a9ba: 000881a4 00000000 00000000 00000280 ................ 00000000b4a7095e: 00000000 00000000 00000000 00000000 ................ 000000000118104c: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#... 00000000afb20971: 8e319a38 ffff9f23 842a0680 ffff9f23 8.1.#.....*.#... 0000000094627f9f: 00000242 00000000 00000001 00000000 B............... 00000000ca214d7e: 00002040 00000000 69c61eb5 00000000 @ .........i.... 00000000742bf598: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000b19073d6: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000eee43435: 00000000 00000000 00000000 00000000 ................ 00000000a34aee59: 0000000c 00000000 00000020 00000000 ........ ....... 00000000c65a7f14: 00000060 00000000 00000000 00000000 `............... 000000006e80f61b: 8e319970 ffff9f23 8e319970 ffff9f23 p.1.#...p.1.#... 000000001e610abe: 00000000 00000000 00000000 00000000 ................ 000000009366ddb7: 001c0e16 00000001 00000000 00000000 ................ 00000000cc446301: 00000000 00000000 00000000 00000000 ................ 000000003c7d0a76: 8e3199b0 ffff9f23 8e3199b0 ffff9f23 ..1.#.....1.#... 0000000043319c32: 00000000 00000000 00000000 00000000 ................ 00000000d05023a6: 8e3199d0 ffff9f23 8e3199d0 ffff9f23 ..1.#.....1.#... 00000000e648dc90: 8e3199e0 ffff9f23 8e3199e0 ffff9f23 ..1.#.....1.#... 00000000c360b9d8: 8e3199f0 ffff9f23 8e3199f0 ffff9f23 ..1.#.....1.#... 00000000493c8262: 00000000 00000000 00000000 00000000 ................ 00000000f19d902d: 00000002 00000000 00000000 00000000 ................ 00000000f8f3de8b: 00000000 00000000 c13f6580 ffffffff .........e?..... 00000000151fefd9: 00000000 00000000 8e3198c0 ffff9f23 ..........1.#... 00000000e12e1cbf: 00000000 00000021 00000000 00000000 ....!........... 000000001745849c: 00000000 00000000 00000000 00000000 ................ 000000009c1e7834: 00000000 00000000 00000000 00000000 ................ 000000005223f125: 00000000 00000000 8e319a78 ffff9f23 ........x.1.#... 00000000461d30cf: 8e319a78 ffff9f23 00000000 00000000 x.1.#........... 0000000021c0e110: 00000000 00000000 00000000 00000000 ................ 000000007d4d7dcb: 00000000 00000000 00000000 00000000 ................ 00000000ee6f93b7: c13f38e0 ffffffff 00000010 00000000 .8?............. 000000008633e84a: 00000000 006200ca 8e319ac8 ffff9f23 ......b...1.#... 00000000b66109e6: 8e319ac8 ffff9f23 00000000 00000000 ..1.#........... 000000003b555195: 00000000 00000000 00000000 00000000 ................ 00000000dc8285c2: 00000000 00000000 00000000 00000000 ................ 00000000f4833bc9: 00000000 00000000 8e319b08 ffff9f23 ..........1.#... 000000000591f7f3: 8e319b08 ffff9f23 00000000 00000000 ..1.#........... 00000000cb57dc04: 22f83855 00000000 00000000 00000000 U8."............ 00000000c54cec38: 00000000 00000000 00000000 00000000 ................ 0000000023878270: 00000000 00000000 00000000 00000000 ................ 000000005e5da414: 00000000 00000000 69c61eb5 00000000 ...........i.... 0000000040e9a641: 0f2bb4dd 00000000 00000000 00000000 ..+............. 00000000e353a342: 8e319b70 ffff9f23 8e319b70 ffff9f23 p.1.#...p.1.#... 0000000051b865ba: 00000000 00000000 00000000 00000000 ................ 00000000eab8ae50: 00000000 00000000 00000000 00000000 ................ 000000006c7937df: 8e319ba0 ffff9f23 8e319ba0 ffff9f23 ..1.#.....1.#... 0000000030942c07: 00000000 00000000 00000000 ffffffff ................ 00000000379a6f9d: 00000000 00000000 00000000 00000000 ................ 000000006db2c717: 00000020 00000000 00000000 00000000 ............... 000000003d3ff5a8: 00000000 00000000 8e319be8 ffff9f23 ..........1.#... 00000000191688e0: 8e319be8 ffff9f23 ffffffe0 0000000f ..1.#........... 00000000eea62bb2: 8e319c00 ffff9f23 8e319c00 ffff9f23 ..1.#.....1.#... 000000000adb78f5: c13e3500 ffffffff 00000000 00000000 .5>............. 00000000d18f31d1: 00000000 00000000 79a79f44 677ba145 ........D..yE.{g 00000000e3624213: 000341ed 00000000 00000000 00000000 .A.............. 00000000e75b571c: 000001f3 000001f3 00000000 00000000 ................ 00000000f4e71bc0: 00000000 00000000 00000000 00000000 ................ 0000000027b2660c: 00000000 00000000 c36bd680 00000000 ..........k..... 000000005c0fb7eb: 00035d84 00000000 .]...... CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50 RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0 R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50 R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 579 (00000000ab8a589c): orphan list check failed! 00000000ab8a589c: 0001f30a 00000004 00000000 00000000 ................ 0000000092ff1fd7: 00000004 000372eb 00000000 00000000 .....r.......... 000000002c689bee: 00000000 00000000 00000000 00000000 ................ 00000000d5d34080: 00000000 00000000 00000000 00000242 ............B... 00000000674579c9: 00000000 00000000 00000000 00000001 ................ 000000002d9dff5a: 8e31ab10 ffff9f23 8e31ab10 ffff9f23 ..1.#.....1.#... 0000000002428c67: 00000000 00000000 00084000 80000004 .........@...... 000000000faf5e56: 00000000 00000000 8e31ab38 ffff9f23 ........8.1.#... 00000000b91edb92: 8e31ab38 ffff9f23 00000000 00000000 8.1.#........... 00000000f21f5620: 00000000 00000000 8e319858 ffff9f23 ........X.1.#... 000000008dd7f552: 8e318558 ffff9f23 00002040 00000000 X.1.#...@ ...... 00000000908f1221: 00000000 00000000 8e31ab78 ffff9f23 ........x.1.#... 000000002f6a2fbe: 8e31ab78 ffff9f23 00000000 00000000 x.1.#........... 0000000029c85e8d: 00000000 00000000 00000000 00000000 ................ 000000004112749d: 8e31aba0 ffff9f23 8e31aba0 ffff9f23 ..1.#.....1.#... 0000000079303e93: 00000000 00000000 00000000 00000000 ................ 00000000d7aea715: 000881a4 00000000 00000000 00000280 ................ 000000000d79e1b3: 00000000 00000000 00000000 00000000 ................ 00000000828ec222: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#... 00000000a2f6d8a9: 8e31ad38 ffff9f23 c19ffe00 ffff9f23 8.1.#.......#... 00000000b8caf025: 00000243 00000000 00000001 00000000 C............... 000000006f35a18f: 00002040 00000000 69c61eb5 00000000 @ .........i.... 00000000e1b8d96d: 00000000 00000000 69c61eb5 00000000 ...........i.... 000000006069af8d: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000c94e641c: 00000000 00000000 00000000 00000000 ................ 00000000ef607272: 0000000c 00000000 00000020 00000000 ........ ....... 000000006b060f8b: 00000060 00000000 00000000 00000000 `............... 0000000098f71a03: 8e31ac70 ffff9f23 8e31ac70 ffff9f23 p.1.#...p.1.#... 0000000065b13196: 00000000 00000000 00000000 00000000 ................ 0000000090287aae: 001c0e17 00000001 00000000 00000000 ................ 000000001c8623c5: 00000000 00000000 00000000 00000000 ................ 0000000005d45f64: 8e31acb0 ffff9f23 8e31acb0 ffff9f23 ..1.#.....1.#... 00000000cff1922b: 00000000 00000000 00000000 00000000 ................ 00000000eb8f606f: 8e31acd0 ffff9f23 8e31acd0 ffff9f23 ..1.#.....1.#... 0000000014fbe2a1: 8e31ace0 ffff9f23 8e31ace0 ffff9f23 ..1.#.....1.#... 000000001e40ef0d: 8e31acf0 ffff9f23 8e31acf0 ffff9f23 ..1.#.....1.#... 00000000ba058d51: 00000000 00000000 00000000 00000000 ................ 00000000582093bb: 00000002 00000000 00000000 00000000 ................ 0000000004ed86ee: 00000000 00000000 c13f6580 ffffffff .........e?..... 000000000aa2b28d: 00000000 00000000 8e31abc0 ffff9f23 ..........1.#... 000000008c0af1a6: 00000000 00000021 00000000 00000000 ....!........... 0000000026a5eab3: 00000000 00000000 00000000 00000000 ................ 00000000010ee638: 00000000 00000000 00000000 00000000 ................ 00000000bd65e2f6: 00000000 00000000 8e31ad78 ffff9f23 ........x.1.#... 000000006e78dbc4: 8e31ad78 ffff9f23 00000000 00000000 x.1.#........... 0000000059bb23b0: 00000000 00000000 00000000 00000000 ................ 0000000044cbb394: 00000000 00000000 00000000 00000000 ................ 0000000045c86e8a: c13f38e0 ffffffff 00000010 00000000 .8?............. 000000002c1f5135: 00000000 006200ca 8e31adc8 ffff9f23 ......b...1.#... 00000000f0ba3311: 8e31adc8 ffff9f23 00000000 00000000 ..1.#........... 00000000693780c7: 00000000 00000000 00000000 00000000 ................ 00000000e2635c98: 00000000 00000000 00000000 00000000 ................ 000000005595a11a: 00000000 00000000 8e31ae08 ffff9f23 ..........1.#... 000000007a09e2fd: 8e31ae08 ffff9f23 00000000 00000000 ..1.#........... 00000000f21576f9: b0e3fee9 00000000 00000000 00000000 ................ 00000000633f7d71: 00000000 00000000 00000000 00000000 ................ 0000000078a7ee40: 00000000 00000000 00000000 00000000 ................ 000000004b880dae: 00000000 00000021 69c61eb5 00000000 ....!......i.... 00000000c6e61f17: 0f3af71b 00000000 00000000 00000000 ..:............. 00000000d667b7a7: 8e31ae70 ffff9f23 8e31ae70 ffff9f23 p.1.#...p.1.#... 0000000045adb43a: 00000000 00000000 00000000 00000000 ................ 00000000830c9478: 00000000 00000000 00000000 00000000 ................ 000000002342d64d: 8e31aea0 ffff9f23 8e31aea0 ffff9f23 ..1.#.....1.#... 00000000bc7b1cb1: 00000000 00000000 00000000 ffffffff ................ 000000004483def6: 00000000 ffffffff 00000000 00000000 ................ 00000000a685920d: 00000020 006200ca 00000000 00000000 .....b......... 000000001474a66d: 00000000 ffff9f23 8e31aee8 ffff9f23 ....#.....1.#... 000000005e46dc43: 8e31aee8 ffff9f23 ffffffe0 0000000f ..1.#........... 000000009af1c00b: 8e31af00 ffff9f23 8e31af00 ffff9f23 ..1.#.....1.#... 000000003bb2559c: c13e3500 ffffffff 8e31af18 ffff9f23 .5>.......1.#... 00000000e44d1887: 8e31af18 ffff9f23 00000016 00000000 ..1.#........... 00000000fc026b37: 00000000 00000000 00000000 00000000 ................ 00000000a1081f6c: 000001f3 000001f3 00000000 00000000 ................ 00000000787518e5: 00000000 00000000 00000000 00000000 ................ 00000000355290dd: 00000000 00000000 00000000 00000000 ................ 0000000098709955: ffffffff ffffffff ........ CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50 RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0 R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50 R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 580 (00000000217a4e26): orphan list check failed! 00000000217a4e26: 0001f30a 00000004 00000000 00000000 ................ 00000000bd1488cb: 00000004 000372ef 00000000 00000000 .....r.......... 0000000018cbd825: 00000000 00000000 00000000 00000000 ................ 000000001fe1c11d: 00000000 00000000 00000000 00000243 ............C... 00000000338545b4: 00000000 00000000 00000000 00000001 ................ 00000000a0c7e545: 8e318510 ffff9f23 8e318510 ffff9f23 ..1.#.....1.#... 00000000ce1b7309: 00000000 00000000 00084000 80000004 .........@...... 000000003d21ab75: 00000000 00000000 8e318538 ffff9f23 ........8.1.#... 00000000d7be9aac: 8e318538 ffff9f23 00000000 00000000 8.1.#........... 000000004177e000: 00000000 00000000 8e31ab58 ffff9f23 ........X.1.#... 00000000097fd495: aaa021d8 ffff9f23 00002040 00000000 .!..#...@ ...... 0000000060d389fb: 00000000 00000000 8e318578 ffff9f23 ........x.1.#... 000000001a10fd8a: 8e318578 ffff9f23 00000000 00000000 x.1.#........... 00000000714d5e1a: 00000000 00000000 00000000 00000000 ................ 00000000876c96f8: 8e3185a0 ffff9f23 8e3185a0 ffff9f23 ..1.#.....1.#... 0000000049444e62: 00000000 00000000 00000000 00000000 ................ 00000000bc6f781b: 000881a4 00000000 00000000 00000280 ................ 00000000c0238a39: 00000000 00000000 00000000 00000000 ................ 00000000b1f4cb3e: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#... 0000000065cd93e0: 8e318738 ffff9f23 c19ffdc0 ffff9f23 8.1.#.......#... 00000000929f12c5: 00000244 00000000 00000001 00000000 D............... 00000000d93f0ae6: 00002040 00000000 69c61eb5 00000000 @ .........i.... 00000000c34c583e: 00000000 00000000 69c61eb5 00000000 ...........i.... 000000003dcc9a2b: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000790e7379: 00000000 00000000 00000000 00000000 ................ 0000000060fd5fe6: 0000000c 00000000 00000020 00000000 ........ ....... 00000000c54ce7cf: 00000060 00000000 00000000 00000000 `............... 000000003a2a8c3e: 8e318670 ffff9f23 8e318670 ffff9f23 p.1.#...p.1.#... 00000000f57fc1c0: 00000000 00000000 00000000 00000000 ................ 00000000fdae1cd4: 001c0e18 00000001 00000000 00000000 ................ 000000001c628aaf: 00000000 00000000 00000000 00000000 ................ 00000000e2c28c09: 8e3186b0 ffff9f23 8e3186b0 ffff9f23 ..1.#.....1.#... 00000000cadb14a7: 00000000 00000000 00000000 00000000 ................ 00000000688beba9: 8e3186d0 ffff9f23 8e3186d0 ffff9f23 ..1.#.....1.#... 00000000521a4760: 8e3186e0 ffff9f23 8e3186e0 ffff9f23 ..1.#.....1.#... 0000000078da5cc4: 8e3186f0 ffff9f23 8e3186f0 ffff9f23 ..1.#.....1.#... 0000000024f01d54: 00000000 00000000 00000000 00000000 ................ 0000000014d13f4a: 00000002 00000000 00000000 00000000 ................ 00000000ae8bec3f: 00000000 00000000 c13f6580 ffffffff .........e?..... 000000004966730a: 00000000 00000000 8e3185c0 ffff9f23 ..........1.#... 0000000023462c42: 00000000 00000021 00000000 00000000 ....!........... 000000008693f1dc: 00000000 00000000 00000000 00000000 ................ 00000000181927f1: 00000000 00000000 00000000 00000000 ................ 000000005ddb8bb6: 00000000 00000000 8e318778 ffff9f23 ........x.1.#... 00000000a965d55f: 8e318778 ffff9f23 00000000 00000000 x.1.#........... 000000000a565ee1: 00000000 00000000 00000000 00000000 ................ 0000000039da274f: 00000000 00000000 00000000 00000000 ................ 000000001641b2ef: c13f38e0 ffffffff 00000010 00000000 .8?............. 00000000e4bd8e7a: 00000000 006200ca 8e3187c8 ffff9f23 ......b...1.#... 00000000576cbb45: 8e3187c8 ffff9f23 00000000 00000000 ..1.#........... 00000000b0640347: 00000000 00000000 00000000 00000000 ................ 000000003b6675b0: 00000000 00000000 00000000 00000000 ................ 00000000ed9f809f: 00000000 00000000 8e318808 ffff9f23 ..........1.#... 00000000c723561a: 8e318808 ffff9f23 00000000 00000000 ..1.#........... 00000000d4fc5050: 05a14c89 00000000 00000000 00000000 .L.............. 000000002da14703: 00000000 00000000 00000000 00000000 ................ 00000000b5a02cb3: 00000000 00000000 00000000 00000000 ................ 000000009538b653: 00000000 00000000 69c61eb5 00000000 ...........i.... 0000000049ca4ff4: 0f4a3959 00000000 00000000 ffff9f23 Y9J.........#... 00000000da7a2158: 8e318870 ffff9f23 8e318870 ffff9f23 p.1.#...p.1.#... 00000000e1253d0d: 00000000 00000000 00000000 00000000 ................ 00000000078bea02: 00000000 00000000 00000000 00000000 ................ 00000000dea4d71c: 8e3188a0 ffff9f23 8e3188a0 ffff9f23 ..1.#.....1.#... 00000000e0d3d8ee: 00000000 00000000 00000000 ffffffff ................ 000000001173dcba: 00000000 ffff9f23 00000000 00000000 ....#........... 00000000d597e56c: 00000020 ffff9f23 00000000 00000000 ...#........... 00000000ee24a50a: 00000000 ffff9f23 8e3188e8 ffff9f23 ....#.....1.#... 00000000af0a5ee2: 8e3188e8 ffff9f23 ffffffe0 0000000f ..1.#........... 000000004f83ad0d: 8e318900 ffff9f23 8e318900 ffff9f23 ..1.#.....1.#... 000000001f8a5b0b: c13e3500 ffffffff b2643f80 ffffffff .5>......?d..... 00000000f931d78d: 00000000 00000000 8e3187b0 ffff9f23 ..........1.#... 00000000d8f85a63: 00000000 00000021 00000000 00000000 ....!........... 00000000d4302368: 000001f3 000001f3 00000000 00000000 ................ 000000000c94719e: 00000000 00000000 00000000 00000000 ................ 0000000055390206: 00000000 00000000 8e318968 00000000 ........h.1..... 00000000d1e1fd58: 8e318968 ffff9f23 h.1.#... CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50 RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0 R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50 R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 581 (000000008cec671e): orphan list check failed! 000000008cec671e: 0001f30a 00000004 00000000 00000000 ................ 00000000eb91c735: 00000004 000372f3 00000000 00000000 .....r.......... 000000000326dcc1: 00000000 00000000 00000000 00000000 ................ 00000000a57b689c: 00000000 00000000 00000000 00000244 ............D... 0000000051fa1068: 00000000 00000000 00000000 00000001 ................ 00000000d1f3dc64: aaa02190 ffff9f23 aaa02190 ffff9f23 .!..#....!..#... 000000002022c31e: 00000000 00000000 00084000 80000004 .........@...... 000000004979b567: 00000000 00000000 aaa021b8 ffff9f23 .........!..#... 00000000a14125b9: aaa021b8 ffff9f23 00000000 00000000 .!..#........... 0000000027604617: 00000000 00000000 8e318558 ffff9f23 ........X.1.#... 000000008819771e: aaa00098 ffff9f23 00002040 00000000 ....#...@ ...... 000000004e006814: 00000000 00000000 aaa021f8 ffff9f23 .........!..#... 00000000b75c932a: aaa021f8 ffff9f23 00000000 00000000 .!..#........... 00000000b9cfdd94: 00000000 00000000 00000000 00000000 ................ 00000000ad42a51f: aaa02220 ffff9f23 aaa02220 ffff9f23 "..#... "..#... 0000000035b432e1: 00000000 00000000 00000000 00000000 ................ 000000001f4f448f: 000881a4 00000000 00000000 00000280 ................ 00000000d2fcf52a: 00000000 00000000 00000000 00000000 ................ 000000009f224ecc: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#... 00000000a941f293: aaa023b8 ffff9f23 acac4a00 ffff9f23 .#..#....J..#... 000000001d5dfdaa: 00000245 00000000 00000001 00000000 E............... 000000003c1ed741: 00002040 00000000 69c61eb5 00000000 @ .........i.... 000000007a7208f3: 00000000 00000000 69c61eb5 00000000 ...........i.... 000000001a149a4a: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000b1b4405e: 00000000 00000000 00000000 00000000 ................ 000000003ffc24f8: 0000000c 00000000 00000020 00000000 ........ ....... 00000000f3e4b3a3: 00000060 00000000 00000000 00000000 `............... 00000000db6d7c88: aaa022f0 ffff9f23 aaa022f0 ffff9f23 ."..#...."..#... 00000000b7e57fcc: 00000000 00000000 00000000 00000000 ................ 000000001b9a0e81: 001c0e19 00000001 00000000 00000000 ................ 000000004b8a3188: 00000000 00000000 00000000 00000000 ................ 00000000bd82d0f2: aaa02330 ffff9f23 aaa02330 ffff9f23 0#..#...0#..#... 00000000433a6009: 00000000 00000000 00000000 00000000 ................ 00000000dfe8ec53: aaa02350 ffff9f23 aaa02350 ffff9f23 P#..#...P#..#... 0000000023d1eb9d: aaa02360 ffff9f23 aaa02360 ffff9f23 `#..#...`#..#... 00000000a03ff449: aaa02370 ffff9f23 aaa02370 ffff9f23 p#..#...p#..#... 0000000068bfa02f: 00000000 00000000 00000000 00000000 ................ 00000000f4ac4226: 00000002 00000000 00000000 00000000 ................ 0000000067fb73e0: 00000000 00000000 c13f6580 ffffffff .........e?..... 00000000087bdf52: 00000000 00000000 aaa02240 ffff9f23 ........@"..#... 00000000f12266ce: 00000000 00000021 00000000 00000000 ....!........... 000000005baad211: 00000000 00000000 00000000 00000000 ................ 0000000090accb2c: 00000000 00000000 00000000 00000000 ................ 0000000029f62d1b: 00000000 00000000 aaa023f8 ffff9f23 .........#..#... 000000007149c9f3: aaa023f8 ffff9f23 00000000 00000000 .#..#........... 00000000f6fea3b1: 00000000 00000000 00000000 00000000 ................ 0000000017bf026f: 00000000 00000000 00000000 00000000 ................ 000000002a73ad0e: c13f38e0 ffffffff 00000010 00000000 .8?............. 00000000e012e664: 00000000 006200ca aaa02448 ffff9f23 ......b.H$..#... 00000000aacc62f9: aaa02448 ffff9f23 00000000 00000000 H$..#........... 000000003855efb5: 00000000 00000000 00000000 00000000 ................ 000000003136cb98: 00000000 00000000 00000000 00000000 ................ 000000008c7cd315: 00000000 00000000 aaa02488 ffff9f23 .........$..#... 0000000094bd36c2: aaa02488 ffff9f23 00000000 00000000 .$..#........... 000000006df29bfa: 42cd0d03 00000000 00000000 00000000 ...B............ 0000000071d1b19f: 00000000 00000000 00000000 00000000 ................ 00000000031597b8: 00000000 00000000 00000000 00000000 ................ 0000000039fd8d37: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000a885c337: 0f4a3959 00000000 00000000 00000000 Y9J............. 000000001ddb1f98: aaa024f0 ffff9f23 aaa024f0 ffff9f23 .$..#....$..#... 00000000cd2bb587: 00000000 00000000 00000000 00000000 ................ 00000000ab5c7f02: 00000000 00000000 00000000 00000000 ................ 00000000f0da9999: aaa02520 ffff9f23 aaa02520 ffff9f23 %..#... %..#... 000000007e2e50fe: 00000000 00000000 00000000 ffffffff ................ 0000000067bd3a39: 00000000 00000000 00000000 00000000 ................ 0000000026b5f851: 00000020 00000000 00000000 00000000 ............... 0000000019473dc3: 00000000 00000000 aaa02568 ffff9f23 ........h%..#... 00000000a77aa6c9: aaa02568 ffff9f23 ffffffe0 0000000f h%..#........... 00000000c53c3354: aaa02580 ffff9f23 aaa02580 ffff9f23 .%..#....%..#... 0000000017ffbbd4: c13e3500 ffffffff 00000000 00000000 .5>............. 0000000051fe4d49: 00000000 00000000 00000000 00000000 ................ 00000000f689f33c: 00000000 00000000 00000000 00000000 ................ 00000000500a9ef5: 000001f3 000001f3 00000000 00000000 ................ 0000000066a503ce: 00000000 00000000 00000000 00000000 ................ 0000000097a97bf7: 00000000 00000000 00000000 00000000 ................ 0000000088738acf: 00000000 00000000 ........ CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50 RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0 R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50 R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 582 (0000000014a0b445): orphan list check failed! 0000000014a0b445: 0001f30a 00000004 00000000 00000000 ................ 0000000010ff2792: 00000004 000372f7 00000000 00000000 .....r.......... 0000000020fecbbc: 00000000 00000000 00000000 00000000 ................ 00000000f46a931b: 00000000 00000000 00000000 00000245 ............E... 00000000a6827806: 00000000 00000000 00000000 00000001 ................ 00000000b57adab5: aaa00050 ffff9f23 aaa00050 ffff9f23 P...#...P...#... 0000000076aec6ce: 00000000 00000000 00084000 80000004 .........@...... 00000000b5eca134: 00000000 00000000 aaa00078 ffff9f23 ........x...#... 0000000026fddaf4: aaa00078 ffff9f23 00000000 00000000 x...#........... 0000000004d64024: 00000000 00000000 aaa021d8 ffff9f23 .........!..#... 0000000000fc774b: aaa01858 ffff9f23 00002040 00000000 X...#...@ ...... 000000003bea0e5f: 00000000 00000000 aaa000b8 ffff9f23 ............#... 0000000057a2cb71: aaa000b8 ffff9f23 00000000 00000000 ....#........... 00000000f52c73e1: 00000000 00000000 00000000 00000000 ................ 0000000032513e23: aaa000e0 ffff9f23 aaa000e0 ffff9f23 ....#.......#... 00000000f5661ee7: 00000000 00000000 00000000 00000000 ................ 00000000dc887a10: 000881a4 00000000 00000000 00000280 ................ 00000000d09253f0: 00000000 00000000 00000000 00000000 ................ 000000002a501e37: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#... 00000000ce8a018c: aaa00278 ffff9f23 acac4040 ffff9f23 x...#...@@..#... 0000000061486f13: 00000246 00000000 00000001 00000000 F............... 00000000cf861bc8: 00002040 00000000 69c61eb5 00000000 @ .........i.... 00000000b83a166b: 00000000 00000000 69c61eb5 00000000 ...........i.... 000000001f9e3767: 00000000 00000000 69c61eb5 00000000 ...........i.... 0000000030a39253: 00000000 00000000 00000000 00000000 ................ 00000000b9aa1e2d: 0000000c 00000000 00000020 00000000 ........ ....... 00000000f71163f8: 00000060 00000000 00000000 00000000 `............... 000000005c4c4fbe: aaa001b0 ffff9f23 aaa001b0 ffff9f23 ....#.......#... 0000000059c919a4: 00000000 00000000 00000000 00000000 ................ 000000005bb2d886: 001c0e19 00000001 00000000 00000000 ................ 000000005a348a28: 00000000 00000000 00000000 00000000 ................ 000000001a5094ad: aaa001f0 ffff9f23 aaa001f0 ffff9f23 ....#.......#... 0000000076d2cb0d: 00000000 00000000 00000000 00000000 ................ 00000000037031e0: aaa00210 ffff9f23 aaa00210 ffff9f23 ....#.......#... 0000000080f86fc8: aaa00220 ffff9f23 aaa00220 ffff9f23 ...#... ...#... 000000002015b43b: aaa00230 ffff9f23 aaa00230 ffff9f23 0...#...0...#... 00000000870ffe81: 00000000 00000000 00000000 00000000 ................ 000000008ebb8aa8: 00000002 00000000 00000000 00000000 ................ 000000004b9f62cb: 00000000 00000000 c13f6580 ffffffff .........e?..... 0000000028cdca53: 00000000 00000000 aaa00100 ffff9f23 ............#... 000000005d6f9ffa: 00000000 00000021 00000000 00000000 ....!........... 000000008702b312: 00000000 00000000 00000000 00000000 ................ 000000000e5f7142: 00000000 00000000 00000000 00000000 ................ 000000003ef70177: 00000000 00000000 aaa002b8 ffff9f23 ............#... 00000000b1b8033a: aaa002b8 ffff9f23 00000000 00000000 ....#........... 000000009ea110bf: 00000000 00000000 00000000 00000000 ................ 00000000fe1e30ca: 00000000 00000000 00000000 00000000 ................ 0000000013fd9869: c13f38e0 ffffffff 00000010 00000000 .8?............. 00000000658fce65: 00000000 006200ca aaa00308 ffff9f23 ......b.....#... 0000000048e54abc: aaa00308 ffff9f23 00000000 00000000 ....#........... 00000000b2f9c0d4: 00000000 00000000 00000000 00000000 ................ 00000000e8bfd996: 00000000 00000000 00000000 00000000 ................ 0000000021dc3216: 00000000 00000000 aaa00348 ffff9f23 ........H...#... 00000000d5229e16: aaa00348 ffff9f23 00000000 00000000 H...#........... 000000002f7f911f: 0abf6fe4 00000000 00000000 00000000 .o.............. 0000000080147e8c: 00000000 00000000 00000000 00000000 ................ 000000006d0ab491: 00000000 00000000 00000000 00000000 ................ 000000005bc143bf: 00000000 00000000 69c61eb5 00000000 ...........i.... 0000000095474b7c: 0f597b97 00000000 00000000 00000000 .{Y............. 00000000d2383301: aaa003b0 ffff9f23 aaa003b0 ffff9f23 ....#.......#... 00000000574cb289: 00000000 00000000 00000000 00000000 ................ 0000000035cc713c: 00000000 00000000 00000000 00000000 ................ 000000009aeab6e7: aaa003e0 ffff9f23 aaa003e0 ffff9f23 ....#.......#... 000000005dbe9d3b: 00000000 00000000 00000000 ffffffff ................ 00000000b8428503: 00000000 00000000 00000000 00000000 ................ 00000000eb49e45e: 00000020 00000000 00000000 00000000 ............... 000000000d6a1bc8: 00000000 00000000 aaa00428 ffff9f23 ........(...#... 0000000096e064ed: aaa00428 ffff9f23 ffffffe0 0000000f (...#........... 00000000e606eeb8: aaa00440 ffff9f23 aaa00440 ffff9f23 @...#...@...#... 0000000041c52175: c13e3500 ffffffff 00000000 00000000 .5>............. 00000000cb8d3d6b: 00000000 00000000 00000000 00000000 ................ 0000000011263628: 00000000 00000000 00000000 00000000 ................ 00000000a7191376: 000001f3 000001f3 00000000 00000000 ................ 00000000c7e12bbc: 00000000 00000000 00000000 00000000 ................ 00000000f72ccfd6: 00000000 00000000 00000000 00000000 ................ 0000000008957615: 00000000 00000000 ........ CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50 RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0 R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50 R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 583 (00000000fb272647): orphan list check failed! 00000000fb272647: 0001f30a 00000004 00000000 00000000 ................ 00000000f4a3074f: 00000004 000372fb 00000000 00000000 .....r.......... 0000000065df4a83: 00000000 00000000 00000000 00000000 ................ 00000000356d59c0: 00000000 00000000 00000000 00000246 ............F... 000000009c4f19eb: 00000000 00000000 00000000 00000001 ................ 00000000acae51da: aaa01810 ffff9f23 aaa01810 ffff9f23 ....#.......#... 00000000c4cb36ed: 00000000 00000000 00084000 80000004 .........@...... 000000006522e32b: 00000000 00000000 aaa01838 ffff9f23 ........8...#... 00000000ef047001: aaa01838 ffff9f23 00000000 00000000 8...#........... 00000000881dc175: 00000000 00000000 aaa00098 ffff9f23 ............#... 00000000b02a1afb: a9c89720 ffff9f23 00002040 00000000 ...#...@ ...... 00000000b97aef20: 00000000 00000000 aaa01878 ffff9f23 ........x...#... 000000009be306c4: aaa01878 ffff9f23 00000000 00000000 x...#........... 0000000022237fae: 00000000 00000000 00000000 00000000 ................ 000000009cc24c1c: aaa018a0 ffff9f23 aaa018a0 ffff9f23 ....#.......#... 0000000000486ff0: 00000000 00000000 00000000 00000000 ................ 0000000086f83954: 000881a4 00000000 00000000 00000280 ................ 00000000de9a757c: 00000000 00000000 00000000 00000000 ................ 00000000e518c32b: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#... 00000000b2ee1f09: aaa01a38 ffff9f23 acac4b80 ffff9f23 8...#....K..#... 00000000e3aba90c: 00000247 00000000 00000001 00000000 G............... 0000000042722cf1: 00002040 00000000 69c61eb5 00000000 @ .........i.... 000000000edb915b: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000a7e23d90: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000eaf42791: 00000000 00000000 00000000 00000000 ................ 00000000c2f5f9b2: 0000000c 00000000 00000020 00000000 ........ ....... 000000009deff075: 00000060 00000000 00000000 00000000 `............... 000000004f022a38: aaa01970 ffff9f23 aaa01970 ffff9f23 p...#...p...#... 0000000043979918: 00000000 00000000 00000000 00000000 ................ 00000000b596200d: 001c0e1a 00000001 00000000 00000000 ................ 0000000063c5e482: 00000000 00000000 00000000 00000000 ................ 0000000086d33556: aaa019b0 ffff9f23 aaa019b0 ffff9f23 ....#.......#... 00000000293bcac5: 00000000 00000000 00000000 00000000 ................ 00000000c9ab4d03: aaa019d0 ffff9f23 aaa019d0 ffff9f23 ....#.......#... 00000000d79e858d: aaa019e0 ffff9f23 aaa019e0 ffff9f23 ....#.......#... 000000006caced5d: aaa019f0 ffff9f23 aaa019f0 ffff9f23 ....#.......#... 00000000e1f37e77: 00000000 00000000 00000000 00000000 ................ 00000000d24a5749: 00000002 00000000 00000000 00000000 ................ 0000000086625dbf: 00000000 00000000 c13f6580 ffffffff .........e?..... 00000000dc8ef1f5: 00000000 00000000 aaa018c0 ffff9f23 ............#... 0000000039b89540: 00000000 00000021 00000000 00000000 ....!........... 00000000bcf2316e: 00000000 00000000 00000000 00000000 ................ 0000000079adb885: 00000000 00000000 00000000 00000000 ................ 000000002d396424: 00000000 00000000 aaa01a78 ffff9f23 ........x...#... 00000000bc2df6ed: aaa01a78 ffff9f23 00000000 00000000 x...#........... 000000009f7e0381: 00000000 00000000 00000000 00000000 ................ 0000000066f654b9: 00000000 00000000 00000000 00000000 ................ 000000009ff95e1a: c13f38e0 ffffffff 00000010 00000000 .8?............. 0000000066000ac9: 00000000 006200ca aaa01ac8 ffff9f23 ......b.....#... 000000006ba89fc8: aaa01ac8 ffff9f23 00000000 00000000 ....#........... 00000000bbc640a7: 00000000 00000000 00000000 00000000 ................ 00000000faacc68d: 00000000 00000000 00000000 00000000 ................ 00000000a4db23fa: 00000000 00000000 aaa01b08 ffff9f23 ............#... 00000000e6695146: aaa01b08 ffff9f23 00000000 00000000 ....#........... 00000000924c0588: bc5b45f5 00000000 00000000 00000000 .E[............. 0000000029804b8e: 00000000 00000000 00000000 00000000 ................ 000000001742a195: 00000000 00000000 00000000 00000000 ................ 0000000044b9eb0c: 00000000 00000000 69c61eb5 00000000 ...........i.... 00000000771cec61: 0f68bdd5 00000000 00000000 00000000 ..h............. 00000000e7669adc: aaa01b70 ffff9f23 aaa01b70 ffff9f23 p...#...p...#... 0000000059a70bcc: 00000000 00000000 00000000 00000000 ................ 00000000eca821a8: 00000000 00000000 00000000 00000000 ................ 0000000002b6ecd7: aaa01ba0 ffff9f23 aaa01ba0 ffff9f23 ....#.......#... 000000004e5384ed: 00000000 00000000 00000000 ffffffff ................ 0000000097829798: 00000000 00000000 00000000 00000000 ................ 000000008ce3b5cd: 00000020 00000000 00000000 00000000 ............... 00000000d0949a8f: 00000000 00000000 aaa01be8 ffff9f23 ............#... 0000000046114f92: aaa01be8 ffff9f23 ffffffe0 0000000f ....#........... 00000000bab87155: aaa01c00 ffff9f23 aaa01c00 ffff9f23 ....#.......#... 00000000cc2b215f: c13e3500 ffffffff 00000000 00000000 .5>............. 00000000e2a834bd: 00000000 00000000 00000000 00000000 ................ 00000000a1501f93: 00000000 00000000 00000000 00000000 ................ 000000004d914805: 000001f3 000001f3 00000000 00000000 ................ 00000000954f0248: 00000000 00000000 00000000 00000000 ................ 00000000504157f0: 00000000 00000000 00000000 00000000 ................ 0000000003c33a6b: 00000000 00000000 ........ CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f16849ee8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50 RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0 R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50 R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff LDISKFS-fs (dm-3): sb orphan head is 583 sb_info orphan list: inode dm-3:583 at 0000000086f83954: mode 100644, nlink 1, next 582 inode dm-3:582 at 00000000dc887a10: mode 100644, nlink 1, next 581 inode dm-3:581 at 000000001f4f448f: mode 100644, nlink 1, next 580 inode dm-3:580 at 00000000bc6f781b: mode 100644, nlink 1, next 579 inode dm-3:579 at 00000000d7aea715: mode 100644, nlink 1, next 578 inode dm-3:578 at 00000000df14a9ba: mode 100644, nlink 1, next 577 inode dm-3:577 at 000000000c18ec88: mode 100644, nlink 1, next 576 inode dm-3:576 at 000000009cc4214f: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 344769 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff729230c741b9f8 EFLAGS: 00010293 RAX: ff30faca6f025858 RBX: ff30faca6b24d720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff30facabbb1e698 RDI: ff30facabbb1e698 RBP: ff30faca6b24d000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff729230c741b810 R12: ff30faca6b24d720 R13: ff30faca6b319000 R14: ffffffffc13b08b0 R15: ff30faca450a38e0 FS: 00007fece1210080(0000) GS:ff30facabbb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00005615b34a7708 CR3: 00000001030f2004 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fece01698fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2785 sb_info orphan list: inode dm-2:2785 at 0000000091df60a2: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP PTI CPU: 1 PID: 333458 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ffffb28d840939f8 EFLAGS: 00010212 RAX: ffff8ce68dd78558 RBX: ffff8ce6b0375720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ffff8ce6bbd1e698 RDI: ffff8ce6bbd1e698 RBP: ffff8ce6b0375000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ffffb28d84093810 R12: ffff8ce6b0375720 R13: ffff8ce6a80e6000 R14: ffffffffc158b8b0 R15: ffff8ce68612df40 FS: 00007f14e9fa0080(0000) GS:ffff8ce6bbd00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000055eef1a931a0 CR3: 00000001301f6003 CR4: 0000000000370ee0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? class_manual_cleanup+0x1c8/0x780 [obdclass] ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? __queue_work+0x145/0x3f0 osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f14e8ef98fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2814 sb_info orphan list: inode dm-2:2814 at 000000001cf8c507: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 359567 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff2bdeb8087ab9f8 EFLAGS: 00010212 RAX: ff27efd7ec63ab58 RBX: ff27efd7f49cf720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff27efd83bb1e698 RDI: ff27efd83bb1e698 RBP: ff27efd7f49cf000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff2bdeb8087ab810 R12: ff27efd7f49cf720 R13: ff27efd7d7189000 R14: ffffffffc15768b0 R15: ff27efd7f7a74fa0 FS: 00007f45c30e4080(0000) GS:ff27efd83bb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f28f4134000 CR3: 0000000136f7a001 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f45c203d8fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2799 sb_info orphan list: inode dm-2:2799 at 00000000c2c4db91: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 328405 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff45af0ec45b79f8 EFLAGS: 00010216 RAX: ff2915eb2fcae698 RBX: ff2915eb31552720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff2915eb7bb1e698 RDI: ff2915eb7bb1e698 RBP: ff2915eb31552000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff45af0ec45b7810 R12: ff2915eb31552720 R13: ff2915eb3171b800 R14: ffffffffc14248b0 R15: ff2915eb467b9280 FS: 00007f34ce3d1080(0000) GS:ff2915eb7bb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000055cbf747d1f8 CR3: 000000010216a006 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f34cd32a8fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2757 sb_info orphan list: inode dm-2:2757 at 0000000069f35175: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 321608 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff6b0acdc480f9f8 EFLAGS: 00010212 RAX: ff1e83e64321c558 RBX: ff1e83e6465f3720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff1e83e67bb1e698 RDI: ff1e83e67bb1e698 RBP: ff1e83e6465f3000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff6b0acdc480f810 R12: ff1e83e6465f3720 R13: ff1e83e631921800 R14: ffffffffc143d8b0 R15: ff1e83e664225be0 FS: 00007f7015be7080(0000) GS:ff1e83e67bb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000055d2822f4008 CR3: 0000000142f9c004 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f7014b408fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2919 sb_info orphan list: inode dm-2:2919 at 000000002d55c9fa: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 332906 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff79142a04b979f8 EFLAGS: 00010293 RAX: ff251cb23ae5ca18 RBX: ff251cb22b765720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff251cb27bb1e698 RDI: ff251cb27bb1e698 RBP: ff251cb22b765000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff79142a04b97810 R12: ff251cb22b765720 R13: ff251cb22b714000 R14: ffffffffc14008b0 R15: ff251cb25eadb3a0 FS: 00007f2a892c8080(0000) GS:ff251cb27bb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f1460a39000 CR3: 000000013344a003 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f2a882218fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2757 sb_info orphan list: inode dm-2:2757 at 00000000f42d5812: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 0 PID: 328291 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff6ddf06449639f8 EFLAGS: 00010297 RAX: ff43315ef993d398 RBX: ff43315ef1599720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff43315f3ba1e698 RDI: ff43315f3ba1e698 RBP: ff43315ef1599000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff6ddf0644963810 R12: ff43315ef1599720 R13: ff43315ecd86f000 R14: ffffffffc14328b0 R15: ff43315eec204760 FS: 00007fb87d2db080(0000) GS:ff43315f3ba00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000561fe2de0008 CR3: 000000016acc4004 CR4: 0000000000771ef0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fb87c2348fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2841 sb_info orphan list: inode dm-2:2841 at 0000000007f88e92: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 0 PID: 358390 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff70ccf9c7f239f8 EFLAGS: 00010216 RAX: ff22440a33154ed8 RBX: ff22440a33a79720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff22440a7ba1e698 RDI: ff22440a7ba1e698 RBP: ff22440a33a79000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff70ccf9c7f23810 R12: ff22440a33a79720 R13: ff22440a31d91800 R14: ffffffffc12b68b0 R15: ff22440a32dba3a0 FS: 00007f6e73af1080(0000) GS:ff22440a7ba00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f4f32b3b018 CR3: 000000013c7a0005 CR4: 0000000000771ef0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f6e72a4a8fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2855 sb_info orphan list: inode dm-2:2855 at 00000000f61c06bc: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 323374 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff6a2aa6445879f8 EFLAGS: 00010293 RAX: ff34a5d56b54dd18 RBX: ff34a5d569812720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff34a5d5bbb1e698 RDI: ff34a5d5bbb1e698 RBP: ff34a5d569812000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff6a2aa644587810 R12: ff34a5d569812720 R13: ff34a5d571f98000 R14: ffffffffc13768b0 R15: ff34a5d59353a160 FS: 00007ff1eb8a3080(0000) GS:ff34a5d5bbb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 000056401ea28500 CR3: 00000001031c8005 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7ff1ea7fc8fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LDISKFS-fs (dm-2): sb orphan head is 2879 sb_info orphan list: inode dm-2:2879 at 00000000c2918fbf: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 396331 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff7625d1079839f8 EFLAGS: 00010293 RAX: ff34828f877f2b58 RBX: ff34828f43691720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff34828fbbb1e698 RDI: ff34828fbbb1e698 RBP: ff34828f43691000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff7625d107983810 R12: ff34828f43691720 R13: ff34828f6e269000 R14: ffffffffc15b18b0 R15: ff34828f47d61ac0 FS: 00007f3e3172c080(0000) GS:ff34828fbbb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fc09d765018 CR3: 000000012f338005 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f3e306858fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1 Lustre: lustre-MDT0000: Not available for connect from 10.240.46.41@tcp (stopping) LustreError: lustre-MDT0000-osp-MDT0002: operation mds_statfs to node 0@lo failed: rc = -107 LustreError: Skipped 2 previous similar messages Lustre: lustre-MDT0000-osp-MDT0002: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: Skipped 11 previous similar messages Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping) Lustre: 370251:0:(gss_svc_upcall.c:720:gss_svc_searchbyctx()) ctx hdl 0x5acc1a9e822bd9df does not have mech ctx: rc = -2 Lustre: 369:0:(gss_svc_upcall.c:720:gss_svc_searchbyctx()) ctx hdl 0x5acc1a9e822bd9e0 does not have mech ctx: rc = -2 Lustre: 369:0:(gss_svc_upcall.c:720:gss_svc_searchbyctx()) Skipped 1 previous similar message Lustre: lustre-MDT0000: Not available for connect from 10.240.46.41@tcp (stopping) Lustre: Skipped 4 previous similar messages LDISKFS-fs (dm-3): sb orphan head is 3175 sb_info orphan list: inode dm-3:3175 at 00000000a9b1979b: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 133f: Check reads/writes of client lustre proc files with bad area io | kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 401206 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff7fd1ef055bf9f8 EFLAGS: 00010293 RAX: ff3bef774db83018 RBX: ff3bef7736f9e720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff3bef777bb1e698 RDI: ff3bef777bb1e698 RBP: ff3bef7736f9e000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff7fd1ef055bf810 R12: ff3bef7736f9e720 R13: ff3bef7702f92000 R14: ffffffffc162e8b0 R15: ff3bef7737c73a60 FS: 00007f963bf83080(0000) GS:ff3bef777bb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f714f62b000 CR3: 00000001230b6001 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0xdd/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x20b0 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x2a2/0x780 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __queue_work+0x145/0x3f0 ? srso_alias_return_thunk+0x5/0xfcdfd ? srso_alias_return_thunk+0x5/0xfcdfd osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f963aedc8fb | Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1 Lustre: lustre-MDT0000: Not available for connect from 10.240.40.59@tcp (stopping) Lustre: Skipped 3 previous similar messages Lustre: lustre-MDT0000: Not available for connect from 10.240.40.53@tcp (stopping) Lustre: Skipped 7 previous similar messages Lustre: lustre-MDT0000-osp-MDT0002: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete Lustre: Skipped 1 previous similar message Lustre: lustre-MDT0000: Not available for connect from 10.240.40.59@tcp (stopping) Lustre: Skipped 5 previous similar messages LDISKFS-fs (dm-3): sb orphan head is 3192 sb_info orphan list: inode dm-3:3192 at 000000005400dee8: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| mmp test complete, duration 1928 sec | kernel BUG at /tmp/rpmbuild-lustre-jenkins-DaCenL6v/BUILD/lustre-2.17.50_86_g9a78504/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff3805a943eefa78 EFLAGS: 00010293 RAX: ff18260ec0954a18 RBX: ff18260eaea50720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff18260efbb1e698 RDI: ff18260efbb1e698 RBP: ff18260eaea50000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff3805a943eef890 R12: ff18260eaea50720 R13: ff18260eaea18800 R14: ffffffffc148d8a8 R15: ff18260eb3b18ac0 FS: 00007fd522286080(0000) GS:ff18260efbb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fe4b65bd000 CR3: 000000012a6cc005 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb | Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds3' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds1_flakey Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1; mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc LDISKFS-fs error (device dm-3): mb_free_blocks:1962: group 10, block 228448:freeing already freed block (bit 19968); block bitmap corrupt. Aborting journal on device dm-3-8. LDISKFS-fs (dm-3): Remounting filesystem read-only LDISKFS-fs warning (device dm-3): ldiskfs_mb_generate_buddy:1239: group 10: block bitmap and bg descriptor inconsistent: 2951 vs 2953 free clusters 3943 in gd, 2 pa's LDISKFS-fs error (device dm-3) in osd_trans_stop:2343: IO failure LustreError: 188950:0:(osd_handler.c:2346:osd_trans_stop()) lustre-MDT0000: failed to stop transaction: rc = -5 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check LustreError: 189124:0:(obd_sysfs.c:242:health_check_show()) lustre-MDT0000-osd: device reported unhealthy Lustre: DEBUG MARKER: /usr/sbin/lctl mark mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: \'NOT HEALTHY\' Lustre: DEBUG MARKER: mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: 'NOT HEALTHY' Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-2/2026-02-04/lustre-reviews_review-dne-subtest-change_121260_106_4eb6d3c7-d190-4e71-ba77-89294fbbb658//mmp.test_10.debug_log.$(hostname -s).1770168927.log; Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1 LustreError: 189565:0:(osd_handler.c:2469:osd_drop_preallocated_space()) lustre-MDT0000: can't truncate: rc=-30 LDISKFS-fs (dm-3): Inode 637 (00000000fc4c053b): orphan list check failed! 00000000fc4c053b: 0001f30a 00000004 00000000 00000000 ................ 000000007b6d8950: 00000004 00037482 00000000 00000000 .....t.......... 000000000ddbbc46: 00000000 00000000 00000000 00000000 ................ 000000007466667c: 00000000 00000000 00000000 00000000 ................ 0000000045907093: 00000000 00000000 00000000 00000001 ................ 000000000bdab2c2: c0971810 ff18260e c0971810 ff18260e .....&.......&.. 0000000040d75bd2: 00000000 00000000 00084000 80000004 .........@...... 00000000ff7332c0: 00000000 00000000 c0971838 ff18260e ........8....&.. 00000000a95448f3: c0971838 ff18260e 00000000 00000000 8....&.......... 00000000cc657276: 00000000 00000000 aea50720 ff18260e ........ ....&.. 000000009af9be88: c0970098 ff18260e 00002040 00000000 .....&..@ ...... 0000000006cb2bef: 00000000 00000000 c0971878 ff18260e ........x....&.. 00000000ce6127b2: c0971878 ff18260e 00000000 00000000 x....&.......... 00000000f60452ac: 00000000 00000000 00000000 00000000 ................ 00000000c655cd93: c09718a0 ff18260e c09718a0 ff18260e .....&.......&.. 000000009d299cb6: 00000000 00000000 00000000 00000000 ................ 0000000065195cb5: 000881a4 00000000 00000000 00000280 ................ 000000005f4447f8: 00000000 00000000 00000000 00000000 ................ 00000000968fdd02: c1464a40 ffffffff aea18800 ff18260e @JF..........&.. 0000000023e5ed03: c0971a38 ff18260e 82eab9c0 ff18260e 8....&.......&.. 000000001da81248: 0000027d 00000000 00000001 00000000 }............... 00000000353c78d4: 00002040 00000000 6982a25e 00000000 @ ......^..i.... 000000002dd827ed: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000d9d693f1: 00000000 00000000 6982a25e 00000000 ........^..i.... 000000009abb7241: 00000000 00000000 00000000 00000000 ................ 00000000501bbee6: 0000000c 00000000 00000020 00000000 ........ ....... 0000000032bc9ae0: 00000060 00000000 00000000 00000000 `............... 00000000a9b63c44: c0971970 ff18260e c0971970 ff18260e p....&..p....&.. 000000000eb473b0: 00000000 00000000 00000000 00000000 ................ 000000000c901f7b: 001c6c98 00000001 00000000 00000000 .l.............. 00000000fdf55441: 00000000 00000000 00000000 00000000 ................ 000000004cc1bdf5: c09719b0 ff18260e c09719b0 ff18260e .....&.......&.. 0000000027be85c6: 00000000 00000000 00000000 00000000 ................ 00000000bf75071b: c09719d0 ff18260e c09719d0 ff18260e .....&.......&.. 000000007a8f87f0: c09719e0 ff18260e c09719e0 ff18260e .....&.......&.. 000000002f8428a9: c09719f0 ff18260e c09719f0 ff18260e .....&.......&.. 000000009df3d34a: 00000000 00000000 00000000 00000000 ................ 000000006c4b0f16: 00000002 00000000 00000000 00000000 ................ 00000000650b5f56: 00000000 00000000 c1464b40 ffffffff ........@KF..... 00000000afac147a: 00000000 00000000 c09718c0 ff18260e .............&.. 00000000744d6051: 00000000 00000021 00000000 00000000 ....!........... 00000000dec3191b: 00000000 00000000 00000000 00000000 ................ 00000000139a6355: 00000000 00000000 00000000 00000000 ................ 00000000123eb629: 00000000 00000000 c0971a78 ff18260e ........x....&.. 000000006a296bb0: c0971a78 ff18260e 00000000 00000000 x....&.......... 00000000676573c2: 00000000 00000000 00000000 00000000 ................ 00000000d90e4f03: 00000000 00000000 00000000 00000000 ................ 00000000c6795f3b: c1462a60 ffffffff 00000010 00000000 `*F............. 00000000b8910cc8: 00000000 006200ca c0971ac8 ff18260e ......b......&.. 00000000d15e6864: c0971ac8 ff18260e 00000000 00000000 .....&.......... 00000000b6cecd92: 00000000 00000000 00000000 00000000 ................ 00000000fb71b4d9: 00000000 00000000 00000000 00000000 ................ 00000000fe9f9bae: 00000000 00000000 c0971b08 ff18260e .............&.. 00000000cf4ed85b: c0971b08 ff18260e 00000000 00000000 .....&.......... 000000002e6f09ab: fb83fc10 00000000 00000000 00000000 ................ 000000002b206683: 00000000 00000000 00000000 00000000 ................ 000000003bd262a9: 00000000 00000000 00000000 00000000 ................ 00000000a8c5c340: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000b00136c0: 1cbe012c 00000000 00000000 00000000 ,............... 00000000a6e3c421: c0971b70 ff18260e c0971b70 ff18260e p....&..p....&.. 000000000fbc50ab: 00000000 00000000 00000000 00000000 ................ 0000000073f1df6a: 00000000 00000000 00000000 00000000 ................ 000000004c67adb8: c0971ba0 ff18260e c0971ba0 ff18260e .....&.......&.. 000000007e14cda0: 00000000 00000000 00000000 ffffffff ................ 000000005d569960: 00000000 00000000 00000000 00000000 ................ 000000007c2220e7: 00000020 00000000 00000000 00000000 ............... 0000000034c80f69: 00000000 00000000 c0971be8 ff18260e .............&.. 00000000a11386db: c0971be8 ff18260e ffffffe0 0000000f .....&.......... 00000000c590edff: c0971c00 ff18260e c0971c00 ff18260e .....&.......&.. 00000000ffc7a9bc: c14048e0 ffffffff 00000000 00000000 .H@............. 00000000c305e63e: 00000000 00000000 acf307db 1e2455b9 .............U$. 000000003e60a729: 00048124 00000000 00000000 00000000 $............... 00000000095a2b0e: 000001ea 000001ea 00000000 00000000 ................ 00000000a2f35a6b: 00000000 00000000 00000000 00000000 ................ 00000000212bd1e7: 00000000 00000000 aefe5f40 00000000 ........@_...... 00000000c5e67dd6: 0004cc2a 00000000 *....... CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0 RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010 R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0 R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 638 (00000000a1158d10): orphan list check failed! 00000000a1158d10: 0001f30a 00000004 00000000 00000000 ................ 00000000291d0913: 00000004 00037486 00000000 00000000 .....t.......... 000000007df47a38: 00000000 00000000 00000000 00000000 ................ 0000000090f3cd1d: 00000000 00000000 00000000 0000027d ............}... 00000000ca3bd06f: 00000000 00000000 00000000 00000001 ................ 0000000055768c81: c0970050 ff18260e c0970050 ff18260e P....&..P....&.. 00000000c765311b: 00000000 00000000 00084000 80000004 .........@...... 000000001c037017: 00000000 00000000 c0970078 ff18260e ........x....&.. 0000000091e56ab3: c0970078 ff18260e 00000000 00000000 x....&.......... 00000000f7ba57e2: 00000000 00000000 c0971858 ff18260e ........X....&.. 00000000459b0272: c0970558 ff18260e 00002040 00000000 X....&..@ ...... 000000001de7a67c: 00000000 00000000 c09700b8 ff18260e .............&.. 00000000f671ef35: c09700b8 ff18260e 00000000 00000000 .....&.......... 00000000ffef040e: 00000000 00000000 00000000 00000000 ................ 00000000dc0a92bc: c09700e0 ff18260e c09700e0 ff18260e .....&.......&.. 00000000b5b5132e: 00000000 00000000 00000000 00000000 ................ 00000000c38ee5cb: 000881a4 00000000 00000000 00000280 ................ 000000001ea9711d: 00000000 00000000 00000000 00000000 ................ 00000000bbb2595d: c1464a40 ffffffff aea18800 ff18260e @JF..........&.. 0000000066ec29c0: c0970278 ff18260e 9f8baf80 ff18260e x....&.......&.. 00000000c30edd0f: 0000027e 00000000 00000001 00000000 ~............... 00000000ad177271: 00002040 00000000 6982a25e 00000000 @ ......^..i.... 00000000d8f9e51d: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000e07d5930: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000ea65a7fe: 00000000 00000000 00000000 00000000 ................ 000000004fafab7c: 0000000c 00000000 00000020 00000000 ........ ....... 00000000681f99c8: 00000060 00000000 00000000 00000000 `............... 0000000065ccbf1d: c09701b0 ff18260e c09701b0 ff18260e .....&.......&.. 0000000095d42b6e: 00000000 00000000 00000000 00000000 ................ 00000000ffc38ad4: 001c6c9b 00000001 00000000 00000000 .l.............. 000000006e452f64: 00000000 00000000 00000000 00000000 ................ 00000000583a2e37: c09701f0 ff18260e c09701f0 ff18260e .....&.......&.. 00000000f74b1775: 00000000 00000000 00000000 00000000 ................ 00000000254e3fca: c0970210 ff18260e c0970210 ff18260e .....&.......&.. 00000000e3c1d9cb: c0970220 ff18260e c0970220 ff18260e ....&.. ....&.. 000000005cc01a69: c0970230 ff18260e c0970230 ff18260e 0....&..0....&.. 000000007217c5aa: 00000000 00000000 00000000 00000000 ................ 00000000386da901: 00000002 00000000 00000000 00000000 ................ 00000000361b3cd2: 00000000 00000000 c1464b40 ffffffff ........@KF..... 00000000b70bc640: 00000000 00000000 c0970100 ff18260e .............&.. 000000005c875d63: 00000000 00000021 00000000 00000000 ....!........... 000000002da486ce: 00000000 00000000 00000000 00000000 ................ 0000000042f84b4c: 00000000 00000000 00000000 00000000 ................ 00000000c6000f7e: 00000000 00000000 c09702b8 ff18260e .............&.. 0000000022ec1538: c09702b8 ff18260e 00000000 00000000 .....&.......... 000000007685b3b3: 00000000 00000000 00000000 00000000 ................ 00000000e1347307: 00000000 00000000 00000000 00000000 ................ 00000000405c9fd9: c1462a60 ffffffff 00000010 00000000 `*F............. 00000000c7d27c87: 00000000 006200ca c0970308 ff18260e ......b......&.. 000000008e55d3a1: c0970308 ff18260e 00000000 00000000 .....&.......... 000000000865aafd: 00000000 00000000 00000000 00000000 ................ 00000000ea221e62: 00000000 00000000 00000000 00000000 ................ 00000000c7f7a61d: 00000000 00000000 c0970348 ff18260e ........H....&.. 00000000d28f82c1: c0970348 ff18260e 00000000 00000000 H....&.......... 00000000c8992709: f43eadcd 00000000 00000000 00000000 ..>............. 0000000094b253df: 00000000 00000000 00000000 00000000 ................ 000000007b2bc020: 00000000 00000000 00000000 00000000 ................ 0000000094443fca: 00000000 00000000 6982a25e 00000000 ........^..i.... 0000000066b9a35a: 1cebc7f5 00000000 00000000 ff18260e .............&.. 00000000b9e39a7d: c09703b0 ff18260e c09703b0 ff18260e .....&.......&.. 000000003d8c0e6e: 00000000 ff18260e 00000000 00000000 .....&.......... 00000000208b5e89: 00000000 00000000 00000000 00000000 ................ 0000000040caf271: c09703e0 ff18260e c09703e0 ff18260e .....&.......&.. 00000000af0d5d45: 00000000 00000000 00000000 ffffffff ................ 0000000006916020: 00000000 00000000 00000000 00000000 ................ 000000009d5c7172: 00000020 00000021 00000000 00000000 ...!........... 0000000010915a8f: 00000000 00000000 c0970428 ff18260e ........(....&.. 000000007a3875fd: c0970428 ff18260e ffffffe0 0000000f (....&.......... 000000001dcf6ace: c0970440 ff18260e c0970440 ff18260e @....&..@....&.. 00000000c6c487ad: c14048e0 ffffffff 00000000 00000000 .H@............. 00000000a64dacc2: 00000000 00000000 00000000 00000000 ................ 00000000e1af0289: 00000000 00000000 00000000 00000000 ................ 000000001faa8276: 000001ea 000001ea 00000000 00000000 ................ 00000000ec72e7b3: 00000000 00000000 00000000 00000000 ................ 00000000bcc8ed93: 00000000 00000000 00000000 00000000 ................ 000000005d65ed59: 00000000 00000000 ........ CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0 RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010 R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0 R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 639 (000000007a7e4f52): orphan list check failed! 000000007a7e4f52: 0001f30a 00000004 00000000 00000000 ................ 00000000a1872b92: 00000004 0003748a 00000000 00000000 .....t.......... 0000000077b4585c: 00000000 00000000 00000000 00000000 ................ 0000000094185237: 00000000 00000000 00000000 0000027e ............~... 000000002804dbc9: 00000000 00000000 00000000 00000001 ................ 0000000033bdf365: c0970510 ff18260e c0970510 ff18260e .....&.......&.. 000000009dfb93ab: 00000000 00000000 00084000 80000004 .........@...... 0000000037263b5f: 00000000 00000000 c0970538 ff18260e ........8....&.. 000000009c89f9a9: c0970538 ff18260e 00000000 00000000 8....&.......... 000000000255be45: 00000000 00000000 c0970098 ff18260e .............&.. 00000000cbb92f8e: c0971d18 ff18260e 00002040 00000000 .....&..@ ...... 00000000499fc8e5: 00000000 00000000 c0970578 ff18260e ........x....&.. 000000006942d217: c0970578 ff18260e 00000000 00000000 x....&.......... 00000000a98231d8: 00000000 00000000 00000000 00000000 ................ 000000009640d9a6: c09705a0 ff18260e c09705a0 ff18260e .....&.......&.. 00000000e629ba3b: 00000000 00000000 00000000 00000000 ................ 000000004d1abbeb: 000881a4 00000000 00000000 00000280 ................ 00000000721c77ec: 00000000 00000000 00000000 00000000 ................ 000000006ab762b9: c1464a40 ffffffff aea18800 ff18260e @JF..........&.. 00000000a430bb78: c0970738 ff18260e 9f8bab00 ff18260e 8....&.......&.. 000000000e70ebbe: 0000027f 00000000 00000001 00000000 ................ 000000004893f869: 00002040 00000000 6982a25e 00000000 @ ......^..i.... 0000000026c981f7: 00000000 00000000 6982a25e 00000000 ........^..i.... 0000000019b87d65: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000c4ae7a78: 00000000 00000000 00000000 00000000 ................ 000000007173c263: 0000000c 00000000 00000020 00000000 ........ ....... 00000000ea274ca1: 00000060 00000000 00000000 00000000 `............... 000000008a9cb53b: c0970670 ff18260e c0970670 ff18260e p....&..p....&.. 000000008ec4f42b: 00000000 00000000 00000000 00000000 ................ 00000000f0904b28: 001c6c9c 00000001 00000000 00000000 .l.............. 00000000b7b77a4e: 00000000 00000000 00000000 00000000 ................ 00000000b6f6d1c9: c09706b0 ff18260e c09706b0 ff18260e .....&.......&.. 00000000b0acacbe: 00000000 00000000 00000000 00000000 ................ 00000000a247b09f: c09706d0 ff18260e c09706d0 ff18260e .....&.......&.. 0000000047421de8: c09706e0 ff18260e c09706e0 ff18260e .....&.......&.. 0000000093031aa5: c09706f0 ff18260e c09706f0 ff18260e .....&.......&.. 00000000dc802010: 00000000 00000000 00000000 00000000 ................ 00000000110d1414: 00000002 00000000 00000000 00000000 ................ 0000000091cedca9: 00000000 00000000 c1464b40 ffffffff ........@KF..... 00000000c2e55764: 00000000 00000000 c09705c0 ff18260e .............&.. 00000000da783296: 00000000 00000021 00000000 00000000 ....!........... 000000003f338f81: 00000000 00000000 00000000 00000000 ................ 00000000066a5726: 00000000 00000000 00000000 00000000 ................ 00000000895e8a75: 00000000 00000000 c0970778 ff18260e ........x....&.. 000000003799e923: c0970778 ff18260e 00000000 00000000 x....&.......... 00000000f826727b: 00000000 00000000 00000000 00000000 ................ 00000000e11ad7a8: 00000000 00000000 00000000 00000000 ................ 00000000e5fbcae4: c1462a60 ffffffff 00000010 00000000 `*F............. 00000000c4e559ab: 00000000 006200ca c09707c8 ff18260e ......b......&.. 000000007ce72f04: c09707c8 ff18260e 00000000 00000000 .....&.......... 0000000043cf35c5: 00000000 00000000 00000000 00000000 ................ 00000000243e6974: 00000000 00000000 00000000 00000000 ................ 0000000085a25ad3: 00000000 00000000 c0970808 ff18260e .............&.. 00000000ab16eade: c0970808 ff18260e 00000000 00000000 .....&.......... 00000000ae1dca6f: 3e242b6e 00000000 00000000 00000000 n+$>............ 0000000068698b3d: 00000000 00000000 00000000 00000000 ................ 000000001239275f: 00000000 00000000 00000000 00000000 ................ 000000009c895a03: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000b9444864: 1cfb0a38 00000000 00000000 ff18260e 8............&.. 00000000b12ff4e6: c0970870 ff18260e c0970870 ff18260e p....&..p....&.. 000000007db3f75a: 00000000 00000000 00000000 00000000 ................ 00000000a53c835d: 00000000 00000000 00000000 00000000 ................ 00000000aebb4599: c09708a0 ff18260e c09708a0 ff18260e .....&.......&.. 000000003e78ffe9: 00000000 00000000 00000000 ffffffff ................ 000000009822c88c: 00000000 ff18260e 00000000 00000000 .....&.......... 00000000b108b876: 00000020 ff18260e 00000000 00000000 ....&.......... 00000000542072a4: 00000000 ff18260e c09708e8 ff18260e .....&.......&.. 0000000093093e5a: c09708e8 ff18260e ffffffe0 0000000f .....&.......... 00000000570488b7: c0970900 ff18260e c0970900 ff18260e .....&.......&.. 00000000838727b7: c14048e0 ffffffff 83057f40 ffffffff .H@.....@....... 00000000385200b2: 00000000 00000000 c09707b0 ff18260e .............&.. 000000005e8cf82e: 00000000 00000021 00000000 00000000 ....!........... 00000000444403ba: 000001ea 000001ea 00000000 00000000 ................ 000000008f9d642f: 00000000 00000000 00000000 00000000 ................ 0000000078510538: 00000000 00000000 c0970968 00000000 ........h....... 000000002ee3a92f: c0970968 ff18260e h....&.. CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0 RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010 R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0 R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 640 (000000003c2dc4d5): orphan list check failed! 000000003c2dc4d5: 0001f30a 00000004 00000000 00000000 ................ 000000001f6e6d09: 00000004 0003748e 00000000 00000000 .....t.......... 00000000d7119c6b: 00000000 00000000 00000000 00000000 ................ 0000000022b0b55a: 00000000 00000000 00000000 0000027f ................ 000000000c4e3a82: 00000000 00000000 00000000 00000001 ................ 00000000e1536791: c0971cd0 ff18260e c0971cd0 ff18260e .....&.......&.. 000000002c97b759: 00000000 00000000 00084000 80000004 .........@...... 0000000067d66896: 00000000 00000000 c0971cf8 ff18260e .............&.. 000000003d4ccf40: c0971cf8 ff18260e 00000000 00000000 .....&.......... 000000002c0de430: 00000000 00000000 c0970558 ff18260e ........X....&.. 000000000a6fecc6: c0957018 ff18260e 00002040 00000000 .p...&..@ ...... 000000004cca78b2: 00000000 00000000 c0971d38 ff18260e ........8....&.. 00000000b8d9b7be: c0971d38 ff18260e 00000000 00000000 8....&.......... 000000008c3051be: 00000000 00000000 00000000 00000000 ................ 00000000139bde92: c0971d60 ff18260e c0971d60 ff18260e `....&..`....&.. 00000000d221daa2: 00000000 00000000 00000000 00000000 ................ 00000000a1411912: 000881a4 00000000 00000000 00000280 ................ 000000005e79a013: 00000000 00000000 00000000 00000000 ................ 000000005f6069a6: c1464a40 ffffffff aea18800 ff18260e @JF..........&.. 00000000d95371a4: c0971ef8 ff18260e b1bfea40 ff18260e .....&..@....&.. 000000004a00b073: 00000280 00000000 00000001 00000000 ................ 00000000dc01bba3: 00002040 00000000 6982a25e 00000000 @ ......^..i.... 00000000f17ea646: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000f240b391: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000ec1f029e: 00000000 00000000 00000000 00000000 ................ 00000000db8389b5: 0000000c 00000000 00000020 00000000 ........ ....... 00000000cbc1d0b8: 00000060 00000000 00000000 00000000 `............... 0000000027c94e3d: c0971e30 ff18260e c0971e30 ff18260e 0....&..0....&.. 00000000b40175b3: 00000000 00000000 00000000 00000000 ................ 000000003ed0ccc1: 001c6c9d 00000001 00000000 00000000 .l.............. 000000006e004bf9: 00000000 00000000 00000000 00000000 ................ 0000000022b38882: c0971e70 ff18260e c0971e70 ff18260e p....&..p....&.. 00000000632c129c: 00000000 00000000 00000000 00000000 ................ 00000000af4aa19a: c0971e90 ff18260e c0971e90 ff18260e .....&.......&.. 0000000019eac546: c0971ea0 ff18260e c0971ea0 ff18260e .....&.......&.. 00000000a72d9bb8: c0971eb0 ff18260e c0971eb0 ff18260e .....&.......&.. 00000000f1348a27: 00000000 00000000 00000000 00000000 ................ 00000000da69cb6e: 00000002 00000000 00000000 00000000 ................ 000000000e1f4c1d: 00000000 00000000 c1464b40 ffffffff ........@KF..... 00000000372f02cb: 00000000 00000000 c0971d80 ff18260e .............&.. 00000000057fd8f5: 00000000 00000021 00000000 00000000 ....!........... 000000003ebe40bf: 00000000 00000000 00000000 00000000 ................ 00000000d8e14db5: 00000000 00000000 00000000 00000000 ................ 0000000084bf9369: 00000000 00000000 c0971f38 ff18260e ........8....&.. 00000000fe014249: c0971f38 ff18260e 00000000 00000000 8....&.......... 0000000057d2a71e: 00000000 00000000 00000000 00000000 ................ 000000000b8938df: 00000000 00000000 00000000 00000000 ................ 000000002237d696: c1462a60 ffffffff 00000010 00000000 `*F............. 000000009e0e442f: 00000000 006200ca c0971f88 ff18260e ......b......&.. 00000000150546c6: c0971f88 ff18260e 00000000 00000000 .....&.......... 000000004f1ba85c: 00000000 00000000 00000000 00000000 ................ 00000000e9cbfd7c: 00000000 00000000 00000000 00000000 ................ 000000004b927a6a: 00000000 00000000 c0971fc8 ff18260e .............&.. 000000001454eef0: c0971fc8 ff18260e 00000000 00000000 .....&.......... 000000008700b773: 2dde3445 00000000 00000000 00000000 E4.-............ 00000000a22ab27a: 00000000 00000000 00000000 00000000 ................ 00000000d7fe15a8: 00000000 00000000 00000000 00000000 ................ 00000000af337456: 00000000 ffffffff 6982a25e 00000000 ........^..i.... 00000000ff99a332: 1d0a4c7b 00000000 00000000 ff18260e {L...........&.. 00000000e0c701a4: c0972030 ff18260e c0972030 ff18260e 0 ...&..0 ...&.. 00000000f473afca: 00000000 00000000 00000000 00000000 ................ 00000000fe0e3be8: 00000000 00000000 00000000 00000000 ................ 00000000d01c9740: c0972060 ff18260e c0972060 ff18260e ` ...&..` ...&.. 0000000007c72100: 00000000 00000000 00000000 ffffffff ................ 000000004e9b2807: 00000000 00000000 00000000 00000000 ................ 000000005705b212: 00000020 00000000 00000000 00000000 ............... 00000000ba4d5f2c: 00000000 00000000 c09720a8 ff18260e ......... ...&.. 000000007f2b3b24: c09720a8 ff18260e ffffffe0 0000000f . ...&.......... 00000000f3d2520c: c09720c0 ff18260e c09720c0 ff18260e . ...&... ...&.. 000000004eeda89d: c14048e0 ffffffff 00000000 00000000 .H@............. 00000000ad9ed34f: 00000000 00000000 00000000 00000000 ................ 000000003376e2dd: c09720f0 ff18260e 00000000 00000000 . ...&.......... 000000007b04ea8c: 000001ea 000001ea 00000000 00000000 ................ 000000003950c9c6: 00000000 00000000 00000000 00000000 ................ 00000000a59e12f6: 00000000 00000000 c0972120 00000000 ........ !...... 000000001ab2b20f: c0972130 ff18260e 0!...&.. CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0 RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010 R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0 R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 641 (00000000f56b1c0a): orphan list check failed! 00000000f56b1c0a: 0001f30a 00000004 00000000 00000000 ................ 0000000049cdfb38: 00000004 00037492 00000000 00000000 .....t.......... 000000000794cf21: 00000000 00000000 00000000 00000000 ................ 00000000ad9ba9f7: 00000000 00000000 00000000 00000280 ................ 0000000091538a5e: 00000000 00000000 00000000 00000001 ................ 0000000065622756: c0956fd0 ff18260e c0956fd0 ff18260e .o...&...o...&.. 00000000436fb7ee: 00000000 00000000 00084000 80000004 .........@...... 000000005e0713d4: 00000000 00000000 c0956ff8 ff18260e .........o...&.. 0000000025122759: c0956ff8 ff18260e 00000000 00000000 .o...&.......... 00000000494d3568: 00000000 00000000 c0971d18 ff18260e .............&.. 0000000011792d23: c09561d8 ff18260e 00002040 00000000 .a...&..@ ...... 00000000c2b15866: 00000000 00000000 c0957038 ff18260e ........8p...&.. 0000000073d1894e: c0957038 ff18260e 00000000 00000000 8p...&.......... 000000001fcd3183: 00000000 00000000 00000000 00000000 ................ 000000009559f4d8: c0957060 ff18260e c0957060 ff18260e `p...&..`p...&.. 000000002052d61d: 00000000 00000000 00000000 00000000 ................ 00000000335ba333: 000881a4 00000000 00000000 00000280 ................ 000000007cbaf4d4: 00000000 00000000 00000000 00000000 ................ 00000000200ed50e: c1464a40 ffffffff aea18800 ff18260e @JF..........&.. 000000009c284170: c09571f8 ff18260e b1bfe600 ff18260e .q...&.......&.. 000000004141e70e: 00000281 00000000 00000001 00000000 ................ 000000007c905050: 00002040 00000000 6982a25e 00000000 @ ......^..i.... 0000000005be7649: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000f8a40969: 00000000 00000000 6982a25e 00000000 ........^..i.... 000000001678317c: 00000000 00000000 00000000 00000000 ................ 00000000ec72ad40: 0000000c 00000000 00000020 00000000 ........ ....... 00000000e925253b: 00000060 00000000 00000000 00000000 `............... 00000000d9673e7e: c0957130 ff18260e c0957130 ff18260e 0q...&..0q...&.. 00000000a9362f8f: 00000000 00000000 00000000 00000000 ................ 00000000333d5782: 001c6c9e 00000001 00000000 00000000 .l.............. 000000008c297273: 00000000 00000000 00000000 00000000 ................ 000000000dd385dd: c0957170 ff18260e c0957170 ff18260e pq...&..pq...&.. 000000006958d116: 00000000 00000000 00000000 00000000 ................ 000000005ad81d4d: c0957190 ff18260e c0957190 ff18260e .q...&...q...&.. 00000000d341be10: c09571a0 ff18260e c09571a0 ff18260e .q...&...q...&.. 0000000008ef3f89: c09571b0 ff18260e c09571b0 ff18260e .q...&...q...&.. 00000000bfb977f1: 00000000 00000000 00000000 00000000 ................ 00000000ac486081: 00000002 00000000 00000000 00000000 ................ 000000007c2ba398: 00000000 00000000 c1464b40 ffffffff ........@KF..... 00000000de5ae1f8: 00000000 00000000 c0957080 ff18260e .........p...&.. 0000000000563181: 00000000 00000021 00000000 00000000 ....!........... 00000000d7372e4f: 00000000 00000000 00000000 00000000 ................ 000000004aa260f3: 00000000 00000000 00000000 00000000 ................ 00000000bbbf51d4: 00000000 00000000 c0957238 ff18260e ........8r...&.. 000000004eaee418: c0957238 ff18260e 00000000 00000000 8r...&.......... 00000000acf5a6f9: 00000000 00000000 00000000 00000000 ................ 000000002be388b6: 00000000 00000000 00000000 00000000 ................ 000000006382d52c: c1462a60 ffffffff 00000010 00000000 `*F............. 00000000f60f03b2: 00000000 006200ca c0957288 ff18260e ......b..r...&.. 00000000c333cec0: c0957288 ff18260e 00000000 00000000 .r...&.......... 000000000752ca3b: 00000000 00000000 00000000 00000000 ................ 00000000f50c6dbd: 00000000 00000000 00000000 00000000 ................ 000000007022acab: 00000000 00000000 c09572c8 ff18260e .........r...&.. 00000000338f206d: c09572c8 ff18260e 00000000 00000000 .r...&.......... 000000005a3044b7: f02b24b2 00000000 00000000 00000000 .$+............. 00000000b19bb0d9: 00000000 00000000 00000000 00000000 ................ 00000000aef019c8: 00000000 00000000 00000000 00000000 ................ 000000001e1c5bd3: 00000000 ff18260e 6982a25e 00000000 .....&..^..i.... 00000000e16c86c6: 1d198ebe 00000000 00000000 ff18260e .............&.. 000000000892cc55: c0957330 ff18260e c0957330 ff18260e 0s...&..0s...&.. 00000000408c4d13: 00000000 00000000 00000000 00000000 ................ 00000000275b1cfa: 00000000 00000000 00000000 00000000 ................ 00000000e07e426f: c0957360 ff18260e c0957360 ff18260e `s...&..`s...&.. 000000004a32c7a8: 00000000 00000000 00000000 ffffffff ................ 000000009344120c: 00000000 00000000 00000000 00000000 ................ 0000000035771654: 00000020 00000000 00000000 00000000 ............... 00000000fb7de7b4: 00000000 00000000 c09573a8 ff18260e .........s...&.. 000000006bececaa: c09573a8 ff18260e ffffffe0 0000000f .s...&.......... 000000007598db43: c09573c0 ff18260e c09573c0 ff18260e .s...&...s...&.. 0000000036c0c33e: c14048e0 ffffffff 00000000 00000000 .H@............. 000000001fb84a0d: 83043540 ffffffff 00000010 00000000 @5.............. 0000000037fe53da: 00000000 006200ca 00000000 00000000 ......b......... 0000000088655f7b: 000001ea 000001ea 00000000 00000000 ................ 0000000081221c9d: 00000000 00000000 00000000 00000000 ................ 00000000024b2004: 00000000 00000000 00000000 00000000 ................ 00000000035b86c1: 00000000 00000000 ........ CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0 RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010 R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0 R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 642 (0000000029f75eb6): orphan list check failed! 0000000029f75eb6: 0001f30a 00000004 00000000 00000000 ................ 000000001ccfdcd2: 00000004 00037496 00000000 00000000 .....t.......... 0000000063c3bbb4: 00000000 00000000 00000000 00000000 ................ 00000000c0fbbb3e: 00000000 00000000 00000000 00000281 ................ 00000000448e802a: 00000000 00000000 00000000 00000001 ................ 000000004d82a603: c0956190 ff18260e c0956190 ff18260e .a...&...a...&.. 0000000070b71a92: 00000000 00000000 00084000 80000004 .........@...... 00000000adb09b94: 00000000 00000000 c09561b8 ff18260e .........a...&.. 0000000025a37e4f: c09561b8 ff18260e 00000000 00000000 .a...&.......... 000000007fc342c4: 00000000 00000000 c0957018 ff18260e .........p...&.. 0000000016a63647: c0955398 ff18260e 00002040 00000000 .S...&..@ ...... 000000002caee790: 00000000 00000000 c09561f8 ff18260e .........a...&.. 00000000d71140d3: c09561f8 ff18260e 00000000 00000000 .a...&.......... 000000006f83b9c6: 00000000 00000000 00000000 00000000 ................ 000000005a048485: c0956220 ff18260e c0956220 ff18260e b...&.. b...&.. 000000003215e0b9: 00000000 00000000 00000000 00000000 ................ 00000000e7090da3: 000881a4 00000000 00000000 00000280 ................ 000000008e72a991: 00000000 00000000 00000000 00000000 ................ 00000000ad78cd49: c1464a40 ffffffff aea18800 ff18260e @JF..........&.. 00000000a39f8434: c09563b8 ff18260e b1bfe140 ff18260e .c...&..@....&.. 00000000927a9c4c: 00000282 00000000 00000001 00000000 ................ 0000000010441c5a: 00002040 00000000 6982a25e 00000000 @ ......^..i.... 000000005df21b2f: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000aae8aa7e: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000fe056223: 00000000 00000000 00000000 00000000 ................ 00000000c3cc0185: 0000000c 00000000 00000020 00000000 ........ ....... 000000004f85c48e: 00000060 00000000 00000000 00000000 `............... 000000004a802057: c09562f0 ff18260e c09562f0 ff18260e .b...&...b...&.. 00000000f14dd69c: 00000000 00000000 00000000 00000000 ................ 0000000043290e20: 001c6c9f 00000001 00000000 00000000 .l.............. 0000000040303d5a: 00000000 00000000 00000000 00000000 ................ 0000000099cbc0a6: c0956330 ff18260e c0956330 ff18260e 0c...&..0c...&.. 00000000865877be: 00000000 00000000 00000000 00000000 ................ 00000000fb15e65f: c0956350 ff18260e c0956350 ff18260e Pc...&..Pc...&.. 00000000f2dbfc1f: c0956360 ff18260e c0956360 ff18260e `c...&..`c...&.. 000000009148a399: c0956370 ff18260e c0956370 ff18260e pc...&..pc...&.. 00000000c6f9225b: 00000000 00000000 00000000 00000000 ................ 00000000ac17beed: 00000002 00000000 00000000 00000000 ................ 00000000bae9e1f6: 00000000 00000000 c1464b40 ffffffff ........@KF..... 00000000d227065a: 00000000 00000000 c0956240 ff18260e ........@b...&.. 00000000803bc985: 00000000 00000021 00000000 00000000 ....!........... 00000000a17231bc: 00000000 00000000 00000000 00000000 ................ 000000006b717e18: 00000000 00000000 00000000 00000000 ................ 000000006ff634c3: 00000000 00000000 c09563f8 ff18260e .........c...&.. 000000000dacad78: c09563f8 ff18260e 00000000 00000000 .c...&.......... 000000007f12dcf8: 00000000 00000000 00000000 00000000 ................ 0000000005926a6d: 00000000 00000000 00000000 00000000 ................ 00000000c06c642d: c1462a60 ffffffff 00000010 00000000 `*F............. 000000000b3a5c83: 00000000 006200ca c0956448 ff18260e ......b.Hd...&.. 00000000398fcd74: c0956448 ff18260e 00000000 00000000 Hd...&.......... 00000000f4ffb57d: 00000000 00000000 00000000 00000000 ................ 000000004085bf57: 00000000 00000000 00000000 00000000 ................ 00000000df12a3a6: 00000000 00000000 c0956488 ff18260e .........d...&.. 0000000029e51314: c0956488 ff18260e 00000000 00000000 .d...&.......... 00000000779a60f0: fec698db 00000000 00000000 00000000 ................ 00000000aea5cbbb: 00000000 00000000 00000000 00000000 ................ 0000000009188cc1: 00000000 00000000 00000000 00000000 ................ 00000000025cefc2: 00000000 00000000 6982a25e 00000000 ........^..i.... 0000000000614756: 1d28d102 00000000 00000000 00000000 ..(............. 000000008b5f72fe: c09564f0 ff18260e c09564f0 ff18260e .d...&...d...&.. 00000000ad217f39: 00000000 ff18260e 00000000 00000000 .....&.......... 00000000ca0dfd6a: 00000000 00000000 00000000 00000000 ................ 00000000bb4e7e77: c0956520 ff18260e c0956520 ff18260e e...&.. e...&.. 0000000087839a75: 00000000 00000000 00000000 ffffffff ................ 000000008ef2665c: 00000000 ffffffff 00000000 00000000 ................ 00000000e851aad9: 00000020 ff18260e 00000000 00000000 ....&.......... 00000000f334c68e: 00000000 00000000 c0956568 ff18260e ........he...&.. 00000000160db24f: c0956568 ff18260e ffffffe0 0000000f he...&.......... 000000000af6b251: c0956580 ff18260e c0956580 ff18260e .e...&...e...&.. 00000000abba20b7: c14048e0 ffffffff 6982a1a8 00000000 .H@........i.... 0000000097dd9674: 16b06f55 00000000 00000000 00000000 Uo.............. 00000000f93aa4ac: 0000000c 00000000 00000000 00000000 ................ 00000000d4b64a56: 000001ea 000001ea 00000000 00000000 ................ 00000000e5c41304: 00000000 00000000 00000000 00000000 ................ 000000001837386e: 00000000 00000000 00000000 00000000 ................ 000000009d078796: 00000000 00000000 ........ CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0 RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010 R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0 R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 643 (00000000b289e28c): orphan list check failed! 00000000b289e28c: 0001f30a 00000004 00000000 00000000 ................ 0000000032b0959a: 00000004 0003749a 00000000 00000000 .....t.......... 0000000074c4ce1c: 00000000 00000000 00000000 00000000 ................ 0000000094dd8f26: 00000000 00000000 00000000 00000282 ................ 00000000e5ca2334: 00000000 00000000 00000000 00000001 ................ 00000000804da50d: c0955350 ff18260e c0955350 ff18260e PS...&..PS...&.. 00000000c25e5b1c: 00000000 00000000 00084000 80000004 .........@...... 00000000053ac9c0: 00000000 00000000 c0955378 ff18260e ........xS...&.. 00000000fa3ca807: c0955378 ff18260e 00000000 00000000 xS...&.......... 00000000e645f9e0: 00000000 00000000 c09561d8 ff18260e .........a...&.. 00000000e4ffc944: c0954a18 ff18260e 00002040 00000000 .J...&..@ ...... 0000000079094e05: 00000000 00000000 c09553b8 ff18260e .........S...&.. 00000000d593eba6: c09553b8 ff18260e 00000000 00000000 .S...&.......... 00000000e051a7be: 00000000 00000000 00000000 00000000 ................ 00000000f95d4d6c: c09553e0 ff18260e c09553e0 ff18260e .S...&...S...&.. 00000000960c77ed: 00000000 00000000 00000000 00000000 ................ 000000008e18b7d5: 000881a4 00000000 00000000 00000280 ................ 000000004670e2b0: 00000000 00000000 00000000 00000000 ................ 000000000fa08732: c1464a40 ffffffff aea18800 ff18260e @JF..........&.. 0000000074d8dd6f: c0955578 ff18260e af96efc0 ff18260e xU...&.......&.. 00000000c9375915: 00000283 00000000 00000001 00000000 ................ 000000002a813fbd: 00002040 00000000 6982a25e 00000000 @ ......^..i.... 00000000245e9ca1: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000777dad64: 00000000 00000000 6982a25e 00000000 ........^..i.... 000000005d9e723e: 00000000 00000000 00000000 00000000 ................ 00000000a61ec8ea: 0000000c 00000000 00000020 00000000 ........ ....... 0000000049cdf3c8: 00000060 00000000 00000000 00000000 `............... 0000000051da5924: c09554b0 ff18260e c09554b0 ff18260e .T...&...T...&.. 00000000120f41f0: 00000000 00000000 00000000 00000000 ................ 000000003287f4a5: 001c6ca0 00000001 00000000 00000000 .l.............. 00000000936d9738: 00000000 00000000 00000000 00000000 ................ 000000007ef53626: c09554f0 ff18260e c09554f0 ff18260e .T...&...T...&.. 00000000b7b34506: 00000000 00000000 00000000 00000000 ................ 000000002bdde22f: c0955510 ff18260e c0955510 ff18260e .U...&...U...&.. 0000000070eded5b: c0955520 ff18260e c0955520 ff18260e U...&.. U...&.. 00000000e53de4ac: c0955530 ff18260e c0955530 ff18260e 0U...&..0U...&.. 000000005bc59f26: 00000000 00000000 00000000 00000000 ................ 0000000004394676: 00000002 00000000 00000000 00000000 ................ 000000006fd9f75b: 00000000 00000000 c1464b40 ffffffff ........@KF..... 00000000fb75f5d3: 00000000 00000000 c0955400 ff18260e .........T...&.. 0000000098eda191: 00000000 00000021 00000000 00000000 ....!........... 000000003a1ce874: 00000000 00000000 00000000 00000000 ................ 000000001988a003: 00000000 00000000 00000000 00000000 ................ 00000000e3e20d88: 00000000 00000000 c09555b8 ff18260e .........U...&.. 0000000006e6a9f1: c09555b8 ff18260e 00000000 00000000 .U...&.......... 000000001d5b5623: 00000000 00000000 00000000 00000000 ................ 00000000040ad626: 00000000 00000000 00000000 00000000 ................ 000000004c3cdffe: c1462a60 ffffffff 00000010 00000000 `*F............. 0000000088b13a33: 00000000 006200ca c0955608 ff18260e ......b..V...&.. 000000004c76bc54: c0955608 ff18260e 00000000 00000000 .V...&.......... 00000000080ad444: 00000000 00000000 00000000 00000000 ................ 000000002cce61ae: 00000000 00000000 00000000 00000000 ................ 000000006af48832: 00000000 00000000 c0955648 ff18260e ........HV...&.. 00000000857731c3: c0955648 ff18260e 00000000 00000000 HV...&.......... 0000000080bcff9d: 1db4ff1b 00000000 00000000 00000000 ................ 000000002343961f: 00000000 00000000 00000000 00000000 ................ 00000000b42189d6: 00000000 00000000 00000000 00000000 ................ 00000000fc0522f6: 00000000 ff18260e 6982a25e 00000000 .....&..^..i.... 000000008e093901: 1d381344 00000000 00000000 00000000 D.8............. 00000000dcb3aa03: c09556b0 ff18260e c09556b0 ff18260e .V...&...V...&.. 0000000041d4bba3: 00000000 00000000 00000000 00000000 ................ 00000000a1b865e8: 00000000 00000000 00000000 00000000 ................ 00000000bcee4e67: c09556e0 ff18260e c09556e0 ff18260e .V...&...V...&.. 00000000f8ae1c47: 00000000 00000000 00000000 ffffffff ................ 00000000a23bf804: 00000000 00000000 00000000 00000000 ................ 0000000093e7e4f3: 00000020 00000000 00000000 00000000 ............... 0000000027c5a65b: 00000000 ffffffff c0955728 ff18260e ........(W...&.. 00000000d2aa6c3b: c0955728 ff18260e ffffffe0 0000000f (W...&.......... 0000000093f239e6: c0955740 ff18260e c0955740 ff18260e @W...&..@W...&.. 00000000481831e2: c14048e0 ffffffff 00000000 00000000 .H@............. 000000009144be16: 00000000 00000000 6982a19f 00000000 ...........i.... 00000000a2d126d9: 293983e3 00000000 00000000 00000000 ..9)............ 0000000082d5a1d3: 000001ea 000001ea 00000000 00000000 ................ 0000000014eaa3d9: 00000000 00000000 00000000 00000000 ................ 00000000285ee682: 00000000 00000000 00000000 00000000 ................ 00000000881681c0: 00000060 00000000 `....... CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0 RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010 R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0 R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 644 (00000000caf5b9ab): orphan list check failed! 00000000caf5b9ab: 0001f30a 00000004 00000000 00000000 ................ 000000009cb5a94b: 00000004 0003749e 00000000 00000000 .....t.......... 000000006e671db7: 00000000 00000000 00000000 00000000 ................ 000000009a61d4b8: 00000000 00000000 00000000 00000283 ................ 000000000f187c9d: 00000000 00000000 00000000 00000001 ................ 000000003d0101bf: c09549d0 ff18260e c09549d0 ff18260e .I...&...I...&.. 00000000b4bc1ac5: 00000000 00000000 00084000 80000004 .........@...... 00000000a904a6c1: 00000000 00000000 c09549f8 ff18260e .........I...&.. 0000000031f7d745: c09549f8 ff18260e 00000000 00000000 .I...&.......... 00000000d0d0aa47: 00000000 00000000 c0955398 ff18260e .........S...&.. 00000000bbc01a6d: aea50720 ff18260e 00002040 00000000 ....&..@ ...... 00000000ddb749f0: 00000000 00000000 c0954a38 ff18260e ........8J...&.. 000000001408a7c2: c0954a38 ff18260e 00000000 00000000 8J...&.......... 0000000080f77a25: 00000000 00000000 00000000 00000000 ................ 000000009e666e2b: c0954a60 ff18260e c0954a60 ff18260e `J...&..`J...&.. 00000000d78d7a64: 00000000 00000000 00000000 00000000 ................ 00000000dda0a0aa: 000881a4 00000000 00000000 00000280 ................ 00000000228a00f6: 00000000 00000000 00000000 00000000 ................ 000000005b3ca8fa: c1464a40 ffffffff aea18800 ff18260e @JF..........&.. 0000000015242fd4: c0954bf8 ff18260e af96ed00 ff18260e .K...&.......&.. 000000007e7e2d1c: 00000284 00000000 00000001 00000000 ................ 0000000030ba0edb: 00002040 00000000 6982a25e 00000000 @ ......^..i.... 000000005a3fadfb: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000d0ffa334: 00000000 00000000 6982a25e 00000000 ........^..i.... 0000000019d716f8: 00000000 00000000 00000000 00000000 ................ 00000000ea2e626b: 0000000c 00000000 00000020 00000000 ........ ....... 00000000f77c5ae7: 00000060 00000000 00000000 00000000 `............... 0000000074f27d3b: c0954b30 ff18260e c0954b30 ff18260e 0K...&..0K...&.. 00000000cb115eaa: 00000000 00000000 00000000 00000000 ................ 000000001929e45b: 001c6ca2 00000001 00000000 00000000 .l.............. 000000007a13c1fb: 00000000 00000000 00000000 00000000 ................ 00000000acfa7385: c0954b70 ff18260e c0954b70 ff18260e pK...&..pK...&.. 00000000cef51b26: 00000000 00000000 00000000 00000000 ................ 0000000054ac3e30: c0954b90 ff18260e c0954b90 ff18260e .K...&...K...&.. 00000000fa891658: c0954ba0 ff18260e c0954ba0 ff18260e .K...&...K...&.. 00000000e0116640: c0954bb0 ff18260e c0954bb0 ff18260e .K...&...K...&.. 00000000b8310b73: 00000000 00000000 00000000 00000000 ................ 000000001680eaa5: 00000002 00000000 00000000 00000000 ................ 000000003be22059: 00000000 00000000 c1464b40 ffffffff ........@KF..... 00000000be391f3b: 00000000 00000000 c0954a80 ff18260e .........J...&.. 000000003c9561db: 00000000 00000021 00000000 00000000 ....!........... 000000001f6e3d67: 00000000 00000000 00000000 00000000 ................ 00000000dbc0d976: 00000000 00000000 00000000 00000000 ................ 000000000f8d7fdb: 00000000 00000000 c0954c38 ff18260e ........8L...&.. 00000000d756c7da: c0954c38 ff18260e 00000000 00000000 8L...&.......... 000000002badc685: 00000000 00000000 00000000 00000000 ................ 00000000b99cd866: 00000000 00000000 00000000 00000000 ................ 00000000ef05f460: c1462a60 ffffffff 00000010 00000000 `*F............. 00000000839a726a: 00000000 006200ca c0954c88 ff18260e ......b..L...&.. 00000000c6285fa5: c0954c88 ff18260e 00000000 00000000 .L...&.......... 000000008715b368: 00000000 00000000 00000000 00000000 ................ 00000000f8c812e9: 00000000 00000000 00000000 00000000 ................ 00000000d52a20d9: 00000000 00000000 c0954cc8 ff18260e .........L...&.. 00000000ce440737: c0954cc8 ff18260e 00000000 00000000 .L...&.......... 000000001e966128: 805bfe2a 00000000 00000000 00000000 *.[............. 000000001864e20f: 00000000 00000000 00000000 00000000 ................ 000000003f4e9fd0: 00000000 00000000 00000000 00000000 ................ 00000000521360c8: 00000000 00000000 6982a25e 00000000 ........^..i.... 00000000b82d927d: 1d475588 00000000 00000000 00000000 .UG............. 00000000ca718bf8: c0954d30 ff18260e c0954d30 ff18260e 0M...&..0M...&.. 0000000099bbb5a3: 00000000 00000000 00000000 00000000 ................ 00000000f2209aa6: 00000000 00000000 00000000 00000000 ................ 00000000556166b7: c0954d60 ff18260e c0954d60 ff18260e `M...&..`M...&.. 00000000d1154eed: 00000000 00000000 00000000 ffffffff ................ 00000000e7206aa0: 00000000 ff18260e 00000000 00000000 .....&.......... 00000000c7fe3419: 00000020 00000000 00000000 00000000 ............... 000000002aabe40d: 00000000 00000000 c0954da8 ff18260e .........M...&.. 000000005af90a39: c0954da8 ff18260e ffffffe0 0000000f .M...&.......... 00000000c72b23d2: c0954dc0 ff18260e c0954dc0 ff18260e .M...&...M...&.. 000000002398ff9c: c14048e0 ffffffff 00000000 00000000 .H@............. 000000006ab6bcd4: c0954de0 ff18260e c0954de0 ff18260e .M...&...M...&.. 000000005a24cd3d: c0954df0 ff18260e 00000000 00000000 .M...&.......... 0000000076093f82: 000001ea 000001ea 00000000 00000000 ................ 00000000fa64a6ad: 00000000 00000000 00000000 00000000 ................ 00000000d91e216b: 00000000 00000000 00000000 00000000 ................ 0000000032cf1294: 00000000 00000000 ........ CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd5211df8fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0 RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010 R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0 R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): sb orphan head is 644 sb_info orphan list: inode dm-3:644 at 00000000dda0a0aa: mode 100644, nlink 1, next 643 inode dm-3:643 at 000000008e18b7d5: mode 100644, nlink 1, next 642 inode dm-3:642 at 00000000e7090da3: mode 100644, nlink 1, next 641 inode dm-3:641 at 00000000335ba333: mode 100644, nlink 1, next 640 inode dm-3:640 at 00000000a1411912: mode 100644, nlink 1, next 639 inode dm-3:639 at 000000004d1abbeb: mode 100644, nlink 1, next 638 inode dm-3:638 at 00000000c38ee5cb: mode 100644, nlink 1, next 637 inode dm-3:637 at 0000000065195cb5: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| mmp test complete, duration 1927 sec | kernel BUG at /tmp/rpmbuild-lustre-jenkins-Qbyfc4Z1/BUILD/lustre-2.17.50_86_g6747b63/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP NOPTI CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ff616882c5573a78 EFLAGS: 00010216 RAX: ff19c7d14faee1d8 RBX: ff19c7d16dbb9720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ff19c7d1bbb1e698 RDI: ff19c7d1bbb1e698 RBP: ff19c7d16dbb9000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ff616882c5573890 R12: ff19c7d16dbb9720 R13: ff19c7d15afa3800 R14: ffffffffc16078a8 R15: ff19c7d16c921580 FS: 00007fd6a8e3d080(0000) GS:ff19c7d1bbb00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000563f1d02b178 CR3: 000000011f332006 CR4: 0000000000771ee0 PKRU: 55555554 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb | Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds3' ' /proc/mounts); Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts); Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1 Lustre: DEBUG MARKER: modprobe dm-flakey; Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey >/dev/null 2>&1 Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey 2>&1 Lustre: DEBUG MARKER: test -b /dev/mapper/mds1_flakey Autotest: Test running for 35 minutes (lustre-reviews_review-dne-subtest-change_121246.106) Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1; mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1 LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 Lustre: Skipped 14 previous similar messages LDISKFS-fs error (device dm-3): mb_free_blocks:1962: group 10, block 228448:freeing already freed block (bit 19968); block bitmap corrupt. Aborting journal on device dm-3-8. LDISKFS-fs (dm-3): Remounting filesystem read-only LDISKFS-fs warning (device dm-3): ldiskfs_mb_generate_buddy:1239: group 10: block bitmap and bg descriptor inconsistent: 2951 vs 2953 free clusters 3943 in gd, 2 pa's LDISKFS-fs error (device dm-3) in osd_trans_stop:2343: IO failure LustreError: 192402:0:(osd_handler.c:2346:osd_trans_stop()) lustre-MDT0000: failed to stop transaction: rc = -5 Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check LustreError: 192576:0:(obd_sysfs.c:242:health_check_show()) lustre-MDT0000-osd: device reported unhealthy Lustre: DEBUG MARKER: /usr/sbin/lctl mark mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: \'NOT HEALTHY\' Lustre: DEBUG MARKER: mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: 'NOT HEALTHY' Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-2/2026-02-03/lustre-reviews_review-dne-subtest-change_121246_106_4bd9e2ca-25ff-4474-b812-f5dd47c9caeb//mmp.test_10.debug_log.$(hostname -s).1770161534.log; Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1 LustreError: 193017:0:(osd_handler.c:2469:osd_drop_preallocated_space()) lustre-MDT0000: can't truncate: rc=-30 LustreError: 193017:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup LustreError: 193017:0:(obd_class.h:479:obd_check_dev()) Skipped 389 previous similar messages LDISKFS-fs (dm-3): Inode 645 (00000000ffc3432f): orphan list check failed! 00000000ffc3432f: 0001f30a 00000004 00000000 00000000 ................ 00000000aa3ac40a: 00000004 000372d6 00000000 00000000 .....r.......... 000000003c407cf1: 00000000 00000000 00000000 00000000 ................ 00000000197a009d: 00000000 00000000 00000000 00000000 ................ 000000004505b04d: 00000000 00000000 00000000 00000001 ................ 0000000006206f43: 4fb32650 ff19c7d1 4fb32650 ff19c7d1 P&.O....P&.O.... 00000000c45c663d: 00000000 00000000 00084000 80000004 .........@...... 0000000004320dcc: 00000000 00000000 4fb32678 ff19c7d1 ........x&.O.... 000000007366ab29: 4fb32678 ff19c7d1 00000000 00000000 x&.O............ 00000000b531bd52: 00000000 00000000 6dbb9720 ff19c7d1 ........ ..m.... 000000004c8a1219: 4fb30558 ff19c7d1 00002040 00000000 X..O....@ ...... 00000000fbba9e18: 00000000 00000000 4fb326b8 ff19c7d1 .........&.O.... 000000009cdc6652: 4fb326b8 ff19c7d1 00000000 00000000 .&.O............ 00000000ac1b6778: 00000000 00000000 00000000 00000000 ................ 0000000055bc6a85: 4fb326e0 ff19c7d1 4fb326e0 ff19c7d1 .&.O.....&.O.... 00000000f9a03d36: 00000000 00000000 00000000 00000000 ................ 0000000005dd4dd0: 000881a4 00000000 00000000 00000280 ................ 00000000aacf5387: 00000000 00000000 00000000 00000000 ................ 00000000cd640e60: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z.... 00000000cdaca561: 4fb32878 ff19c7d1 5435a640 ff19c7d1 x(.O....@.5T.... 0000000036846a4e: 00000285 00000000 00000001 00000000 ................ 000000008ca52e1c: 00002040 00000000 6982857d 00000000 @ ......}..i.... 000000003c3cff2b: 00000000 00000000 6982857d 00000000 ........}..i.... 0000000018c878ea: 00000000 00000000 6982857d 00000000 ........}..i.... 000000009462b681: 00000000 00000000 00000000 00000000 ................ 000000009dd13ca7: 0000000c 00000000 00000020 00000000 ........ ....... 00000000cb065702: 00000060 00000000 00000000 00000000 `............... 000000006e373f08: 4fb327b0 ff19c7d1 4fb327b0 ff19c7d1 .'.O.....'.O.... 00000000870e60ae: 00000000 00000000 00000000 00000000 ................ 00000000885f648a: 001c67f8 00000001 00000000 00000000 .g.............. 00000000b65b88e9: 00000000 00000000 00000000 00000000 ................ 000000007e2c2d2c: 4fb327f0 ff19c7d1 4fb327f0 ff19c7d1 .'.O.....'.O.... 00000000c90fc266: 00000000 00000000 00000000 00000000 ................ 000000001f6e19d3: 4fb32810 ff19c7d1 4fb32810 ff19c7d1 .(.O.....(.O.... 0000000093340bf0: 4fb32820 ff19c7d1 4fb32820 ff19c7d1 (.O.... (.O.... 0000000042fbda8c: 4fb32830 ff19c7d1 4fb32830 ff19c7d1 0(.O....0(.O.... 00000000b735aa24: 00000000 00000000 00000000 00000000 ................ 000000001e6e5886: 00000002 00000000 00000000 00000000 ................ 000000004ae3e99b: 00000000 00000000 c15deb40 ffffffff ........@.]..... 0000000091c6136a: 00000000 00000000 4fb32700 ff19c7d1 .........'.O.... 000000001f22b8e9: 00000000 00000021 00000000 00000000 ....!........... 00000000b140c881: 00000000 00000000 00000000 00000000 ................ 00000000522e3519: 00000000 00000000 00000000 00000000 ................ 00000000b575f627: 00000000 00000000 4fb328b8 ff19c7d1 .........(.O.... 00000000a72f30ed: 4fb328b8 ff19c7d1 00000000 00000000 .(.O............ 00000000ffa95159: 00000000 00000000 00000000 00000000 ................ 0000000003afdb33: 00000000 00000000 00000000 00000000 ................ 0000000094ab257e: c15dca60 ffffffff 00000010 00000000 `.]............. 000000002195c969: 00000000 006200ca 4fb32908 ff19c7d1 ......b..).O.... 00000000e03869ee: 4fb32908 ff19c7d1 00000000 00000000 .).O............ 000000005bec6eb0: 00000000 00000000 00000000 00000000 ................ 000000005a95b72f: 00000000 00000000 00000000 00000000 ................ 000000009ff9a122: 00000000 00000000 4fb32948 ff19c7d1 ........H).O.... 000000004cfe0cd5: 4fb32948 ff19c7d1 00000000 00000000 H).O............ 00000000b26ac546: 05890448 00000000 00000000 00000000 H............... 000000008fd0c5d6: 00000000 00000000 00000000 00000000 ................ 000000009866ee6c: 00000000 00000000 00000000 00000000 ................ 00000000376b0bfe: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000d8997023: 12c5e42b 00000000 00000000 00000000 +............... 00000000271f892a: 4fb329b0 ff19c7d1 4fb329b0 ff19c7d1 .).O.....).O.... 00000000875d65e7: 00000000 ff19c7d1 00000000 00000000 ................ 00000000569ef8de: 00000000 00000000 00000000 00000000 ................ 000000003859b10f: 4fb329e0 ff19c7d1 4fb329e0 ff19c7d1 .).O.....).O.... 000000008950e178: 00000000 00000000 00000000 ffffffff ................ 00000000b37578d2: 00000000 ff19c7d1 00000000 00000000 ................ 00000000c4f6d20b: 00000020 00000000 00000000 00000000 ............... 000000003c994cab: 00000000 ff19c7d1 4fb32a28 ff19c7d1 ........(*.O.... 00000000a4d6d5d4: 4fb32a28 ff19c7d1 ffffffe0 0000000f (*.O............ 00000000d47da39a: 4fb32a40 ff19c7d1 4fb32a40 ff19c7d1 @*.O....@*.O.... 00000000948b3804: c157e8e0 ffffffff ffffffff ffffffff ..W............. 000000000caf209a: bc655140 ffffffff 40cb5000 ff19c7d1 @Qe......P.@.... 0000000065f6c782: 4fb32bb8 ff19c7d1 00000000 00000000 .+.O............ 00000000ef58a945: 000001f0 000001f0 00000000 00000000 ................ 0000000019293a3f: 00000000 00000000 00000000 00000000 ................ 00000000a0ec349f: 00000000 00000000 69828388 00000000 ...........i.... 00000000a710f4ad: 27b435b5 00000000 .5.'.... CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0 RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010 R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0 R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 646 (000000007a67e056): orphan list check failed! 000000007a67e056: 0001f30a 00000004 00000000 00000000 ................ 000000005717d82e: 00000004 000372da 00000000 00000000 .....r.......... 0000000089f13a02: 00000000 00000000 00000000 00000000 ................ 00000000f138d8a1: 00000000 00000000 00000000 00000285 ................ 00000000555e4113: 00000000 00000000 00000000 00000001 ................ 000000005bfe6fdb: 4fb30510 ff19c7d1 4fb30510 ff19c7d1 ...O.......O.... 0000000055ffbaeb: 00000000 00000000 00084000 80000004 .........@...... 000000007be9f525: 00000000 00000000 4fb30538 ff19c7d1 ........8..O.... 000000005cc2a403: 4fb30538 ff19c7d1 00000000 00000000 8..O............ 00000000d217fa66: 00000000 00000000 4fb32698 ff19c7d1 .........&.O.... 00000000b511666b: 4fb33018 ff19c7d1 00002040 00000000 .0.O....@ ...... 0000000073ffabfa: 00000000 00000000 4fb30578 ff19c7d1 ........x..O.... 00000000753773a2: 4fb30578 ff19c7d1 00000000 00000000 x..O............ 00000000f6f9ffe1: 00000000 00000000 00000000 00000000 ................ 00000000a982408c: 4fb305a0 ff19c7d1 4fb305a0 ff19c7d1 ...O.......O.... 00000000ab5edb57: 00000000 00000000 00000000 00000000 ................ 00000000860da577: 000881a4 00000000 00000000 00000280 ................ 000000002204ac7f: 00000000 00000000 00000000 00000000 ................ 00000000cb26633f: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z.... 00000000a34c6d35: 4fb30738 ff19c7d1 41bd2ac0 ff19c7d1 8..O.....*.A.... 00000000a0e544ef: 00000286 00000000 00000001 00000000 ................ 000000004e892824: 00002040 00000000 6982857d 00000000 @ ......}..i.... 00000000d1ef13e7: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000a184960c: 00000000 00000000 6982857d 00000000 ........}..i.... 000000005afc02ad: 00000000 00000000 00000000 00000000 ................ 00000000cb3e0fa1: 0000000c 00000000 00000020 00000000 ........ ....... 000000000b65df31: 00000060 00000000 00000000 00000000 `............... 000000002505d1af: 4fb30670 ff19c7d1 4fb30670 ff19c7d1 p..O....p..O.... 000000005ceb8449: 00000000 00000000 00000000 00000000 ................ 000000001818c43e: 001c67fb 00000001 00000000 00000000 .g.............. 000000008463f459: 00000000 00000000 00000000 00000000 ................ 0000000013f30a20: 4fb306b0 ff19c7d1 4fb306b0 ff19c7d1 ...O.......O.... 00000000c5e6980c: 00000000 00000000 00000000 00000000 ................ 00000000d5a501be: 4fb306d0 ff19c7d1 4fb306d0 ff19c7d1 ...O.......O.... 000000006b46e8cd: 4fb306e0 ff19c7d1 4fb306e0 ff19c7d1 ...O.......O.... 000000007dc71629: 4fb306f0 ff19c7d1 4fb306f0 ff19c7d1 ...O.......O.... 00000000da36563a: 00000000 00000000 00000000 00000000 ................ 0000000001df8f1c: 00000002 00000000 00000000 00000000 ................ 0000000076a4317c: 00000000 00000000 c15deb40 ffffffff ........@.]..... 00000000b1f42fd4: 00000000 00000000 4fb305c0 ff19c7d1 ...........O.... 00000000319e29b0: 00000000 00000021 00000000 00000000 ....!........... 000000002ab04c08: 00000000 00000000 00000000 00000000 ................ 000000009243ebc9: 00000000 00000000 00000000 00000000 ................ 00000000bdcf491c: 00000000 00000000 4fb30778 ff19c7d1 ........x..O.... 00000000ead29a0e: 4fb30778 ff19c7d1 00000000 00000000 x..O............ 00000000a8067950: 00000000 00000000 00000000 00000000 ................ 0000000054212057: 00000000 00000000 00000000 00000000 ................ 000000006317dee3: c15dca60 ffffffff 00000010 00000000 `.]............. 00000000f07f8c2d: 00000000 006200ca 4fb307c8 ff19c7d1 ......b....O.... 000000006bd27d0a: 4fb307c8 ff19c7d1 00000000 00000000 ...O............ 000000005a8af1e1: 00000000 00000000 00000000 00000000 ................ 00000000100efb0c: 00000000 00000000 00000000 00000000 ................ 00000000a588813a: 00000000 00000000 4fb30808 ff19c7d1 ...........O.... 00000000559657c6: 4fb30808 ff19c7d1 00000000 00000000 ...O............ 000000000e2ea883: 1260fe95 00000000 00000000 00000000 ..`............. 0000000032bbfd35: 00000000 00000000 00000000 00000000 ................ 000000003f946141: 00000000 00000000 00000000 00000000 ................ 00000000b45ba8cc: 00000000 00000000 6982857d 00000000 ........}..i.... 000000006addf68b: 12f3aaf7 00000000 00000000 ff19c7d1 ................ 000000004efc7e92: 4fb30870 ff19c7d1 4fb30870 ff19c7d1 p..O....p..O.... 00000000ff6f6c8e: 00000000 00000000 00000000 00000000 ................ 00000000db5bf071: 00000000 00000000 00000000 00000000 ................ 00000000bd3b6d87: 4fb308a0 ff19c7d1 4fb308a0 ff19c7d1 ...O.......O.... 00000000abe14a04: 00000000 00000000 00000000 ffffffff ................ 000000000abe5b13: 00000000 ff19c7d1 00000000 00000000 ................ 000000008c2bea6c: 00000020 ff19c7d1 00000000 00000000 ............... 0000000089e0256f: 00000000 ff19c7d1 4fb308e8 ff19c7d1 ...........O.... 000000006f12464a: 4fb308e8 ff19c7d1 ffffffe0 0000000f ...O............ 00000000d70bdccb: 4fb30900 ff19c7d1 4fb30900 ff19c7d1 ...O.......O.... 0000000070228582: c157e8e0 ffffffff bc657f40 ffffffff ..W.....@.e..... 00000000d58ad6bd: 00000000 00000000 4fb307b0 ff19c7d1 ...........O.... 0000000066006190: 00000000 00000021 00000000 00000000 ....!........... 000000009fc9b7d7: 000001f0 000001f0 00000000 00000000 ................ 00000000d0dd9fa8: 00000000 00000000 00000000 00000000 ................ 000000005f2e95b7: 00000000 00000000 4fb30968 00000000 ........h..O.... 00000000d3530989: 4fb30968 ff19c7d1 h..O.... CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0 RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010 R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0 R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 647 (00000000b8361129): orphan list check failed! 00000000b8361129: 0001f30a 00000004 00000000 00000000 ................ 000000009fe2edbf: 00000004 000372de 00000000 00000000 .....r.......... 0000000081ee16a8: 00000000 00000000 00000000 00000000 ................ 00000000af9db302: 00000000 00000000 00000000 00000286 ................ 00000000ce0ae3c1: 00000000 00000000 00000000 00000001 ................ 00000000b7d93223: 4fb32fd0 ff19c7d1 4fb32fd0 ff19c7d1 ./.O...../.O.... 00000000ba292746: 00000000 00000000 00084000 80000004 .........@...... 000000001eb5500d: 00000000 00000000 4fb32ff8 ff19c7d1 ........./.O.... 00000000e82c5e89: 4fb32ff8 ff19c7d1 00000000 00000000 ./.O............ 00000000228ff5c1: 00000000 00000000 4fb30558 ff19c7d1 ........X..O.... 0000000046a35055: 4fb30ed8 ff19c7d1 00002040 00000000 ...O....@ ...... 0000000082671281: 00000000 00000000 4fb33038 ff19c7d1 ........80.O.... 000000005a70f3e3: 4fb33038 ff19c7d1 00000000 00000000 80.O............ 0000000037c00629: 00000000 00000000 00000000 00000000 ................ 00000000838a14e1: 4fb33060 ff19c7d1 4fb33060 ff19c7d1 `0.O....`0.O.... 00000000058a9b44: 00000000 00000000 00000000 00000000 ................ 00000000dc40ec5a: 000881a4 00000000 00000000 00000280 ................ 00000000b2f8c55a: 00000000 00000000 00000000 00000000 ................ 0000000094057b4e: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z.... 000000006197f1d6: 4fb331f8 ff19c7d1 427029c0 ff19c7d1 .1.O.....)pB.... 00000000b6e3b7bc: 00000287 00000000 00000001 00000000 ................ 000000003af83d16: 00002040 00000000 6982857d 00000000 @ ......}..i.... 00000000f87cff56: 00000000 00000000 6982857d 00000000 ........}..i.... 000000003f20d7f4: 00000000 00000000 6982857d 00000000 ........}..i.... 000000008acd6535: 00000000 00000000 00000000 00000000 ................ 00000000c023643a: 0000000c 00000000 00000020 00000000 ........ ....... 000000000ccab14b: 00000060 00000000 00000000 00000000 `............... 000000004ffe0279: 4fb33130 ff19c7d1 4fb33130 ff19c7d1 01.O....01.O.... 00000000c25267b8: 00000000 00000000 00000000 00000000 ................ 000000001b28972d: 001c67fc 00000001 00000000 00000000 .g.............. 000000002ffc2e6b: 00000000 00000000 00000000 00000000 ................ 00000000ecdc5796: 4fb33170 ff19c7d1 4fb33170 ff19c7d1 p1.O....p1.O.... 00000000bb541957: 00000000 00000000 00000000 00000000 ................ 0000000088059aee: 4fb33190 ff19c7d1 4fb33190 ff19c7d1 .1.O.....1.O.... 0000000032cefcb8: 4fb331a0 ff19c7d1 4fb331a0 ff19c7d1 .1.O.....1.O.... 0000000069884bba: 4fb331b0 ff19c7d1 4fb331b0 ff19c7d1 .1.O.....1.O.... 00000000799ec50a: 00000000 00000000 00000000 00000000 ................ 0000000069315ba2: 00000002 00000000 00000000 00000000 ................ 00000000fc6d2bdc: 00000000 00000000 c15deb40 ffffffff ........@.]..... 00000000d016df4c: 00000000 00000000 4fb33080 ff19c7d1 .........0.O.... 0000000035003dd6: 00000000 00000021 00000000 00000000 ....!........... 00000000742b6ed2: 00000000 00000000 00000000 00000000 ................ 000000005d89a248: 00000000 00000000 00000000 00000000 ................ 00000000017890d8: 00000000 00000000 4fb33238 ff19c7d1 ........82.O.... 000000007c281463: 4fb33238 ff19c7d1 00000000 00000000 82.O............ 000000001a39c7f0: 00000000 00000000 00000000 00000000 ................ 00000000bee8f209: 00000000 00000000 00000000 00000000 ................ 00000000e87525bb: c15dca60 ffffffff 00000010 00000000 `.]............. 00000000a7038f9c: 00000000 006200ca 4fb33288 ff19c7d1 ......b..2.O.... 00000000144d6ac4: 4fb33288 ff19c7d1 00000000 00000000 .2.O............ 00000000675957a4: 00000000 00000000 00000000 00000000 ................ 000000005a4ba571: 00000000 00000000 00000000 00000000 ................ 0000000079db2ebd: 00000000 00000000 4fb332c8 ff19c7d1 .........2.O.... 00000000d253cb0a: 4fb332c8 ff19c7d1 00000000 00000000 .2.O............ 00000000bfa2a73e: d19cb39b 00000000 00000000 00000000 ................ 000000000014e23a: 00000000 00000000 00000000 00000000 ................ 0000000080e90327: 00000000 00000000 00000000 00000000 ................ 000000009a6d6943: 00000000 ff19c7d1 6982857d 00000000 ........}..i.... 0000000070fafd2e: 1302ed3a 00000000 00000000 ff19c7d1 :............... 000000003ccbdd5e: 4fb33330 ff19c7d1 4fb33330 ff19c7d1 03.O....03.O.... 00000000bae3c0ae: 00000000 00000000 00000000 00000000 ................ 000000006a497992: 00000000 00000000 00000000 00000000 ................ 0000000099a406bc: 4fb33360 ff19c7d1 4fb33360 ff19c7d1 `3.O....`3.O.... 0000000048753999: 00000000 00000000 00000000 ffffffff ................ 00000000fee02e6d: 00000000 00000000 00000000 00000000 ................ 00000000b8ad6539: 00000020 00000000 00000000 00000000 ............... 00000000b2dbbe46: 00000000 00000000 4fb333a8 ff19c7d1 .........3.O.... 0000000025431183: 4fb333a8 ff19c7d1 ffffffe0 0000000f .3.O............ 00000000bc3b36d8: 4fb333c0 ff19c7d1 4fb333c0 ff19c7d1 .3.O.....3.O.... 000000001c74f2a5: c157e8e0 ffffffff 00000000 00000000 ..W............. 0000000026e2e67d: bc643540 ffffffff 00000010 00000000 @5d............. 00000000f558e0f6: 00000000 006200ca 00000000 00000000 ......b......... 00000000b8f8fed4: 000001f0 000001f0 00000000 00000000 ................ 000000002133b2ab: 00000000 00000000 00000000 00000000 ................ 00000000a2214dac: 00000000 00000000 00000000 00000000 ................ 00000000e20397fa: 00000000 00000000 ........ CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0 RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010 R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0 R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 648 (000000003ba7c2e2): orphan list check failed! 000000003ba7c2e2: 0001f30a 00000004 00000000 00000000 ................ 00000000063929e6: 00000004 000372e2 00000000 00000000 .....r.......... 000000004bcd1eb4: 00000000 00000000 00000000 00000000 ................ 00000000e46eaac0: 00000000 00000000 00000000 00000287 ................ 000000007185cc14: 00000000 00000000 00000000 00000001 ................ 0000000045909be1: 4fb30e90 ff19c7d1 4fb30e90 ff19c7d1 ...O.......O.... 000000009c44f3b7: 00000000 00000000 00084000 80000004 .........@...... 00000000009e7ad1: 00000000 00000000 4fb30eb8 ff19c7d1 ...........O.... 00000000bffa0358: 4fb30eb8 ff19c7d1 00000000 00000000 ...O............ 000000008e4b476e: 00000000 00000000 4fb33018 ff19c7d1 .........0.O.... 0000000048d0668a: 4fb31d18 ff19c7d1 00002040 00000000 ...O....@ ...... 00000000cc4ca4f4: 00000000 00000000 4fb30ef8 ff19c7d1 ...........O.... 00000000b8e214d7: 4fb30ef8 ff19c7d1 00000000 00000000 ...O............ 00000000cf35f2b2: 00000000 00000000 00000000 00000000 ................ 00000000c698c388: 4fb30f20 ff19c7d1 4fb30f20 ff19c7d1 ..O.... ..O.... 000000002b79cc3f: 00000000 00000000 00000000 00000000 ................ 0000000012f35321: 000881a4 00000000 00000000 00000280 ................ 00000000830023e4: 00000000 00000000 00000000 00000000 ................ 00000000ede013d8: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z.... 00000000df874d32: 4fb310b8 ff19c7d1 543a2280 ff19c7d1 ...O.....":T.... 00000000a06ac7fb: 00000288 00000000 00000001 00000000 ................ 0000000054807c0e: 00002040 00000000 6982857d 00000000 @ ......}..i.... 000000000f573280: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000f0dd8005: 00000000 00000000 6982857d 00000000 ........}..i.... 000000008f8cfb7f: 00000000 00000000 00000000 00000000 ................ 000000003c7cafac: 0000000c 00000000 00000020 00000000 ........ ....... 000000000f47a428: 00000060 00000000 00000000 00000000 `............... 00000000a4bac57d: 4fb30ff0 ff19c7d1 4fb30ff0 ff19c7d1 ...O.......O.... 0000000001d61d2a: 00000000 00000000 00000000 00000000 ................ 000000002db2f6ce: 001c67fd 00000001 00000000 00000000 .g.............. 0000000095b0a82a: 00000000 00000000 00000000 00000000 ................ 00000000049f431d: 4fb31030 ff19c7d1 4fb31030 ff19c7d1 0..O....0..O.... 00000000907eae3a: 00000000 00000000 00000000 00000000 ................ 000000009078a6ed: 4fb31050 ff19c7d1 4fb31050 ff19c7d1 P..O....P..O.... 00000000db51cfbc: 4fb31060 ff19c7d1 4fb31060 ff19c7d1 `..O....`..O.... 00000000ce1fd6f2: 4fb31070 ff19c7d1 4fb31070 ff19c7d1 p..O....p..O.... 00000000c4ac0edc: 00000000 00000000 00000000 00000000 ................ 00000000e6e36164: 00000002 00000000 00000000 00000000 ................ 000000004068a0cc: 00000000 00000000 c15deb40 ffffffff ........@.]..... 00000000c08890e2: 00000000 00000000 4fb30f40 ff19c7d1 ........@..O.... 0000000036126955: 00000000 00000021 00000000 00000000 ....!........... 00000000041d5937: 00000000 00000000 00000000 00000000 ................ 00000000c25041cf: 00000000 00000000 00000000 00000000 ................ 00000000451c3a1f: 00000000 00000000 4fb310f8 ff19c7d1 ...........O.... 0000000006f0b488: 4fb310f8 ff19c7d1 00000000 00000000 ...O............ 000000009875a544: 00000000 00000000 00000000 00000000 ................ 00000000b52beffc: 00000000 00000000 00000000 00000000 ................ 000000008c895bba: c15dca60 ffffffff 00000010 00000000 `.]............. 0000000039b7e707: 00000000 006200ca 4fb31148 ff19c7d1 ......b.H..O.... 00000000e1bf9d3c: 4fb31148 ff19c7d1 00000000 00000000 H..O............ 000000007d9412a4: 00000000 00000000 00000000 00000000 ................ 0000000067392b90: 00000000 00000000 00000000 00000000 ................ 000000001d8ae63a: 00000000 00000000 4fb31188 ff19c7d1 ...........O.... 00000000132b8ecc: 4fb31188 ff19c7d1 00000000 00000000 ...O............ 0000000073119571: 70fff939 00000000 00000000 00000000 9..p............ 00000000a1e84abd: 00000000 00000000 00000000 00000000 ................ 00000000071b7250: 00000000 00000000 00000000 00000000 ................ 0000000065e07cdb: 00000000 00000000 6982857d 00000000 ........}..i.... 000000008a9c38aa: 13122f7e 00000000 00000000 ad951e33 ~/..........3... 00000000e1c359f9: 4fb311f0 ff19c7d1 4fb311f0 ff19c7d1 ...O.......O.... 00000000ae261045: 00000000 ffffffff 00000000 00000000 ................ 0000000006745814: 00000000 00000000 00000000 00000000 ................ 00000000eb9cb80e: 4fb31220 ff19c7d1 4fb31220 ff19c7d1 ..O.... ..O.... 00000000bda29a02: 00000000 00000000 00000000 ffffffff ................ 000000006954f524: 00000000 00000000 00000000 00000000 ................ 0000000050a112e5: 00000020 00000000 00000000 00000000 ............... 000000004ec88315: 00000000 00000000 4fb31268 ff19c7d1 ........h..O.... 00000000c078f64d: 4fb31268 ff19c7d1 ffffffe0 0000000f h..O............ 00000000b649f409: 4fb31280 ff19c7d1 4fb31280 ff19c7d1 ...O.......O.... 00000000b7196ff5: c157e8e0 ffffffff 00000000 00000000 ..W............. 0000000001f29b59: 4fb312a0 ff19c7d1 4fb312a0 ff19c7d1 ...O.......O.... 00000000e40da815: 00000000 00000000 00000000 00000000 ................ 00000000ab527eec: 000001f0 000001f0 00000000 00000000 ................ 000000004dec55a8: 00000000 00000000 00000000 00000000 ................ 00000000cca1f47b: 00000000 00000000 4fb312e0 00000000 ...........O.... 000000001ba16bc8: 00000000 00000000 ........ CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0 RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010 R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0 R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 649 (00000000051cbb94): orphan list check failed! 00000000051cbb94: 0001f30a 00000004 00000000 00000000 ................ 000000005b7be891: 00000004 000372e6 00000000 00000000 .....r.......... 000000001bc43042: 00000000 00000000 00000000 00000000 ................ 00000000a14a1101: 00000000 00000000 00000000 00000288 ................ 00000000306037a4: 00000000 00000000 00000000 00000001 ................ 0000000015dadfae: 4fb31cd0 ff19c7d1 4fb31cd0 ff19c7d1 ...O.......O.... 00000000f115e3c1: 00000000 00000000 00084000 80000004 .........@...... 000000005ddd9de3: 00000000 00000000 4fb31cf8 ff19c7d1 ...........O.... 000000001083de3d: 4fb31cf8 ff19c7d1 00000000 00000000 ...O............ 0000000097a57357: 00000000 00000000 4fb30ed8 ff19c7d1 ...........O.... 00000000d1502e27: 4fb31858 ff19c7d1 00002040 00000000 X..O....@ ...... 00000000b5111347: 00000000 00000000 4fb31d38 ff19c7d1 ........8..O.... 000000006d11bca6: 4fb31d38 ff19c7d1 00000000 00000000 8..O............ 0000000005680df5: 00000000 00000000 00000000 00000000 ................ 00000000d8ee081a: 4fb31d60 ff19c7d1 4fb31d60 ff19c7d1 `..O....`..O.... 00000000a2f54e39: 00000000 00000000 00000000 00000000 ................ 00000000d0f6fe0b: 000881a4 00000000 00000000 00000280 ................ 0000000077ac0f78: 00000000 00000000 00000000 00000000 ................ 00000000595bd032: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z.... 00000000bb211b54: 4fb31ef8 ff19c7d1 543a21c0 ff19c7d1 ...O.....!:T.... 00000000d0a23882: 00000289 00000000 00000001 00000000 ................ 00000000ab21f717: 00002040 00000000 6982857d 00000000 @ ......}..i.... 0000000002770176: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000b0aa3ca2: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000b84239b9: 00000000 00000000 00000000 00000000 ................ 0000000021b6cb14: 0000000c 00000000 00000020 00000000 ........ ....... 0000000062a84e05: 00000060 00000000 00000000 00000000 `............... 00000000355e93c9: 4fb31e30 ff19c7d1 4fb31e30 ff19c7d1 0..O....0..O.... 00000000417a98b6: 00000000 00000000 00000000 00000000 ................ 000000006d701da5: 001c67fe 00000001 00000000 00000000 .g.............. 000000008298365a: 00000000 00000000 00000000 00000000 ................ 000000008865af2e: 4fb31e70 ff19c7d1 4fb31e70 ff19c7d1 p..O....p..O.... 00000000c0efe89f: 00000000 00000000 00000000 00000000 ................ 0000000049fc1b1d: 4fb31e90 ff19c7d1 4fb31e90 ff19c7d1 ...O.......O.... 000000001a7134db: 4fb31ea0 ff19c7d1 4fb31ea0 ff19c7d1 ...O.......O.... 0000000028f9c38a: 4fb31eb0 ff19c7d1 4fb31eb0 ff19c7d1 ...O.......O.... 000000008d4919c3: 00000000 00000000 00000000 00000000 ................ 00000000a0eef8db: 00000002 00000000 00000000 00000000 ................ 00000000a8c849d0: 00000000 00000000 c15deb40 ffffffff ........@.]..... 00000000da6644b7: 00000000 00000000 4fb31d80 ff19c7d1 ...........O.... 00000000ba530495: 00000000 00000021 00000000 00000000 ....!........... 00000000539db65d: 00000000 00000000 00000000 00000000 ................ 000000002a62ba52: 00000000 00000000 00000000 00000000 ................ 000000006067d0b7: 00000000 00000000 4fb31f38 ff19c7d1 ........8..O.... 000000008ca4cde5: 4fb31f38 ff19c7d1 00000000 00000000 8..O............ 00000000afef9335: 00000000 00000000 00000000 00000000 ................ 0000000052416736: 00000000 00000000 00000000 00000000 ................ 000000001d9d92b6: c15dca60 ffffffff 00000010 00000000 `.]............. 0000000080284243: 00000000 006200ca 4fb31f88 ff19c7d1 ......b....O.... 000000001064e676: 4fb31f88 ff19c7d1 00000000 00000000 ...O............ 000000003f3c4bd2: 00000000 00000000 00000000 00000000 ................ 00000000ea22dea3: 00000000 00000000 00000000 00000000 ................ 000000002a66a5fe: 00000000 00000000 4fb31fc8 ff19c7d1 ...........O.... 00000000077158bf: 4fb31fc8 ff19c7d1 00000000 00000000 ...O............ 000000009a066da4: 480a43a4 00000000 00000000 00000000 .C.H............ 00000000dfd8f5d4: 00000000 00000000 00000000 00000000 ................ 00000000756986af: 00000000 00000000 00000000 00000000 ................ 000000002e574390: 00000000 ffffffff 6982857d 00000000 ........}..i.... 00000000980337a4: 132171c2 00000000 00000000 ff19c7d1 .q!............. 00000000e3a16f8e: 4fb32030 ff19c7d1 4fb32030 ff19c7d1 0 .O....0 .O.... 00000000b29fafa1: 00000000 00000000 00000000 00000000 ................ 00000000e21ded6a: 00000000 00000000 00000000 00000000 ................ 0000000076434a52: 4fb32060 ff19c7d1 4fb32060 ff19c7d1 ` .O....` .O.... 00000000769f0c75: 00000000 00000000 00000000 ffffffff ................ 00000000a10a633e: 00000000 00000000 00000000 00000000 ................ 00000000a2c37ae7: 00000020 00000000 00000000 00000000 ............... 00000000dd52162d: 00000000 00000000 4fb320a8 ff19c7d1 ......... .O.... 00000000297f353e: 4fb320a8 ff19c7d1 ffffffe0 0000000f . .O............ 00000000b7918963: 4fb320c0 ff19c7d1 4fb320c0 ff19c7d1 . .O..... .O.... 00000000b12d0477: c157e8e0 ffffffff 00000000 00000000 ..W............. 00000000ae8339fb: 00000000 00000000 00000000 00000000 ................ 000000008148d559: 4fb320f0 ff19c7d1 00000000 00000000 . .O............ 0000000071d2b40c: 000001f0 000001f0 00000000 00000000 ................ 000000004b16e41e: 00000000 00000000 00000000 00000000 ................ 00000000243fda1e: 00000000 00000000 4fb32120 00000000 ........ !.O.... 0000000019e85ffc: 4fb32130 ff19c7d1 0!.O.... CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0 RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010 R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0 R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 650 (0000000096a55d6e): orphan list check failed! 0000000096a55d6e: 0001f30a 00000004 00000000 00000000 ................ 000000007864a03b: 00000004 000372ea 00000000 00000000 .....r.......... 000000005cccc1ee: 00000000 00000000 00000000 00000000 ................ 00000000b9290921: 00000000 00000000 00000000 00000289 ................ 000000006507fa08: 00000000 00000000 00000000 00000001 ................ 000000008540ae4f: 4fb31810 ff19c7d1 4fb31810 ff19c7d1 ...O.......O.... 00000000582aa200: 00000000 00000000 00084000 80000004 .........@...... 00000000d17dabf4: 00000000 00000000 4fb31838 ff19c7d1 ........8..O.... 00000000973098a5: 4fb31838 ff19c7d1 00000000 00000000 8..O............ 0000000031b7e127: 00000000 00000000 4fb31d18 ff19c7d1 ...........O.... 00000000d8eb576c: 4faef998 ff19c7d1 00002040 00000000 ...O....@ ...... 00000000820f8182: 00000000 00000000 4fb31878 ff19c7d1 ........x..O.... 0000000032b65e12: 4fb31878 ff19c7d1 00000000 00000000 x..O............ 00000000f35c8d2a: 00000000 00000000 00000000 00000000 ................ 000000004b2487ba: 4fb318a0 ff19c7d1 4fb318a0 ff19c7d1 ...O.......O.... 000000008dfb7fb1: 00000000 00000000 00000000 00000000 ................ 0000000013111064: 000881a4 00000000 00000000 00000280 ................ 00000000f61cee04: 00000000 00000000 00000000 00000000 ................ 000000002a02fa34: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z.... 00000000b4f8bbdb: 4fb31a38 ff19c7d1 5e25f900 ff19c7d1 8..O......%^.... 000000000a4a0d99: 0000028a 00000000 00000001 00000000 ................ 00000000942f3989: 00002040 00000000 6982857d 00000000 @ ......}..i.... 00000000c0d55e59: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000070de36d: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000ea873d42: 00000000 00000000 00000000 00000000 ................ 00000000ffb4d8af: 0000000c 00000000 00000020 00000000 ........ ....... 000000006a0b6439: 00000060 00000000 00000000 00000000 `............... 000000003efa7a00: 4fb31970 ff19c7d1 4fb31970 ff19c7d1 p..O....p..O.... 000000002a945c11: 00000000 00000000 00000000 00000000 ................ 00000000788ab9ac: 001c67ff 00000001 00000000 00000000 .g.............. 0000000080ae2f1b: 00000000 00000000 00000000 00000000 ................ 0000000027c0d86e: 4fb319b0 ff19c7d1 4fb319b0 ff19c7d1 ...O.......O.... 00000000752dfeec: 00000000 00000000 00000000 00000000 ................ 000000000e96f2e0: 4fb319d0 ff19c7d1 4fb319d0 ff19c7d1 ...O.......O.... 00000000a88d2221: 4fb319e0 ff19c7d1 4fb319e0 ff19c7d1 ...O.......O.... 000000002ddf2506: 4fb319f0 ff19c7d1 4fb319f0 ff19c7d1 ...O.......O.... 0000000093b31cea: 00000000 00000000 00000000 00000000 ................ 00000000d05b6331: 00000002 00000000 00000000 00000000 ................ 000000009fbffb35: 00000000 00000000 c15deb40 ffffffff ........@.]..... 00000000b09e813e: 00000000 00000000 4fb318c0 ff19c7d1 ...........O.... 00000000fa908ee7: 00000000 00000021 00000000 00000000 ....!........... 000000000d5d408c: 00000000 00000000 00000000 00000000 ................ 00000000c150294c: 00000000 00000000 00000000 00000000 ................ 000000004996c981: 00000000 00000000 4fb31a78 ff19c7d1 ........x..O.... 00000000a6ddcca4: 4fb31a78 ff19c7d1 00000000 00000000 x..O............ 000000002676fa85: 00000000 00000000 00000000 00000000 ................ 000000000861f0ac: 00000000 00000000 00000000 00000000 ................ 000000000be0b7b0: c15dca60 ffffffff 00000010 00000000 `.]............. 00000000d325d280: 00000000 006200ca 4fb31ac8 ff19c7d1 ......b....O.... 0000000079cfdf20: 4fb31ac8 ff19c7d1 00000000 00000000 ...O............ 00000000bad4b906: 00000000 00000000 00000000 00000000 ................ 00000000f78db0aa: 00000000 00000000 00000000 00000000 ................ 000000004ac909b1: 00000000 00000000 4fb31b08 ff19c7d1 ...........O.... 0000000050cf5526: 4fb31b08 ff19c7d1 00000000 00000000 ...O............ 00000000782e1383: 3e4f0914 00000000 00000000 00000000 ..O>............ 00000000fdc968ad: 00000000 00000000 00000000 00000000 ................ 0000000064335d23: 00000000 00000000 00000000 00000000 ................ 0000000047a3d10f: 00000000 00000000 6982857d 00000000 ........}..i.... 000000005021bb40: 1330b406 00000000 00000000 00000000 ..0............. 00000000d286a099: 4fb31b70 ff19c7d1 4fb31b70 ff19c7d1 p..O....p..O.... 0000000087c166be: 00000000 00000000 00000000 00000000 ................ 00000000fd1c7a69: 00000000 00000000 00000000 00000000 ................ 0000000035e4ff33: 4fb31ba0 ff19c7d1 4fb31ba0 ff19c7d1 ...O.......O.... 000000005f86de63: 00000000 00000000 00000000 ffffffff ................ 0000000070acf85a: 00000000 00000000 00000000 00000000 ................ 000000001adae621: 00000020 00000000 00000000 00000000 ............... 00000000c8c60dce: 00000000 00000000 4fb31be8 ff19c7d1 ...........O.... 00000000da6dd9ef: 4fb31be8 ff19c7d1 ffffffe0 0000000f ...O............ 000000001daaf481: 4fb31c00 ff19c7d1 4fb31c00 ff19c7d1 ...O.......O.... 0000000025f9dff8: c157e8e0 ffffffff 00000000 00000000 ..W............. 000000002ca9b2c9: 00000000 00000000 b42a20f1 6d981e33 ......... *.3..m 00000000ad17d2e4: 00048080 00000000 00000000 00000000 ................ 000000000021722c: 000001f0 000001f0 00000000 00000000 ................ 00000000e27aae01: 00000000 00000000 00000000 00000000 ................ 000000002ac81e4b: 00000000 00000000 5e325480 00000000 .........T2^.... 0000000007b55e98: 00043876 00000000 v8...... CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0 RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010 R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0 R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 651 (0000000048b958ef): orphan list check failed! 0000000048b958ef: 0001f30a 00000004 00000000 00000000 ................ 00000000720b3337: 00000004 000372ee 00000000 00000000 .....r.......... 000000003f6c1355: 00000000 00000000 00000000 00000000 ................ 00000000597be6d7: 00000000 00000000 00000000 0000028a ................ 0000000036014be9: 00000000 00000000 00000000 00000001 ................ 000000003cac5b1a: 4faef950 ff19c7d1 4faef950 ff19c7d1 P..O....P..O.... 00000000d6486928: 00000000 00000000 00084000 80000004 .........@...... 00000000f94730f9: 00000000 00000000 4faef978 ff19c7d1 ........x..O.... 00000000193747eb: 4faef978 ff19c7d1 00000000 00000000 x..O............ 00000000e72a03d4: 00000000 00000000 4fb31858 ff19c7d1 ........X..O.... 000000009d53f4f7: 4faee1d8 ff19c7d1 00002040 00000000 ...O....@ ...... 0000000064cb4839: 00000000 00000000 4faef9b8 ff19c7d1 ...........O.... 00000000ad80ba14: 4faef9b8 ff19c7d1 00000000 00000000 ...O............ 0000000079c554d7: 00000000 00000000 00000000 00000000 ................ 0000000054238928: 4faef9e0 ff19c7d1 4faef9e0 ff19c7d1 ...O.......O.... 0000000021cec261: 00000000 00000000 00000000 00000000 ................ 0000000000752f26: 000881a4 00000000 00000000 00000280 ................ 000000005977829f: 00000000 00000000 00000000 00000000 ................ 000000002d10c8b4: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z.... 0000000057828af5: 4faefb78 ff19c7d1 5e25fc00 ff19c7d1 x..O......%^.... 000000009101ebc1: 0000028b 00000000 00000001 00000000 ................ 00000000df3c316b: 00002040 00000000 6982857d 00000000 @ ......}..i.... 0000000081a1407f: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000bba7486a: 00000000 00000000 6982857d 00000000 ........}..i.... 0000000022870782: 00000000 00000000 00000000 00000000 ................ 000000003b46ff10: 0000000c 00000000 00000020 00000000 ........ ....... 000000008ee6379c: 00000060 00000000 00000000 00000000 `............... 000000006ec2d411: 4faefab0 ff19c7d1 4faefab0 ff19c7d1 ...O.......O.... 00000000024590fb: 00000000 00000000 00000000 00000000 ................ 0000000010914d23: 001c6800 00000001 00000000 00000000 .h.............. 000000007ba907c8: 00000000 00000000 00000000 00000000 ................ 00000000a8dfa206: 4faefaf0 ff19c7d1 4faefaf0 ff19c7d1 ...O.......O.... 000000002afb7fa8: 00000000 00000000 00000000 00000000 ................ 00000000c412da35: 4faefb10 ff19c7d1 4faefb10 ff19c7d1 ...O.......O.... 00000000186be3dd: 4faefb20 ff19c7d1 4faefb20 ff19c7d1 ..O.... ..O.... 000000000112a8a2: 4faefb30 ff19c7d1 4faefb30 ff19c7d1 0..O....0..O.... 000000000c19754c: 00000000 00000000 00000000 00000000 ................ 0000000030b4acfe: 00000002 00000000 00000000 00000000 ................ 000000005ae1e057: 00000000 00000000 c15deb40 ffffffff ........@.]..... 000000008fb1e8b7: 00000000 00000000 4faefa00 ff19c7d1 ...........O.... 0000000051569afd: 00000000 00000021 00000000 00000000 ....!........... 000000007274fcda: 00000000 00000000 00000000 00000000 ................ 000000002b81b4de: 00000000 00000000 00000000 00000000 ................ 000000002c4b4665: 00000000 00000000 4faefbb8 ff19c7d1 ...........O.... 000000007a78da73: 4faefbb8 ff19c7d1 00000000 00000000 ...O............ 000000001d801c72: 00000000 00000000 00000000 00000000 ................ 00000000790e6759: 00000000 00000000 00000000 00000000 ................ 00000000ebbbffa0: c15dca60 ffffffff 00000010 00000000 `.]............. 00000000610ef8a8: 00000000 006200ca 4faefc08 ff19c7d1 ......b....O.... 000000005a23b488: 4faefc08 ff19c7d1 00000000 00000000 ...O............ 00000000476ee6ad: 00000000 00000000 00000000 00000000 ................ 00000000f912482a: 00000000 00000000 00000000 00000000 ................ 0000000079124f63: 00000000 00000000 4faefc48 ff19c7d1 ........H..O.... 00000000afde248c: 4faefc48 ff19c7d1 00000000 00000000 H..O............ 00000000ddfc1ddd: ea437795 00000000 00000000 00000000 .wC............. 00000000cf9d1cb2: 00000000 00000000 00000000 00000000 ................ 0000000060ca7326: 00000000 00000000 00000000 00000000 ................ 0000000053ed9716: 00000000 00000000 6982857d 00000000 ........}..i.... 000000001c15bb3d: 133ff649 00000000 00000000 00000000 I.?............. 000000000704f796: 4faefcb0 ff19c7d1 4faefcb0 ff19c7d1 ...O.......O.... 00000000ddab11aa: 00000000 00000000 00000000 00000000 ................ 00000000fcecf899: 00000000 00000000 00000000 00000000 ................ 00000000db8c0dae: 4faefce0 ff19c7d1 4faefce0 ff19c7d1 ...O.......O.... 0000000032668b0a: 00000000 00000000 00000000 ffffffff ................ 00000000cc6ef532: 00000000 00000000 00000000 00000000 ................ 0000000028cb991b: 00000020 00000000 00000000 00000000 ............... 00000000abf344ba: 00000000 ff19c7d1 4faefd28 ff19c7d1 ........(..O.... 000000001f067d6e: 4faefd28 ff19c7d1 ffffffe0 0000000f (..O............ 000000001b198ad0: 4faefd40 ff19c7d1 4faefd40 ff19c7d1 @..O....@..O.... 0000000020823a1c: c157e8e0 ffffffff 4faefd50 ff19c7d1 ..W.....P..O.... 00000000867ea328: 4faefd60 ff19c7d1 4faefd60 ff19c7d1 `..O....`..O.... 00000000fc255883: 4fa96ef0 ff19c7d1 00000000 00000000 .n.O............ 00000000ad283562: 000001f0 000001f0 00000000 00000000 ................ 00000000d2eaf928: 00000000 00000000 00000000 00000000 ................ 000000007defd392: 00000000 00000000 4faefc30 00000000 ........0..O.... 00000000483b557e: 00000000 00000021 ....!... CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0 RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010 R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0 R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 652 (00000000883b74e0): orphan list check failed! 00000000883b74e0: 0001f30a 00000004 00000000 00000000 ................ 00000000375125f0: 00000004 000372f2 00000000 00000000 .....r.......... 00000000d6b46257: 00000000 00000000 00000000 00000000 ................ 000000001d643f09: 00000000 00000000 00000000 0000028b ................ 00000000632a5f8b: 00000000 00000000 00000000 00000001 ................ 00000000459a1071: 4faee190 ff19c7d1 4faee190 ff19c7d1 ...O.......O.... 0000000095c747de: 00000000 00000000 00084000 80000004 .........@...... 000000002b066f50: 00000000 00000000 4faee1b8 ff19c7d1 ...........O.... 00000000126afc32: 4faee1b8 ff19c7d1 00000000 00000000 ...O............ 000000009d2c52e9: 00000000 00000000 4faef998 ff19c7d1 ...........O.... 0000000068cbdc45: 6dbb9720 ff19c7d1 00002040 00000000 ..m....@ ...... 000000007aef869b: 00000000 00000000 4faee1f8 ff19c7d1 ...........O.... 00000000ae94ecf5: 4faee1f8 ff19c7d1 00000000 00000000 ...O............ 0000000024fc8ed1: 00000000 00000000 00000000 00000000 ................ 000000004ccfeef0: 4faee220 ff19c7d1 4faee220 ff19c7d1 ..O.... ..O.... 0000000053e61dd7: 00000000 00000000 00000000 00000000 ................ 000000003433fd67: 000881a4 00000000 00000000 00000280 ................ 000000002764dd5a: 00000000 00000000 00000000 00000000 ................ 0000000065e583a5: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z.... 0000000073fc9bbf: 4faee3b8 ff19c7d1 5e25f9c0 ff19c7d1 ...O......%^.... 000000005ac7e4ce: 0000028c 00000000 00000001 00000000 ................ 0000000099568b1b: 00002040 00000000 6982857d 00000000 @ ......}..i.... 000000007928114e: 00000000 00000000 6982857d 00000000 ........}..i.... 0000000089927763: 00000000 00000000 6982857d 00000000 ........}..i.... 000000008f5f2692: 00000000 00000000 00000000 00000000 ................ 00000000bffe1bb0: 0000000c 00000000 00000020 00000000 ........ ....... 00000000787fa84a: 00000060 00000000 00000000 00000000 `............... 00000000bb50f68f: 4faee2f0 ff19c7d1 4faee2f0 ff19c7d1 ...O.......O.... 0000000097e69499: 00000000 00000000 00000000 00000000 ................ 00000000f6148914: 001c6801 00000001 00000000 00000000 .h.............. 00000000eb26c406: 00000000 00000000 00000000 00000000 ................ 00000000a10d6523: 4faee330 ff19c7d1 4faee330 ff19c7d1 0..O....0..O.... 00000000f709a69b: 00000000 00000000 00000000 00000000 ................ 000000003dabf151: 4faee350 ff19c7d1 4faee350 ff19c7d1 P..O....P..O.... 000000000adfdc4b: 4faee360 ff19c7d1 4faee360 ff19c7d1 `..O....`..O.... 000000001d36d5e0: 4faee370 ff19c7d1 4faee370 ff19c7d1 p..O....p..O.... 000000002181e967: 00000000 00000000 00000000 00000000 ................ 00000000064a8d1a: 00000002 00000000 00000000 00000000 ................ 00000000f72498dc: 00000000 00000000 c15deb40 ffffffff ........@.]..... 00000000e35fcf84: 00000000 00000000 4faee240 ff19c7d1 ........@..O.... 0000000046f38361: 00000000 00000021 00000000 00000000 ....!........... 00000000f839b790: 00000000 00000000 00000000 00000000 ................ 00000000063710ff: 00000000 00000000 00000000 00000000 ................ 00000000a8780071: 00000000 00000000 4faee3f8 ff19c7d1 ...........O.... 000000005beee1ae: 4faee3f8 ff19c7d1 00000000 00000000 ...O............ 000000009e7024cd: 00000000 00000000 00000000 00000000 ................ 00000000063ca87e: 00000000 00000000 00000000 00000000 ................ 000000009d3f4e1f: c15dca60 ffffffff 00000010 00000000 `.]............. 00000000631a583c: 00000000 006200ca 4faee448 ff19c7d1 ......b.H..O.... 00000000857556c2: 4faee448 ff19c7d1 00000000 00000000 H..O............ 00000000a0c9ace4: 00000000 00000000 00000000 00000000 ................ 00000000d60f1979: 00000000 00000000 00000000 00000000 ................ 000000004547defc: 00000000 00000000 4faee488 ff19c7d1 ...........O.... 000000005f9c97de: 4faee488 ff19c7d1 00000000 00000000 ...O............ 00000000895b5e06: caa89bbb 00000000 00000000 00000000 ................ 00000000b4013d11: 00000000 00000000 00000000 00000000 ................ 00000000c87ddaba: 00000000 00000000 00000000 00000000 ................ 000000006ea361b0: 00000000 00000000 6982857d 00000000 ........}..i.... 00000000b720280d: 134f388d 00000000 00000000 00000000 .8O............. 0000000002aad829: 4faee4f0 ff19c7d1 4faee4f0 ff19c7d1 ...O.......O.... 00000000ea300293: 00000000 00000000 00000000 00000000 ................ 00000000138ab811: 00000000 00000000 00000000 00000000 ................ 000000001fa23a70: 4faee520 ff19c7d1 4faee520 ff19c7d1 ..O.... ..O.... 00000000f705a7dc: 00000000 00000000 00000000 ffffffff ................ 0000000075225c1e: 00000000 ffffffff 00000000 00000000 ................ 0000000027cee4e2: 00000020 ff19c7d1 00000000 00000000 ............... 000000007d710a4c: 00000000 00000000 4faee568 ff19c7d1 ........h..O.... 0000000080c0b086: 4faee568 ff19c7d1 ffffffe0 0000000f h..O............ 00000000595243de: 4faee580 ff19c7d1 4faee580 ff19c7d1 ...O.......O.... 000000003ff62cb8: c157e8e0 ffffffff 69828518 00000000 ..W........i.... 00000000484b2936: 387af90c 00000000 00000000 00000000 ..z8............ 00000000b76a4d90: 0000000c 00000000 00000000 00000000 ................ 00000000367652be: 000001f0 000001f0 00000000 00000000 ................ 000000004d036ba8: 00000000 00000000 00000000 00000000 ................ 00000000b7c542d3: 00000000 00000000 00000000 00000000 ................ 0000000002c5b245: 00000000 00000000 ........ CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] ? srso_alias_return_thunk+0x5/0xfcdfd osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.33+0x8e/0x280 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? class_disconnect_exports+0x2d6/0x2f0 [obdclass] class_cleanup+0x326/0x7d0 [obdclass] class_process_config+0x3bb/0x2040 [obdclass] ? srso_alias_return_thunk+0x5/0xfcdfd ? __kmalloc+0x113/0x250 class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x10a/0x570 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x14a0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfcdfd ? fsnotify_sb_delete+0x138/0x1c0 ? __dentry_kill+0x121/0x170 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xf4/0x100 do_syscall_64+0x1cb/0x1d0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7fd6a7d968fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0 RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010 R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0 R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): sb orphan head is 652 sb_info orphan list: inode dm-3:652 at 000000003433fd67: mode 100644, nlink 1, next 651 inode dm-3:651 at 0000000000752f26: mode 100644, nlink 1, next 650 inode dm-3:650 at 0000000013111064: mode 100644, nlink 1, next 649 inode dm-3:649 at 00000000d0f6fe0b: mode 100644, nlink 1, next 648 inode dm-3:648 at 0000000012f35321: mode 100644, nlink 1, next 647 inode dm-3:647 at 00000000dc40ec5a: mode 100644, nlink 1, next 646 inode dm-3:646 at 00000000860da577: mode 100644, nlink 1, next 645 inode dm-3:645 at 0000000005dd4dd0: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |
| sanity test 257: xattr locks are not lost | kernel BUG at /tmp/rpmbuild-lustre-jenkins-xWFq17Cn/BUILD/lustre-2.16.61_40_g0660e94/ldiskfs/super.c:1186! invalid opcode: 0000 [#1] SMP PTI CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af RSP: 0018:ffffa8ae49ac7a78 EFLAGS: 00010216 RAX: ffff95e05ef2d398 RBX: ffff95e07d392720 RCX: 0000000000000000 RDX: 0000000000000000 RSI: ffff95e17bd1e698 RDI: ffff95e17bd1e698 RBP: ffff95e07d392000 R08: 0000000000000000 R09: c0000000ffff7fff R10: 0000000000000001 R11: ffffa8ae49ac7890 R12: ffff95e07d392720 R13: ffff95e142c8d800 R14: ffffffffc12d6218 R15: ffff95e0a8dddf40 FS: 00007f983496d080(0000) GS:ffff95e17bd00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00005598bbc8d838 CR3: 000000001ddfc001 CR4: 00000000001706e0 Call Trace: ? __die_body+0x1a/0x60 ? die+0x2a/0x50 ? do_trap+0xe7/0x110 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? do_invalid_op+0x36/0x40 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] ? invalid_op+0x14/0x20 ? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs] generic_shutdown_super+0x6c/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb | Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0x80000161 Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1 Lustre: Failing over lustre-MDT0000 LustreError: 806297:0:(osd_handler.c:2458:osd_drop_preallocated_space()) lustre-MDT0000: can't truncate: rc=-30 LustreError: 775124:0:(llog_cat.c:443:llog_cat_close()) lustre-OST0000-osc-MDT0000: failure destroying log during cleanup: rc = -30 LustreError: 775124:0:(llog_cat.c:443:llog_cat_close()) Skipped 3 previous similar messages LustreError: 806297:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup LustreError: 806297:0:(obd_class.h:479:obd_check_dev()) Skipped 23 previous similar messages LDISKFS-fs (dm-3): Inode 213 (000000002ce492e7): orphan list check failed! 000000002ce492e7: 0001f30a 00000004 00000000 00000000 ................ 00000000ea2e1939: 00000004 00038a2d 00000000 00000000 ....-........... 0000000073b11470: 00000000 00000000 00000000 00000000 ................ 000000006d89151b: 00000000 00000000 00000000 00000000 ................ 00000000e5f9d754: 00000000 00000000 00000000 00000001 ................ 0000000092808c84: 54f0d350 ffff95e0 54f0d350 ffff95e0 P..T....P..T.... 0000000080f95d5f: 00000000 00000000 00084000 80000004 .........@...... 000000007be0976f: 00000000 00000000 54f0d378 ffff95e0 ........x..T.... 000000007f13d503: 54f0d378 ffff95e0 00000000 00000000 x..T............ 0000000099d6a43d: 00000000 00000000 7d392720 ffff95e0 ........ '9}.... 00000000d1f98eb6: 54f0f4d8 ffff95e0 00002400 00000000 ...T.....$...... 00000000e9564a15: 00000000 00000000 54f0d3b8 ffff95e0 ...........T.... 00000000a93ed055: 54f0d3b8 ffff95e0 00000000 00000000 ...T............ 00000000331101e2: 00000000 00000000 00000000 00000000 ................ 000000004d82d6e4: 54f0d3e0 ffff95e0 54f0d3e0 ffff95e0 ...T.......T.... 0000000082046a26: 00000000 00000000 00000000 00000000 ................ 000000007789655b: 000881a4 00000000 00000000 00000080 ................ 00000000bab06023: 00000000 00000000 00000000 00000000 ................ 00000000e9b1a590: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 000000005ccd11df: 54f0d578 ffff95e0 7c926c40 ffff95e0 x..T....@l.|.... 00000000cddb6daa: 000000d5 00000000 00000001 00000000 ................ 00000000cb957b04: 00002400 00000000 691ccee5 00000000 .$.........i.... 0000000032d6b6bd: 00000000 00000000 691ccf36 00000000 ........6..i.... 0000000033d24073: 00000000 00000000 691ccee5 00000000 ...........i.... 000000002412a55c: 00000000 00000000 00000000 00000000 ................ 00000000313adf93: 0000000c 00000000 00000020 00000000 ........ ....... 000000003f8c0133: 00000060 00000000 00000000 00000000 `............... 00000000cedc653d: 54f0d4b0 ffff95e0 54f0d4b0 ffff95e0 ...T.......T.... 00000000ffbf3cb3: 00000000 00000000 00000000 00000000 ................ 000000004316b164: 00a08ae0 00000001 00000000 00000000 ................ 0000000037530aa4: 00000000 00000000 00000000 00000000 ................ 0000000027dede92: 54f0d4f0 ffff95e0 54f0d4f0 ffff95e0 ...T.......T.... 00000000adfecf9a: 00000000 00000000 00000000 00000000 ................ 00000000a5fb0e95: 54f0d510 ffff95e0 54f0d510 ffff95e0 ...T.......T.... 00000000ef5d5d86: 54f0d520 ffff95e0 54f0d520 ffff95e0 ..T.... ..T.... 000000004312f25f: 54f0d530 ffff95e0 54f0d530 ffff95e0 0..T....0..T.... 000000002ae903f9: 00000000 00000000 00000000 00000000 ................ 00000000b3036504: 00000002 00000000 00000000 00000000 ................ 000000007a847b4c: 00000000 00000000 c12d0100 ffffffff ..........-..... 0000000042ec2d42: 00000000 00000000 54f0d400 ffff95e0 ...........T.... 00000000520dd9ca: 00000000 00000021 00000000 00000000 ....!........... 0000000015ea23a0: 00000000 00000000 00000000 00000000 ................ 000000001d79296f: 00000000 00000000 00000000 00000000 ................ 00000000ee9cb434: 00000000 00000000 54f0d5b8 ffff95e0 ...........T.... 0000000087e44304: 54f0d5b8 ffff95e0 00000000 00000000 ...T............ 000000002c1432ad: 00000000 00000000 00000000 00000000 ................ 00000000a3b92a66: 00000000 00000000 00000000 00000000 ................ 00000000788ccde0: c12d0ba0 ffffffff 00000010 00000000 ..-............. 000000008895fadb: 00000000 006200ca 54f0d608 ffff95e0 ......b....T.... 00000000453856ce: 54f0d608 ffff95e0 00000000 00000000 ...T............ 00000000fbae9779: 00000000 00000000 00000000 00000000 ................ 000000003d020e3d: 00000000 00000000 00000000 00000000 ................ 0000000091804ac9: 00000000 00000000 54f0d648 ffff95e0 ........H..T.... 000000009d5973b9: 54f0d648 ffff95e0 00000000 00000000 H..T............ 00000000f1075a10: 915f82a4 00000000 00000000 00000000 .._............. 00000000d09a15d8: 00000000 00000000 00000000 00000000 ................ 0000000031b442a0: 00000000 00000000 00000000 00000000 ................ 00000000af166f6b: 00000000 00000000 691ccee5 00000000 ...........i.... 00000000213b1e04: 3185b268 00000000 00000000 00000000 h..1............ 00000000e06828aa: 54f0d6b0 ffff95e0 54f0d6b0 ffff95e0 ...T.......T.... 00000000980f4e79: 00000000 ffff95e0 00000000 00000000 ................ 00000000b12bf7a0: 00000000 00000000 00000000 00000000 ................ 0000000090ec5357: 54f0d6e0 ffff95e0 54f0d6e0 ffff95e0 ...T.......T.... 00000000b49569f6: 00000000 00000000 00000000 ffffffff ................ 00000000fb5c9dd5: 00000000 00000000 00000000 00000000 ................ 000000000de3c126: 00000020 00000000 00000000 00000000 ............... 000000006e902942: 00000000 ffffffff 54f0d728 ffff95e0 ........(..T.... 00000000ef6b6f70: 54f0d728 ffff95e0 ffffffe0 0000000f (..T............ 0000000074962f89: 54f0d740 ffff95e0 54f0d740 ffff95e0 @..T....@..T.... 00000000c5c683a2: c1277db0 ffffffff 00000000 00000000 .}'............. 00000000ec2495cf: 691ccadd 00000000 3900a3bc 00000000 ...i.......9.... 000000001e7c64a1: 691ccadd 00000000 00000000 00000000 ...i............ 000000009161ac4b: 00001b7c 00001b7c 00000000 00000000 |...|........... 00000000aea19de1: 00000000 00000000 00000000 00000000 ................ 00000000c581e76f: 00000000 00000000 00000060 00000000 ........`....... 00000000e426296d: 00000000 00000000 ........ CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 274 (00000000c892ffad): orphan list check failed! 00000000c892ffad: 0001f30a 00000004 00000000 00000000 ................ 00000000d4ff1fbf: 00000004 00038a31 00000000 00000000 ....1........... 00000000b436e146: 00000000 00000000 00000000 00000000 ................ 000000006278d98e: 00000000 00000000 00000000 000000d5 ................ 00000000e597f19c: 00000000 00000000 00000000 00000001 ................ 00000000c113043d: 54f0f490 ffff95e0 54f0f490 ffff95e0 ...T.......T.... 0000000061b1fa61: 00000000 00000000 00084000 80000004 .........@...... 0000000056bfe9f2: 00000000 00000000 54f0f4b8 ffff95e0 ...........T.... 00000000ad46f8fd: 54f0f4b8 ffff95e0 00000000 00000000 ...T............ 00000000d1c82c51: 00000000 00000000 54f0d398 ffff95e0 ...........T.... 00000000b4e35d44: 54f0f998 ffff95e0 00002400 00000000 ...T.....$...... 0000000040903d0a: 00000000 00000000 54f0f4f8 ffff95e0 ...........T.... 00000000395d021d: 54f0f4f8 ffff95e0 00000000 00000000 ...T............ 000000007496a44d: 00000000 00000000 00000000 00000000 ................ 0000000092ac4d0b: 54f0f520 ffff95e0 54f0f520 ffff95e0 ..T.... ..T.... 00000000e4055535: 00000000 00000000 00000000 00000000 ................ 00000000b047a7e0: 000881a4 00000000 00000000 00000080 ................ 00000000b3da6988: 00000000 00000000 00000000 00000000 ................ 0000000008cee986: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 000000006329ccc0: 54f0f6b8 ffff95e0 52862840 ffff95e0 ...T....@(.R.... 000000005b058486: 00000112 00000000 00000001 00000000 ................ 000000005e6e93fb: 00002400 00000000 691ccee5 00000000 .$.........i.... 00000000e6a7245a: 00000000 00000000 691ccf31 00000000 ........1..i.... 00000000d10e80be: 00000000 00000000 691ccee5 00000000 ...........i.... 00000000ba4ef7ae: 00000000 00000000 00000000 00000000 ................ 00000000a51737ff: 0000000c 00000000 00000020 00000000 ........ ....... 0000000093985b7a: 00000060 00000000 00000000 00000000 `............... 00000000d627566a: 54f0f5f0 ffff95e0 54f0f5f0 ffff95e0 ...T.......T.... 000000000cd0f16d: 00000000 00000000 00000000 00000000 ................ 000000007f8f264e: 00a08ae4 00000001 00000000 00000000 ................ 000000005a1216e4: 00000000 00000000 00000000 00000000 ................ 00000000364934ff: 54f0f630 ffff95e0 54f0f630 ffff95e0 0..T....0..T.... 00000000e850f010: 00000000 00000000 00000000 00000000 ................ 00000000a213ff6f: 54f0f650 ffff95e0 54f0f650 ffff95e0 P..T....P..T.... 0000000008af9bfe: 54f0f660 ffff95e0 54f0f660 ffff95e0 `..T....`..T.... 00000000db1e82fc: 54f0f670 ffff95e0 54f0f670 ffff95e0 p..T....p..T.... 0000000031821b21: 00000000 00000000 00000000 00000000 ................ 00000000be7408f2: 00000002 00000000 00000000 00000000 ................ 00000000c185a751: 00000000 00000000 c12d0100 ffffffff ..........-..... 00000000e98f1400: 00000000 00000000 54f0f540 ffff95e0 ........@..T.... 00000000b108df54: 00000000 00000021 00000000 00000000 ....!........... 000000002961c8f0: 00000000 00000000 00000000 00000000 ................ 00000000a247ca83: 00000000 00000000 00000000 00000000 ................ 0000000089e0bbd9: 00000000 00000000 54f0f6f8 ffff95e0 ...........T.... 000000008e0f3853: 54f0f6f8 ffff95e0 00000000 00000000 ...T............ 000000001280a341: 00000000 00000000 00000000 00000000 ................ 00000000973961cc: 00000000 00000000 00000000 00000000 ................ 00000000ee00dec4: c12d0ba0 ffffffff 00000010 00000000 ..-............. 0000000069cf255a: 00000000 006200ca 54f0f748 ffff95e0 ......b.H..T.... 00000000bcf21e72: 54f0f748 ffff95e0 00000000 00000000 H..T............ 00000000296bf3a5: 00000000 00000000 00000000 00000000 ................ 00000000c84759fb: 00000000 00000000 00000000 00000000 ................ 000000005dbd2792: 00000000 00000000 54f0f788 ffff95e0 ...........T.... 0000000041f8f475: 54f0f788 ffff95e0 00000000 00000000 ...T............ 00000000e55c2cb3: 3088b857 00000000 00000000 00000000 W..0............ 00000000345bb882: 00000000 00000000 00000000 00000000 ................ 000000005b1f5966: 00000000 00000000 00000000 00000000 ................ 0000000079dfd26c: 00000000 00000021 691ccee5 00000000 ....!......i.... 0000000024dfc6c0: 31b37996 00000000 00000000 00000000 .y.1............ 00000000d68e065d: 54f0f7f0 ffff95e0 54f0f7f0 ffff95e0 ...T.......T.... 00000000f6acd9cc: 00000000 00000000 00000000 00000000 ................ 00000000b5fc37a3: 00000000 00000000 00000000 00000000 ................ 00000000c087ab8e: 54f0f820 ffff95e0 54f0f820 ffff95e0 ..T.... ..T.... 00000000aa8e96b7: 00000000 00000000 00000000 ffffffff ................ 000000001fcc71b9: 00000000 ffffffff 00000000 00000000 ................ 000000001b9eccc9: 00000020 006200ca 00000000 00000000 .....b......... 000000000dd799bf: 00000000 ffff95e0 54f0f868 ffff95e0 ........h..T.... 00000000c5567b7d: 54f0f868 ffff95e0 ffffffe0 0000000f h..T............ 000000007d34a46d: 54f0f880 ffff95e0 54f0f880 ffff95e0 ...T.......T.... 00000000b383f6c6: c1277db0 ffffffff 54f0f898 ffff95e0 .}'........T.... 000000001423ca22: 54f0f898 ffff95e0 00000000 00000000 ...T............ 000000009cbcd7f0: 00000000 00000000 00000000 00000000 ................ 000000009496f976: 00001b6b 00001b6b 00000000 00000000 k...k........... 00000000bc3a8ee4: 00000000 00000000 00000000 00000000 ................ 00000000dd5b8362: 00000000 00000000 00000000 00000000 ................ 000000008eb6c884: 00000000 00000000 ........ CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 287 (00000000607af172): orphan list check failed! 00000000607af172: 0001f30a 00000004 00000000 00000000 ................ 000000007c9e3a47: 00000004 00038a35 00000000 00000000 ....5........... 00000000e44c1412: 00000000 00000000 00000000 00000000 ................ 00000000ad032634: 00000000 00000000 00000000 00000112 ................ 000000003145e0f9: 00000000 00000000 00000000 00000001 ................ 00000000b36bee4b: 54f0f950 ffff95e0 54f0f950 ffff95e0 P..T....P..T.... 0000000032417e9d: 00000000 00000000 00084000 80000004 .........@...... 0000000017734e68: 00000000 00000000 54f0f978 ffff95e0 ........x..T.... 000000005e382f36: 54f0f978 ffff95e0 00000000 00000000 x..T............ 00000000e3c4227d: 00000000 00000000 54f0f4d8 ffff95e0 ...........T.... 00000000eb6bfedd: 54f0ced8 ffff95e0 00002400 00000000 ...T.....$...... 00000000bde3841e: 00000000 00000000 54f0f9b8 ffff95e0 ...........T.... 000000005390171b: 54f0f9b8 ffff95e0 00000000 00000000 ...T............ 0000000057a464d2: 00000000 00000000 00000000 00000000 ................ 00000000aad584a5: 54f0f9e0 ffff95e0 54f0f9e0 ffff95e0 ...T.......T.... 00000000e5ae730e: 00000000 00000000 00000000 00000000 ................ 00000000c5e81a3a: 000881a4 00000000 00000000 00000080 ................ 000000005045b681: 00000000 00000000 00000000 00000000 ................ 0000000018fbeb62: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 00000000bc797a62: 54f0fb78 ffff95e0 5e78e180 ffff95e0 x..T......x^.... 000000009c8c1d9b: 0000011f 00000000 00000001 00000000 ................ 00000000c25e80c4: 00002400 00000000 691ccee5 00000000 .$.........i.... 000000000704d8b1: 00000000 00000000 691ccf31 00000000 ........1..i.... 00000000d4bf51a1: 00000000 00000000 691ccee5 00000000 ...........i.... 00000000eb54dac9: 00000000 00000000 00000000 00000000 ................ 00000000cb677c37: 0000000c 00000000 00000020 00000000 ........ ....... 00000000382fd95d: 00000060 00000000 00000000 00000000 `............... 00000000a30eb030: 54f0fab0 ffff95e0 54f0fab0 ffff95e0 ...T.......T.... 000000003d43b74e: 00000000 00000000 00000000 00000000 ................ 00000000d9bca3a9: 00a08ae6 00000001 00000000 00000000 ................ 00000000a9cd49ac: 00000000 00000000 00000000 00000000 ................ 00000000527eb9d7: 54f0faf0 ffff95e0 54f0faf0 ffff95e0 ...T.......T.... 000000002ce3840b: 00000000 00000000 00000000 00000000 ................ 0000000007359edd: 54f0fb10 ffff95e0 54f0fb10 ffff95e0 ...T.......T.... 00000000e9a7f684: 54f0fb20 ffff95e0 54f0fb20 ffff95e0 ..T.... ..T.... 00000000342720aa: 54f0fb30 ffff95e0 54f0fb30 ffff95e0 0..T....0..T.... 000000001ad0a8bf: 00000000 00000000 00000000 00000000 ................ 00000000d8f25451: 00000002 00000000 00000000 00000000 ................ 00000000cc277967: 00000000 00000000 c12d0100 ffffffff ..........-..... 00000000560261c2: 00000000 00000000 54f0fa00 ffff95e0 ...........T.... 0000000031ffa001: 00000000 00000021 00000000 00000000 ....!........... 00000000c7085316: 00000000 00000000 00000000 00000000 ................ 000000007306eb29: 00000000 00000000 00000000 00000000 ................ 0000000065564a45: 00000000 00000000 54f0fbb8 ffff95e0 ...........T.... 00000000b008709c: 54f0fbb8 ffff95e0 00000000 00000000 ...T............ 0000000053bbc980: 00000000 00000000 00000000 00000000 ................ 00000000a6901567: 00000000 00000000 00000000 00000000 ................ 00000000dfa9fb4c: c12d0ba0 ffffffff 00000010 00000000 ..-............. 00000000f3b4eb93: 00000000 006200ca 54f0fc08 ffff95e0 ......b....T.... 000000005b143a3f: 54f0fc08 ffff95e0 00000000 00000000 ...T............ 00000000a070db0e: 00000000 00000000 00000000 00000000 ................ 0000000020b3ce27: 00000000 00000000 00000000 00000000 ................ 000000002e8a1dc4: 00000000 00000000 54f0fc48 ffff95e0 ........H..T.... 000000006b4e1b1d: 54f0fc48 ffff95e0 00000000 00000000 H..T............ 0000000011bec33a: d455278e 00000000 00000000 00000000 .'U............. 00000000874c9053: 00000000 00000000 00000000 00000000 ................ 000000004f13f98b: 00000000 00000000 00000000 00000000 ................ 00000000b8d3db02: 00000000 00000000 691ccee5 00000000 ...........i.... 00000000e2f3cf53: 31d1fe5e 00000000 00000000 00000000 ^..1............ 00000000baa5138f: 54f0fcb0 ffff95e0 54f0fcb0 ffff95e0 ...T.......T.... 000000006558bbd0: 00000000 00000000 00000000 00000000 ................ 00000000c573f9e4: 00000000 00000000 00000000 00000000 ................ 0000000068b30e82: 54f0fce0 ffff95e0 54f0fce0 ffff95e0 ...T.......T.... 00000000a433211c: 00000000 00000000 00000000 ffffffff ................ 00000000c82dbc2b: 00000000 00000000 00000000 00000000 ................ 0000000028aef925: 00000020 ffff95e0 00000000 00000000 ............... 000000000029ea8d: 00000000 ffff95e0 54f0fd28 ffff95e0 ........(..T.... 00000000b1c7ceeb: 54f0fd28 ffff95e0 ffffffe0 0000000f (..T............ 0000000054e5869c: 54f0fd40 ffff95e0 54f0fd40 ffff95e0 @..T....@..T.... 000000008c955a63: c1277db0 ffffffff 00000000 00000000 .}'............. 000000002eb4fc27: 00000000 00000000 8264bba0 ffffffff ..........d..... 00000000a7c549ea: 00000000 00000000 00000000 00000000 ................ 0000000020bff75c: 00001b6b 00001b6b 00000000 00000000 k...k........... 0000000092aaa4e8: 00000000 00000000 00000000 00000000 ................ 000000003d85c0bd: 00000000 00000000 00000000 00000000 ................ 000000004b2a40a4: 00000000 00000000 ........ CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 291 (000000008a6e3658): orphan list check failed! 000000008a6e3658: 0001f30a 00000004 00000000 00000000 ................ 00000000cbed7604: 00000004 00038a39 00000000 00000000 ....9........... 00000000756bfdc0: 00000000 00000000 00000000 00000000 ................ 000000005bff7a18: 00000000 00000000 00000000 0000011f ................ 0000000075ee038f: 00000000 00000000 00000000 00000001 ................ 000000005c1516a0: 54f0ce90 ffff95e0 54f0ce90 ffff95e0 ...T.......T.... 00000000e9981fb7: 00000000 00000000 00084000 80000004 .........@...... 00000000402ff93e: 00000000 00000000 54f0ceb8 ffff95e0 ...........T.... 00000000a96dabf1: 54f0ceb8 ffff95e0 00000000 00000000 ...T............ 0000000048e82bf3: 00000000 00000000 54f0f998 ffff95e0 ...........T.... 00000000d5e5e870: 54f0ca18 ffff95e0 000023c0 00000000 ...T.....#...... 00000000e285e260: 00000000 00000000 54f0cef8 ffff95e0 ...........T.... 00000000c6de429e: 54f0cef8 ffff95e0 00000000 00000000 ...T............ 00000000d19ecede: 00000000 00000000 00000000 00000000 ................ 00000000244a8d14: 54f0cf20 ffff95e0 54f0cf20 ffff95e0 ..T.... ..T.... 00000000c7ba59ad: 00000000 00000000 00000000 00000000 ................ 00000000641496b4: 000881a4 00000000 00000000 00000080 ................ 00000000ebdac5da: 00000000 00000000 00000000 00000000 ................ 00000000e257a4e0: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 000000002d7b2b28: 54f0d0b8 ffff95e0 44851540 ffff95e1 ...T....@..D.... 000000001671695b: 00000123 00000000 00000001 00000000 #............... 00000000e7e5cf7c: 000023c0 00000000 691ccee5 00000000 .#.........i.... 00000000988676ee: 00000000 00000000 691ccf2d 00000000 ........-..i.... 00000000f6097621: 00000000 00000000 691ccee5 00000000 ...........i.... 000000008a3ee9da: 00000000 00000000 00000000 00000000 ................ 00000000b808f8d5: 0000000c 00000000 00000020 00000000 ........ ....... 00000000713e493c: 00000060 00000000 00000000 00000000 `............... 000000001e1312c9: 54f0cff0 ffff95e0 54f0cff0 ffff95e0 ...T.......T.... 00000000c6bc27fc: 00000000 00000000 00000000 00000000 ................ 000000004dd14eb6: 00a08ae8 00000001 00000000 00000000 ................ 00000000c0c06877: 00000000 00000000 00000000 00000000 ................ 00000000fa206fa6: 54f0d030 ffff95e0 54f0d030 ffff95e0 0..T....0..T.... 00000000f3cb04ba: 00000000 00000000 00000000 00000000 ................ 000000004a8c3ee6: 54f0d050 ffff95e0 54f0d050 ffff95e0 P..T....P..T.... 0000000047a850a7: 54f0d060 ffff95e0 54f0d060 ffff95e0 `..T....`..T.... 0000000075304ced: 54f0d070 ffff95e0 54f0d070 ffff95e0 p..T....p..T.... 0000000081d6e479: 00000000 00000000 00000000 00000000 ................ 000000006eed76ca: 00000002 00000000 00000000 00000000 ................ 00000000bd364634: 00000000 00000000 c12d0100 ffffffff ..........-..... 00000000e97f03ee: 00000000 00000000 54f0cf40 ffff95e0 ........@..T.... 000000007980b665: 00000000 00000021 00000000 00000000 ....!........... 00000000f2fe9e77: 00000000 00000000 00000000 00000000 ................ 0000000082acbc95: 00000000 00000000 00000000 00000000 ................ 00000000b1575e47: 00000000 00000000 54f0d0f8 ffff95e0 ...........T.... 000000009cdb0d03: 54f0d0f8 ffff95e0 00000000 00000000 ...T............ 00000000d4cd6d06: 00000000 00000000 00000000 00000000 ................ 000000001fca13de: 00000000 00000000 00000000 00000000 ................ 0000000097417c9c: c12d0ba0 ffffffff 00000010 00000000 ..-............. 0000000093b20b1f: 00000000 006200ca 54f0d148 ffff95e0 ......b.H..T.... 000000000f1d01c6: 54f0d148 ffff95e0 00000000 00000000 H..T............ 0000000052321c67: 00000000 00000000 00000000 00000000 ................ 0000000055f99927: 00000000 00000000 00000000 00000000 ................ 00000000c898093b: 00000000 00000000 54f0d188 ffff95e0 ...........T.... 0000000093d488fb: 54f0d188 ffff95e0 00000000 00000000 ...T............ 00000000e25bd65b: 044f0d2e 00000000 00000000 00000000 ..O............. 0000000006ee86ac: 00000000 00000000 00000000 00000000 ................ 000000008424c952: 00000000 00000000 00000000 00000000 ................ 0000000091246078: 00000000 00000000 691ccee5 00000000 ...........i.... 000000004b50569f: 31ffc58b 00000000 00000000 00000000 ...1............ 00000000fb281758: 54f0d1f0 ffff95e0 54f0d1f0 ffff95e0 ...T.......T.... 00000000318f424a: 00000000 00000000 00000000 00000000 ................ 00000000a97a037b: 00000000 00000000 00000000 00000000 ................ 00000000321f9657: 54f0d220 ffff95e0 54f0d220 ffff95e0 ..T.... ..T.... 00000000fab82b0b: 00000000 00000000 00000000 ffffffff ................ 00000000b8e8ae5b: 00000000 00000000 00000000 00000000 ................ 000000008ec1be5c: 00000020 ffff95e0 00000000 00000000 ............... 0000000016b78225: 00000000 00000000 54f0d268 ffff95e0 ........h..T.... 0000000052dc1c86: 54f0d268 ffff95e0 ffffffe0 0000000f h..T............ 000000005eaf617d: 54f0d280 ffff95e0 54f0d280 ffff95e0 ...T.......T.... 00000000e71fad2c: c1277db0 ffffffff 8096cb30 ffff95e0 .}'.....0....... 00000000d1ddb8c9: 00000000 00000000 00000000 00000000 ................ 0000000032bb0560: 00000000 00000000 00000000 00000000 ................ 00000000f8ad75fb: 00001b64 00001b64 00000000 00000000 d...d........... 000000003bf08d59: 00000000 00000000 00000000 00000000 ................ 00000000a407f6dc: 00000000 00000000 00000000 00000000 ................ 0000000018c2edad: 00000000 00000000 ........ CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 336 (000000005a7b7ab5): orphan list check failed! 000000005a7b7ab5: 0001f30a 00000004 00000000 00000000 ................ 00000000b9a9f0dc: 00000004 00038a3d 00000000 00000000 ....=........... 00000000c9d82d76: 00000000 00000000 00000000 00000000 ................ 00000000669235a1: 00000000 00000000 00000000 00000123 ............#... 00000000c0d067ee: 00000000 00000000 00000000 00000001 ................ 000000005571e39c: 54f0c9d0 ffff95e0 54f0c9d0 ffff95e0 ...T.......T.... 00000000cdcee909: 00000000 00000000 00084000 80000004 .........@...... 000000003df4c2f3: 00000000 00000000 54f0c9f8 ffff95e0 ...........T.... 000000003c926a83: 54f0c9f8 ffff95e0 00000000 00000000 ...T............ 000000007b34daf7: 00000000 00000000 54f0ced8 ffff95e0 ...........T.... 00000000c8c7ba05: 5ed57998 ffff95e0 000023c0 00000000 .y.^.....#...... 00000000ccdd8581: 00000000 00000000 54f0ca38 ffff95e0 ........8..T.... 00000000802f8c75: 54f0ca38 ffff95e0 00000000 00000000 8..T............ 00000000af24b9cc: 00000000 00000000 00000000 00000000 ................ 00000000728d3c91: 54f0ca60 ffff95e0 54f0ca60 ffff95e0 `..T....`..T.... 00000000eca1b45e: 00000000 00000000 00000000 00000000 ................ 00000000cb171e83: 000881a4 00000000 00000000 00000080 ................ 0000000013bb68b9: 00000000 00000000 00000000 00000000 ................ 00000000da5da0ee: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 000000007fdd4237: 54f0cbf8 ffff95e0 44851240 ffff95e1 ...T....@..D.... 00000000c3e93160: 00000150 00000000 00000001 00000000 P............... 00000000feac20a5: 000023c0 00000000 691ccee5 00000000 .#.........i.... 0000000051726e55: 00000000 00000000 691ccf31 00000000 ........1..i.... 000000008c106c52: 00000000 00000000 691ccee5 00000000 ...........i.... 0000000094ab745e: 00000000 00000000 00000000 00000000 ................ 00000000c6d54460: 0000000c 00000000 00000020 00000000 ........ ....... 000000000375e2c7: 00000060 00000000 00000000 00000000 `............... 00000000d0e28e12: 54f0cb30 ffff95e0 54f0cb30 ffff95e0 0..T....0..T.... 00000000601c87fb: 00000000 00000000 00000000 00000000 ................ 00000000d72e5946: 00a08aea 00000001 00000000 00000000 ................ 000000002b70fcf0: 00000000 00000000 00000000 00000000 ................ 0000000099a5304f: 54f0cb70 ffff95e0 54f0cb70 ffff95e0 p..T....p..T.... 0000000092678ff8: 00000000 00000000 00000000 00000000 ................ 000000004ddb7d51: 54f0cb90 ffff95e0 54f0cb90 ffff95e0 ...T.......T.... 0000000046df7f07: 54f0cba0 ffff95e0 54f0cba0 ffff95e0 ...T.......T.... 0000000067c0a5cd: 54f0cbb0 ffff95e0 54f0cbb0 ffff95e0 ...T.......T.... 0000000087c4d847: 00000000 00000000 00000000 00000000 ................ 000000007dc6c546: 00000002 00000000 00000000 00000000 ................ 00000000480e7406: 00000000 00000000 c12d0100 ffffffff ..........-..... 0000000053beb200: 00000000 00000000 54f0ca80 ffff95e0 ...........T.... 0000000076f12c5e: 00000000 00000021 00000000 00000000 ....!........... 00000000f685f314: 00000000 00000000 00000000 00000000 ................ 0000000035d0c4b8: 00000000 00000000 00000000 00000000 ................ 00000000f773bfa7: 00000000 00000000 54f0cc38 ffff95e0 ........8..T.... 00000000bf123c6b: 54f0cc38 ffff95e0 00000000 00000000 8..T............ 00000000fee8372f: 00000000 00000000 00000000 00000000 ................ 000000007daa735d: 00000000 00000000 00000000 00000000 ................ 0000000091da0f84: c12d0ba0 ffffffff 00000010 00000000 ..-............. 000000007f88fa9c: 00000000 006200ca 54f0cc88 ffff95e0 ......b....T.... 000000005052346f: 54f0cc88 ffff95e0 00000000 00000000 ...T............ 000000005d4cf598: 00000000 00000000 00000000 00000000 ................ 0000000042b075a4: 00000000 00000000 00000000 00000000 ................ 000000005d955de0: 00000000 00000000 54f0ccc8 ffff95e0 ...........T.... 000000007eafec50: 54f0ccc8 ffff95e0 00000000 00000000 ...T............ 000000004fa07261: 0eafeb3a 00000000 00000000 00000000 :............... 0000000047347eca: 00000000 00000000 00000000 00000000 ................ 0000000020a3fdb7: 00000000 00000000 00000000 00000000 ................ 000000005dfeb0e7: 00000000 ffffffff 691ccee5 00000000 ...........i.... 0000000094fc1b4d: 320f07f0 00000000 00000000 00000021 ...2........!... 00000000446e286f: 54f0cd30 ffff95e0 54f0cd30 ffff95e0 0..T....0..T.... 00000000ee967fc9: 00000000 00000000 00000000 00000000 ................ 0000000030e7d4dd: 00000000 00000000 00000000 00000000 ................ 00000000429c20ef: 54f0cd60 ffff95e0 54f0cd60 ffff95e0 `..T....`..T.... 0000000072b64f88: 00000000 00000000 00000000 ffffffff ................ 00000000331efe6d: 00000000 00000000 00000000 00000000 ................ 000000007db192a0: 00000020 00000000 00000000 00000000 ............... 0000000052e7c24e: 00000000 00000000 54f0cda8 ffff95e0 ...........T.... 000000004372e922: 54f0cda8 ffff95e0 ffffffe0 0000000f ...T............ 000000007b5aeaac: 54f0cdc0 ffff95e0 54f0cdc0 ffff95e0 ...T.......T.... 000000006a1d961b: c1277db0 ffffffff 00000000 00000000 .}'............. 00000000469524bd: 00000000 00000000 00000000 00000000 ................ 00000000d9a7d769: 54f0cdf0 ffff95e0 00000000 00000000 ...T............ 000000004efdb759: 00001b6b 00001b6b 00000000 00000000 k...k........... 00000000f885f12e: 00000000 00000000 00000000 00000000 ................ 00000000cc03f17e: 00000000 00000000 00000000 00000000 ................ 00000000ffc968c0: b423c745 9e2c759f E.#..u,. CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 430 (0000000077f757ec): orphan list check failed! 0000000077f757ec: 0001f30a 00000004 00000000 00000000 ................ 00000000780282e5: 00000004 00038a41 00000000 00000000 ....A........... 00000000ed437647: 00000000 00000000 00000000 00000000 ................ 00000000baa0965d: 00000000 00000000 00000000 00000150 ............P... 00000000a4fd9eaa: 00000000 00000000 00000000 00000001 ................ 000000005d890ca8: 5ed57950 ffff95e0 5ed57950 ffff95e0 Py.^....Py.^.... 0000000071968bb9: 00000000 00000000 00084000 80000004 .........@...... 00000000aeced2c6: 00000000 00000000 5ed57978 ffff95e0 ........xy.^.... 00000000de50b8da: 5ed57978 ffff95e0 00000000 00000000 xy.^............ 00000000efccfeb7: 00000000 00000000 54f0ca18 ffff95e0 ...........T.... 00000000f81116f7: 5ed56b58 ffff95e0 000023c0 00000000 Xk.^.....#...... 00000000cc489894: 00000000 00000000 5ed579b8 ffff95e0 .........y.^.... 0000000028e95735: 5ed579b8 ffff95e0 00000000 00000000 .y.^............ 000000009bf8721e: 00000000 00000000 00000000 00000000 ................ 00000000b90ec91f: 5ed579e0 ffff95e0 5ed579e0 ffff95e0 .y.^.....y.^.... 0000000060bbe537: 00000000 00000000 00000000 00000000 ................ 00000000d77b5111: 000881a4 00000000 00000000 00000080 ................ 0000000014cc8514: 00000000 00000000 00000000 00000000 ................ 00000000b343e07f: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 00000000755249dc: 5ed57b78 ffff95e0 439053c0 ffff95e1 x{.^.....S.C.... 000000001ac2e91a: 000001ae 00000000 00000001 00000000 ................ 00000000ac285595: 000023c0 00000000 691ccee5 00000000 .#.........i.... 00000000db702d26: 00000000 00000000 691ccf31 00000000 ........1..i.... 00000000d61c16ed: 00000000 00000000 691ccee5 00000000 ...........i.... 00000000380562d4: 00000000 00000000 00000000 00000000 ................ 000000001cdec3c2: 0000000c 00000000 00000020 00000000 ........ ....... 000000006c5aa240: 00000060 00000000 00000000 00000000 `............... 00000000d55caa8f: 5ed57ab0 ffff95e0 5ed57ab0 ffff95e0 .z.^.....z.^.... 000000001028ef84: 00000000 00000000 00000000 00000000 ................ 000000009e8e1836: 00a08aec 00000001 00000000 00000000 ................ 000000005e802c87: 00000000 00000000 00000000 00000000 ................ 00000000d89ea02b: 5ed57af0 ffff95e0 5ed57af0 ffff95e0 .z.^.....z.^.... 00000000966dcd20: 00000000 00000000 00000000 00000000 ................ 000000009aa655b2: 5ed57b10 ffff95e0 5ed57b10 ffff95e0 .{.^.....{.^.... 000000008ad87996: 5ed57b20 ffff95e0 5ed57b20 ffff95e0 {.^.... {.^.... 0000000016053e3d: 5ed57b30 ffff95e0 5ed57b30 ffff95e0 0{.^....0{.^.... 00000000ccd52f8a: 00000000 00000000 00000000 00000000 ................ 0000000063e355d0: 00000002 00000000 00000000 00000000 ................ 000000009abf6e5c: 00000000 00000000 c12d0100 ffffffff ..........-..... 00000000c0c027e6: 00000000 00000000 5ed57a00 ffff95e0 .........z.^.... 00000000014044db: 00000000 00000021 00000000 00000000 ....!........... 00000000ea6524e8: 00000000 00000000 00000000 00000000 ................ 0000000034b1a144: 00000000 00000000 00000000 00000000 ................ 000000006c25158c: 00000000 00000000 5ed57bb8 ffff95e0 .........{.^.... 000000008bc91470: 5ed57bb8 ffff95e0 00000000 00000000 .{.^............ 00000000773536d2: 00000000 00000000 00000000 00000000 ................ 00000000903fd7f2: 00000000 00000000 00000000 00000000 ................ 00000000826cc2fd: c12d0ba0 ffffffff 00000010 00000000 ..-............. 000000005a3427c8: 00000000 006200ca 5ed57c08 ffff95e0 ......b..|.^.... 0000000035258623: 5ed57c08 ffff95e0 00000000 00000000 .|.^............ 000000006c169a65: 00000000 00000000 00000000 00000000 ................ 000000006bde382f: 00000000 00000000 00000000 00000000 ................ 000000000e875aa3: 00000000 00000000 5ed57c48 ffff95e0 ........H|.^.... 00000000f5357f9e: 5ed57c48 ffff95e0 00000000 00000000 H|.^............ 0000000040627a57: 92cc31af 00000000 00000000 00000000 .1.............. 0000000048f7798a: 00000000 00000000 00000000 00000000 ................ 00000000a3576986: 00000000 00000000 00000000 00000000 ................ 0000000025db0389: 00000000 00000000 691ccee5 00000000 ...........i.... 00000000e65828b2: 323ccf1d 00000000 00000000 fffffb95 ..<2............ 00000000af187bd2: 5ed57cb0 ffff95e0 5ed57cb0 ffff95e0 .|.^.....|.^.... 00000000c0af0b95: 00000000 ffff95e0 00000000 00000000 ................ 00000000ba5c22f9: 00000000 00000000 00000000 00000000 ................ 00000000a356e893: 5ed57ce0 ffff95e0 5ed57ce0 ffff95e0 .|.^.....|.^.... 00000000e6e5adcf: 00000000 00000000 00000000 ffffffff ................ 000000009884bc27: 00000000 00000000 00000000 00000000 ................ 0000000076ce8bd2: 00000020 fffffb95 00000000 00000000 ............... 000000000d72bad3: 00000000 00000000 5ed57d28 ffff95e0 ........(}.^.... 00000000a58313fa: 5ed57d28 ffff95e0 ffffffe0 0000000f (}.^............ 00000000f21e6832: 5ed57d40 ffff95e0 5ed57d40 ffff95e0 @}.^....@}.^.... 0000000048cd602e: c1277db0 ffffffff 00000000 00000000 .}'............. 00000000890a54fc: 00000000 00000000 00000021 00000000 ........!....... 000000004c20035e: 5ed57d68 ffff95e0 00000000 00000000 h}.^............ 00000000f4f5b1ee: 00001b6b 00001b6b 00000000 00000000 k...k........... 00000000875c0395: 00000000 00000000 00000000 00000000 ................ 00000000d433e883: 00000000 00000000 00000000 00000000 ................ 000000009b9fdfbc: 5ed57db0 ffff95e0 .}.^.... CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 440 (00000000ca9e2390): orphan list check failed! 00000000ca9e2390: 0001f30a 00000004 00000000 00000000 ................ 00000000df1dd538: 00000004 00038a45 00000000 00000000 ....E........... 000000000527466d: 00000000 00000000 00000000 00000000 ................ 00000000abec9476: 00000000 00000000 00000000 000001ae ................ 00000000fafa664f: 00000000 00000000 00000000 00000001 ................ 000000007433bf36: 5ed56b10 ffff95e0 5ed56b10 ffff95e0 .k.^.....k.^.... 00000000d389f8e6: 00000000 00000000 00084000 80000004 .........@...... 000000008e48e133: 00000000 00000000 5ed56b38 ffff95e0 ........8k.^.... 000000004633c6fb: 5ed56b38 ffff95e0 00000000 00000000 8k.^............ 0000000082595949: 00000000 00000000 5ed57998 ffff95e0 .........y.^.... 000000002ed56420: 5ed54558 ffff95e0 000023c0 00000000 XE.^.....#...... 0000000034900f09: 00000000 00000000 5ed56b78 ffff95e0 ........xk.^.... 0000000037494c82: 5ed56b78 ffff95e0 00000000 00000000 xk.^............ 00000000d2a67e6c: 00000000 00000000 00000000 00000000 ................ 0000000010200359: 5ed56ba0 ffff95e0 5ed56ba0 ffff95e0 .k.^.....k.^.... 000000000ae32ba6: 00000000 00000000 00000000 00000000 ................ 00000000a562c9c2: 000881a4 00000000 00000000 00000080 ................ 000000006eb81764: 00000000 00000000 00000000 00000000 ................ 0000000068ac36fd: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 00000000f6110b2a: 5ed56d38 ffff95e0 44fa5180 ffff95e1 8m.^.....Q.D.... 00000000ae31fcbf: 000001b8 00000000 00000001 00000000 ................ 000000005b64bdd9: 000023c0 00000000 691ccee5 00000000 .#.........i.... 00000000664e0cb6: 00000000 00000000 691ccf31 00000000 ........1..i.... 00000000c8dbacae: 00000000 00000000 691ccee5 00000000 ...........i.... 000000001a8978a4: 00000000 00000000 00000000 00000000 ................ 0000000048a379ef: 0000000c 00000000 00000020 00000000 ........ ....... 000000004ff265fc: 00000060 00000000 00000000 00000000 `............... 0000000041055348: 5ed56c70 ffff95e0 5ed56c70 ffff95e0 pl.^....pl.^.... 0000000019765085: 00000000 00000000 00000000 00000000 ................ 00000000f6ea7e7a: 00a08aee 00000001 00000000 00000000 ................ 00000000ccbd1206: 00000000 00000000 00000000 00000000 ................ 00000000ab59e296: 5ed56cb0 ffff95e0 5ed56cb0 ffff95e0 .l.^.....l.^.... 000000009ed0448b: 00000000 00000000 00000000 00000000 ................ 00000000464302b3: 5ed56cd0 ffff95e0 5ed56cd0 ffff95e0 .l.^.....l.^.... 00000000641b7868: 5ed56ce0 ffff95e0 5ed56ce0 ffff95e0 .l.^.....l.^.... 00000000cf2b0a71: 5ed56cf0 ffff95e0 5ed56cf0 ffff95e0 .l.^.....l.^.... 000000001d94d2b7: 00000000 00000000 00000000 00000000 ................ 0000000068b78958: 00000002 00000000 00000000 00000000 ................ 0000000072a62160: 00000000 00000000 c12d0100 ffffffff ..........-..... 000000007ffc53b0: 00000000 00000000 5ed56bc0 ffff95e0 .........k.^.... 000000009e7b8a92: 00000000 00000021 00000000 00000000 ....!........... 00000000d073e9e3: 00000000 00000000 00000000 00000000 ................ 0000000005288a75: 00000000 00000000 00000000 00000000 ................ 00000000599ab276: 00000000 00000000 5ed56d78 ffff95e0 ........xm.^.... 0000000066228ed5: 5ed56d78 ffff95e0 00000000 00000000 xm.^............ 000000007e075702: 00000000 00000000 00000000 00000000 ................ 000000008c4069d2: 00000000 00000000 00000000 00000000 ................ 000000001dd07f98: c12d0ba0 ffffffff 00000010 00000000 ..-............. 00000000ba5492eb: 00000000 006200ca 5ed56dc8 ffff95e0 ......b..m.^.... 00000000ede1bf74: 5ed56dc8 ffff95e0 00000000 00000000 .m.^............ 000000008e889e23: 00000000 00000000 00000000 00000000 ................ 000000006acd6970: 00000000 00000000 00000000 00000000 ................ 0000000087e027a2: 00000000 00000000 5ed56e08 ffff95e0 .........n.^.... 00000000e02ad7d4: 5ed56e08 ffff95e0 00000000 00000000 .n.^............ 000000009a9c2204: f97997d9 00000000 00000000 00000000 ..y............. 00000000b9d51ee9: 00000000 00000000 00000000 00000000 ................ 00000000b1de449e: 00000000 00000000 00000000 00000000 ................ 00000000b3bd7d0f: 00000000 00000000 691ccee5 00000000 ...........i.... 0000000013348221: 325b53e6 00000000 00000000 a16b9bca .S[2..........k. 000000004b22acf4: 5ed56e70 ffff95e0 5ed56e70 ffff95e0 pn.^....pn.^.... 00000000af3fbcf0: 00000000 ffff95e0 00000000 00000000 ................ 000000009a1fadb1: 00000000 00000000 00000000 00000000 ................ 000000008a85f261: 5ed56ea0 ffff95e0 5ed56ea0 ffff95e0 .n.^.....n.^.... 00000000ed87fb15: 00000000 00000000 00000000 ffffffff ................ 0000000094e88552: 00000000 00000000 00000000 00000000 ................ 000000000e81372c: 00000020 196b9bca 00000000 00000000 .....k......... 000000001197e037: 00000000 00000000 5ed56ee8 ffff95e0 .........n.^.... 00000000ece177b2: 5ed56ee8 ffff95e0 ffffffe0 0000000f .n.^............ 0000000034bb9133: 5ed56f00 ffff95e0 5ed56f00 ffff95e0 .o.^.....o.^.... 000000004e444094: c1277db0 ffffffff 81274080 fffffb95 .}'......@'..... 000000002389351a: 00038eb0 00000000 00001000 00000000 ................ 000000009ee2c30a: 89d02000 ffff95e0 00000000 00000000 . .............. 000000003fbd8173: 00001b6b 00001b6b 00000000 00000000 k...k........... 00000000da28ca2e: 00000000 00000000 00000000 00000000 ................ 00000000955193dc: 00000000 00000000 00000000 00000000 ................ 0000000092116dc5: 00000021 00000000 !....... CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 441 (00000000cef1c530): orphan list check failed! 00000000cef1c530: 0001f30a 00000004 00000000 00000000 ................ 00000000e6fb27f2: 00000004 00038a49 00000000 00000000 ....I........... 000000004da6032a: 00000000 00000000 00000000 00000000 ................ 00000000b4ee18f4: 00000000 00000000 00000000 000001b8 ................ 0000000040e5adba: 00000000 00000000 00000000 00000001 ................ 00000000f06ca9fb: 5ed54510 ffff95e0 5ed54510 ffff95e0 .E.^.....E.^.... 0000000062f30195: 00000000 00000000 00084000 80000004 .........@...... 00000000cf2d242d: 00000000 00000000 5ed54538 ffff95e0 ........8E.^.... 00000000e006983d: 5ed54538 ffff95e0 00000000 00000000 8E.^............ 000000000ffd4a61: 00000000 00000000 5ed56b58 ffff95e0 ........Xk.^.... 00000000a273633d: 5ef2d398 ffff95e0 000023c0 00000000 ...^.....#...... 000000004334d963: 00000000 00000000 5ed54578 ffff95e0 ........xE.^.... 00000000f698a969: 5ed54578 ffff95e0 00000000 00000000 xE.^............ 000000005639e5ef: 00000000 00000000 00000000 00000000 ................ 000000002cc0f0e9: 5ed545a0 ffff95e0 5ed545a0 ffff95e0 .E.^.....E.^.... 00000000ca7f20ac: 00000000 00000000 00000000 00000000 ................ 00000000e430bab2: 000881a4 00000000 00000000 00000080 ................ 000000008779acff: 00000000 00000000 00000000 00000000 ................ 00000000673875ab: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 00000000fb6cb654: 5ed54738 ffff95e0 456c5780 ffff95e1 8G.^.....WlE.... 00000000a7914dcb: 000001b9 00000000 00000001 00000000 ................ 0000000084162977: 000023c0 00000000 691ccee5 00000000 .#.........i.... 00000000dbc449f8: 00000000 00000000 691ccf2d 00000000 ........-..i.... 000000007e641e51: 00000000 00000000 691ccee5 00000000 ...........i.... 000000001632f74d: 00000000 00000000 00000000 00000000 ................ 000000007f99fc2a: 0000000c 00000000 00000020 00000000 ........ ....... 000000004191d7bd: 00000060 00000000 00000000 00000000 `............... 000000005ebc2549: 5ed54670 ffff95e0 5ed54670 ffff95e0 pF.^....pF.^.... 000000005e7ff03a: 00000000 00000000 00000000 00000000 ................ 000000001ddcd2ae: 00a08af0 00000001 00000000 00000000 ................ 00000000df58a83e: 00000000 00000000 00000000 00000000 ................ 000000009aaca14f: 5ed546b0 ffff95e0 5ed546b0 ffff95e0 .F.^.....F.^.... 00000000e711cef5: 00000000 00000000 00000000 00000000 ................ 00000000f1b50b8e: 5ed546d0 ffff95e0 5ed546d0 ffff95e0 .F.^.....F.^.... 000000003deac964: 5ed546e0 ffff95e0 5ed546e0 ffff95e0 .F.^.....F.^.... 00000000cbe64a1c: 5ed546f0 ffff95e0 5ed546f0 ffff95e0 .F.^.....F.^.... 00000000380aac06: 00000000 00000000 00000000 00000000 ................ 00000000f8854e3d: 00000002 00000000 00000000 00000000 ................ 00000000ea175dea: 00000000 00000000 c12d0100 ffffffff ..........-..... 000000009eaffa50: 00000000 00000000 5ed545c0 ffff95e0 .........E.^.... 00000000a0eee750: 00000000 00000021 00000000 00000000 ....!........... 000000009a5c4e42: 00000000 00000000 00000000 00000000 ................ 00000000d8fdab72: 00000000 00000000 00000000 00000000 ................ 0000000028f4da12: 00000000 00000000 5ed54778 ffff95e0 ........xG.^.... 00000000da22dc10: 5ed54778 ffff95e0 00000000 00000000 xG.^............ 00000000c7efff45: 00000000 00000000 00000000 00000000 ................ 000000003dba95dd: 00000000 00000000 00000000 00000000 ................ 000000002e1db883: c12d0ba0 ffffffff 00000010 00000000 ..-............. 00000000f959c8cd: 00000000 006200ca 5ed547c8 ffff95e0 ......b..G.^.... 0000000094e1a962: 5ed547c8 ffff95e0 00000000 00000000 .G.^............ 00000000759218a6: 00000000 00000000 00000000 00000000 ................ 000000008fb24e59: 00000000 00000000 00000000 00000000 ................ 00000000cc68b32d: 00000000 00000000 5ed54808 ffff95e0 .........H.^.... 0000000086b31057: 5ed54808 ffff95e0 00000000 00000000 .H.^............ 0000000097cea915: 32f8161b 00000000 00000000 00000000 ...2............ 00000000e1952e10: 00000000 00000000 00000000 00000000 ................ 000000003f2b9392: 00000000 00000000 00000000 00000000 ................ 00000000b67282ad: 00000000 994d9bca 691ccee5 00000000 ......M....i.... 000000007218d69d: 3279d8ae 00000000 00000000 ffff95e0 ..y2............ 000000006f44c90b: 5ed54870 ffff95e0 5ed54870 ffff95e0 pH.^....pH.^.... 00000000eb1c4614: 00000000 00000000 00000000 00000000 ................ 00000000debd8ee2: 00000000 00000000 00000000 00000000 ................ 00000000af19e05c: 5ed548a0 ffff95e0 5ed548a0 ffff95e0 .H.^.....H.^.... 00000000669992e2: 00000000 00000000 00000000 ffffffff ................ 0000000054829ceb: 00000000 00000000 00000000 00000000 ................ 00000000e145d0b7: 00000020 ffff95e0 00000000 00000000 ............... 00000000c42b3ff9: 00000000 00000000 5ed548e8 ffff95e0 .........H.^.... 00000000dcbc2d3e: 5ed548e8 ffff95e0 ffffffe0 0000000f .H.^............ 0000000046bf2d19: 5ed54900 ffff95e0 5ed54900 ffff95e0 .I.^.....I.^.... 000000002ed6835c: c1277db0 ffffffff 87ac2000 ffff95e0 .}'...... ...... 00000000aa4b5a2d: c723699f e94c9bca 00000000 00000000 .i#...L......... 000000002c8478e7: 00000000 00000000 00000000 00000000 ................ 0000000072fc2ffa: 00001b62 00001b62 00000000 00000000 b...b........... 000000009ea973e7: 00000000 00000000 00000000 00000000 ................ 00000000485e7ec1: 00000000 00000000 811eb180 00000000 ................ 0000000091529a36: 00038d7c 00000000 |....... CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): Inode 3177 (00000000b193ad84): orphan list check failed! 00000000b193ad84: 0001f30a 00010004 00000000 00000000 ................ 00000000c86d9d93: 00036f55 00030000 0000000c 00000004 Uo.............. 00000000124f6f8a: 00038dd2 00000010 00000004 00038a5c ............\... 00000000b274a826: 00000014 00000004 00038a61 000001b9 ........a....... 00000000ae07f498: 00000000 00000000 00000000 00000001 ................ 0000000096a4881d: 5ef2d350 ffff95e0 5ef2d350 ffff95e0 P..^....P..^.... 00000000284da230: 00000000 00000000 00084000 80000004 .........@...... 00000000dca7fb5b: 00000000 00000000 5ef2d378 ffff95e0 ........x..^.... 000000004d5569d2: 5ef2d378 ffff95e0 00000000 00000000 x..^............ 0000000001e44ce1: 00000000 00000000 5ed54558 ffff95e0 ........XE.^.... 00000000b4492793: 7d392720 ffff95e0 00200038 00000000 '9}....8. ..... 000000001e068621: 00000000 00000000 5ef2d3b8 ffff95e0 ...........^.... 00000000c0f5a6f1: 5ef2d3b8 ffff95e0 00000000 00000000 ...^............ 0000000071bce5ed: 00000000 00000000 00000000 00000000 ................ 00000000c41284de: 5ef2d3e0 ffff95e0 5ef2d3e0 ffff95e0 ...^.......^.... 00000000bc2e15d5: 00000000 00000000 00000000 00000000 ................ 0000000047099d7a: 000881a4 00000000 00000000 00000080 ................ 000000005feb6c3d: 00000000 00000000 00000000 00000000 ................ 000000006dbf7835: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B.... 000000008ab6d62b: 5ef2d578 ffff95e0 9435c980 ffff95e0 x..^......5..... 0000000045e0de52: 00000c69 00000000 00000001 00000000 i............... 000000006a7633d4: 00200038 00000000 691ccf24 00000000 8. .....$..i.... 000000009a0ede61: 00000000 00000000 691ccfd1 00000000 ...........i.... 000000003b3730e6: 00000000 00000000 691ccf24 00000000 ........$..i.... 000000007862339f: 00000000 00000000 00000000 00000000 ................ 00000000a095f999: 0000000c 00000000 00001028 00000000 ........(....... 000000005d5dd20a: 00000060 00000000 00000000 00000000 `............... 00000000c59a73f7: 5ef2d4b0 ffff95e0 5ef2d4b0 ffff95e0 ...^.......^.... 0000000018ca890d: 00000000 00000000 00000000 00000000 ................ 000000007b3e5a18: 00a3c72d 00000001 00000000 00000000 -............... 00000000aabf118d: 00000000 00000000 00000000 00000000 ................ 0000000067e28f5d: 5ef2d4f0 ffff95e0 5ef2d4f0 ffff95e0 ...^.......^.... 00000000af32dd40: 00000000 00000000 00000000 00000000 ................ 0000000084168210: 5ef2d510 ffff95e0 5ef2d510 ffff95e0 ...^.......^.... 00000000db8edc38: 5ef2d520 ffff95e0 5ef2d520 ffff95e0 ..^.... ..^.... 00000000afe45284: 5ef2d530 ffff95e0 5ef2d530 ffff95e0 0..^....0..^.... 000000007306a98c: 00000000 00000000 00000000 00000000 ................ 000000003c3ee3b0: 00000002 00000000 00000000 00000000 ................ 00000000760843a3: 00000000 00000000 c12d0100 ffffffff ..........-..... 00000000a23b0bab: 00000000 00000000 5ef2d400 ffff95e0 ...........^.... 000000005c842bc0: 00000000 00000021 00000000 00000000 ....!........... 00000000bfcd9638: 00000000 00000000 00000000 00000000 ................ 00000000e23e1312: 00000000 00000000 00000000 00000000 ................ 00000000de1367ca: 00000000 00000000 5ef2d5b8 ffff95e0 ...........^.... 00000000919380ad: 5ef2d5b8 ffff95e0 00000000 00000000 ...^............ 0000000078229268: 00000000 00000000 00000000 00000000 ................ 00000000f26e7a65: 00000000 00000000 00000000 00000000 ................ 000000009eb86ad8: c12d0ba0 ffffffff 00000010 00000000 ..-............. 0000000014c8ad01: 00000000 006200ca 5ef2d608 ffff95e0 ......b....^.... 00000000ddb6e62f: 5ef2d608 ffff95e0 00000000 00000000 ...^............ 00000000832e373c: 00000000 00000000 00000000 00000000 ................ 00000000785f86ec: 00000000 00000000 00000000 00000000 ................ 0000000049ae97e6: 00000000 00000000 5ef2d648 ffff95e0 ........H..^.... 00000000012230e7: 5ef2d648 ffff95e0 00000000 00000000 H..^............ 0000000024231026: 3aa00385 00000000 00000000 00000000 ...:............ 0000000030a6cdc6: 00000000 00000000 00000000 00000000 ................ 00000000090f84a4: 00000000 00000000 00000000 00000000 ................ 000000003985c2a1: 00000000 00000000 691ccf24 00000000 ........$..i.... 000000002c79faa2: 0756867a 00000000 00000000 00000000 z.V............. 00000000e8025876: 5ef2d6b0 ffff95e0 5ef2d6b0 ffff95e0 ...^.......^.... 0000000019d77bdf: 00000000 00000000 00000000 00000000 ................ 00000000c77c3f85: 00000000 00000000 00000000 00000000 ................ 00000000bf91b85b: 5ef2d6e0 ffff95e0 5ef2d6e0 ffff95e0 ...^.......^.... 00000000ac7de1d4: 00000000 00000000 00000000 ffffffff ................ 000000000d25e798: 00000000 00000000 00000000 00000000 ................ 000000007e74e821: 00000020 00000000 00000000 00000000 ............... 00000000aaa8bd47: 00000000 00000000 5ef2d728 ffff95e0 ........(..^.... 0000000044bf9980: 5ef2d728 ffff95e0 ffffffe0 0000000f (..^............ LustreError: 611332:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from fd33:3981:3213:f010:0:5254:8a:7683@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 000000006087970a: 5ef2d740 ffff95e0 5ef2d740 ffff95e0 @..^....@..^.... 000000006581a28f: c1277db0 ffffffff 00000000 00000000 .}'............. 00000000abf0c7d8: 00000000 00000000 00000000 00000000 ................ 000000009c8e8f25: 00000000 00000000 00000000 00000000 ................ 00000000174581fe: 00001daa 00001daa 00000000 00000000 ................ 000000000ba2e901: 00000000 00000000 00000000 00000000 ................ 000000003609c097: 00000000 00000000 00000000 00000000 ................ 00000000c8961e96: 00000000 00000000 ........ CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs] LustreError: 611332:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 15 previous similar messages dispose_list+0x48/0x70 evict_inodes+0x160/0x1b0 generic_shutdown_super+0x37/0x110 kill_block_super+0x21/0x50 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 osd_umount+0x7d/0x1b0 [osd_ldiskfs] osd_device_fini+0x1b8/0x210 [osd_ldiskfs] obd_precleanup.isra.32+0x8e/0x280 [obdclass] ? class_disconnect_exports+0x187/0x2f0 [obdclass] class_cleanup+0x326/0x7e0 [obdclass] class_process_config+0x3bb/0x2060 [obdclass] ? class_manual_cleanup+0x191/0x730 [obdclass] class_manual_cleanup+0x26b/0x730 [obdclass] osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs] lustre_put_lsi_free+0x107/0x270 [obdclass] lustre_put_lsi+0x17c/0x1e0 [obdclass] server_put_super+0x263/0x1490 [ptlrpc] ? fsnotify_sb_delete+0x138/0x1c0 generic_shutdown_super+0x6c/0x110 kill_anon_super+0x14/0x30 deactivate_locked_super+0x34/0x70 cleanup_mnt+0x3b/0x70 task_work_run+0x8a/0xb0 exit_to_usermode_loop+0xef/0x100 do_syscall_64+0x195/0x1a0 entry_SYSCALL_64_after_hwframe+0x66/0xcb RIP: 0033:0x7f98338c68fb Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48 RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6 RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0 RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010 R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0 R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff LDISKFS-fs (dm-3): sb orphan head is 3177 sb_info orphan list: inode dm-3:3177 at 0000000047099d7a: mode 100644, nlink 1, next 441 inode dm-3:441 at 00000000e430bab2: mode 100644, nlink 1, next 440 inode dm-3:440 at 00000000a562c9c2: mode 100644, nlink 1, next 430 inode dm-3:430 at 00000000d77b5111: mode 100644, nlink 1, next 336 inode dm-3:336 at 00000000cb171e83: mode 100644, nlink 1, next 291 inode dm-3:291 at 00000000641496b4: mode 100644, nlink 1, next 287 inode dm-3:287 at 00000000c5e81a3a: mode 100644, nlink 1, next 274 inode dm-3:274 at 00000000b047a7e0: mode 100644, nlink 1, next 213 inode dm-3:213 at 000000007789655b: mode 100644, nlink 1, next 0 ------------[ cut here ]------------ | Link to test |