Editing crashreport #74168

ReasonCrashing FunctionWhere to cut BacktraceReports Count
kernel BUG at ldiskfs_put_supergeneric_shutdown_super
kill_block_super
deactivate_locked_super
cleanup_mnt
osd_umount
osd_device_fini
obd_precleanup
class_cleanup
class_process_config
class_manual_cleanup
osd_obd_disconnect
lustre_put_lsi_free
lustre_put_lsi
server_put_super
generic_shutdown_super
kill_anon_super
deactivate_locked_super
cleanup_mnt
task_work_run
exit_to_usermode_loop
do_syscall_64
entry_SYSCALL_64_after_hwframe
15

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
mmp test complete, duration 1901 sec
kernel BUG at /tmp/rpmbuild-lustre-jenkins-Ui9P732t/BUILD/lustre-2.17.51_23_gb36f204/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP PTI
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ffffbf09c56279f8 EFLAGS: 00010293
RAX: ffff9f23aaa01858 RBX: ffff9f23a9c89720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff9f23fbc1e698 RDI: ffff9f23fbc1e698
RBP: ffff9f23a9c89000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ffffbf09c5627810 R12: ffff9f23a9c89720
R13: ffff9f2395f29800 R14: ffffffffc13fcc70 R15: ffff9f23c23b8520
FS: 00007f1685a95080(0000) GS:ffff9f23fbc00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055a1bc589ee8 CR3: 0000000128e6a004 CR4: 0000000000170ef0
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts);
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds3' ' /proc/mounts);
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts);
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1
Lustre: DEBUG MARKER: modprobe dm-flakey;
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey >/dev/null 2>&1
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey 2>&1
Lustre: DEBUG MARKER: test -b /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1; mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1
LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
Lustre: Skipped 13 previous similar messages
LDISKFS-fs error (device dm-3): mb_free_blocks:1962: group 10, block 225360:freeing already freed block (bit 16880); block bitmap corrupt.
Aborting journal on device dm-3-8.
LDISKFS-fs (dm-3): Remounting filesystem read-only
LDISKFS-fs warning (device dm-3): ldiskfs_mb_generate_buddy:1239: group 10: block bitmap and bg descriptor inconsistent: 3466 vs 3468 free clusters 3946 in gd, 1 pa's
LDISKFS-fs error (device dm-3) in osd_trans_stop:2340: IO failure
LustreError: 178024:0:(osd_handler.c:2343:osd_trans_stop()) lustre-MDT0000: failed to stop transaction: rc = -5
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check
LustreError: 178198:0:(obd_sysfs.c:269:health_check_show()) lustre-MDT0000-osd: device reported unhealthy
Lustre: DEBUG MARKER: /usr/sbin/lctl mark mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: \'NOT HEALTHY\'
Lustre: DEBUG MARKER: mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: 'NOT HEALTHY'
Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-2/2026-03-27/lustre-reviews_review-dne-subtest-change_122939_104_1853660e-67b8-4caf-b360-19cdfc75c178//mmp.test_10.debug_log.$(hostname -s).1774591669.log;
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1
LustreError: 178640:0:(osd_handler.c:2455:osd_drop_preallocated_space()) lustre-MDT0000: can't truncate: rc=-30
LDISKFS-fs (dm-3): Inode 576 (00000000b61feaea): orphan list check failed!
00000000b61feaea: 0001f30a 00000004 00000000 00000000 ................
00000000c47bbf7a: 00000004 000372df 00000000 00000000 .....r..........
000000004b81bf7e: 00000000 00000000 00000000 00000000 ................
000000004cb5791f: 00000000 00000000 00000000 00000000 ................
000000000ad436a0: 00000000 00000000 00000000 00000001 ................
00000000dc8415cc: 8e31a190 ffff9f23 8e31a190 ffff9f23 ..1.#.....1.#...
00000000a32605fa: 00000000 00000000 00084000 80000004 .........@......
000000006623e314: 00000000 00000000 8e31a1b8 ffff9f23 ..........1.#...
0000000031c8a6f8: 8e31a1b8 ffff9f23 00000000 00000000 ..1.#...........
000000004e07ff5f: 00000000 00000000 a9c89720 ffff9f23 ........ ...#...
00000000f56cda9e: 8e318098 ffff9f23 00002040 00000000 ..1.#...@ ......
00000000c4845bc1: 00000000 00000000 8e31a1f8 ffff9f23 ..........1.#...
00000000c0177230: 8e31a1f8 ffff9f23 00000000 00000000 ..1.#...........
000000006f069fd0: 00000000 00000000 00000000 00000000 ................
00000000cdba2807: 8e31a220 ffff9f23 8e31a220 ffff9f23 .1.#... .1.#...
000000002843d953: 00000000 00000000 00000000 00000000 ................
000000009cc4214f: 000881a4 00000000 00000000 00000280 ................
0000000096186928: 00000000 00000000 00000000 00000000 ................
000000004d626c5c: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#...
00000000904b5e4f: 8e31a3b8 ffff9f23 842a0c40 ffff9f23 ..1.#...@.*.#...
000000001f00f164: 00000240 00000000 00000001 00000000 @...............
000000008aec56b5: 00002040 00000000 69c61eb5 00000000 @ .........i....
000000003843a0c6: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000a50d4b1e: 00000000 00000000 69c61eb5 00000000 ...........i....
0000000037f8beca: 00000000 00000000 00000000 00000000 ................
00000000066cdeeb: 0000000c 00000000 00000020 00000000 ........ .......
00000000524b57c6: 00000060 00000000 00000000 00000000 `...............
00000000c4dd3772: 8e31a2f0 ffff9f23 8e31a2f0 ffff9f23 ..1.#.....1.#...
000000004753a2b9: 00000000 00000000 00000000 00000000 ................
00000000b576e37b: 001c0e13 00000001 00000000 00000000 ................
000000000be5cff9: 00000000 00000000 00000000 00000000 ................
00000000f59eaae6: 8e31a330 ffff9f23 8e31a330 ffff9f23 0.1.#...0.1.#...
00000000700cc572: 00000000 00000000 00000000 00000000 ................
000000003541bb38: 8e31a350 ffff9f23 8e31a350 ffff9f23 P.1.#...P.1.#...
0000000067e7c0a6: 8e31a360 ffff9f23 8e31a360 ffff9f23 `.1.#...`.1.#...
00000000f14a41b5: 8e31a370 ffff9f23 8e31a370 ffff9f23 p.1.#...p.1.#...
000000007a1fc688: 00000000 00000000 00000000 00000000 ................
00000000275a4b7f: 00000002 00000000 00000000 00000000 ................
000000009a1323a5: 00000000 00000000 c13f6580 ffffffff .........e?.....
00000000067619b9: 00000000 00000000 8e31a240 ffff9f23 ........@.1.#...
00000000061cb1af: 00000000 00000021 00000000 00000000 ....!...........
0000000089f90a79: 00000000 00000000 00000000 00000000 ................
000000000491997f: 00000000 00000000 00000000 00000000 ................
000000004f82a63a: 00000000 00000000 8e31a3f8 ffff9f23 ..........1.#...
0000000061e0d28a: 8e31a3f8 ffff9f23 00000000 00000000 ..1.#...........
00000000705e47d8: 00000000 00000000 00000000 00000000 ................
000000006fd6d0a5: 00000000 00000000 00000000 00000000 ................
0000000046be4182: c13f38e0 ffffffff 00000010 00000000 .8?.............
00000000e57394b1: 00000000 006200ca 8e31a448 ffff9f23 ......b.H.1.#...
00000000e8d89389: 8e31a448 ffff9f23 00000000 00000000 H.1.#...........
000000006298b813: 00000000 00000000 00000000 00000000 ................
0000000060fdb4ef: 00000000 00000000 00000000 00000000 ................
0000000063dfa033: 00000000 00000000 8e31a488 ffff9f23 ..........1.#...
00000000fc16d167: 8e31a488 ffff9f23 00000000 00000000 ..1.#...........
00000000c3d13f8f: 274d6518 00000000 00000000 00000000 .eM'............
0000000026f3a660: 00000000 00000000 00000000 00000000 ................
000000006524348d: 00000000 00000000 00000000 00000000 ................
0000000068be0756: 00000000 00000000 69c61eb5 00000000 ...........i....
000000007bcc9711: 0efdee22 00000000 00000000 00000000 "...............
00000000e024a0fe: 8e31a4f0 ffff9f23 8e31a4f0 ffff9f23 ..1.#.....1.#...
00000000403bb030: 00000000 ffff9f23 00000000 00000000 ....#...........
00000000114e0c44: 00000000 00000000 00000000 00000000 ................
00000000f0186abd: 8e31a520 ffff9f23 8e31a520 ffff9f23 .1.#... .1.#...
0000000054594e1b: 00000000 00000000 00000000 ffffffff ................
000000009fd42c39: 00000000 ffffffff 00000000 00000000 ................
00000000d2bf4e50: 00000020 ffff9f23 00000000 00000000 ...#...........
00000000b30e0f8a: 00000000 00000000 8e31a568 ffff9f23 ........h.1.#...
000000000be735b9: 8e31a568 ffff9f23 ffffffe0 0000000f h.1.#...........
0000000035d2f7ed: 8e31a580 ffff9f23 8e31a580 ffff9f23 ..1.#.....1.#...
00000000bd560a75: c13e3500 ffffffff 69c61bcc 00000000 .5>........i....
00000000d30fc6c5: 10cedc09 00000000 00000000 00000000 ................
000000004f83854b: 0000000c 00000000 00000000 00000000 ................
00000000f31671bc: 000001f3 000001f3 00000000 00000000 ................
00000000bcbfcc2d: 00000000 00000000 00000000 00000000 ................
000000000654ba7f: 00000000 00000000 00000000 00000000 ................
00000000f1946104: 00000000 00000000 ........
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50
RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0
R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50
R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 577 (00000000efae7cf6): orphan list check failed!
00000000efae7cf6: 0001f30a 00000004 00000000 00000000 ................
00000000b7980af8: 00000004 000372e3 00000000 00000000 .....r..........
0000000033305509: 00000000 00000000 00000000 00000000 ................
00000000e985dbca: 00000000 00000000 00000000 00000240 ............@...
00000000e8c20942: 00000000 00000000 00000000 00000001 ................
00000000b3d075f0: 8e318050 ffff9f23 8e318050 ffff9f23 P.1.#...P.1.#...
00000000af5fc306: 00000000 00000000 00084000 80000004 .........@......
00000000fc56082a: 00000000 00000000 8e318078 ffff9f23 ........x.1.#...
0000000071284652: 8e318078 ffff9f23 00000000 00000000 x.1.#...........
0000000020a57267: 00000000 00000000 8e31a1d8 ffff9f23 ..........1.#...
000000008fe34a81: 8e319858 ffff9f23 00002040 00000000 X.1.#...@ ......
00000000c0a46cef: 00000000 00000000 8e3180b8 ffff9f23 ..........1.#...
00000000bdf20e04: 8e3180b8 ffff9f23 00000000 00000000 ..1.#...........
0000000034f13dd5: 00000000 00000000 00000000 00000000 ................
00000000d84bee65: 8e3180e0 ffff9f23 8e3180e0 ffff9f23 ..1.#.....1.#...
00000000dd8984f6: 00000000 00000000 00000000 00000000 ................
000000000c18ec88: 000881a4 00000000 00000000 00000280 ................
0000000011533763: 00000000 00000000 00000000 00000000 ................
0000000085c4bed4: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#...
00000000ba37ec51: 8e318278 ffff9f23 842a0200 ffff9f23 x.1.#.....*.#...
00000000508967a0: 00000241 00000000 00000001 00000000 A...............
000000004efe87fe: 00002040 00000000 69c61eb5 00000000 @ .........i....
0000000037ec5641: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000996c1bdf: 00000000 00000000 69c61eb5 00000000 ...........i....
000000000d1fadf0: 00000000 00000000 00000000 00000000 ................
000000002eba089c: 0000000c 00000000 00000020 00000000 ........ .......
000000008c1cc977: 00000060 00000000 00000000 00000000 `...............
0000000025569576: 8e3181b0 ffff9f23 8e3181b0 ffff9f23 ..1.#.....1.#...
00000000713941f5: 00000000 00000000 00000000 00000000 ................
000000003892fc72: 001c0e15 00000001 00000000 00000000 ................
000000003c74535e: 00000000 00000000 00000000 00000000 ................
000000005452cd0b: 8e3181f0 ffff9f23 8e3181f0 ffff9f23 ..1.#.....1.#...
0000000040a48a43: 00000000 00000000 00000000 00000000 ................
00000000e3fdd6d8: 8e318210 ffff9f23 8e318210 ffff9f23 ..1.#.....1.#...
000000003f52e3e2: 8e318220 ffff9f23 8e318220 ffff9f23 .1.#... .1.#...
0000000041712585: 8e318230 ffff9f23 8e318230 ffff9f23 0.1.#...0.1.#...
00000000ac8285f4: 00000000 00000000 00000000 00000000 ................
0000000040d3d541: 00000002 00000000 00000000 00000000 ................
00000000fb45c44e: 00000000 00000000 c13f6580 ffffffff .........e?.....
00000000c1eac0d9: 00000000 00000000 8e318100 ffff9f23 ..........1.#...
0000000003572ee2: 00000000 00000021 00000000 00000000 ....!...........
0000000001977719: 00000000 00000000 00000000 00000000 ................
0000000051192341: 00000000 00000000 00000000 00000000 ................
000000001f6286d2: 00000000 00000000 8e3182b8 ffff9f23 ..........1.#...
000000002cf37804: 8e3182b8 ffff9f23 00000000 00000000 ..1.#...........
00000000adad12b1: 00000000 00000000 00000000 00000000 ................
00000000fd7f2f49: 00000000 00000000 00000000 00000000 ................
000000001195caac: c13f38e0 ffffffff 00000010 00000000 .8?.............
00000000c2a5afde: 00000000 006200ca 8e318308 ffff9f23 ......b...1.#...
000000004c4f3201: 8e318308 ffff9f23 00000000 00000000 ..1.#...........
0000000065e4c9b7: 00000000 00000000 00000000 00000000 ................
000000001ea64da4: 00000000 00000000 00000000 00000000 ................
00000000e2108748: 00000000 00000000 8e318348 ffff9f23 ........H.1.#...
0000000026c6be1b: 8e318348 ffff9f23 00000000 00000000 H.1.#...........
00000000d55506e0: 42d3ea40 00000000 00000000 00000000 @..B............
00000000d70682dd: 00000000 00000000 00000000 00000000 ................
00000000c57c0312: 00000000 00000000 00000000 00000000 ................
00000000a853c50f: 00000000 00000000 69c61eb5 00000000 ...........i....
0000000099727151: 0f1c729f 00000000 00000000 ffff9f23 .r..........#...
00000000c679a8b4: 8e3183b0 ffff9f23 8e3183b0 ffff9f23 ..1.#.....1.#...
00000000fb7ed445: 00000000 ffff9f23 00000000 00000000 ....#...........
000000006c6d0442: 00000000 00000000 00000000 00000000 ................
00000000c9348b3d: 8e3183e0 ffff9f23 8e3183e0 ffff9f23 ..1.#.....1.#...
000000000c9aa24d: 00000000 00000000 00000000 ffffffff ................
00000000f771ff84: 00000000 00000000 00000000 00000000 ................
000000004b4c579d: 00000020 00000021 00000000 00000000 ...!...........
00000000ea27a427: 00000000 00000000 8e318428 ffff9f23 ........(.1.#...
00000000dc42589d: 8e318428 ffff9f23 ffffffe0 0000000f (.1.#...........
000000006104aba4: 8e318440 ffff9f23 8e318440 ffff9f23 @.1.#...@.1.#...
000000000f1c1a43: c13e3500 ffffffff 00000000 00000000 .5>.............
0000000026688276: 00000000 00000000 00000000 00000000 ................
000000008ec1ddcb: 00000000 00000000 00000000 00000000 ................
00000000487c4d3a: 000001f3 000001f3 00000000 00000000 ................
000000008bb9edec: 00000000 00000000 00000000 00000000 ................
000000004422f116: 00000000 00000000 00000000 00000000 ................
00000000f0100613: 00000000 00000000 ........
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50
RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0
R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50
R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 578 (00000000e337e33d): orphan list check failed!
00000000e337e33d: 0001f30a 00000004 00000000 00000000 ................
000000000fa89e6b: 00000004 000372e7 00000000 00000000 .....r..........
0000000011277dad: 00000000 00000000 00000000 00000000 ................
000000001e3ac533: 00000000 00000000 00000000 00000241 ............A...
00000000bcebc335: 00000000 00000000 00000000 00000001 ................
000000009beee06e: 8e319810 ffff9f23 8e319810 ffff9f23 ..1.#.....1.#...
000000004aa76898: 00000000 00000000 00084000 80000004 .........@......
0000000014309ea0: 00000000 00000000 8e319838 ffff9f23 ........8.1.#...
000000003535017a: 8e319838 ffff9f23 00000000 00000000 8.1.#...........
00000000554c656f: 00000000 00000000 8e318098 ffff9f23 ..........1.#...
00000000f954f12e: 8e31ab58 ffff9f23 00002040 00000000 X.1.#...@ ......
0000000032fd6d32: 00000000 00000000 8e319878 ffff9f23 ........x.1.#...
0000000015c3fe30: 8e319878 ffff9f23 00000000 00000000 x.1.#...........
000000005473c8bf: 00000000 00000000 00000000 00000000 ................
000000004b0672e6: 8e3198a0 ffff9f23 8e3198a0 ffff9f23 ..1.#.....1.#...
00000000020b8208: 00000000 00000000 00000000 00000000 ................
00000000df14a9ba: 000881a4 00000000 00000000 00000280 ................
00000000b4a7095e: 00000000 00000000 00000000 00000000 ................
000000000118104c: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#...
00000000afb20971: 8e319a38 ffff9f23 842a0680 ffff9f23 8.1.#.....*.#...
0000000094627f9f: 00000242 00000000 00000001 00000000 B...............
00000000ca214d7e: 00002040 00000000 69c61eb5 00000000 @ .........i....
00000000742bf598: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000b19073d6: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000eee43435: 00000000 00000000 00000000 00000000 ................
00000000a34aee59: 0000000c 00000000 00000020 00000000 ........ .......
00000000c65a7f14: 00000060 00000000 00000000 00000000 `...............
000000006e80f61b: 8e319970 ffff9f23 8e319970 ffff9f23 p.1.#...p.1.#...
000000001e610abe: 00000000 00000000 00000000 00000000 ................
000000009366ddb7: 001c0e16 00000001 00000000 00000000 ................
00000000cc446301: 00000000 00000000 00000000 00000000 ................
000000003c7d0a76: 8e3199b0 ffff9f23 8e3199b0 ffff9f23 ..1.#.....1.#...
0000000043319c32: 00000000 00000000 00000000 00000000 ................
00000000d05023a6: 8e3199d0 ffff9f23 8e3199d0 ffff9f23 ..1.#.....1.#...
00000000e648dc90: 8e3199e0 ffff9f23 8e3199e0 ffff9f23 ..1.#.....1.#...
00000000c360b9d8: 8e3199f0 ffff9f23 8e3199f0 ffff9f23 ..1.#.....1.#...
00000000493c8262: 00000000 00000000 00000000 00000000 ................
00000000f19d902d: 00000002 00000000 00000000 00000000 ................
00000000f8f3de8b: 00000000 00000000 c13f6580 ffffffff .........e?.....
00000000151fefd9: 00000000 00000000 8e3198c0 ffff9f23 ..........1.#...
00000000e12e1cbf: 00000000 00000021 00000000 00000000 ....!...........
000000001745849c: 00000000 00000000 00000000 00000000 ................
000000009c1e7834: 00000000 00000000 00000000 00000000 ................
000000005223f125: 00000000 00000000 8e319a78 ffff9f23 ........x.1.#...
00000000461d30cf: 8e319a78 ffff9f23 00000000 00000000 x.1.#...........
0000000021c0e110: 00000000 00000000 00000000 00000000 ................
000000007d4d7dcb: 00000000 00000000 00000000 00000000 ................
00000000ee6f93b7: c13f38e0 ffffffff 00000010 00000000 .8?.............
000000008633e84a: 00000000 006200ca 8e319ac8 ffff9f23 ......b...1.#...
00000000b66109e6: 8e319ac8 ffff9f23 00000000 00000000 ..1.#...........
000000003b555195: 00000000 00000000 00000000 00000000 ................
00000000dc8285c2: 00000000 00000000 00000000 00000000 ................
00000000f4833bc9: 00000000 00000000 8e319b08 ffff9f23 ..........1.#...
000000000591f7f3: 8e319b08 ffff9f23 00000000 00000000 ..1.#...........
00000000cb57dc04: 22f83855 00000000 00000000 00000000 U8."............
00000000c54cec38: 00000000 00000000 00000000 00000000 ................
0000000023878270: 00000000 00000000 00000000 00000000 ................
000000005e5da414: 00000000 00000000 69c61eb5 00000000 ...........i....
0000000040e9a641: 0f2bb4dd 00000000 00000000 00000000 ..+.............
00000000e353a342: 8e319b70 ffff9f23 8e319b70 ffff9f23 p.1.#...p.1.#...
0000000051b865ba: 00000000 00000000 00000000 00000000 ................
00000000eab8ae50: 00000000 00000000 00000000 00000000 ................
000000006c7937df: 8e319ba0 ffff9f23 8e319ba0 ffff9f23 ..1.#.....1.#...
0000000030942c07: 00000000 00000000 00000000 ffffffff ................
00000000379a6f9d: 00000000 00000000 00000000 00000000 ................
000000006db2c717: 00000020 00000000 00000000 00000000 ...............
000000003d3ff5a8: 00000000 00000000 8e319be8 ffff9f23 ..........1.#...
00000000191688e0: 8e319be8 ffff9f23 ffffffe0 0000000f ..1.#...........
00000000eea62bb2: 8e319c00 ffff9f23 8e319c00 ffff9f23 ..1.#.....1.#...
000000000adb78f5: c13e3500 ffffffff 00000000 00000000 .5>.............
00000000d18f31d1: 00000000 00000000 79a79f44 677ba145 ........D..yE.{g
00000000e3624213: 000341ed 00000000 00000000 00000000 .A..............
00000000e75b571c: 000001f3 000001f3 00000000 00000000 ................
00000000f4e71bc0: 00000000 00000000 00000000 00000000 ................
0000000027b2660c: 00000000 00000000 c36bd680 00000000 ..........k.....
000000005c0fb7eb: 00035d84 00000000 .]......
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50
RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0
R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50
R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 579 (00000000ab8a589c): orphan list check failed!
00000000ab8a589c: 0001f30a 00000004 00000000 00000000 ................
0000000092ff1fd7: 00000004 000372eb 00000000 00000000 .....r..........
000000002c689bee: 00000000 00000000 00000000 00000000 ................
00000000d5d34080: 00000000 00000000 00000000 00000242 ............B...
00000000674579c9: 00000000 00000000 00000000 00000001 ................
000000002d9dff5a: 8e31ab10 ffff9f23 8e31ab10 ffff9f23 ..1.#.....1.#...
0000000002428c67: 00000000 00000000 00084000 80000004 .........@......
000000000faf5e56: 00000000 00000000 8e31ab38 ffff9f23 ........8.1.#...
00000000b91edb92: 8e31ab38 ffff9f23 00000000 00000000 8.1.#...........
00000000f21f5620: 00000000 00000000 8e319858 ffff9f23 ........X.1.#...
000000008dd7f552: 8e318558 ffff9f23 00002040 00000000 X.1.#...@ ......
00000000908f1221: 00000000 00000000 8e31ab78 ffff9f23 ........x.1.#...
000000002f6a2fbe: 8e31ab78 ffff9f23 00000000 00000000 x.1.#...........
0000000029c85e8d: 00000000 00000000 00000000 00000000 ................
000000004112749d: 8e31aba0 ffff9f23 8e31aba0 ffff9f23 ..1.#.....1.#...
0000000079303e93: 00000000 00000000 00000000 00000000 ................
00000000d7aea715: 000881a4 00000000 00000000 00000280 ................
000000000d79e1b3: 00000000 00000000 00000000 00000000 ................
00000000828ec222: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#...
00000000a2f6d8a9: 8e31ad38 ffff9f23 c19ffe00 ffff9f23 8.1.#.......#...
00000000b8caf025: 00000243 00000000 00000001 00000000 C...............
000000006f35a18f: 00002040 00000000 69c61eb5 00000000 @ .........i....
00000000e1b8d96d: 00000000 00000000 69c61eb5 00000000 ...........i....
000000006069af8d: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000c94e641c: 00000000 00000000 00000000 00000000 ................
00000000ef607272: 0000000c 00000000 00000020 00000000 ........ .......
000000006b060f8b: 00000060 00000000 00000000 00000000 `...............
0000000098f71a03: 8e31ac70 ffff9f23 8e31ac70 ffff9f23 p.1.#...p.1.#...
0000000065b13196: 00000000 00000000 00000000 00000000 ................
0000000090287aae: 001c0e17 00000001 00000000 00000000 ................
000000001c8623c5: 00000000 00000000 00000000 00000000 ................
0000000005d45f64: 8e31acb0 ffff9f23 8e31acb0 ffff9f23 ..1.#.....1.#...
00000000cff1922b: 00000000 00000000 00000000 00000000 ................
00000000eb8f606f: 8e31acd0 ffff9f23 8e31acd0 ffff9f23 ..1.#.....1.#...
0000000014fbe2a1: 8e31ace0 ffff9f23 8e31ace0 ffff9f23 ..1.#.....1.#...
000000001e40ef0d: 8e31acf0 ffff9f23 8e31acf0 ffff9f23 ..1.#.....1.#...
00000000ba058d51: 00000000 00000000 00000000 00000000 ................
00000000582093bb: 00000002 00000000 00000000 00000000 ................
0000000004ed86ee: 00000000 00000000 c13f6580 ffffffff .........e?.....
000000000aa2b28d: 00000000 00000000 8e31abc0 ffff9f23 ..........1.#...
000000008c0af1a6: 00000000 00000021 00000000 00000000 ....!...........
0000000026a5eab3: 00000000 00000000 00000000 00000000 ................
00000000010ee638: 00000000 00000000 00000000 00000000 ................
00000000bd65e2f6: 00000000 00000000 8e31ad78 ffff9f23 ........x.1.#...
000000006e78dbc4: 8e31ad78 ffff9f23 00000000 00000000 x.1.#...........
0000000059bb23b0: 00000000 00000000 00000000 00000000 ................
0000000044cbb394: 00000000 00000000 00000000 00000000 ................
0000000045c86e8a: c13f38e0 ffffffff 00000010 00000000 .8?.............
000000002c1f5135: 00000000 006200ca 8e31adc8 ffff9f23 ......b...1.#...
00000000f0ba3311: 8e31adc8 ffff9f23 00000000 00000000 ..1.#...........
00000000693780c7: 00000000 00000000 00000000 00000000 ................
00000000e2635c98: 00000000 00000000 00000000 00000000 ................
000000005595a11a: 00000000 00000000 8e31ae08 ffff9f23 ..........1.#...
000000007a09e2fd: 8e31ae08 ffff9f23 00000000 00000000 ..1.#...........
00000000f21576f9: b0e3fee9 00000000 00000000 00000000 ................
00000000633f7d71: 00000000 00000000 00000000 00000000 ................
0000000078a7ee40: 00000000 00000000 00000000 00000000 ................
000000004b880dae: 00000000 00000021 69c61eb5 00000000 ....!......i....
00000000c6e61f17: 0f3af71b 00000000 00000000 00000000 ..:.............
00000000d667b7a7: 8e31ae70 ffff9f23 8e31ae70 ffff9f23 p.1.#...p.1.#...
0000000045adb43a: 00000000 00000000 00000000 00000000 ................
00000000830c9478: 00000000 00000000 00000000 00000000 ................
000000002342d64d: 8e31aea0 ffff9f23 8e31aea0 ffff9f23 ..1.#.....1.#...
00000000bc7b1cb1: 00000000 00000000 00000000 ffffffff ................
000000004483def6: 00000000 ffffffff 00000000 00000000 ................
00000000a685920d: 00000020 006200ca 00000000 00000000 .....b.........
000000001474a66d: 00000000 ffff9f23 8e31aee8 ffff9f23 ....#.....1.#...
000000005e46dc43: 8e31aee8 ffff9f23 ffffffe0 0000000f ..1.#...........
000000009af1c00b: 8e31af00 ffff9f23 8e31af00 ffff9f23 ..1.#.....1.#...
000000003bb2559c: c13e3500 ffffffff 8e31af18 ffff9f23 .5>.......1.#...
00000000e44d1887: 8e31af18 ffff9f23 00000016 00000000 ..1.#...........
00000000fc026b37: 00000000 00000000 00000000 00000000 ................
00000000a1081f6c: 000001f3 000001f3 00000000 00000000 ................
00000000787518e5: 00000000 00000000 00000000 00000000 ................
00000000355290dd: 00000000 00000000 00000000 00000000 ................
0000000098709955: ffffffff ffffffff ........
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50
RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0
R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50
R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 580 (00000000217a4e26): orphan list check failed!
00000000217a4e26: 0001f30a 00000004 00000000 00000000 ................
00000000bd1488cb: 00000004 000372ef 00000000 00000000 .....r..........
0000000018cbd825: 00000000 00000000 00000000 00000000 ................
000000001fe1c11d: 00000000 00000000 00000000 00000243 ............C...
00000000338545b4: 00000000 00000000 00000000 00000001 ................
00000000a0c7e545: 8e318510 ffff9f23 8e318510 ffff9f23 ..1.#.....1.#...
00000000ce1b7309: 00000000 00000000 00084000 80000004 .........@......
000000003d21ab75: 00000000 00000000 8e318538 ffff9f23 ........8.1.#...
00000000d7be9aac: 8e318538 ffff9f23 00000000 00000000 8.1.#...........
000000004177e000: 00000000 00000000 8e31ab58 ffff9f23 ........X.1.#...
00000000097fd495: aaa021d8 ffff9f23 00002040 00000000 .!..#...@ ......
0000000060d389fb: 00000000 00000000 8e318578 ffff9f23 ........x.1.#...
000000001a10fd8a: 8e318578 ffff9f23 00000000 00000000 x.1.#...........
00000000714d5e1a: 00000000 00000000 00000000 00000000 ................
00000000876c96f8: 8e3185a0 ffff9f23 8e3185a0 ffff9f23 ..1.#.....1.#...
0000000049444e62: 00000000 00000000 00000000 00000000 ................
00000000bc6f781b: 000881a4 00000000 00000000 00000280 ................
00000000c0238a39: 00000000 00000000 00000000 00000000 ................
00000000b1f4cb3e: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#...
0000000065cd93e0: 8e318738 ffff9f23 c19ffdc0 ffff9f23 8.1.#.......#...
00000000929f12c5: 00000244 00000000 00000001 00000000 D...............
00000000d93f0ae6: 00002040 00000000 69c61eb5 00000000 @ .........i....
00000000c34c583e: 00000000 00000000 69c61eb5 00000000 ...........i....
000000003dcc9a2b: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000790e7379: 00000000 00000000 00000000 00000000 ................
0000000060fd5fe6: 0000000c 00000000 00000020 00000000 ........ .......
00000000c54ce7cf: 00000060 00000000 00000000 00000000 `...............
000000003a2a8c3e: 8e318670 ffff9f23 8e318670 ffff9f23 p.1.#...p.1.#...
00000000f57fc1c0: 00000000 00000000 00000000 00000000 ................
00000000fdae1cd4: 001c0e18 00000001 00000000 00000000 ................
000000001c628aaf: 00000000 00000000 00000000 00000000 ................
00000000e2c28c09: 8e3186b0 ffff9f23 8e3186b0 ffff9f23 ..1.#.....1.#...
00000000cadb14a7: 00000000 00000000 00000000 00000000 ................
00000000688beba9: 8e3186d0 ffff9f23 8e3186d0 ffff9f23 ..1.#.....1.#...
00000000521a4760: 8e3186e0 ffff9f23 8e3186e0 ffff9f23 ..1.#.....1.#...
0000000078da5cc4: 8e3186f0 ffff9f23 8e3186f0 ffff9f23 ..1.#.....1.#...
0000000024f01d54: 00000000 00000000 00000000 00000000 ................
0000000014d13f4a: 00000002 00000000 00000000 00000000 ................
00000000ae8bec3f: 00000000 00000000 c13f6580 ffffffff .........e?.....
000000004966730a: 00000000 00000000 8e3185c0 ffff9f23 ..........1.#...
0000000023462c42: 00000000 00000021 00000000 00000000 ....!...........
000000008693f1dc: 00000000 00000000 00000000 00000000 ................
00000000181927f1: 00000000 00000000 00000000 00000000 ................
000000005ddb8bb6: 00000000 00000000 8e318778 ffff9f23 ........x.1.#...
00000000a965d55f: 8e318778 ffff9f23 00000000 00000000 x.1.#...........
000000000a565ee1: 00000000 00000000 00000000 00000000 ................
0000000039da274f: 00000000 00000000 00000000 00000000 ................
000000001641b2ef: c13f38e0 ffffffff 00000010 00000000 .8?.............
00000000e4bd8e7a: 00000000 006200ca 8e3187c8 ffff9f23 ......b...1.#...
00000000576cbb45: 8e3187c8 ffff9f23 00000000 00000000 ..1.#...........
00000000b0640347: 00000000 00000000 00000000 00000000 ................
000000003b6675b0: 00000000 00000000 00000000 00000000 ................
00000000ed9f809f: 00000000 00000000 8e318808 ffff9f23 ..........1.#...
00000000c723561a: 8e318808 ffff9f23 00000000 00000000 ..1.#...........
00000000d4fc5050: 05a14c89 00000000 00000000 00000000 .L..............
000000002da14703: 00000000 00000000 00000000 00000000 ................
00000000b5a02cb3: 00000000 00000000 00000000 00000000 ................
000000009538b653: 00000000 00000000 69c61eb5 00000000 ...........i....
0000000049ca4ff4: 0f4a3959 00000000 00000000 ffff9f23 Y9J.........#...
00000000da7a2158: 8e318870 ffff9f23 8e318870 ffff9f23 p.1.#...p.1.#...
00000000e1253d0d: 00000000 00000000 00000000 00000000 ................
00000000078bea02: 00000000 00000000 00000000 00000000 ................
00000000dea4d71c: 8e3188a0 ffff9f23 8e3188a0 ffff9f23 ..1.#.....1.#...
00000000e0d3d8ee: 00000000 00000000 00000000 ffffffff ................
000000001173dcba: 00000000 ffff9f23 00000000 00000000 ....#...........
00000000d597e56c: 00000020 ffff9f23 00000000 00000000 ...#...........
00000000ee24a50a: 00000000 ffff9f23 8e3188e8 ffff9f23 ....#.....1.#...
00000000af0a5ee2: 8e3188e8 ffff9f23 ffffffe0 0000000f ..1.#...........
000000004f83ad0d: 8e318900 ffff9f23 8e318900 ffff9f23 ..1.#.....1.#...
000000001f8a5b0b: c13e3500 ffffffff b2643f80 ffffffff .5>......?d.....
00000000f931d78d: 00000000 00000000 8e3187b0 ffff9f23 ..........1.#...
00000000d8f85a63: 00000000 00000021 00000000 00000000 ....!...........
00000000d4302368: 000001f3 000001f3 00000000 00000000 ................
000000000c94719e: 00000000 00000000 00000000 00000000 ................
0000000055390206: 00000000 00000000 8e318968 00000000 ........h.1.....
00000000d1e1fd58: 8e318968 ffff9f23 h.1.#...
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50
RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0
R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50
R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 581 (000000008cec671e): orphan list check failed!
000000008cec671e: 0001f30a 00000004 00000000 00000000 ................
00000000eb91c735: 00000004 000372f3 00000000 00000000 .....r..........
000000000326dcc1: 00000000 00000000 00000000 00000000 ................
00000000a57b689c: 00000000 00000000 00000000 00000244 ............D...
0000000051fa1068: 00000000 00000000 00000000 00000001 ................
00000000d1f3dc64: aaa02190 ffff9f23 aaa02190 ffff9f23 .!..#....!..#...
000000002022c31e: 00000000 00000000 00084000 80000004 .........@......
000000004979b567: 00000000 00000000 aaa021b8 ffff9f23 .........!..#...
00000000a14125b9: aaa021b8 ffff9f23 00000000 00000000 .!..#...........
0000000027604617: 00000000 00000000 8e318558 ffff9f23 ........X.1.#...
000000008819771e: aaa00098 ffff9f23 00002040 00000000 ....#...@ ......
000000004e006814: 00000000 00000000 aaa021f8 ffff9f23 .........!..#...
00000000b75c932a: aaa021f8 ffff9f23 00000000 00000000 .!..#...........
00000000b9cfdd94: 00000000 00000000 00000000 00000000 ................
00000000ad42a51f: aaa02220 ffff9f23 aaa02220 ffff9f23 "..#... "..#...
0000000035b432e1: 00000000 00000000 00000000 00000000 ................
000000001f4f448f: 000881a4 00000000 00000000 00000280 ................
00000000d2fcf52a: 00000000 00000000 00000000 00000000 ................
000000009f224ecc: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#...
00000000a941f293: aaa023b8 ffff9f23 acac4a00 ffff9f23 .#..#....J..#...
000000001d5dfdaa: 00000245 00000000 00000001 00000000 E...............
000000003c1ed741: 00002040 00000000 69c61eb5 00000000 @ .........i....
000000007a7208f3: 00000000 00000000 69c61eb5 00000000 ...........i....
000000001a149a4a: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000b1b4405e: 00000000 00000000 00000000 00000000 ................
000000003ffc24f8: 0000000c 00000000 00000020 00000000 ........ .......
00000000f3e4b3a3: 00000060 00000000 00000000 00000000 `...............
00000000db6d7c88: aaa022f0 ffff9f23 aaa022f0 ffff9f23 ."..#...."..#...
00000000b7e57fcc: 00000000 00000000 00000000 00000000 ................
000000001b9a0e81: 001c0e19 00000001 00000000 00000000 ................
000000004b8a3188: 00000000 00000000 00000000 00000000 ................
00000000bd82d0f2: aaa02330 ffff9f23 aaa02330 ffff9f23 0#..#...0#..#...
00000000433a6009: 00000000 00000000 00000000 00000000 ................
00000000dfe8ec53: aaa02350 ffff9f23 aaa02350 ffff9f23 P#..#...P#..#...
0000000023d1eb9d: aaa02360 ffff9f23 aaa02360 ffff9f23 `#..#...`#..#...
00000000a03ff449: aaa02370 ffff9f23 aaa02370 ffff9f23 p#..#...p#..#...
0000000068bfa02f: 00000000 00000000 00000000 00000000 ................
00000000f4ac4226: 00000002 00000000 00000000 00000000 ................
0000000067fb73e0: 00000000 00000000 c13f6580 ffffffff .........e?.....
00000000087bdf52: 00000000 00000000 aaa02240 ffff9f23 ........@"..#...
00000000f12266ce: 00000000 00000021 00000000 00000000 ....!...........
000000005baad211: 00000000 00000000 00000000 00000000 ................
0000000090accb2c: 00000000 00000000 00000000 00000000 ................
0000000029f62d1b: 00000000 00000000 aaa023f8 ffff9f23 .........#..#...
000000007149c9f3: aaa023f8 ffff9f23 00000000 00000000 .#..#...........
00000000f6fea3b1: 00000000 00000000 00000000 00000000 ................
0000000017bf026f: 00000000 00000000 00000000 00000000 ................
000000002a73ad0e: c13f38e0 ffffffff 00000010 00000000 .8?.............
00000000e012e664: 00000000 006200ca aaa02448 ffff9f23 ......b.H$..#...
00000000aacc62f9: aaa02448 ffff9f23 00000000 00000000 H$..#...........
000000003855efb5: 00000000 00000000 00000000 00000000 ................
000000003136cb98: 00000000 00000000 00000000 00000000 ................
000000008c7cd315: 00000000 00000000 aaa02488 ffff9f23 .........$..#...
0000000094bd36c2: aaa02488 ffff9f23 00000000 00000000 .$..#...........
000000006df29bfa: 42cd0d03 00000000 00000000 00000000 ...B............
0000000071d1b19f: 00000000 00000000 00000000 00000000 ................
00000000031597b8: 00000000 00000000 00000000 00000000 ................
0000000039fd8d37: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000a885c337: 0f4a3959 00000000 00000000 00000000 Y9J.............
000000001ddb1f98: aaa024f0 ffff9f23 aaa024f0 ffff9f23 .$..#....$..#...
00000000cd2bb587: 00000000 00000000 00000000 00000000 ................
00000000ab5c7f02: 00000000 00000000 00000000 00000000 ................
00000000f0da9999: aaa02520 ffff9f23 aaa02520 ffff9f23 %..#... %..#...
000000007e2e50fe: 00000000 00000000 00000000 ffffffff ................
0000000067bd3a39: 00000000 00000000 00000000 00000000 ................
0000000026b5f851: 00000020 00000000 00000000 00000000 ...............
0000000019473dc3: 00000000 00000000 aaa02568 ffff9f23 ........h%..#...
00000000a77aa6c9: aaa02568 ffff9f23 ffffffe0 0000000f h%..#...........
00000000c53c3354: aaa02580 ffff9f23 aaa02580 ffff9f23 .%..#....%..#...
0000000017ffbbd4: c13e3500 ffffffff 00000000 00000000 .5>.............
0000000051fe4d49: 00000000 00000000 00000000 00000000 ................
00000000f689f33c: 00000000 00000000 00000000 00000000 ................
00000000500a9ef5: 000001f3 000001f3 00000000 00000000 ................
0000000066a503ce: 00000000 00000000 00000000 00000000 ................
0000000097a97bf7: 00000000 00000000 00000000 00000000 ................
0000000088738acf: 00000000 00000000 ........
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50
RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0
R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50
R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 582 (0000000014a0b445): orphan list check failed!
0000000014a0b445: 0001f30a 00000004 00000000 00000000 ................
0000000010ff2792: 00000004 000372f7 00000000 00000000 .....r..........
0000000020fecbbc: 00000000 00000000 00000000 00000000 ................
00000000f46a931b: 00000000 00000000 00000000 00000245 ............E...
00000000a6827806: 00000000 00000000 00000000 00000001 ................
00000000b57adab5: aaa00050 ffff9f23 aaa00050 ffff9f23 P...#...P...#...
0000000076aec6ce: 00000000 00000000 00084000 80000004 .........@......
00000000b5eca134: 00000000 00000000 aaa00078 ffff9f23 ........x...#...
0000000026fddaf4: aaa00078 ffff9f23 00000000 00000000 x...#...........
0000000004d64024: 00000000 00000000 aaa021d8 ffff9f23 .........!..#...
0000000000fc774b: aaa01858 ffff9f23 00002040 00000000 X...#...@ ......
000000003bea0e5f: 00000000 00000000 aaa000b8 ffff9f23 ............#...
0000000057a2cb71: aaa000b8 ffff9f23 00000000 00000000 ....#...........
00000000f52c73e1: 00000000 00000000 00000000 00000000 ................
0000000032513e23: aaa000e0 ffff9f23 aaa000e0 ffff9f23 ....#.......#...
00000000f5661ee7: 00000000 00000000 00000000 00000000 ................
00000000dc887a10: 000881a4 00000000 00000000 00000280 ................
00000000d09253f0: 00000000 00000000 00000000 00000000 ................
000000002a501e37: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#...
00000000ce8a018c: aaa00278 ffff9f23 acac4040 ffff9f23 x...#...@@..#...
0000000061486f13: 00000246 00000000 00000001 00000000 F...............
00000000cf861bc8: 00002040 00000000 69c61eb5 00000000 @ .........i....
00000000b83a166b: 00000000 00000000 69c61eb5 00000000 ...........i....
000000001f9e3767: 00000000 00000000 69c61eb5 00000000 ...........i....
0000000030a39253: 00000000 00000000 00000000 00000000 ................
00000000b9aa1e2d: 0000000c 00000000 00000020 00000000 ........ .......
00000000f71163f8: 00000060 00000000 00000000 00000000 `...............
000000005c4c4fbe: aaa001b0 ffff9f23 aaa001b0 ffff9f23 ....#.......#...
0000000059c919a4: 00000000 00000000 00000000 00000000 ................
000000005bb2d886: 001c0e19 00000001 00000000 00000000 ................
000000005a348a28: 00000000 00000000 00000000 00000000 ................
000000001a5094ad: aaa001f0 ffff9f23 aaa001f0 ffff9f23 ....#.......#...
0000000076d2cb0d: 00000000 00000000 00000000 00000000 ................
00000000037031e0: aaa00210 ffff9f23 aaa00210 ffff9f23 ....#.......#...
0000000080f86fc8: aaa00220 ffff9f23 aaa00220 ffff9f23 ...#... ...#...
000000002015b43b: aaa00230 ffff9f23 aaa00230 ffff9f23 0...#...0...#...
00000000870ffe81: 00000000 00000000 00000000 00000000 ................
000000008ebb8aa8: 00000002 00000000 00000000 00000000 ................
000000004b9f62cb: 00000000 00000000 c13f6580 ffffffff .........e?.....
0000000028cdca53: 00000000 00000000 aaa00100 ffff9f23 ............#...
000000005d6f9ffa: 00000000 00000021 00000000 00000000 ....!...........
000000008702b312: 00000000 00000000 00000000 00000000 ................
000000000e5f7142: 00000000 00000000 00000000 00000000 ................
000000003ef70177: 00000000 00000000 aaa002b8 ffff9f23 ............#...
00000000b1b8033a: aaa002b8 ffff9f23 00000000 00000000 ....#...........
000000009ea110bf: 00000000 00000000 00000000 00000000 ................
00000000fe1e30ca: 00000000 00000000 00000000 00000000 ................
0000000013fd9869: c13f38e0 ffffffff 00000010 00000000 .8?.............
00000000658fce65: 00000000 006200ca aaa00308 ffff9f23 ......b.....#...
0000000048e54abc: aaa00308 ffff9f23 00000000 00000000 ....#...........
00000000b2f9c0d4: 00000000 00000000 00000000 00000000 ................
00000000e8bfd996: 00000000 00000000 00000000 00000000 ................
0000000021dc3216: 00000000 00000000 aaa00348 ffff9f23 ........H...#...
00000000d5229e16: aaa00348 ffff9f23 00000000 00000000 H...#...........
000000002f7f911f: 0abf6fe4 00000000 00000000 00000000 .o..............
0000000080147e8c: 00000000 00000000 00000000 00000000 ................
000000006d0ab491: 00000000 00000000 00000000 00000000 ................
000000005bc143bf: 00000000 00000000 69c61eb5 00000000 ...........i....
0000000095474b7c: 0f597b97 00000000 00000000 00000000 .{Y.............
00000000d2383301: aaa003b0 ffff9f23 aaa003b0 ffff9f23 ....#.......#...
00000000574cb289: 00000000 00000000 00000000 00000000 ................
0000000035cc713c: 00000000 00000000 00000000 00000000 ................
000000009aeab6e7: aaa003e0 ffff9f23 aaa003e0 ffff9f23 ....#.......#...
000000005dbe9d3b: 00000000 00000000 00000000 ffffffff ................
00000000b8428503: 00000000 00000000 00000000 00000000 ................
00000000eb49e45e: 00000020 00000000 00000000 00000000 ...............
000000000d6a1bc8: 00000000 00000000 aaa00428 ffff9f23 ........(...#...
0000000096e064ed: aaa00428 ffff9f23 ffffffe0 0000000f (...#...........
00000000e606eeb8: aaa00440 ffff9f23 aaa00440 ffff9f23 @...#...@...#...
0000000041c52175: c13e3500 ffffffff 00000000 00000000 .5>.............
00000000cb8d3d6b: 00000000 00000000 00000000 00000000 ................
0000000011263628: 00000000 00000000 00000000 00000000 ................
00000000a7191376: 000001f3 000001f3 00000000 00000000 ................
00000000c7e12bbc: 00000000 00000000 00000000 00000000 ................
00000000f72ccfd6: 00000000 00000000 00000000 00000000 ................
0000000008957615: 00000000 00000000 ........
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50
RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0
R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50
R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 583 (00000000fb272647): orphan list check failed!
00000000fb272647: 0001f30a 00000004 00000000 00000000 ................
00000000f4a3074f: 00000004 000372fb 00000000 00000000 .....r..........
0000000065df4a83: 00000000 00000000 00000000 00000000 ................
00000000356d59c0: 00000000 00000000 00000000 00000246 ............F...
000000009c4f19eb: 00000000 00000000 00000000 00000001 ................
00000000acae51da: aaa01810 ffff9f23 aaa01810 ffff9f23 ....#.......#...
00000000c4cb36ed: 00000000 00000000 00084000 80000004 .........@......
000000006522e32b: 00000000 00000000 aaa01838 ffff9f23 ........8...#...
00000000ef047001: aaa01838 ffff9f23 00000000 00000000 8...#...........
00000000881dc175: 00000000 00000000 aaa00098 ffff9f23 ............#...
00000000b02a1afb: a9c89720 ffff9f23 00002040 00000000 ...#...@ ......
00000000b97aef20: 00000000 00000000 aaa01878 ffff9f23 ........x...#...
000000009be306c4: aaa01878 ffff9f23 00000000 00000000 x...#...........
0000000022237fae: 00000000 00000000 00000000 00000000 ................
000000009cc24c1c: aaa018a0 ffff9f23 aaa018a0 ffff9f23 ....#.......#...
0000000000486ff0: 00000000 00000000 00000000 00000000 ................
0000000086f83954: 000881a4 00000000 00000000 00000280 ................
00000000de9a757c: 00000000 00000000 00000000 00000000 ................
00000000e518c32b: c13f6480 ffffffff 95f29800 ffff9f23 .d?.........#...
00000000b2ee1f09: aaa01a38 ffff9f23 acac4b80 ffff9f23 8...#....K..#...
00000000e3aba90c: 00000247 00000000 00000001 00000000 G...............
0000000042722cf1: 00002040 00000000 69c61eb5 00000000 @ .........i....
000000000edb915b: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000a7e23d90: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000eaf42791: 00000000 00000000 00000000 00000000 ................
00000000c2f5f9b2: 0000000c 00000000 00000020 00000000 ........ .......
000000009deff075: 00000060 00000000 00000000 00000000 `...............
000000004f022a38: aaa01970 ffff9f23 aaa01970 ffff9f23 p...#...p...#...
0000000043979918: 00000000 00000000 00000000 00000000 ................
00000000b596200d: 001c0e1a 00000001 00000000 00000000 ................
0000000063c5e482: 00000000 00000000 00000000 00000000 ................
0000000086d33556: aaa019b0 ffff9f23 aaa019b0 ffff9f23 ....#.......#...
00000000293bcac5: 00000000 00000000 00000000 00000000 ................
00000000c9ab4d03: aaa019d0 ffff9f23 aaa019d0 ffff9f23 ....#.......#...
00000000d79e858d: aaa019e0 ffff9f23 aaa019e0 ffff9f23 ....#.......#...
000000006caced5d: aaa019f0 ffff9f23 aaa019f0 ffff9f23 ....#.......#...
00000000e1f37e77: 00000000 00000000 00000000 00000000 ................
00000000d24a5749: 00000002 00000000 00000000 00000000 ................
0000000086625dbf: 00000000 00000000 c13f6580 ffffffff .........e?.....
00000000dc8ef1f5: 00000000 00000000 aaa018c0 ffff9f23 ............#...
0000000039b89540: 00000000 00000021 00000000 00000000 ....!...........
00000000bcf2316e: 00000000 00000000 00000000 00000000 ................
0000000079adb885: 00000000 00000000 00000000 00000000 ................
000000002d396424: 00000000 00000000 aaa01a78 ffff9f23 ........x...#...
00000000bc2df6ed: aaa01a78 ffff9f23 00000000 00000000 x...#...........
000000009f7e0381: 00000000 00000000 00000000 00000000 ................
0000000066f654b9: 00000000 00000000 00000000 00000000 ................
000000009ff95e1a: c13f38e0 ffffffff 00000010 00000000 .8?.............
0000000066000ac9: 00000000 006200ca aaa01ac8 ffff9f23 ......b.....#...
000000006ba89fc8: aaa01ac8 ffff9f23 00000000 00000000 ....#...........
00000000bbc640a7: 00000000 00000000 00000000 00000000 ................
00000000faacc68d: 00000000 00000000 00000000 00000000 ................
00000000a4db23fa: 00000000 00000000 aaa01b08 ffff9f23 ............#...
00000000e6695146: aaa01b08 ffff9f23 00000000 00000000 ....#...........
00000000924c0588: bc5b45f5 00000000 00000000 00000000 .E[.............
0000000029804b8e: 00000000 00000000 00000000 00000000 ................
000000001742a195: 00000000 00000000 00000000 00000000 ................
0000000044b9eb0c: 00000000 00000000 69c61eb5 00000000 ...........i....
00000000771cec61: 0f68bdd5 00000000 00000000 00000000 ..h.............
00000000e7669adc: aaa01b70 ffff9f23 aaa01b70 ffff9f23 p...#...p...#...
0000000059a70bcc: 00000000 00000000 00000000 00000000 ................
00000000eca821a8: 00000000 00000000 00000000 00000000 ................
0000000002b6ecd7: aaa01ba0 ffff9f23 aaa01ba0 ffff9f23 ....#.......#...
000000004e5384ed: 00000000 00000000 00000000 ffffffff ................
0000000097829798: 00000000 00000000 00000000 00000000 ................
000000008ce3b5cd: 00000020 00000000 00000000 00000000 ...............
00000000d0949a8f: 00000000 00000000 aaa01be8 ffff9f23 ............#...
0000000046114f92: aaa01be8 ffff9f23 ffffffe0 0000000f ....#...........
00000000bab87155: aaa01c00 ffff9f23 aaa01c00 ffff9f23 ....#.......#...
00000000cc2b215f: c13e3500 ffffffff 00000000 00000000 .5>.............
00000000e2a834bd: 00000000 00000000 00000000 00000000 ................
00000000a1501f93: 00000000 00000000 00000000 00000000 ................
000000004d914805: 000001f3 000001f3 00000000 00000000 ................
00000000954f0248: 00000000 00000000 00000000 00000000 ................
00000000504157f0: 00000000 00000000 00000000 00000000 ................
0000000003c33a6b: 00000000 00000000 ........
CPU: 0 PID: 178640 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f16849ee8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffff1aa1508 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000564cd4aea400 RCX: 00007f16849ee8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000564cd4aeff50
RBP: 0000000000000001 R08: 0000564cd4af9c90 R09: 00007f1684d85bc0
R10: 0000000000000007 R11: 0000000000000202 R12: 0000564cd4aeff50
R13: 00007f1685871184 R14: 0000564cd4af0100 R15: 00000000ffffffff
LDISKFS-fs (dm-3): sb orphan head is 583
sb_info orphan list:
inode dm-3:583 at 0000000086f83954: mode 100644, nlink 1, next 582
inode dm-3:582 at 00000000dc887a10: mode 100644, nlink 1, next 581
inode dm-3:581 at 000000001f4f448f: mode 100644, nlink 1, next 580
inode dm-3:580 at 00000000bc6f781b: mode 100644, nlink 1, next 579
inode dm-3:579 at 00000000d7aea715: mode 100644, nlink 1, next 578
inode dm-3:578 at 00000000df14a9ba: mode 100644, nlink 1, next 577
inode dm-3:577 at 000000000c18ec88: mode 100644, nlink 1, next 576
inode dm-3:576 at 000000009cc4214f: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 344769 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff729230c741b9f8 EFLAGS: 00010293
RAX: ff30faca6f025858 RBX: ff30faca6b24d720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff30facabbb1e698 RDI: ff30facabbb1e698
RBP: ff30faca6b24d000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff729230c741b810 R12: ff30faca6b24d720
R13: ff30faca6b319000 R14: ffffffffc13b08b0 R15: ff30faca450a38e0
FS: 00007fece1210080(0000) GS:ff30facabbb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005615b34a7708 CR3: 00000001030f2004 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fece01698fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2785
sb_info orphan list:
inode dm-2:2785 at 0000000091df60a2: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP PTI
CPU: 1 PID: 333458 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ffffb28d840939f8 EFLAGS: 00010212
RAX: ffff8ce68dd78558 RBX: ffff8ce6b0375720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff8ce6bbd1e698 RDI: ffff8ce6bbd1e698
RBP: ffff8ce6b0375000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ffffb28d84093810 R12: ffff8ce6b0375720
R13: ffff8ce6a80e6000 R14: ffffffffc158b8b0 R15: ffff8ce68612df40
FS: 00007f14e9fa0080(0000) GS:ffff8ce6bbd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055eef1a931a0 CR3: 00000001301f6003 CR4: 0000000000370ee0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? class_manual_cleanup+0x1c8/0x780 [obdclass]
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? __queue_work+0x145/0x3f0
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f14e8ef98fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2814
sb_info orphan list:
inode dm-2:2814 at 000000001cf8c507: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 359567 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff2bdeb8087ab9f8 EFLAGS: 00010212
RAX: ff27efd7ec63ab58 RBX: ff27efd7f49cf720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff27efd83bb1e698 RDI: ff27efd83bb1e698
RBP: ff27efd7f49cf000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff2bdeb8087ab810 R12: ff27efd7f49cf720
R13: ff27efd7d7189000 R14: ffffffffc15768b0 R15: ff27efd7f7a74fa0
FS: 00007f45c30e4080(0000) GS:ff27efd83bb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f28f4134000 CR3: 0000000136f7a001 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f45c203d8fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2799
sb_info orphan list:
inode dm-2:2799 at 00000000c2c4db91: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 328405 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff45af0ec45b79f8 EFLAGS: 00010216
RAX: ff2915eb2fcae698 RBX: ff2915eb31552720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff2915eb7bb1e698 RDI: ff2915eb7bb1e698
RBP: ff2915eb31552000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff45af0ec45b7810 R12: ff2915eb31552720
R13: ff2915eb3171b800 R14: ffffffffc14248b0 R15: ff2915eb467b9280
FS: 00007f34ce3d1080(0000) GS:ff2915eb7bb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055cbf747d1f8 CR3: 000000010216a006 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f34cd32a8fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2757
sb_info orphan list:
inode dm-2:2757 at 0000000069f35175: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 321608 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff6b0acdc480f9f8 EFLAGS: 00010212
RAX: ff1e83e64321c558 RBX: ff1e83e6465f3720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff1e83e67bb1e698 RDI: ff1e83e67bb1e698
RBP: ff1e83e6465f3000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff6b0acdc480f810 R12: ff1e83e6465f3720
R13: ff1e83e631921800 R14: ffffffffc143d8b0 R15: ff1e83e664225be0
FS: 00007f7015be7080(0000) GS:ff1e83e67bb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000055d2822f4008 CR3: 0000000142f9c004 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f7014b408fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2919
sb_info orphan list:
inode dm-2:2919 at 000000002d55c9fa: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 332906 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff79142a04b979f8 EFLAGS: 00010293
RAX: ff251cb23ae5ca18 RBX: ff251cb22b765720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff251cb27bb1e698 RDI: ff251cb27bb1e698
RBP: ff251cb22b765000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff79142a04b97810 R12: ff251cb22b765720
R13: ff251cb22b714000 R14: ffffffffc14008b0 R15: ff251cb25eadb3a0
FS: 00007f2a892c8080(0000) GS:ff251cb27bb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f1460a39000 CR3: 000000013344a003 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f2a882218fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2757
sb_info orphan list:
inode dm-2:2757 at 00000000f42d5812: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 0 PID: 328291 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff6ddf06449639f8 EFLAGS: 00010297
RAX: ff43315ef993d398 RBX: ff43315ef1599720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff43315f3ba1e698 RDI: ff43315f3ba1e698
RBP: ff43315ef1599000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff6ddf0644963810 R12: ff43315ef1599720
R13: ff43315ecd86f000 R14: ffffffffc14328b0 R15: ff43315eec204760
FS: 00007fb87d2db080(0000) GS:ff43315f3ba00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000561fe2de0008 CR3: 000000016acc4004 CR4: 0000000000771ef0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fb87c2348fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2841
sb_info orphan list:
inode dm-2:2841 at 0000000007f88e92: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 0 PID: 358390 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff70ccf9c7f239f8 EFLAGS: 00010216
RAX: ff22440a33154ed8 RBX: ff22440a33a79720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff22440a7ba1e698 RDI: ff22440a7ba1e698
RBP: ff22440a33a79000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff70ccf9c7f23810 R12: ff22440a33a79720
R13: ff22440a31d91800 R14: ffffffffc12b68b0 R15: ff22440a32dba3a0
FS: 00007f6e73af1080(0000) GS:ff22440a7ba00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f4f32b3b018 CR3: 000000013c7a0005 CR4: 0000000000771ef0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f6e72a4a8fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2855
sb_info orphan list:
inode dm-2:2855 at 00000000f61c06bc: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 323374 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff6a2aa6445879f8 EFLAGS: 00010293
RAX: ff34a5d56b54dd18 RBX: ff34a5d569812720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff34a5d5bbb1e698 RDI: ff34a5d5bbb1e698
RBP: ff34a5d569812000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff6a2aa644587810 R12: ff34a5d569812720
R13: ff34a5d571f98000 R14: ffffffffc13768b0 R15: ff34a5d59353a160
FS: 00007ff1eb8a3080(0000) GS:ff34a5d5bbb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 000056401ea28500 CR3: 00000001031c8005 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7ff1ea7fc8fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LDISKFS-fs (dm-2): sb orphan head is 2879
sb_info orphan list:
inode dm-2:2879 at 00000000c2918fbf: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 396331 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff7625d1079839f8 EFLAGS: 00010293
RAX: ff34828f877f2b58 RBX: ff34828f43691720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff34828fbbb1e698 RDI: ff34828fbbb1e698
RBP: ff34828f43691000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff7625d107983810 R12: ff34828f43691720
R13: ff34828f6e269000 R14: ffffffffc15b18b0 R15: ff34828f47d61ac0
FS: 00007f3e3172c080(0000) GS:ff34828fbbb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fc09d765018 CR3: 000000012f338005 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f3e306858fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1
Lustre: lustre-MDT0000: Not available for connect from 10.240.46.41@tcp (stopping)
LustreError: lustre-MDT0000-osp-MDT0002: operation mds_statfs to node 0@lo failed: rc = -107
LustreError: Skipped 2 previous similar messages
Lustre: lustre-MDT0000-osp-MDT0002: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
Lustre: Skipped 11 previous similar messages
Lustre: lustre-MDT0000: Not available for connect from 0@lo (stopping)
Lustre: 370251:0:(gss_svc_upcall.c:720:gss_svc_searchbyctx()) ctx hdl 0x5acc1a9e822bd9df does not have mech ctx: rc = -2
Lustre: 369:0:(gss_svc_upcall.c:720:gss_svc_searchbyctx()) ctx hdl 0x5acc1a9e822bd9e0 does not have mech ctx: rc = -2
Lustre: 369:0:(gss_svc_upcall.c:720:gss_svc_searchbyctx()) Skipped 1 previous similar message
Lustre: lustre-MDT0000: Not available for connect from 10.240.46.41@tcp (stopping)
Lustre: Skipped 4 previous similar messages
LDISKFS-fs (dm-3): sb orphan head is 3175
sb_info orphan list:
inode dm-3:3175 at 00000000a9b1979b: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 133f: Check reads/writes of client lustre proc files with bad area io
kernel BUG at /tmp/rpmbuild-lustre-jenkins-GAv2hsmD/BUILD/lustre-2.17.51_25_geb77c55/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 401206 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff7fd1ef055bf9f8 EFLAGS: 00010293
RAX: ff3bef774db83018 RBX: ff3bef7736f9e720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff3bef777bb1e698 RDI: ff3bef777bb1e698
RBP: ff3bef7736f9e000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff7fd1ef055bf810 R12: ff3bef7736f9e720
R13: ff3bef7702f92000 R14: ffffffffc162e8b0 R15: ff3bef7737c73a60
FS: 00007f963bf83080(0000) GS:ff3bef777bb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f714f62b000 CR3: 00000001230b6001 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0xdd/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x20b0 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x2a2/0x780 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __queue_work+0x145/0x3f0
? srso_alias_return_thunk+0x5/0xfcdfd
? srso_alias_return_thunk+0x5/0xfcdfd
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f963aedc8fb
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1
Lustre: lustre-MDT0000: Not available for connect from 10.240.40.59@tcp (stopping)
Lustre: Skipped 3 previous similar messages
Lustre: lustre-MDT0000: Not available for connect from 10.240.40.53@tcp (stopping)
Lustre: Skipped 7 previous similar messages
Lustre: lustre-MDT0000-osp-MDT0002: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 1 previous similar message
Lustre: lustre-MDT0000: Not available for connect from 10.240.40.59@tcp (stopping)
Lustre: Skipped 5 previous similar messages
LDISKFS-fs (dm-3): sb orphan head is 3192
sb_info orphan list:
inode dm-3:3192 at 000000005400dee8: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
mmp test complete, duration 1928 sec
kernel BUG at /tmp/rpmbuild-lustre-jenkins-DaCenL6v/BUILD/lustre-2.17.50_86_g9a78504/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff3805a943eefa78 EFLAGS: 00010293
RAX: ff18260ec0954a18 RBX: ff18260eaea50720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff18260efbb1e698 RDI: ff18260efbb1e698
RBP: ff18260eaea50000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff3805a943eef890 R12: ff18260eaea50720
R13: ff18260eaea18800 R14: ffffffffc148d8a8 R15: ff18260eb3b18ac0
FS: 00007fd522286080(0000) GS:ff18260efbb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe4b65bd000 CR3: 000000012a6cc005 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts);
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds3' ' /proc/mounts);
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts);
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1
Lustre: DEBUG MARKER: modprobe dm-flakey;
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey >/dev/null 2>&1
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey 2>&1
Lustre: DEBUG MARKER: test -b /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1; mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1
LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
LDISKFS-fs error (device dm-3): mb_free_blocks:1962: group 10, block 228448:freeing already freed block (bit 19968); block bitmap corrupt.
Aborting journal on device dm-3-8.
LDISKFS-fs (dm-3): Remounting filesystem read-only
LDISKFS-fs warning (device dm-3): ldiskfs_mb_generate_buddy:1239: group 10: block bitmap and bg descriptor inconsistent: 2951 vs 2953 free clusters 3943 in gd, 2 pa's
LDISKFS-fs error (device dm-3) in osd_trans_stop:2343: IO failure
LustreError: 188950:0:(osd_handler.c:2346:osd_trans_stop()) lustre-MDT0000: failed to stop transaction: rc = -5
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check
LustreError: 189124:0:(obd_sysfs.c:242:health_check_show()) lustre-MDT0000-osd: device reported unhealthy
Lustre: DEBUG MARKER: /usr/sbin/lctl mark mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: \'NOT HEALTHY\'
Lustre: DEBUG MARKER: mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: 'NOT HEALTHY'
Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-2/2026-02-04/lustre-reviews_review-dne-subtest-change_121260_106_4eb6d3c7-d190-4e71-ba77-89294fbbb658//mmp.test_10.debug_log.$(hostname -s).1770168927.log;
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1
LustreError: 189565:0:(osd_handler.c:2469:osd_drop_preallocated_space()) lustre-MDT0000: can't truncate: rc=-30
LDISKFS-fs (dm-3): Inode 637 (00000000fc4c053b): orphan list check failed!
00000000fc4c053b: 0001f30a 00000004 00000000 00000000 ................
000000007b6d8950: 00000004 00037482 00000000 00000000 .....t..........
000000000ddbbc46: 00000000 00000000 00000000 00000000 ................
000000007466667c: 00000000 00000000 00000000 00000000 ................
0000000045907093: 00000000 00000000 00000000 00000001 ................
000000000bdab2c2: c0971810 ff18260e c0971810 ff18260e .....&.......&..
0000000040d75bd2: 00000000 00000000 00084000 80000004 .........@......
00000000ff7332c0: 00000000 00000000 c0971838 ff18260e ........8....&..
00000000a95448f3: c0971838 ff18260e 00000000 00000000 8....&..........
00000000cc657276: 00000000 00000000 aea50720 ff18260e ........ ....&..
000000009af9be88: c0970098 ff18260e 00002040 00000000 .....&..@ ......
0000000006cb2bef: 00000000 00000000 c0971878 ff18260e ........x....&..
00000000ce6127b2: c0971878 ff18260e 00000000 00000000 x....&..........
00000000f60452ac: 00000000 00000000 00000000 00000000 ................
00000000c655cd93: c09718a0 ff18260e c09718a0 ff18260e .....&.......&..
000000009d299cb6: 00000000 00000000 00000000 00000000 ................
0000000065195cb5: 000881a4 00000000 00000000 00000280 ................
000000005f4447f8: 00000000 00000000 00000000 00000000 ................
00000000968fdd02: c1464a40 ffffffff aea18800 ff18260e @JF..........&..
0000000023e5ed03: c0971a38 ff18260e 82eab9c0 ff18260e 8....&.......&..
000000001da81248: 0000027d 00000000 00000001 00000000 }...............
00000000353c78d4: 00002040 00000000 6982a25e 00000000 @ ......^..i....
000000002dd827ed: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000d9d693f1: 00000000 00000000 6982a25e 00000000 ........^..i....
000000009abb7241: 00000000 00000000 00000000 00000000 ................
00000000501bbee6: 0000000c 00000000 00000020 00000000 ........ .......
0000000032bc9ae0: 00000060 00000000 00000000 00000000 `...............
00000000a9b63c44: c0971970 ff18260e c0971970 ff18260e p....&..p....&..
000000000eb473b0: 00000000 00000000 00000000 00000000 ................
000000000c901f7b: 001c6c98 00000001 00000000 00000000 .l..............
00000000fdf55441: 00000000 00000000 00000000 00000000 ................
000000004cc1bdf5: c09719b0 ff18260e c09719b0 ff18260e .....&.......&..
0000000027be85c6: 00000000 00000000 00000000 00000000 ................
00000000bf75071b: c09719d0 ff18260e c09719d0 ff18260e .....&.......&..
000000007a8f87f0: c09719e0 ff18260e c09719e0 ff18260e .....&.......&..
000000002f8428a9: c09719f0 ff18260e c09719f0 ff18260e .....&.......&..
000000009df3d34a: 00000000 00000000 00000000 00000000 ................
000000006c4b0f16: 00000002 00000000 00000000 00000000 ................
00000000650b5f56: 00000000 00000000 c1464b40 ffffffff ........@KF.....
00000000afac147a: 00000000 00000000 c09718c0 ff18260e .............&..
00000000744d6051: 00000000 00000021 00000000 00000000 ....!...........
00000000dec3191b: 00000000 00000000 00000000 00000000 ................
00000000139a6355: 00000000 00000000 00000000 00000000 ................
00000000123eb629: 00000000 00000000 c0971a78 ff18260e ........x....&..
000000006a296bb0: c0971a78 ff18260e 00000000 00000000 x....&..........
00000000676573c2: 00000000 00000000 00000000 00000000 ................
00000000d90e4f03: 00000000 00000000 00000000 00000000 ................
00000000c6795f3b: c1462a60 ffffffff 00000010 00000000 `*F.............
00000000b8910cc8: 00000000 006200ca c0971ac8 ff18260e ......b......&..
00000000d15e6864: c0971ac8 ff18260e 00000000 00000000 .....&..........
00000000b6cecd92: 00000000 00000000 00000000 00000000 ................
00000000fb71b4d9: 00000000 00000000 00000000 00000000 ................
00000000fe9f9bae: 00000000 00000000 c0971b08 ff18260e .............&..
00000000cf4ed85b: c0971b08 ff18260e 00000000 00000000 .....&..........
000000002e6f09ab: fb83fc10 00000000 00000000 00000000 ................
000000002b206683: 00000000 00000000 00000000 00000000 ................
000000003bd262a9: 00000000 00000000 00000000 00000000 ................
00000000a8c5c340: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000b00136c0: 1cbe012c 00000000 00000000 00000000 ,...............
00000000a6e3c421: c0971b70 ff18260e c0971b70 ff18260e p....&..p....&..
000000000fbc50ab: 00000000 00000000 00000000 00000000 ................
0000000073f1df6a: 00000000 00000000 00000000 00000000 ................
000000004c67adb8: c0971ba0 ff18260e c0971ba0 ff18260e .....&.......&..
000000007e14cda0: 00000000 00000000 00000000 ffffffff ................
000000005d569960: 00000000 00000000 00000000 00000000 ................
000000007c2220e7: 00000020 00000000 00000000 00000000 ...............
0000000034c80f69: 00000000 00000000 c0971be8 ff18260e .............&..
00000000a11386db: c0971be8 ff18260e ffffffe0 0000000f .....&..........
00000000c590edff: c0971c00 ff18260e c0971c00 ff18260e .....&.......&..
00000000ffc7a9bc: c14048e0 ffffffff 00000000 00000000 .H@.............
00000000c305e63e: 00000000 00000000 acf307db 1e2455b9 .............U$.
000000003e60a729: 00048124 00000000 00000000 00000000 $...............
00000000095a2b0e: 000001ea 000001ea 00000000 00000000 ................
00000000a2f35a6b: 00000000 00000000 00000000 00000000 ................
00000000212bd1e7: 00000000 00000000 aefe5f40 00000000 ........@_......
00000000c5e67dd6: 0004cc2a 00000000 *.......
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0
RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010
R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0
R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 638 (00000000a1158d10): orphan list check failed!
00000000a1158d10: 0001f30a 00000004 00000000 00000000 ................
00000000291d0913: 00000004 00037486 00000000 00000000 .....t..........
000000007df47a38: 00000000 00000000 00000000 00000000 ................
0000000090f3cd1d: 00000000 00000000 00000000 0000027d ............}...
00000000ca3bd06f: 00000000 00000000 00000000 00000001 ................
0000000055768c81: c0970050 ff18260e c0970050 ff18260e P....&..P....&..
00000000c765311b: 00000000 00000000 00084000 80000004 .........@......
000000001c037017: 00000000 00000000 c0970078 ff18260e ........x....&..
0000000091e56ab3: c0970078 ff18260e 00000000 00000000 x....&..........
00000000f7ba57e2: 00000000 00000000 c0971858 ff18260e ........X....&..
00000000459b0272: c0970558 ff18260e 00002040 00000000 X....&..@ ......
000000001de7a67c: 00000000 00000000 c09700b8 ff18260e .............&..
00000000f671ef35: c09700b8 ff18260e 00000000 00000000 .....&..........
00000000ffef040e: 00000000 00000000 00000000 00000000 ................
00000000dc0a92bc: c09700e0 ff18260e c09700e0 ff18260e .....&.......&..
00000000b5b5132e: 00000000 00000000 00000000 00000000 ................
00000000c38ee5cb: 000881a4 00000000 00000000 00000280 ................
000000001ea9711d: 00000000 00000000 00000000 00000000 ................
00000000bbb2595d: c1464a40 ffffffff aea18800 ff18260e @JF..........&..
0000000066ec29c0: c0970278 ff18260e 9f8baf80 ff18260e x....&.......&..
00000000c30edd0f: 0000027e 00000000 00000001 00000000 ~...............
00000000ad177271: 00002040 00000000 6982a25e 00000000 @ ......^..i....
00000000d8f9e51d: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000e07d5930: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000ea65a7fe: 00000000 00000000 00000000 00000000 ................
000000004fafab7c: 0000000c 00000000 00000020 00000000 ........ .......
00000000681f99c8: 00000060 00000000 00000000 00000000 `...............
0000000065ccbf1d: c09701b0 ff18260e c09701b0 ff18260e .....&.......&..
0000000095d42b6e: 00000000 00000000 00000000 00000000 ................
00000000ffc38ad4: 001c6c9b 00000001 00000000 00000000 .l..............
000000006e452f64: 00000000 00000000 00000000 00000000 ................
00000000583a2e37: c09701f0 ff18260e c09701f0 ff18260e .....&.......&..
00000000f74b1775: 00000000 00000000 00000000 00000000 ................
00000000254e3fca: c0970210 ff18260e c0970210 ff18260e .....&.......&..
00000000e3c1d9cb: c0970220 ff18260e c0970220 ff18260e ....&.. ....&..
000000005cc01a69: c0970230 ff18260e c0970230 ff18260e 0....&..0....&..
000000007217c5aa: 00000000 00000000 00000000 00000000 ................
00000000386da901: 00000002 00000000 00000000 00000000 ................
00000000361b3cd2: 00000000 00000000 c1464b40 ffffffff ........@KF.....
00000000b70bc640: 00000000 00000000 c0970100 ff18260e .............&..
000000005c875d63: 00000000 00000021 00000000 00000000 ....!...........
000000002da486ce: 00000000 00000000 00000000 00000000 ................
0000000042f84b4c: 00000000 00000000 00000000 00000000 ................
00000000c6000f7e: 00000000 00000000 c09702b8 ff18260e .............&..
0000000022ec1538: c09702b8 ff18260e 00000000 00000000 .....&..........
000000007685b3b3: 00000000 00000000 00000000 00000000 ................
00000000e1347307: 00000000 00000000 00000000 00000000 ................
00000000405c9fd9: c1462a60 ffffffff 00000010 00000000 `*F.............
00000000c7d27c87: 00000000 006200ca c0970308 ff18260e ......b......&..
000000008e55d3a1: c0970308 ff18260e 00000000 00000000 .....&..........
000000000865aafd: 00000000 00000000 00000000 00000000 ................
00000000ea221e62: 00000000 00000000 00000000 00000000 ................
00000000c7f7a61d: 00000000 00000000 c0970348 ff18260e ........H....&..
00000000d28f82c1: c0970348 ff18260e 00000000 00000000 H....&..........
00000000c8992709: f43eadcd 00000000 00000000 00000000 ..>.............
0000000094b253df: 00000000 00000000 00000000 00000000 ................
000000007b2bc020: 00000000 00000000 00000000 00000000 ................
0000000094443fca: 00000000 00000000 6982a25e 00000000 ........^..i....
0000000066b9a35a: 1cebc7f5 00000000 00000000 ff18260e .............&..
00000000b9e39a7d: c09703b0 ff18260e c09703b0 ff18260e .....&.......&..
000000003d8c0e6e: 00000000 ff18260e 00000000 00000000 .....&..........
00000000208b5e89: 00000000 00000000 00000000 00000000 ................
0000000040caf271: c09703e0 ff18260e c09703e0 ff18260e .....&.......&..
00000000af0d5d45: 00000000 00000000 00000000 ffffffff ................
0000000006916020: 00000000 00000000 00000000 00000000 ................
000000009d5c7172: 00000020 00000021 00000000 00000000 ...!...........
0000000010915a8f: 00000000 00000000 c0970428 ff18260e ........(....&..
000000007a3875fd: c0970428 ff18260e ffffffe0 0000000f (....&..........
000000001dcf6ace: c0970440 ff18260e c0970440 ff18260e @....&..@....&..
00000000c6c487ad: c14048e0 ffffffff 00000000 00000000 .H@.............
00000000a64dacc2: 00000000 00000000 00000000 00000000 ................
00000000e1af0289: 00000000 00000000 00000000 00000000 ................
000000001faa8276: 000001ea 000001ea 00000000 00000000 ................
00000000ec72e7b3: 00000000 00000000 00000000 00000000 ................
00000000bcc8ed93: 00000000 00000000 00000000 00000000 ................
000000005d65ed59: 00000000 00000000 ........
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0
RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010
R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0
R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 639 (000000007a7e4f52): orphan list check failed!
000000007a7e4f52: 0001f30a 00000004 00000000 00000000 ................
00000000a1872b92: 00000004 0003748a 00000000 00000000 .....t..........
0000000077b4585c: 00000000 00000000 00000000 00000000 ................
0000000094185237: 00000000 00000000 00000000 0000027e ............~...
000000002804dbc9: 00000000 00000000 00000000 00000001 ................
0000000033bdf365: c0970510 ff18260e c0970510 ff18260e .....&.......&..
000000009dfb93ab: 00000000 00000000 00084000 80000004 .........@......
0000000037263b5f: 00000000 00000000 c0970538 ff18260e ........8....&..
000000009c89f9a9: c0970538 ff18260e 00000000 00000000 8....&..........
000000000255be45: 00000000 00000000 c0970098 ff18260e .............&..
00000000cbb92f8e: c0971d18 ff18260e 00002040 00000000 .....&..@ ......
00000000499fc8e5: 00000000 00000000 c0970578 ff18260e ........x....&..
000000006942d217: c0970578 ff18260e 00000000 00000000 x....&..........
00000000a98231d8: 00000000 00000000 00000000 00000000 ................
000000009640d9a6: c09705a0 ff18260e c09705a0 ff18260e .....&.......&..
00000000e629ba3b: 00000000 00000000 00000000 00000000 ................
000000004d1abbeb: 000881a4 00000000 00000000 00000280 ................
00000000721c77ec: 00000000 00000000 00000000 00000000 ................
000000006ab762b9: c1464a40 ffffffff aea18800 ff18260e @JF..........&..
00000000a430bb78: c0970738 ff18260e 9f8bab00 ff18260e 8....&.......&..
000000000e70ebbe: 0000027f 00000000 00000001 00000000 ................
000000004893f869: 00002040 00000000 6982a25e 00000000 @ ......^..i....
0000000026c981f7: 00000000 00000000 6982a25e 00000000 ........^..i....
0000000019b87d65: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000c4ae7a78: 00000000 00000000 00000000 00000000 ................
000000007173c263: 0000000c 00000000 00000020 00000000 ........ .......
00000000ea274ca1: 00000060 00000000 00000000 00000000 `...............
000000008a9cb53b: c0970670 ff18260e c0970670 ff18260e p....&..p....&..
000000008ec4f42b: 00000000 00000000 00000000 00000000 ................
00000000f0904b28: 001c6c9c 00000001 00000000 00000000 .l..............
00000000b7b77a4e: 00000000 00000000 00000000 00000000 ................
00000000b6f6d1c9: c09706b0 ff18260e c09706b0 ff18260e .....&.......&..
00000000b0acacbe: 00000000 00000000 00000000 00000000 ................
00000000a247b09f: c09706d0 ff18260e c09706d0 ff18260e .....&.......&..
0000000047421de8: c09706e0 ff18260e c09706e0 ff18260e .....&.......&..
0000000093031aa5: c09706f0 ff18260e c09706f0 ff18260e .....&.......&..
00000000dc802010: 00000000 00000000 00000000 00000000 ................
00000000110d1414: 00000002 00000000 00000000 00000000 ................
0000000091cedca9: 00000000 00000000 c1464b40 ffffffff ........@KF.....
00000000c2e55764: 00000000 00000000 c09705c0 ff18260e .............&..
00000000da783296: 00000000 00000021 00000000 00000000 ....!...........
000000003f338f81: 00000000 00000000 00000000 00000000 ................
00000000066a5726: 00000000 00000000 00000000 00000000 ................
00000000895e8a75: 00000000 00000000 c0970778 ff18260e ........x....&..
000000003799e923: c0970778 ff18260e 00000000 00000000 x....&..........
00000000f826727b: 00000000 00000000 00000000 00000000 ................
00000000e11ad7a8: 00000000 00000000 00000000 00000000 ................
00000000e5fbcae4: c1462a60 ffffffff 00000010 00000000 `*F.............
00000000c4e559ab: 00000000 006200ca c09707c8 ff18260e ......b......&..
000000007ce72f04: c09707c8 ff18260e 00000000 00000000 .....&..........
0000000043cf35c5: 00000000 00000000 00000000 00000000 ................
00000000243e6974: 00000000 00000000 00000000 00000000 ................
0000000085a25ad3: 00000000 00000000 c0970808 ff18260e .............&..
00000000ab16eade: c0970808 ff18260e 00000000 00000000 .....&..........
00000000ae1dca6f: 3e242b6e 00000000 00000000 00000000 n+$>............
0000000068698b3d: 00000000 00000000 00000000 00000000 ................
000000001239275f: 00000000 00000000 00000000 00000000 ................
000000009c895a03: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000b9444864: 1cfb0a38 00000000 00000000 ff18260e 8............&..
00000000b12ff4e6: c0970870 ff18260e c0970870 ff18260e p....&..p....&..
000000007db3f75a: 00000000 00000000 00000000 00000000 ................
00000000a53c835d: 00000000 00000000 00000000 00000000 ................
00000000aebb4599: c09708a0 ff18260e c09708a0 ff18260e .....&.......&..
000000003e78ffe9: 00000000 00000000 00000000 ffffffff ................
000000009822c88c: 00000000 ff18260e 00000000 00000000 .....&..........
00000000b108b876: 00000020 ff18260e 00000000 00000000 ....&..........
00000000542072a4: 00000000 ff18260e c09708e8 ff18260e .....&.......&..
0000000093093e5a: c09708e8 ff18260e ffffffe0 0000000f .....&..........
00000000570488b7: c0970900 ff18260e c0970900 ff18260e .....&.......&..
00000000838727b7: c14048e0 ffffffff 83057f40 ffffffff .H@.....@.......
00000000385200b2: 00000000 00000000 c09707b0 ff18260e .............&..
000000005e8cf82e: 00000000 00000021 00000000 00000000 ....!...........
00000000444403ba: 000001ea 000001ea 00000000 00000000 ................
000000008f9d642f: 00000000 00000000 00000000 00000000 ................
0000000078510538: 00000000 00000000 c0970968 00000000 ........h.......
000000002ee3a92f: c0970968 ff18260e h....&..
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0
RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010
R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0
R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 640 (000000003c2dc4d5): orphan list check failed!
000000003c2dc4d5: 0001f30a 00000004 00000000 00000000 ................
000000001f6e6d09: 00000004 0003748e 00000000 00000000 .....t..........
00000000d7119c6b: 00000000 00000000 00000000 00000000 ................
0000000022b0b55a: 00000000 00000000 00000000 0000027f ................
000000000c4e3a82: 00000000 00000000 00000000 00000001 ................
00000000e1536791: c0971cd0 ff18260e c0971cd0 ff18260e .....&.......&..
000000002c97b759: 00000000 00000000 00084000 80000004 .........@......
0000000067d66896: 00000000 00000000 c0971cf8 ff18260e .............&..
000000003d4ccf40: c0971cf8 ff18260e 00000000 00000000 .....&..........
000000002c0de430: 00000000 00000000 c0970558 ff18260e ........X....&..
000000000a6fecc6: c0957018 ff18260e 00002040 00000000 .p...&..@ ......
000000004cca78b2: 00000000 00000000 c0971d38 ff18260e ........8....&..
00000000b8d9b7be: c0971d38 ff18260e 00000000 00000000 8....&..........
000000008c3051be: 00000000 00000000 00000000 00000000 ................
00000000139bde92: c0971d60 ff18260e c0971d60 ff18260e `....&..`....&..
00000000d221daa2: 00000000 00000000 00000000 00000000 ................
00000000a1411912: 000881a4 00000000 00000000 00000280 ................
000000005e79a013: 00000000 00000000 00000000 00000000 ................
000000005f6069a6: c1464a40 ffffffff aea18800 ff18260e @JF..........&..
00000000d95371a4: c0971ef8 ff18260e b1bfea40 ff18260e .....&..@....&..
000000004a00b073: 00000280 00000000 00000001 00000000 ................
00000000dc01bba3: 00002040 00000000 6982a25e 00000000 @ ......^..i....
00000000f17ea646: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000f240b391: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000ec1f029e: 00000000 00000000 00000000 00000000 ................
00000000db8389b5: 0000000c 00000000 00000020 00000000 ........ .......
00000000cbc1d0b8: 00000060 00000000 00000000 00000000 `...............
0000000027c94e3d: c0971e30 ff18260e c0971e30 ff18260e 0....&..0....&..
00000000b40175b3: 00000000 00000000 00000000 00000000 ................
000000003ed0ccc1: 001c6c9d 00000001 00000000 00000000 .l..............
000000006e004bf9: 00000000 00000000 00000000 00000000 ................
0000000022b38882: c0971e70 ff18260e c0971e70 ff18260e p....&..p....&..
00000000632c129c: 00000000 00000000 00000000 00000000 ................
00000000af4aa19a: c0971e90 ff18260e c0971e90 ff18260e .....&.......&..
0000000019eac546: c0971ea0 ff18260e c0971ea0 ff18260e .....&.......&..
00000000a72d9bb8: c0971eb0 ff18260e c0971eb0 ff18260e .....&.......&..
00000000f1348a27: 00000000 00000000 00000000 00000000 ................
00000000da69cb6e: 00000002 00000000 00000000 00000000 ................
000000000e1f4c1d: 00000000 00000000 c1464b40 ffffffff ........@KF.....
00000000372f02cb: 00000000 00000000 c0971d80 ff18260e .............&..
00000000057fd8f5: 00000000 00000021 00000000 00000000 ....!...........
000000003ebe40bf: 00000000 00000000 00000000 00000000 ................
00000000d8e14db5: 00000000 00000000 00000000 00000000 ................
0000000084bf9369: 00000000 00000000 c0971f38 ff18260e ........8....&..
00000000fe014249: c0971f38 ff18260e 00000000 00000000 8....&..........
0000000057d2a71e: 00000000 00000000 00000000 00000000 ................
000000000b8938df: 00000000 00000000 00000000 00000000 ................
000000002237d696: c1462a60 ffffffff 00000010 00000000 `*F.............
000000009e0e442f: 00000000 006200ca c0971f88 ff18260e ......b......&..
00000000150546c6: c0971f88 ff18260e 00000000 00000000 .....&..........
000000004f1ba85c: 00000000 00000000 00000000 00000000 ................
00000000e9cbfd7c: 00000000 00000000 00000000 00000000 ................
000000004b927a6a: 00000000 00000000 c0971fc8 ff18260e .............&..
000000001454eef0: c0971fc8 ff18260e 00000000 00000000 .....&..........
000000008700b773: 2dde3445 00000000 00000000 00000000 E4.-............
00000000a22ab27a: 00000000 00000000 00000000 00000000 ................
00000000d7fe15a8: 00000000 00000000 00000000 00000000 ................
00000000af337456: 00000000 ffffffff 6982a25e 00000000 ........^..i....
00000000ff99a332: 1d0a4c7b 00000000 00000000 ff18260e {L...........&..
00000000e0c701a4: c0972030 ff18260e c0972030 ff18260e 0 ...&..0 ...&..
00000000f473afca: 00000000 00000000 00000000 00000000 ................
00000000fe0e3be8: 00000000 00000000 00000000 00000000 ................
00000000d01c9740: c0972060 ff18260e c0972060 ff18260e ` ...&..` ...&..
0000000007c72100: 00000000 00000000 00000000 ffffffff ................
000000004e9b2807: 00000000 00000000 00000000 00000000 ................
000000005705b212: 00000020 00000000 00000000 00000000 ...............
00000000ba4d5f2c: 00000000 00000000 c09720a8 ff18260e ......... ...&..
000000007f2b3b24: c09720a8 ff18260e ffffffe0 0000000f . ...&..........
00000000f3d2520c: c09720c0 ff18260e c09720c0 ff18260e . ...&... ...&..
000000004eeda89d: c14048e0 ffffffff 00000000 00000000 .H@.............
00000000ad9ed34f: 00000000 00000000 00000000 00000000 ................
000000003376e2dd: c09720f0 ff18260e 00000000 00000000 . ...&..........
000000007b04ea8c: 000001ea 000001ea 00000000 00000000 ................
000000003950c9c6: 00000000 00000000 00000000 00000000 ................
00000000a59e12f6: 00000000 00000000 c0972120 00000000 ........ !......
000000001ab2b20f: c0972130 ff18260e 0!...&..
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0
RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010
R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0
R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 641 (00000000f56b1c0a): orphan list check failed!
00000000f56b1c0a: 0001f30a 00000004 00000000 00000000 ................
0000000049cdfb38: 00000004 00037492 00000000 00000000 .....t..........
000000000794cf21: 00000000 00000000 00000000 00000000 ................
00000000ad9ba9f7: 00000000 00000000 00000000 00000280 ................
0000000091538a5e: 00000000 00000000 00000000 00000001 ................
0000000065622756: c0956fd0 ff18260e c0956fd0 ff18260e .o...&...o...&..
00000000436fb7ee: 00000000 00000000 00084000 80000004 .........@......
000000005e0713d4: 00000000 00000000 c0956ff8 ff18260e .........o...&..
0000000025122759: c0956ff8 ff18260e 00000000 00000000 .o...&..........
00000000494d3568: 00000000 00000000 c0971d18 ff18260e .............&..
0000000011792d23: c09561d8 ff18260e 00002040 00000000 .a...&..@ ......
00000000c2b15866: 00000000 00000000 c0957038 ff18260e ........8p...&..
0000000073d1894e: c0957038 ff18260e 00000000 00000000 8p...&..........
000000001fcd3183: 00000000 00000000 00000000 00000000 ................
000000009559f4d8: c0957060 ff18260e c0957060 ff18260e `p...&..`p...&..
000000002052d61d: 00000000 00000000 00000000 00000000 ................
00000000335ba333: 000881a4 00000000 00000000 00000280 ................
000000007cbaf4d4: 00000000 00000000 00000000 00000000 ................
00000000200ed50e: c1464a40 ffffffff aea18800 ff18260e @JF..........&..
000000009c284170: c09571f8 ff18260e b1bfe600 ff18260e .q...&.......&..
000000004141e70e: 00000281 00000000 00000001 00000000 ................
000000007c905050: 00002040 00000000 6982a25e 00000000 @ ......^..i....
0000000005be7649: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000f8a40969: 00000000 00000000 6982a25e 00000000 ........^..i....
000000001678317c: 00000000 00000000 00000000 00000000 ................
00000000ec72ad40: 0000000c 00000000 00000020 00000000 ........ .......
00000000e925253b: 00000060 00000000 00000000 00000000 `...............
00000000d9673e7e: c0957130 ff18260e c0957130 ff18260e 0q...&..0q...&..
00000000a9362f8f: 00000000 00000000 00000000 00000000 ................
00000000333d5782: 001c6c9e 00000001 00000000 00000000 .l..............
000000008c297273: 00000000 00000000 00000000 00000000 ................
000000000dd385dd: c0957170 ff18260e c0957170 ff18260e pq...&..pq...&..
000000006958d116: 00000000 00000000 00000000 00000000 ................
000000005ad81d4d: c0957190 ff18260e c0957190 ff18260e .q...&...q...&..
00000000d341be10: c09571a0 ff18260e c09571a0 ff18260e .q...&...q...&..
0000000008ef3f89: c09571b0 ff18260e c09571b0 ff18260e .q...&...q...&..
00000000bfb977f1: 00000000 00000000 00000000 00000000 ................
00000000ac486081: 00000002 00000000 00000000 00000000 ................
000000007c2ba398: 00000000 00000000 c1464b40 ffffffff ........@KF.....
00000000de5ae1f8: 00000000 00000000 c0957080 ff18260e .........p...&..
0000000000563181: 00000000 00000021 00000000 00000000 ....!...........
00000000d7372e4f: 00000000 00000000 00000000 00000000 ................
000000004aa260f3: 00000000 00000000 00000000 00000000 ................
00000000bbbf51d4: 00000000 00000000 c0957238 ff18260e ........8r...&..
000000004eaee418: c0957238 ff18260e 00000000 00000000 8r...&..........
00000000acf5a6f9: 00000000 00000000 00000000 00000000 ................
000000002be388b6: 00000000 00000000 00000000 00000000 ................
000000006382d52c: c1462a60 ffffffff 00000010 00000000 `*F.............
00000000f60f03b2: 00000000 006200ca c0957288 ff18260e ......b..r...&..
00000000c333cec0: c0957288 ff18260e 00000000 00000000 .r...&..........
000000000752ca3b: 00000000 00000000 00000000 00000000 ................
00000000f50c6dbd: 00000000 00000000 00000000 00000000 ................
000000007022acab: 00000000 00000000 c09572c8 ff18260e .........r...&..
00000000338f206d: c09572c8 ff18260e 00000000 00000000 .r...&..........
000000005a3044b7: f02b24b2 00000000 00000000 00000000 .$+.............
00000000b19bb0d9: 00000000 00000000 00000000 00000000 ................
00000000aef019c8: 00000000 00000000 00000000 00000000 ................
000000001e1c5bd3: 00000000 ff18260e 6982a25e 00000000 .....&..^..i....
00000000e16c86c6: 1d198ebe 00000000 00000000 ff18260e .............&..
000000000892cc55: c0957330 ff18260e c0957330 ff18260e 0s...&..0s...&..
00000000408c4d13: 00000000 00000000 00000000 00000000 ................
00000000275b1cfa: 00000000 00000000 00000000 00000000 ................
00000000e07e426f: c0957360 ff18260e c0957360 ff18260e `s...&..`s...&..
000000004a32c7a8: 00000000 00000000 00000000 ffffffff ................
000000009344120c: 00000000 00000000 00000000 00000000 ................
0000000035771654: 00000020 00000000 00000000 00000000 ...............
00000000fb7de7b4: 00000000 00000000 c09573a8 ff18260e .........s...&..
000000006bececaa: c09573a8 ff18260e ffffffe0 0000000f .s...&..........
000000007598db43: c09573c0 ff18260e c09573c0 ff18260e .s...&...s...&..
0000000036c0c33e: c14048e0 ffffffff 00000000 00000000 .H@.............
000000001fb84a0d: 83043540 ffffffff 00000010 00000000 @5..............
0000000037fe53da: 00000000 006200ca 00000000 00000000 ......b.........
0000000088655f7b: 000001ea 000001ea 00000000 00000000 ................
0000000081221c9d: 00000000 00000000 00000000 00000000 ................
00000000024b2004: 00000000 00000000 00000000 00000000 ................
00000000035b86c1: 00000000 00000000 ........
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0
RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010
R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0
R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 642 (0000000029f75eb6): orphan list check failed!
0000000029f75eb6: 0001f30a 00000004 00000000 00000000 ................
000000001ccfdcd2: 00000004 00037496 00000000 00000000 .....t..........
0000000063c3bbb4: 00000000 00000000 00000000 00000000 ................
00000000c0fbbb3e: 00000000 00000000 00000000 00000281 ................
00000000448e802a: 00000000 00000000 00000000 00000001 ................
000000004d82a603: c0956190 ff18260e c0956190 ff18260e .a...&...a...&..
0000000070b71a92: 00000000 00000000 00084000 80000004 .........@......
00000000adb09b94: 00000000 00000000 c09561b8 ff18260e .........a...&..
0000000025a37e4f: c09561b8 ff18260e 00000000 00000000 .a...&..........
000000007fc342c4: 00000000 00000000 c0957018 ff18260e .........p...&..
0000000016a63647: c0955398 ff18260e 00002040 00000000 .S...&..@ ......
000000002caee790: 00000000 00000000 c09561f8 ff18260e .........a...&..
00000000d71140d3: c09561f8 ff18260e 00000000 00000000 .a...&..........
000000006f83b9c6: 00000000 00000000 00000000 00000000 ................
000000005a048485: c0956220 ff18260e c0956220 ff18260e b...&.. b...&..
000000003215e0b9: 00000000 00000000 00000000 00000000 ................
00000000e7090da3: 000881a4 00000000 00000000 00000280 ................
000000008e72a991: 00000000 00000000 00000000 00000000 ................
00000000ad78cd49: c1464a40 ffffffff aea18800 ff18260e @JF..........&..
00000000a39f8434: c09563b8 ff18260e b1bfe140 ff18260e .c...&..@....&..
00000000927a9c4c: 00000282 00000000 00000001 00000000 ................
0000000010441c5a: 00002040 00000000 6982a25e 00000000 @ ......^..i....
000000005df21b2f: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000aae8aa7e: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000fe056223: 00000000 00000000 00000000 00000000 ................
00000000c3cc0185: 0000000c 00000000 00000020 00000000 ........ .......
000000004f85c48e: 00000060 00000000 00000000 00000000 `...............
000000004a802057: c09562f0 ff18260e c09562f0 ff18260e .b...&...b...&..
00000000f14dd69c: 00000000 00000000 00000000 00000000 ................
0000000043290e20: 001c6c9f 00000001 00000000 00000000 .l..............
0000000040303d5a: 00000000 00000000 00000000 00000000 ................
0000000099cbc0a6: c0956330 ff18260e c0956330 ff18260e 0c...&..0c...&..
00000000865877be: 00000000 00000000 00000000 00000000 ................
00000000fb15e65f: c0956350 ff18260e c0956350 ff18260e Pc...&..Pc...&..
00000000f2dbfc1f: c0956360 ff18260e c0956360 ff18260e `c...&..`c...&..
000000009148a399: c0956370 ff18260e c0956370 ff18260e pc...&..pc...&..
00000000c6f9225b: 00000000 00000000 00000000 00000000 ................
00000000ac17beed: 00000002 00000000 00000000 00000000 ................
00000000bae9e1f6: 00000000 00000000 c1464b40 ffffffff ........@KF.....
00000000d227065a: 00000000 00000000 c0956240 ff18260e ........@b...&..
00000000803bc985: 00000000 00000021 00000000 00000000 ....!...........
00000000a17231bc: 00000000 00000000 00000000 00000000 ................
000000006b717e18: 00000000 00000000 00000000 00000000 ................
000000006ff634c3: 00000000 00000000 c09563f8 ff18260e .........c...&..
000000000dacad78: c09563f8 ff18260e 00000000 00000000 .c...&..........
000000007f12dcf8: 00000000 00000000 00000000 00000000 ................
0000000005926a6d: 00000000 00000000 00000000 00000000 ................
00000000c06c642d: c1462a60 ffffffff 00000010 00000000 `*F.............
000000000b3a5c83: 00000000 006200ca c0956448 ff18260e ......b.Hd...&..
00000000398fcd74: c0956448 ff18260e 00000000 00000000 Hd...&..........
00000000f4ffb57d: 00000000 00000000 00000000 00000000 ................
000000004085bf57: 00000000 00000000 00000000 00000000 ................
00000000df12a3a6: 00000000 00000000 c0956488 ff18260e .........d...&..
0000000029e51314: c0956488 ff18260e 00000000 00000000 .d...&..........
00000000779a60f0: fec698db 00000000 00000000 00000000 ................
00000000aea5cbbb: 00000000 00000000 00000000 00000000 ................
0000000009188cc1: 00000000 00000000 00000000 00000000 ................
00000000025cefc2: 00000000 00000000 6982a25e 00000000 ........^..i....
0000000000614756: 1d28d102 00000000 00000000 00000000 ..(.............
000000008b5f72fe: c09564f0 ff18260e c09564f0 ff18260e .d...&...d...&..
00000000ad217f39: 00000000 ff18260e 00000000 00000000 .....&..........
00000000ca0dfd6a: 00000000 00000000 00000000 00000000 ................
00000000bb4e7e77: c0956520 ff18260e c0956520 ff18260e e...&.. e...&..
0000000087839a75: 00000000 00000000 00000000 ffffffff ................
000000008ef2665c: 00000000 ffffffff 00000000 00000000 ................
00000000e851aad9: 00000020 ff18260e 00000000 00000000 ....&..........
00000000f334c68e: 00000000 00000000 c0956568 ff18260e ........he...&..
00000000160db24f: c0956568 ff18260e ffffffe0 0000000f he...&..........
000000000af6b251: c0956580 ff18260e c0956580 ff18260e .e...&...e...&..
00000000abba20b7: c14048e0 ffffffff 6982a1a8 00000000 .H@........i....
0000000097dd9674: 16b06f55 00000000 00000000 00000000 Uo..............
00000000f93aa4ac: 0000000c 00000000 00000000 00000000 ................
00000000d4b64a56: 000001ea 000001ea 00000000 00000000 ................
00000000e5c41304: 00000000 00000000 00000000 00000000 ................
000000001837386e: 00000000 00000000 00000000 00000000 ................
000000009d078796: 00000000 00000000 ........
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0
RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010
R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0
R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 643 (00000000b289e28c): orphan list check failed!
00000000b289e28c: 0001f30a 00000004 00000000 00000000 ................
0000000032b0959a: 00000004 0003749a 00000000 00000000 .....t..........
0000000074c4ce1c: 00000000 00000000 00000000 00000000 ................
0000000094dd8f26: 00000000 00000000 00000000 00000282 ................
00000000e5ca2334: 00000000 00000000 00000000 00000001 ................
00000000804da50d: c0955350 ff18260e c0955350 ff18260e PS...&..PS...&..
00000000c25e5b1c: 00000000 00000000 00084000 80000004 .........@......
00000000053ac9c0: 00000000 00000000 c0955378 ff18260e ........xS...&..
00000000fa3ca807: c0955378 ff18260e 00000000 00000000 xS...&..........
00000000e645f9e0: 00000000 00000000 c09561d8 ff18260e .........a...&..
00000000e4ffc944: c0954a18 ff18260e 00002040 00000000 .J...&..@ ......
0000000079094e05: 00000000 00000000 c09553b8 ff18260e .........S...&..
00000000d593eba6: c09553b8 ff18260e 00000000 00000000 .S...&..........
00000000e051a7be: 00000000 00000000 00000000 00000000 ................
00000000f95d4d6c: c09553e0 ff18260e c09553e0 ff18260e .S...&...S...&..
00000000960c77ed: 00000000 00000000 00000000 00000000 ................
000000008e18b7d5: 000881a4 00000000 00000000 00000280 ................
000000004670e2b0: 00000000 00000000 00000000 00000000 ................
000000000fa08732: c1464a40 ffffffff aea18800 ff18260e @JF..........&..
0000000074d8dd6f: c0955578 ff18260e af96efc0 ff18260e xU...&.......&..
00000000c9375915: 00000283 00000000 00000001 00000000 ................
000000002a813fbd: 00002040 00000000 6982a25e 00000000 @ ......^..i....
00000000245e9ca1: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000777dad64: 00000000 00000000 6982a25e 00000000 ........^..i....
000000005d9e723e: 00000000 00000000 00000000 00000000 ................
00000000a61ec8ea: 0000000c 00000000 00000020 00000000 ........ .......
0000000049cdf3c8: 00000060 00000000 00000000 00000000 `...............
0000000051da5924: c09554b0 ff18260e c09554b0 ff18260e .T...&...T...&..
00000000120f41f0: 00000000 00000000 00000000 00000000 ................
000000003287f4a5: 001c6ca0 00000001 00000000 00000000 .l..............
00000000936d9738: 00000000 00000000 00000000 00000000 ................
000000007ef53626: c09554f0 ff18260e c09554f0 ff18260e .T...&...T...&..
00000000b7b34506: 00000000 00000000 00000000 00000000 ................
000000002bdde22f: c0955510 ff18260e c0955510 ff18260e .U...&...U...&..
0000000070eded5b: c0955520 ff18260e c0955520 ff18260e U...&.. U...&..
00000000e53de4ac: c0955530 ff18260e c0955530 ff18260e 0U...&..0U...&..
000000005bc59f26: 00000000 00000000 00000000 00000000 ................
0000000004394676: 00000002 00000000 00000000 00000000 ................
000000006fd9f75b: 00000000 00000000 c1464b40 ffffffff ........@KF.....
00000000fb75f5d3: 00000000 00000000 c0955400 ff18260e .........T...&..
0000000098eda191: 00000000 00000021 00000000 00000000 ....!...........
000000003a1ce874: 00000000 00000000 00000000 00000000 ................
000000001988a003: 00000000 00000000 00000000 00000000 ................
00000000e3e20d88: 00000000 00000000 c09555b8 ff18260e .........U...&..
0000000006e6a9f1: c09555b8 ff18260e 00000000 00000000 .U...&..........
000000001d5b5623: 00000000 00000000 00000000 00000000 ................
00000000040ad626: 00000000 00000000 00000000 00000000 ................
000000004c3cdffe: c1462a60 ffffffff 00000010 00000000 `*F.............
0000000088b13a33: 00000000 006200ca c0955608 ff18260e ......b..V...&..
000000004c76bc54: c0955608 ff18260e 00000000 00000000 .V...&..........
00000000080ad444: 00000000 00000000 00000000 00000000 ................
000000002cce61ae: 00000000 00000000 00000000 00000000 ................
000000006af48832: 00000000 00000000 c0955648 ff18260e ........HV...&..
00000000857731c3: c0955648 ff18260e 00000000 00000000 HV...&..........
0000000080bcff9d: 1db4ff1b 00000000 00000000 00000000 ................
000000002343961f: 00000000 00000000 00000000 00000000 ................
00000000b42189d6: 00000000 00000000 00000000 00000000 ................
00000000fc0522f6: 00000000 ff18260e 6982a25e 00000000 .....&..^..i....
000000008e093901: 1d381344 00000000 00000000 00000000 D.8.............
00000000dcb3aa03: c09556b0 ff18260e c09556b0 ff18260e .V...&...V...&..
0000000041d4bba3: 00000000 00000000 00000000 00000000 ................
00000000a1b865e8: 00000000 00000000 00000000 00000000 ................
00000000bcee4e67: c09556e0 ff18260e c09556e0 ff18260e .V...&...V...&..
00000000f8ae1c47: 00000000 00000000 00000000 ffffffff ................
00000000a23bf804: 00000000 00000000 00000000 00000000 ................
0000000093e7e4f3: 00000020 00000000 00000000 00000000 ...............
0000000027c5a65b: 00000000 ffffffff c0955728 ff18260e ........(W...&..
00000000d2aa6c3b: c0955728 ff18260e ffffffe0 0000000f (W...&..........
0000000093f239e6: c0955740 ff18260e c0955740 ff18260e @W...&..@W...&..
00000000481831e2: c14048e0 ffffffff 00000000 00000000 .H@.............
000000009144be16: 00000000 00000000 6982a19f 00000000 ...........i....
00000000a2d126d9: 293983e3 00000000 00000000 00000000 ..9)............
0000000082d5a1d3: 000001ea 000001ea 00000000 00000000 ................
0000000014eaa3d9: 00000000 00000000 00000000 00000000 ................
00000000285ee682: 00000000 00000000 00000000 00000000 ................
00000000881681c0: 00000060 00000000 `.......
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0
RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010
R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0
R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 644 (00000000caf5b9ab): orphan list check failed!
00000000caf5b9ab: 0001f30a 00000004 00000000 00000000 ................
000000009cb5a94b: 00000004 0003749e 00000000 00000000 .....t..........
000000006e671db7: 00000000 00000000 00000000 00000000 ................
000000009a61d4b8: 00000000 00000000 00000000 00000283 ................
000000000f187c9d: 00000000 00000000 00000000 00000001 ................
000000003d0101bf: c09549d0 ff18260e c09549d0 ff18260e .I...&...I...&..
00000000b4bc1ac5: 00000000 00000000 00084000 80000004 .........@......
00000000a904a6c1: 00000000 00000000 c09549f8 ff18260e .........I...&..
0000000031f7d745: c09549f8 ff18260e 00000000 00000000 .I...&..........
00000000d0d0aa47: 00000000 00000000 c0955398 ff18260e .........S...&..
00000000bbc01a6d: aea50720 ff18260e 00002040 00000000 ....&..@ ......
00000000ddb749f0: 00000000 00000000 c0954a38 ff18260e ........8J...&..
000000001408a7c2: c0954a38 ff18260e 00000000 00000000 8J...&..........
0000000080f77a25: 00000000 00000000 00000000 00000000 ................
000000009e666e2b: c0954a60 ff18260e c0954a60 ff18260e `J...&..`J...&..
00000000d78d7a64: 00000000 00000000 00000000 00000000 ................
00000000dda0a0aa: 000881a4 00000000 00000000 00000280 ................
00000000228a00f6: 00000000 00000000 00000000 00000000 ................
000000005b3ca8fa: c1464a40 ffffffff aea18800 ff18260e @JF..........&..
0000000015242fd4: c0954bf8 ff18260e af96ed00 ff18260e .K...&.......&..
000000007e7e2d1c: 00000284 00000000 00000001 00000000 ................
0000000030ba0edb: 00002040 00000000 6982a25e 00000000 @ ......^..i....
000000005a3fadfb: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000d0ffa334: 00000000 00000000 6982a25e 00000000 ........^..i....
0000000019d716f8: 00000000 00000000 00000000 00000000 ................
00000000ea2e626b: 0000000c 00000000 00000020 00000000 ........ .......
00000000f77c5ae7: 00000060 00000000 00000000 00000000 `...............
0000000074f27d3b: c0954b30 ff18260e c0954b30 ff18260e 0K...&..0K...&..
00000000cb115eaa: 00000000 00000000 00000000 00000000 ................
000000001929e45b: 001c6ca2 00000001 00000000 00000000 .l..............
000000007a13c1fb: 00000000 00000000 00000000 00000000 ................
00000000acfa7385: c0954b70 ff18260e c0954b70 ff18260e pK...&..pK...&..
00000000cef51b26: 00000000 00000000 00000000 00000000 ................
0000000054ac3e30: c0954b90 ff18260e c0954b90 ff18260e .K...&...K...&..
00000000fa891658: c0954ba0 ff18260e c0954ba0 ff18260e .K...&...K...&..
00000000e0116640: c0954bb0 ff18260e c0954bb0 ff18260e .K...&...K...&..
00000000b8310b73: 00000000 00000000 00000000 00000000 ................
000000001680eaa5: 00000002 00000000 00000000 00000000 ................
000000003be22059: 00000000 00000000 c1464b40 ffffffff ........@KF.....
00000000be391f3b: 00000000 00000000 c0954a80 ff18260e .........J...&..
000000003c9561db: 00000000 00000021 00000000 00000000 ....!...........
000000001f6e3d67: 00000000 00000000 00000000 00000000 ................
00000000dbc0d976: 00000000 00000000 00000000 00000000 ................
000000000f8d7fdb: 00000000 00000000 c0954c38 ff18260e ........8L...&..
00000000d756c7da: c0954c38 ff18260e 00000000 00000000 8L...&..........
000000002badc685: 00000000 00000000 00000000 00000000 ................
00000000b99cd866: 00000000 00000000 00000000 00000000 ................
00000000ef05f460: c1462a60 ffffffff 00000010 00000000 `*F.............
00000000839a726a: 00000000 006200ca c0954c88 ff18260e ......b..L...&..
00000000c6285fa5: c0954c88 ff18260e 00000000 00000000 .L...&..........
000000008715b368: 00000000 00000000 00000000 00000000 ................
00000000f8c812e9: 00000000 00000000 00000000 00000000 ................
00000000d52a20d9: 00000000 00000000 c0954cc8 ff18260e .........L...&..
00000000ce440737: c0954cc8 ff18260e 00000000 00000000 .L...&..........
000000001e966128: 805bfe2a 00000000 00000000 00000000 *.[.............
000000001864e20f: 00000000 00000000 00000000 00000000 ................
000000003f4e9fd0: 00000000 00000000 00000000 00000000 ................
00000000521360c8: 00000000 00000000 6982a25e 00000000 ........^..i....
00000000b82d927d: 1d475588 00000000 00000000 00000000 .UG.............
00000000ca718bf8: c0954d30 ff18260e c0954d30 ff18260e 0M...&..0M...&..
0000000099bbb5a3: 00000000 00000000 00000000 00000000 ................
00000000f2209aa6: 00000000 00000000 00000000 00000000 ................
00000000556166b7: c0954d60 ff18260e c0954d60 ff18260e `M...&..`M...&..
00000000d1154eed: 00000000 00000000 00000000 ffffffff ................
00000000e7206aa0: 00000000 ff18260e 00000000 00000000 .....&..........
00000000c7fe3419: 00000020 00000000 00000000 00000000 ...............
000000002aabe40d: 00000000 00000000 c0954da8 ff18260e .........M...&..
000000005af90a39: c0954da8 ff18260e ffffffe0 0000000f .M...&..........
00000000c72b23d2: c0954dc0 ff18260e c0954dc0 ff18260e .M...&...M...&..
000000002398ff9c: c14048e0 ffffffff 00000000 00000000 .H@.............
000000006ab6bcd4: c0954de0 ff18260e c0954de0 ff18260e .M...&...M...&..
000000005a24cd3d: c0954df0 ff18260e 00000000 00000000 .M...&..........
0000000076093f82: 000001ea 000001ea 00000000 00000000 ................
00000000fa64a6ad: 00000000 00000000 00000000 00000000 ................
00000000d91e216b: 00000000 00000000 00000000 00000000 ................
0000000032cf1294: 00000000 00000000 ........
CPU: 1 PID: 189565 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd5211df8fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffca36dd318 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 0000563cab30d400 RCX: 00007fd5211df8fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 0000563cab312dd0
RBP: 0000000000000001 R08: 0000563cab313960 R09: 0000563cab30a010
R10: 0000000000000000 R11: 0000000000000202 R12: 0000563cab312dd0
R13: 00007fd522062184 R14: 0000563cab30d5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): sb orphan head is 644
sb_info orphan list:
inode dm-3:644 at 00000000dda0a0aa: mode 100644, nlink 1, next 643
inode dm-3:643 at 000000008e18b7d5: mode 100644, nlink 1, next 642
inode dm-3:642 at 00000000e7090da3: mode 100644, nlink 1, next 641
inode dm-3:641 at 00000000335ba333: mode 100644, nlink 1, next 640
inode dm-3:640 at 00000000a1411912: mode 100644, nlink 1, next 639
inode dm-3:639 at 000000004d1abbeb: mode 100644, nlink 1, next 638
inode dm-3:638 at 00000000c38ee5cb: mode 100644, nlink 1, next 637
inode dm-3:637 at 0000000065195cb5: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
mmp test complete, duration 1927 sec
kernel BUG at /tmp/rpmbuild-lustre-jenkins-Qbyfc4Z1/BUILD/lustre-2.17.50_86_g6747b63/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP NOPTI
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ff616882c5573a78 EFLAGS: 00010216
RAX: ff19c7d14faee1d8 RBX: ff19c7d16dbb9720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ff19c7d1bbb1e698 RDI: ff19c7d1bbb1e698
RBP: ff19c7d16dbb9000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ff616882c5573890 R12: ff19c7d16dbb9720
R13: ff19c7d15afa3800 R14: ffffffffc16078a8 R15: ff19c7d16c921580
FS: 00007fd6a8e3d080(0000) GS:ff19c7d1bbb00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000563f1d02b178 CR3: 000000011f332006 CR4: 0000000000771ee0
PKRU: 55555554
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts);
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds3' ' /proc/mounts);
Lustre: DEBUG MARKER: running=$(grep -c /mnt/lustre-mds1' ' /proc/mounts);
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1
Lustre: DEBUG MARKER: modprobe dm-flakey;
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey >/dev/null 2>&1
Lustre: DEBUG MARKER: dmsetup status /dev/mapper/mds1_flakey 2>&1
Lustre: DEBUG MARKER: test -b /dev/mapper/mds1_flakey
Autotest: Test running for 35 minutes (lustre-reviews_review-dne-subtest-change_121246.106)
Lustre: DEBUG MARKER: e2label /dev/mapper/mds1_flakey
Lustre: DEBUG MARKER: mkdir -p /mnt/lustre-mds1; mount -t lustre -o localrecov /dev/mapper/mds1_flakey /mnt/lustre-mds1
LDISKFS-fs (dm-3): mounted filesystem with ordered data mode. Opts: user_xattr,errors=remount-ro,no_mbcache,nodelalloc
Lustre: lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180
Lustre: Skipped 14 previous similar messages
LDISKFS-fs error (device dm-3): mb_free_blocks:1962: group 10, block 228448:freeing already freed block (bit 19968); block bitmap corrupt.
Aborting journal on device dm-3-8.
LDISKFS-fs (dm-3): Remounting filesystem read-only
LDISKFS-fs warning (device dm-3): ldiskfs_mb_generate_buddy:1239: group 10: block bitmap and bg descriptor inconsistent: 2951 vs 2953 free clusters 3943 in gd, 2 pa's
LDISKFS-fs error (device dm-3) in osd_trans_stop:2343: IO failure
LustreError: 192402:0:(osd_handler.c:2346:osd_trans_stop()) lustre-MDT0000: failed to stop transaction: rc = -5
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n health_check
LustreError: 192576:0:(obd_sysfs.c:242:health_check_show()) lustre-MDT0000-osd: device reported unhealthy
Lustre: DEBUG MARKER: /usr/sbin/lctl mark mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: \'NOT HEALTHY\'
Lustre: DEBUG MARKER: mmp test_10: @@@@@@ FAIL: mds1 is in a unhealthy state, got: 'NOT HEALTHY'
Lustre: DEBUG MARKER: /usr/sbin/lctl dk > /autotest/autotest-2/2026-02-03/lustre-reviews_review-dne-subtest-change_121246_106_4bd9e2ca-25ff-4474-b812-f5dd47c9caeb//mmp.test_10.debug_log.$(hostname -s).1770161534.log;
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d -f /mnt/lustre-mds1
LustreError: 193017:0:(osd_handler.c:2469:osd_drop_preallocated_space()) lustre-MDT0000: can't truncate: rc=-30
LustreError: 193017:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup
LustreError: 193017:0:(obd_class.h:479:obd_check_dev()) Skipped 389 previous similar messages
LDISKFS-fs (dm-3): Inode 645 (00000000ffc3432f): orphan list check failed!
00000000ffc3432f: 0001f30a 00000004 00000000 00000000 ................
00000000aa3ac40a: 00000004 000372d6 00000000 00000000 .....r..........
000000003c407cf1: 00000000 00000000 00000000 00000000 ................
00000000197a009d: 00000000 00000000 00000000 00000000 ................
000000004505b04d: 00000000 00000000 00000000 00000001 ................
0000000006206f43: 4fb32650 ff19c7d1 4fb32650 ff19c7d1 P&.O....P&.O....
00000000c45c663d: 00000000 00000000 00084000 80000004 .........@......
0000000004320dcc: 00000000 00000000 4fb32678 ff19c7d1 ........x&.O....
000000007366ab29: 4fb32678 ff19c7d1 00000000 00000000 x&.O............
00000000b531bd52: 00000000 00000000 6dbb9720 ff19c7d1 ........ ..m....
000000004c8a1219: 4fb30558 ff19c7d1 00002040 00000000 X..O....@ ......
00000000fbba9e18: 00000000 00000000 4fb326b8 ff19c7d1 .........&.O....
000000009cdc6652: 4fb326b8 ff19c7d1 00000000 00000000 .&.O............
00000000ac1b6778: 00000000 00000000 00000000 00000000 ................
0000000055bc6a85: 4fb326e0 ff19c7d1 4fb326e0 ff19c7d1 .&.O.....&.O....
00000000f9a03d36: 00000000 00000000 00000000 00000000 ................
0000000005dd4dd0: 000881a4 00000000 00000000 00000280 ................
00000000aacf5387: 00000000 00000000 00000000 00000000 ................
00000000cd640e60: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z....
00000000cdaca561: 4fb32878 ff19c7d1 5435a640 ff19c7d1 x(.O....@.5T....
0000000036846a4e: 00000285 00000000 00000001 00000000 ................
000000008ca52e1c: 00002040 00000000 6982857d 00000000 @ ......}..i....
000000003c3cff2b: 00000000 00000000 6982857d 00000000 ........}..i....
0000000018c878ea: 00000000 00000000 6982857d 00000000 ........}..i....
000000009462b681: 00000000 00000000 00000000 00000000 ................
000000009dd13ca7: 0000000c 00000000 00000020 00000000 ........ .......
00000000cb065702: 00000060 00000000 00000000 00000000 `...............
000000006e373f08: 4fb327b0 ff19c7d1 4fb327b0 ff19c7d1 .'.O.....'.O....
00000000870e60ae: 00000000 00000000 00000000 00000000 ................
00000000885f648a: 001c67f8 00000001 00000000 00000000 .g..............
00000000b65b88e9: 00000000 00000000 00000000 00000000 ................
000000007e2c2d2c: 4fb327f0 ff19c7d1 4fb327f0 ff19c7d1 .'.O.....'.O....
00000000c90fc266: 00000000 00000000 00000000 00000000 ................
000000001f6e19d3: 4fb32810 ff19c7d1 4fb32810 ff19c7d1 .(.O.....(.O....
0000000093340bf0: 4fb32820 ff19c7d1 4fb32820 ff19c7d1 (.O.... (.O....
0000000042fbda8c: 4fb32830 ff19c7d1 4fb32830 ff19c7d1 0(.O....0(.O....
00000000b735aa24: 00000000 00000000 00000000 00000000 ................
000000001e6e5886: 00000002 00000000 00000000 00000000 ................
000000004ae3e99b: 00000000 00000000 c15deb40 ffffffff ........@.].....
0000000091c6136a: 00000000 00000000 4fb32700 ff19c7d1 .........'.O....
000000001f22b8e9: 00000000 00000021 00000000 00000000 ....!...........
00000000b140c881: 00000000 00000000 00000000 00000000 ................
00000000522e3519: 00000000 00000000 00000000 00000000 ................
00000000b575f627: 00000000 00000000 4fb328b8 ff19c7d1 .........(.O....
00000000a72f30ed: 4fb328b8 ff19c7d1 00000000 00000000 .(.O............
00000000ffa95159: 00000000 00000000 00000000 00000000 ................
0000000003afdb33: 00000000 00000000 00000000 00000000 ................
0000000094ab257e: c15dca60 ffffffff 00000010 00000000 `.].............
000000002195c969: 00000000 006200ca 4fb32908 ff19c7d1 ......b..).O....
00000000e03869ee: 4fb32908 ff19c7d1 00000000 00000000 .).O............
000000005bec6eb0: 00000000 00000000 00000000 00000000 ................
000000005a95b72f: 00000000 00000000 00000000 00000000 ................
000000009ff9a122: 00000000 00000000 4fb32948 ff19c7d1 ........H).O....
000000004cfe0cd5: 4fb32948 ff19c7d1 00000000 00000000 H).O............
00000000b26ac546: 05890448 00000000 00000000 00000000 H...............
000000008fd0c5d6: 00000000 00000000 00000000 00000000 ................
000000009866ee6c: 00000000 00000000 00000000 00000000 ................
00000000376b0bfe: 00000000 00000000 6982857d 00000000 ........}..i....
00000000d8997023: 12c5e42b 00000000 00000000 00000000 +...............
00000000271f892a: 4fb329b0 ff19c7d1 4fb329b0 ff19c7d1 .).O.....).O....
00000000875d65e7: 00000000 ff19c7d1 00000000 00000000 ................
00000000569ef8de: 00000000 00000000 00000000 00000000 ................
000000003859b10f: 4fb329e0 ff19c7d1 4fb329e0 ff19c7d1 .).O.....).O....
000000008950e178: 00000000 00000000 00000000 ffffffff ................
00000000b37578d2: 00000000 ff19c7d1 00000000 00000000 ................
00000000c4f6d20b: 00000020 00000000 00000000 00000000 ...............
000000003c994cab: 00000000 ff19c7d1 4fb32a28 ff19c7d1 ........(*.O....
00000000a4d6d5d4: 4fb32a28 ff19c7d1 ffffffe0 0000000f (*.O............
00000000d47da39a: 4fb32a40 ff19c7d1 4fb32a40 ff19c7d1 @*.O....@*.O....
00000000948b3804: c157e8e0 ffffffff ffffffff ffffffff ..W.............
000000000caf209a: bc655140 ffffffff 40cb5000 ff19c7d1 @Qe......P.@....
0000000065f6c782: 4fb32bb8 ff19c7d1 00000000 00000000 .+.O............
00000000ef58a945: 000001f0 000001f0 00000000 00000000 ................
0000000019293a3f: 00000000 00000000 00000000 00000000 ................
00000000a0ec349f: 00000000 00000000 69828388 00000000 ...........i....
00000000a710f4ad: 27b435b5 00000000 .5.'....
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0
RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010
R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0
R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 646 (000000007a67e056): orphan list check failed!
000000007a67e056: 0001f30a 00000004 00000000 00000000 ................
000000005717d82e: 00000004 000372da 00000000 00000000 .....r..........
0000000089f13a02: 00000000 00000000 00000000 00000000 ................
00000000f138d8a1: 00000000 00000000 00000000 00000285 ................
00000000555e4113: 00000000 00000000 00000000 00000001 ................
000000005bfe6fdb: 4fb30510 ff19c7d1 4fb30510 ff19c7d1 ...O.......O....
0000000055ffbaeb: 00000000 00000000 00084000 80000004 .........@......
000000007be9f525: 00000000 00000000 4fb30538 ff19c7d1 ........8..O....
000000005cc2a403: 4fb30538 ff19c7d1 00000000 00000000 8..O............
00000000d217fa66: 00000000 00000000 4fb32698 ff19c7d1 .........&.O....
00000000b511666b: 4fb33018 ff19c7d1 00002040 00000000 .0.O....@ ......
0000000073ffabfa: 00000000 00000000 4fb30578 ff19c7d1 ........x..O....
00000000753773a2: 4fb30578 ff19c7d1 00000000 00000000 x..O............
00000000f6f9ffe1: 00000000 00000000 00000000 00000000 ................
00000000a982408c: 4fb305a0 ff19c7d1 4fb305a0 ff19c7d1 ...O.......O....
00000000ab5edb57: 00000000 00000000 00000000 00000000 ................
00000000860da577: 000881a4 00000000 00000000 00000280 ................
000000002204ac7f: 00000000 00000000 00000000 00000000 ................
00000000cb26633f: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z....
00000000a34c6d35: 4fb30738 ff19c7d1 41bd2ac0 ff19c7d1 8..O.....*.A....
00000000a0e544ef: 00000286 00000000 00000001 00000000 ................
000000004e892824: 00002040 00000000 6982857d 00000000 @ ......}..i....
00000000d1ef13e7: 00000000 00000000 6982857d 00000000 ........}..i....
00000000a184960c: 00000000 00000000 6982857d 00000000 ........}..i....
000000005afc02ad: 00000000 00000000 00000000 00000000 ................
00000000cb3e0fa1: 0000000c 00000000 00000020 00000000 ........ .......
000000000b65df31: 00000060 00000000 00000000 00000000 `...............
000000002505d1af: 4fb30670 ff19c7d1 4fb30670 ff19c7d1 p..O....p..O....
000000005ceb8449: 00000000 00000000 00000000 00000000 ................
000000001818c43e: 001c67fb 00000001 00000000 00000000 .g..............
000000008463f459: 00000000 00000000 00000000 00000000 ................
0000000013f30a20: 4fb306b0 ff19c7d1 4fb306b0 ff19c7d1 ...O.......O....
00000000c5e6980c: 00000000 00000000 00000000 00000000 ................
00000000d5a501be: 4fb306d0 ff19c7d1 4fb306d0 ff19c7d1 ...O.......O....
000000006b46e8cd: 4fb306e0 ff19c7d1 4fb306e0 ff19c7d1 ...O.......O....
000000007dc71629: 4fb306f0 ff19c7d1 4fb306f0 ff19c7d1 ...O.......O....
00000000da36563a: 00000000 00000000 00000000 00000000 ................
0000000001df8f1c: 00000002 00000000 00000000 00000000 ................
0000000076a4317c: 00000000 00000000 c15deb40 ffffffff ........@.].....
00000000b1f42fd4: 00000000 00000000 4fb305c0 ff19c7d1 ...........O....
00000000319e29b0: 00000000 00000021 00000000 00000000 ....!...........
000000002ab04c08: 00000000 00000000 00000000 00000000 ................
000000009243ebc9: 00000000 00000000 00000000 00000000 ................
00000000bdcf491c: 00000000 00000000 4fb30778 ff19c7d1 ........x..O....
00000000ead29a0e: 4fb30778 ff19c7d1 00000000 00000000 x..O............
00000000a8067950: 00000000 00000000 00000000 00000000 ................
0000000054212057: 00000000 00000000 00000000 00000000 ................
000000006317dee3: c15dca60 ffffffff 00000010 00000000 `.].............
00000000f07f8c2d: 00000000 006200ca 4fb307c8 ff19c7d1 ......b....O....
000000006bd27d0a: 4fb307c8 ff19c7d1 00000000 00000000 ...O............
000000005a8af1e1: 00000000 00000000 00000000 00000000 ................
00000000100efb0c: 00000000 00000000 00000000 00000000 ................
00000000a588813a: 00000000 00000000 4fb30808 ff19c7d1 ...........O....
00000000559657c6: 4fb30808 ff19c7d1 00000000 00000000 ...O............
000000000e2ea883: 1260fe95 00000000 00000000 00000000 ..`.............
0000000032bbfd35: 00000000 00000000 00000000 00000000 ................
000000003f946141: 00000000 00000000 00000000 00000000 ................
00000000b45ba8cc: 00000000 00000000 6982857d 00000000 ........}..i....
000000006addf68b: 12f3aaf7 00000000 00000000 ff19c7d1 ................
000000004efc7e92: 4fb30870 ff19c7d1 4fb30870 ff19c7d1 p..O....p..O....
00000000ff6f6c8e: 00000000 00000000 00000000 00000000 ................
00000000db5bf071: 00000000 00000000 00000000 00000000 ................
00000000bd3b6d87: 4fb308a0 ff19c7d1 4fb308a0 ff19c7d1 ...O.......O....
00000000abe14a04: 00000000 00000000 00000000 ffffffff ................
000000000abe5b13: 00000000 ff19c7d1 00000000 00000000 ................
000000008c2bea6c: 00000020 ff19c7d1 00000000 00000000 ...............
0000000089e0256f: 00000000 ff19c7d1 4fb308e8 ff19c7d1 ...........O....
000000006f12464a: 4fb308e8 ff19c7d1 ffffffe0 0000000f ...O............
00000000d70bdccb: 4fb30900 ff19c7d1 4fb30900 ff19c7d1 ...O.......O....
0000000070228582: c157e8e0 ffffffff bc657f40 ffffffff ..W.....@.e.....
00000000d58ad6bd: 00000000 00000000 4fb307b0 ff19c7d1 ...........O....
0000000066006190: 00000000 00000021 00000000 00000000 ....!...........
000000009fc9b7d7: 000001f0 000001f0 00000000 00000000 ................
00000000d0dd9fa8: 00000000 00000000 00000000 00000000 ................
000000005f2e95b7: 00000000 00000000 4fb30968 00000000 ........h..O....
00000000d3530989: 4fb30968 ff19c7d1 h..O....
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0
RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010
R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0
R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 647 (00000000b8361129): orphan list check failed!
00000000b8361129: 0001f30a 00000004 00000000 00000000 ................
000000009fe2edbf: 00000004 000372de 00000000 00000000 .....r..........
0000000081ee16a8: 00000000 00000000 00000000 00000000 ................
00000000af9db302: 00000000 00000000 00000000 00000286 ................
00000000ce0ae3c1: 00000000 00000000 00000000 00000001 ................
00000000b7d93223: 4fb32fd0 ff19c7d1 4fb32fd0 ff19c7d1 ./.O...../.O....
00000000ba292746: 00000000 00000000 00084000 80000004 .........@......
000000001eb5500d: 00000000 00000000 4fb32ff8 ff19c7d1 ........./.O....
00000000e82c5e89: 4fb32ff8 ff19c7d1 00000000 00000000 ./.O............
00000000228ff5c1: 00000000 00000000 4fb30558 ff19c7d1 ........X..O....
0000000046a35055: 4fb30ed8 ff19c7d1 00002040 00000000 ...O....@ ......
0000000082671281: 00000000 00000000 4fb33038 ff19c7d1 ........80.O....
000000005a70f3e3: 4fb33038 ff19c7d1 00000000 00000000 80.O............
0000000037c00629: 00000000 00000000 00000000 00000000 ................
00000000838a14e1: 4fb33060 ff19c7d1 4fb33060 ff19c7d1 `0.O....`0.O....
00000000058a9b44: 00000000 00000000 00000000 00000000 ................
00000000dc40ec5a: 000881a4 00000000 00000000 00000280 ................
00000000b2f8c55a: 00000000 00000000 00000000 00000000 ................
0000000094057b4e: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z....
000000006197f1d6: 4fb331f8 ff19c7d1 427029c0 ff19c7d1 .1.O.....)pB....
00000000b6e3b7bc: 00000287 00000000 00000001 00000000 ................
000000003af83d16: 00002040 00000000 6982857d 00000000 @ ......}..i....
00000000f87cff56: 00000000 00000000 6982857d 00000000 ........}..i....
000000003f20d7f4: 00000000 00000000 6982857d 00000000 ........}..i....
000000008acd6535: 00000000 00000000 00000000 00000000 ................
00000000c023643a: 0000000c 00000000 00000020 00000000 ........ .......
000000000ccab14b: 00000060 00000000 00000000 00000000 `...............
000000004ffe0279: 4fb33130 ff19c7d1 4fb33130 ff19c7d1 01.O....01.O....
00000000c25267b8: 00000000 00000000 00000000 00000000 ................
000000001b28972d: 001c67fc 00000001 00000000 00000000 .g..............
000000002ffc2e6b: 00000000 00000000 00000000 00000000 ................
00000000ecdc5796: 4fb33170 ff19c7d1 4fb33170 ff19c7d1 p1.O....p1.O....
00000000bb541957: 00000000 00000000 00000000 00000000 ................
0000000088059aee: 4fb33190 ff19c7d1 4fb33190 ff19c7d1 .1.O.....1.O....
0000000032cefcb8: 4fb331a0 ff19c7d1 4fb331a0 ff19c7d1 .1.O.....1.O....
0000000069884bba: 4fb331b0 ff19c7d1 4fb331b0 ff19c7d1 .1.O.....1.O....
00000000799ec50a: 00000000 00000000 00000000 00000000 ................
0000000069315ba2: 00000002 00000000 00000000 00000000 ................
00000000fc6d2bdc: 00000000 00000000 c15deb40 ffffffff ........@.].....
00000000d016df4c: 00000000 00000000 4fb33080 ff19c7d1 .........0.O....
0000000035003dd6: 00000000 00000021 00000000 00000000 ....!...........
00000000742b6ed2: 00000000 00000000 00000000 00000000 ................
000000005d89a248: 00000000 00000000 00000000 00000000 ................
00000000017890d8: 00000000 00000000 4fb33238 ff19c7d1 ........82.O....
000000007c281463: 4fb33238 ff19c7d1 00000000 00000000 82.O............
000000001a39c7f0: 00000000 00000000 00000000 00000000 ................
00000000bee8f209: 00000000 00000000 00000000 00000000 ................
00000000e87525bb: c15dca60 ffffffff 00000010 00000000 `.].............
00000000a7038f9c: 00000000 006200ca 4fb33288 ff19c7d1 ......b..2.O....
00000000144d6ac4: 4fb33288 ff19c7d1 00000000 00000000 .2.O............
00000000675957a4: 00000000 00000000 00000000 00000000 ................
000000005a4ba571: 00000000 00000000 00000000 00000000 ................
0000000079db2ebd: 00000000 00000000 4fb332c8 ff19c7d1 .........2.O....
00000000d253cb0a: 4fb332c8 ff19c7d1 00000000 00000000 .2.O............
00000000bfa2a73e: d19cb39b 00000000 00000000 00000000 ................
000000000014e23a: 00000000 00000000 00000000 00000000 ................
0000000080e90327: 00000000 00000000 00000000 00000000 ................
000000009a6d6943: 00000000 ff19c7d1 6982857d 00000000 ........}..i....
0000000070fafd2e: 1302ed3a 00000000 00000000 ff19c7d1 :...............
000000003ccbdd5e: 4fb33330 ff19c7d1 4fb33330 ff19c7d1 03.O....03.O....
00000000bae3c0ae: 00000000 00000000 00000000 00000000 ................
000000006a497992: 00000000 00000000 00000000 00000000 ................
0000000099a406bc: 4fb33360 ff19c7d1 4fb33360 ff19c7d1 `3.O....`3.O....
0000000048753999: 00000000 00000000 00000000 ffffffff ................
00000000fee02e6d: 00000000 00000000 00000000 00000000 ................
00000000b8ad6539: 00000020 00000000 00000000 00000000 ...............
00000000b2dbbe46: 00000000 00000000 4fb333a8 ff19c7d1 .........3.O....
0000000025431183: 4fb333a8 ff19c7d1 ffffffe0 0000000f .3.O............
00000000bc3b36d8: 4fb333c0 ff19c7d1 4fb333c0 ff19c7d1 .3.O.....3.O....
000000001c74f2a5: c157e8e0 ffffffff 00000000 00000000 ..W.............
0000000026e2e67d: bc643540 ffffffff 00000010 00000000 @5d.............
00000000f558e0f6: 00000000 006200ca 00000000 00000000 ......b.........
00000000b8f8fed4: 000001f0 000001f0 00000000 00000000 ................
000000002133b2ab: 00000000 00000000 00000000 00000000 ................
00000000a2214dac: 00000000 00000000 00000000 00000000 ................
00000000e20397fa: 00000000 00000000 ........
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0
RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010
R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0
R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 648 (000000003ba7c2e2): orphan list check failed!
000000003ba7c2e2: 0001f30a 00000004 00000000 00000000 ................
00000000063929e6: 00000004 000372e2 00000000 00000000 .....r..........
000000004bcd1eb4: 00000000 00000000 00000000 00000000 ................
00000000e46eaac0: 00000000 00000000 00000000 00000287 ................
000000007185cc14: 00000000 00000000 00000000 00000001 ................
0000000045909be1: 4fb30e90 ff19c7d1 4fb30e90 ff19c7d1 ...O.......O....
000000009c44f3b7: 00000000 00000000 00084000 80000004 .........@......
00000000009e7ad1: 00000000 00000000 4fb30eb8 ff19c7d1 ...........O....
00000000bffa0358: 4fb30eb8 ff19c7d1 00000000 00000000 ...O............
000000008e4b476e: 00000000 00000000 4fb33018 ff19c7d1 .........0.O....
0000000048d0668a: 4fb31d18 ff19c7d1 00002040 00000000 ...O....@ ......
00000000cc4ca4f4: 00000000 00000000 4fb30ef8 ff19c7d1 ...........O....
00000000b8e214d7: 4fb30ef8 ff19c7d1 00000000 00000000 ...O............
00000000cf35f2b2: 00000000 00000000 00000000 00000000 ................
00000000c698c388: 4fb30f20 ff19c7d1 4fb30f20 ff19c7d1 ..O.... ..O....
000000002b79cc3f: 00000000 00000000 00000000 00000000 ................
0000000012f35321: 000881a4 00000000 00000000 00000280 ................
00000000830023e4: 00000000 00000000 00000000 00000000 ................
00000000ede013d8: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z....
00000000df874d32: 4fb310b8 ff19c7d1 543a2280 ff19c7d1 ...O.....":T....
00000000a06ac7fb: 00000288 00000000 00000001 00000000 ................
0000000054807c0e: 00002040 00000000 6982857d 00000000 @ ......}..i....
000000000f573280: 00000000 00000000 6982857d 00000000 ........}..i....
00000000f0dd8005: 00000000 00000000 6982857d 00000000 ........}..i....
000000008f8cfb7f: 00000000 00000000 00000000 00000000 ................
000000003c7cafac: 0000000c 00000000 00000020 00000000 ........ .......
000000000f47a428: 00000060 00000000 00000000 00000000 `...............
00000000a4bac57d: 4fb30ff0 ff19c7d1 4fb30ff0 ff19c7d1 ...O.......O....
0000000001d61d2a: 00000000 00000000 00000000 00000000 ................
000000002db2f6ce: 001c67fd 00000001 00000000 00000000 .g..............
0000000095b0a82a: 00000000 00000000 00000000 00000000 ................
00000000049f431d: 4fb31030 ff19c7d1 4fb31030 ff19c7d1 0..O....0..O....
00000000907eae3a: 00000000 00000000 00000000 00000000 ................
000000009078a6ed: 4fb31050 ff19c7d1 4fb31050 ff19c7d1 P..O....P..O....
00000000db51cfbc: 4fb31060 ff19c7d1 4fb31060 ff19c7d1 `..O....`..O....
00000000ce1fd6f2: 4fb31070 ff19c7d1 4fb31070 ff19c7d1 p..O....p..O....
00000000c4ac0edc: 00000000 00000000 00000000 00000000 ................
00000000e6e36164: 00000002 00000000 00000000 00000000 ................
000000004068a0cc: 00000000 00000000 c15deb40 ffffffff ........@.].....
00000000c08890e2: 00000000 00000000 4fb30f40 ff19c7d1 ........@..O....
0000000036126955: 00000000 00000021 00000000 00000000 ....!...........
00000000041d5937: 00000000 00000000 00000000 00000000 ................
00000000c25041cf: 00000000 00000000 00000000 00000000 ................
00000000451c3a1f: 00000000 00000000 4fb310f8 ff19c7d1 ...........O....
0000000006f0b488: 4fb310f8 ff19c7d1 00000000 00000000 ...O............
000000009875a544: 00000000 00000000 00000000 00000000 ................
00000000b52beffc: 00000000 00000000 00000000 00000000 ................
000000008c895bba: c15dca60 ffffffff 00000010 00000000 `.].............
0000000039b7e707: 00000000 006200ca 4fb31148 ff19c7d1 ......b.H..O....
00000000e1bf9d3c: 4fb31148 ff19c7d1 00000000 00000000 H..O............
000000007d9412a4: 00000000 00000000 00000000 00000000 ................
0000000067392b90: 00000000 00000000 00000000 00000000 ................
000000001d8ae63a: 00000000 00000000 4fb31188 ff19c7d1 ...........O....
00000000132b8ecc: 4fb31188 ff19c7d1 00000000 00000000 ...O............
0000000073119571: 70fff939 00000000 00000000 00000000 9..p............
00000000a1e84abd: 00000000 00000000 00000000 00000000 ................
00000000071b7250: 00000000 00000000 00000000 00000000 ................
0000000065e07cdb: 00000000 00000000 6982857d 00000000 ........}..i....
000000008a9c38aa: 13122f7e 00000000 00000000 ad951e33 ~/..........3...
00000000e1c359f9: 4fb311f0 ff19c7d1 4fb311f0 ff19c7d1 ...O.......O....
00000000ae261045: 00000000 ffffffff 00000000 00000000 ................
0000000006745814: 00000000 00000000 00000000 00000000 ................
00000000eb9cb80e: 4fb31220 ff19c7d1 4fb31220 ff19c7d1 ..O.... ..O....
00000000bda29a02: 00000000 00000000 00000000 ffffffff ................
000000006954f524: 00000000 00000000 00000000 00000000 ................
0000000050a112e5: 00000020 00000000 00000000 00000000 ...............
000000004ec88315: 00000000 00000000 4fb31268 ff19c7d1 ........h..O....
00000000c078f64d: 4fb31268 ff19c7d1 ffffffe0 0000000f h..O............
00000000b649f409: 4fb31280 ff19c7d1 4fb31280 ff19c7d1 ...O.......O....
00000000b7196ff5: c157e8e0 ffffffff 00000000 00000000 ..W.............
0000000001f29b59: 4fb312a0 ff19c7d1 4fb312a0 ff19c7d1 ...O.......O....
00000000e40da815: 00000000 00000000 00000000 00000000 ................
00000000ab527eec: 000001f0 000001f0 00000000 00000000 ................
000000004dec55a8: 00000000 00000000 00000000 00000000 ................
00000000cca1f47b: 00000000 00000000 4fb312e0 00000000 ...........O....
000000001ba16bc8: 00000000 00000000 ........
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0
RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010
R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0
R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 649 (00000000051cbb94): orphan list check failed!
00000000051cbb94: 0001f30a 00000004 00000000 00000000 ................
000000005b7be891: 00000004 000372e6 00000000 00000000 .....r..........
000000001bc43042: 00000000 00000000 00000000 00000000 ................
00000000a14a1101: 00000000 00000000 00000000 00000288 ................
00000000306037a4: 00000000 00000000 00000000 00000001 ................
0000000015dadfae: 4fb31cd0 ff19c7d1 4fb31cd0 ff19c7d1 ...O.......O....
00000000f115e3c1: 00000000 00000000 00084000 80000004 .........@......
000000005ddd9de3: 00000000 00000000 4fb31cf8 ff19c7d1 ...........O....
000000001083de3d: 4fb31cf8 ff19c7d1 00000000 00000000 ...O............
0000000097a57357: 00000000 00000000 4fb30ed8 ff19c7d1 ...........O....
00000000d1502e27: 4fb31858 ff19c7d1 00002040 00000000 X..O....@ ......
00000000b5111347: 00000000 00000000 4fb31d38 ff19c7d1 ........8..O....
000000006d11bca6: 4fb31d38 ff19c7d1 00000000 00000000 8..O............
0000000005680df5: 00000000 00000000 00000000 00000000 ................
00000000d8ee081a: 4fb31d60 ff19c7d1 4fb31d60 ff19c7d1 `..O....`..O....
00000000a2f54e39: 00000000 00000000 00000000 00000000 ................
00000000d0f6fe0b: 000881a4 00000000 00000000 00000280 ................
0000000077ac0f78: 00000000 00000000 00000000 00000000 ................
00000000595bd032: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z....
00000000bb211b54: 4fb31ef8 ff19c7d1 543a21c0 ff19c7d1 ...O.....!:T....
00000000d0a23882: 00000289 00000000 00000001 00000000 ................
00000000ab21f717: 00002040 00000000 6982857d 00000000 @ ......}..i....
0000000002770176: 00000000 00000000 6982857d 00000000 ........}..i....
00000000b0aa3ca2: 00000000 00000000 6982857d 00000000 ........}..i....
00000000b84239b9: 00000000 00000000 00000000 00000000 ................
0000000021b6cb14: 0000000c 00000000 00000020 00000000 ........ .......
0000000062a84e05: 00000060 00000000 00000000 00000000 `...............
00000000355e93c9: 4fb31e30 ff19c7d1 4fb31e30 ff19c7d1 0..O....0..O....
00000000417a98b6: 00000000 00000000 00000000 00000000 ................
000000006d701da5: 001c67fe 00000001 00000000 00000000 .g..............
000000008298365a: 00000000 00000000 00000000 00000000 ................
000000008865af2e: 4fb31e70 ff19c7d1 4fb31e70 ff19c7d1 p..O....p..O....
00000000c0efe89f: 00000000 00000000 00000000 00000000 ................
0000000049fc1b1d: 4fb31e90 ff19c7d1 4fb31e90 ff19c7d1 ...O.......O....
000000001a7134db: 4fb31ea0 ff19c7d1 4fb31ea0 ff19c7d1 ...O.......O....
0000000028f9c38a: 4fb31eb0 ff19c7d1 4fb31eb0 ff19c7d1 ...O.......O....
000000008d4919c3: 00000000 00000000 00000000 00000000 ................
00000000a0eef8db: 00000002 00000000 00000000 00000000 ................
00000000a8c849d0: 00000000 00000000 c15deb40 ffffffff ........@.].....
00000000da6644b7: 00000000 00000000 4fb31d80 ff19c7d1 ...........O....
00000000ba530495: 00000000 00000021 00000000 00000000 ....!...........
00000000539db65d: 00000000 00000000 00000000 00000000 ................
000000002a62ba52: 00000000 00000000 00000000 00000000 ................
000000006067d0b7: 00000000 00000000 4fb31f38 ff19c7d1 ........8..O....
000000008ca4cde5: 4fb31f38 ff19c7d1 00000000 00000000 8..O............
00000000afef9335: 00000000 00000000 00000000 00000000 ................
0000000052416736: 00000000 00000000 00000000 00000000 ................
000000001d9d92b6: c15dca60 ffffffff 00000010 00000000 `.].............
0000000080284243: 00000000 006200ca 4fb31f88 ff19c7d1 ......b....O....
000000001064e676: 4fb31f88 ff19c7d1 00000000 00000000 ...O............
000000003f3c4bd2: 00000000 00000000 00000000 00000000 ................
00000000ea22dea3: 00000000 00000000 00000000 00000000 ................
000000002a66a5fe: 00000000 00000000 4fb31fc8 ff19c7d1 ...........O....
00000000077158bf: 4fb31fc8 ff19c7d1 00000000 00000000 ...O............
000000009a066da4: 480a43a4 00000000 00000000 00000000 .C.H............
00000000dfd8f5d4: 00000000 00000000 00000000 00000000 ................
00000000756986af: 00000000 00000000 00000000 00000000 ................
000000002e574390: 00000000 ffffffff 6982857d 00000000 ........}..i....
00000000980337a4: 132171c2 00000000 00000000 ff19c7d1 .q!.............
00000000e3a16f8e: 4fb32030 ff19c7d1 4fb32030 ff19c7d1 0 .O....0 .O....
00000000b29fafa1: 00000000 00000000 00000000 00000000 ................
00000000e21ded6a: 00000000 00000000 00000000 00000000 ................
0000000076434a52: 4fb32060 ff19c7d1 4fb32060 ff19c7d1 ` .O....` .O....
00000000769f0c75: 00000000 00000000 00000000 ffffffff ................
00000000a10a633e: 00000000 00000000 00000000 00000000 ................
00000000a2c37ae7: 00000020 00000000 00000000 00000000 ...............
00000000dd52162d: 00000000 00000000 4fb320a8 ff19c7d1 ......... .O....
00000000297f353e: 4fb320a8 ff19c7d1 ffffffe0 0000000f . .O............
00000000b7918963: 4fb320c0 ff19c7d1 4fb320c0 ff19c7d1 . .O..... .O....
00000000b12d0477: c157e8e0 ffffffff 00000000 00000000 ..W.............
00000000ae8339fb: 00000000 00000000 00000000 00000000 ................
000000008148d559: 4fb320f0 ff19c7d1 00000000 00000000 . .O............
0000000071d2b40c: 000001f0 000001f0 00000000 00000000 ................
000000004b16e41e: 00000000 00000000 00000000 00000000 ................
00000000243fda1e: 00000000 00000000 4fb32120 00000000 ........ !.O....
0000000019e85ffc: 4fb32130 ff19c7d1 0!.O....
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0
RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010
R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0
R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 650 (0000000096a55d6e): orphan list check failed!
0000000096a55d6e: 0001f30a 00000004 00000000 00000000 ................
000000007864a03b: 00000004 000372ea 00000000 00000000 .....r..........
000000005cccc1ee: 00000000 00000000 00000000 00000000 ................
00000000b9290921: 00000000 00000000 00000000 00000289 ................
000000006507fa08: 00000000 00000000 00000000 00000001 ................
000000008540ae4f: 4fb31810 ff19c7d1 4fb31810 ff19c7d1 ...O.......O....
00000000582aa200: 00000000 00000000 00084000 80000004 .........@......
00000000d17dabf4: 00000000 00000000 4fb31838 ff19c7d1 ........8..O....
00000000973098a5: 4fb31838 ff19c7d1 00000000 00000000 8..O............
0000000031b7e127: 00000000 00000000 4fb31d18 ff19c7d1 ...........O....
00000000d8eb576c: 4faef998 ff19c7d1 00002040 00000000 ...O....@ ......
00000000820f8182: 00000000 00000000 4fb31878 ff19c7d1 ........x..O....
0000000032b65e12: 4fb31878 ff19c7d1 00000000 00000000 x..O............
00000000f35c8d2a: 00000000 00000000 00000000 00000000 ................
000000004b2487ba: 4fb318a0 ff19c7d1 4fb318a0 ff19c7d1 ...O.......O....
000000008dfb7fb1: 00000000 00000000 00000000 00000000 ................
0000000013111064: 000881a4 00000000 00000000 00000280 ................
00000000f61cee04: 00000000 00000000 00000000 00000000 ................
000000002a02fa34: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z....
00000000b4f8bbdb: 4fb31a38 ff19c7d1 5e25f900 ff19c7d1 8..O......%^....
000000000a4a0d99: 0000028a 00000000 00000001 00000000 ................
00000000942f3989: 00002040 00000000 6982857d 00000000 @ ......}..i....
00000000c0d55e59: 00000000 00000000 6982857d 00000000 ........}..i....
00000000070de36d: 00000000 00000000 6982857d 00000000 ........}..i....
00000000ea873d42: 00000000 00000000 00000000 00000000 ................
00000000ffb4d8af: 0000000c 00000000 00000020 00000000 ........ .......
000000006a0b6439: 00000060 00000000 00000000 00000000 `...............
000000003efa7a00: 4fb31970 ff19c7d1 4fb31970 ff19c7d1 p..O....p..O....
000000002a945c11: 00000000 00000000 00000000 00000000 ................
00000000788ab9ac: 001c67ff 00000001 00000000 00000000 .g..............
0000000080ae2f1b: 00000000 00000000 00000000 00000000 ................
0000000027c0d86e: 4fb319b0 ff19c7d1 4fb319b0 ff19c7d1 ...O.......O....
00000000752dfeec: 00000000 00000000 00000000 00000000 ................
000000000e96f2e0: 4fb319d0 ff19c7d1 4fb319d0 ff19c7d1 ...O.......O....
00000000a88d2221: 4fb319e0 ff19c7d1 4fb319e0 ff19c7d1 ...O.......O....
000000002ddf2506: 4fb319f0 ff19c7d1 4fb319f0 ff19c7d1 ...O.......O....
0000000093b31cea: 00000000 00000000 00000000 00000000 ................
00000000d05b6331: 00000002 00000000 00000000 00000000 ................
000000009fbffb35: 00000000 00000000 c15deb40 ffffffff ........@.].....
00000000b09e813e: 00000000 00000000 4fb318c0 ff19c7d1 ...........O....
00000000fa908ee7: 00000000 00000021 00000000 00000000 ....!...........
000000000d5d408c: 00000000 00000000 00000000 00000000 ................
00000000c150294c: 00000000 00000000 00000000 00000000 ................
000000004996c981: 00000000 00000000 4fb31a78 ff19c7d1 ........x..O....
00000000a6ddcca4: 4fb31a78 ff19c7d1 00000000 00000000 x..O............
000000002676fa85: 00000000 00000000 00000000 00000000 ................
000000000861f0ac: 00000000 00000000 00000000 00000000 ................
000000000be0b7b0: c15dca60 ffffffff 00000010 00000000 `.].............
00000000d325d280: 00000000 006200ca 4fb31ac8 ff19c7d1 ......b....O....
0000000079cfdf20: 4fb31ac8 ff19c7d1 00000000 00000000 ...O............
00000000bad4b906: 00000000 00000000 00000000 00000000 ................
00000000f78db0aa: 00000000 00000000 00000000 00000000 ................
000000004ac909b1: 00000000 00000000 4fb31b08 ff19c7d1 ...........O....
0000000050cf5526: 4fb31b08 ff19c7d1 00000000 00000000 ...O............
00000000782e1383: 3e4f0914 00000000 00000000 00000000 ..O>............
00000000fdc968ad: 00000000 00000000 00000000 00000000 ................
0000000064335d23: 00000000 00000000 00000000 00000000 ................
0000000047a3d10f: 00000000 00000000 6982857d 00000000 ........}..i....
000000005021bb40: 1330b406 00000000 00000000 00000000 ..0.............
00000000d286a099: 4fb31b70 ff19c7d1 4fb31b70 ff19c7d1 p..O....p..O....
0000000087c166be: 00000000 00000000 00000000 00000000 ................
00000000fd1c7a69: 00000000 00000000 00000000 00000000 ................
0000000035e4ff33: 4fb31ba0 ff19c7d1 4fb31ba0 ff19c7d1 ...O.......O....
000000005f86de63: 00000000 00000000 00000000 ffffffff ................
0000000070acf85a: 00000000 00000000 00000000 00000000 ................
000000001adae621: 00000020 00000000 00000000 00000000 ...............
00000000c8c60dce: 00000000 00000000 4fb31be8 ff19c7d1 ...........O....
00000000da6dd9ef: 4fb31be8 ff19c7d1 ffffffe0 0000000f ...O............
000000001daaf481: 4fb31c00 ff19c7d1 4fb31c00 ff19c7d1 ...O.......O....
0000000025f9dff8: c157e8e0 ffffffff 00000000 00000000 ..W.............
000000002ca9b2c9: 00000000 00000000 b42a20f1 6d981e33 ......... *.3..m
00000000ad17d2e4: 00048080 00000000 00000000 00000000 ................
000000000021722c: 000001f0 000001f0 00000000 00000000 ................
00000000e27aae01: 00000000 00000000 00000000 00000000 ................
000000002ac81e4b: 00000000 00000000 5e325480 00000000 .........T2^....
0000000007b55e98: 00043876 00000000 v8......
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0
RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010
R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0
R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 651 (0000000048b958ef): orphan list check failed!
0000000048b958ef: 0001f30a 00000004 00000000 00000000 ................
00000000720b3337: 00000004 000372ee 00000000 00000000 .....r..........
000000003f6c1355: 00000000 00000000 00000000 00000000 ................
00000000597be6d7: 00000000 00000000 00000000 0000028a ................
0000000036014be9: 00000000 00000000 00000000 00000001 ................
000000003cac5b1a: 4faef950 ff19c7d1 4faef950 ff19c7d1 P..O....P..O....
00000000d6486928: 00000000 00000000 00084000 80000004 .........@......
00000000f94730f9: 00000000 00000000 4faef978 ff19c7d1 ........x..O....
00000000193747eb: 4faef978 ff19c7d1 00000000 00000000 x..O............
00000000e72a03d4: 00000000 00000000 4fb31858 ff19c7d1 ........X..O....
000000009d53f4f7: 4faee1d8 ff19c7d1 00002040 00000000 ...O....@ ......
0000000064cb4839: 00000000 00000000 4faef9b8 ff19c7d1 ...........O....
00000000ad80ba14: 4faef9b8 ff19c7d1 00000000 00000000 ...O............
0000000079c554d7: 00000000 00000000 00000000 00000000 ................
0000000054238928: 4faef9e0 ff19c7d1 4faef9e0 ff19c7d1 ...O.......O....
0000000021cec261: 00000000 00000000 00000000 00000000 ................
0000000000752f26: 000881a4 00000000 00000000 00000280 ................
000000005977829f: 00000000 00000000 00000000 00000000 ................
000000002d10c8b4: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z....
0000000057828af5: 4faefb78 ff19c7d1 5e25fc00 ff19c7d1 x..O......%^....
000000009101ebc1: 0000028b 00000000 00000001 00000000 ................
00000000df3c316b: 00002040 00000000 6982857d 00000000 @ ......}..i....
0000000081a1407f: 00000000 00000000 6982857d 00000000 ........}..i....
00000000bba7486a: 00000000 00000000 6982857d 00000000 ........}..i....
0000000022870782: 00000000 00000000 00000000 00000000 ................
000000003b46ff10: 0000000c 00000000 00000020 00000000 ........ .......
000000008ee6379c: 00000060 00000000 00000000 00000000 `...............
000000006ec2d411: 4faefab0 ff19c7d1 4faefab0 ff19c7d1 ...O.......O....
00000000024590fb: 00000000 00000000 00000000 00000000 ................
0000000010914d23: 001c6800 00000001 00000000 00000000 .h..............
000000007ba907c8: 00000000 00000000 00000000 00000000 ................
00000000a8dfa206: 4faefaf0 ff19c7d1 4faefaf0 ff19c7d1 ...O.......O....
000000002afb7fa8: 00000000 00000000 00000000 00000000 ................
00000000c412da35: 4faefb10 ff19c7d1 4faefb10 ff19c7d1 ...O.......O....
00000000186be3dd: 4faefb20 ff19c7d1 4faefb20 ff19c7d1 ..O.... ..O....
000000000112a8a2: 4faefb30 ff19c7d1 4faefb30 ff19c7d1 0..O....0..O....
000000000c19754c: 00000000 00000000 00000000 00000000 ................
0000000030b4acfe: 00000002 00000000 00000000 00000000 ................
000000005ae1e057: 00000000 00000000 c15deb40 ffffffff ........@.].....
000000008fb1e8b7: 00000000 00000000 4faefa00 ff19c7d1 ...........O....
0000000051569afd: 00000000 00000021 00000000 00000000 ....!...........
000000007274fcda: 00000000 00000000 00000000 00000000 ................
000000002b81b4de: 00000000 00000000 00000000 00000000 ................
000000002c4b4665: 00000000 00000000 4faefbb8 ff19c7d1 ...........O....
000000007a78da73: 4faefbb8 ff19c7d1 00000000 00000000 ...O............
000000001d801c72: 00000000 00000000 00000000 00000000 ................
00000000790e6759: 00000000 00000000 00000000 00000000 ................
00000000ebbbffa0: c15dca60 ffffffff 00000010 00000000 `.].............
00000000610ef8a8: 00000000 006200ca 4faefc08 ff19c7d1 ......b....O....
000000005a23b488: 4faefc08 ff19c7d1 00000000 00000000 ...O............
00000000476ee6ad: 00000000 00000000 00000000 00000000 ................
00000000f912482a: 00000000 00000000 00000000 00000000 ................
0000000079124f63: 00000000 00000000 4faefc48 ff19c7d1 ........H..O....
00000000afde248c: 4faefc48 ff19c7d1 00000000 00000000 H..O............
00000000ddfc1ddd: ea437795 00000000 00000000 00000000 .wC.............
00000000cf9d1cb2: 00000000 00000000 00000000 00000000 ................
0000000060ca7326: 00000000 00000000 00000000 00000000 ................
0000000053ed9716: 00000000 00000000 6982857d 00000000 ........}..i....
000000001c15bb3d: 133ff649 00000000 00000000 00000000 I.?.............
000000000704f796: 4faefcb0 ff19c7d1 4faefcb0 ff19c7d1 ...O.......O....
00000000ddab11aa: 00000000 00000000 00000000 00000000 ................
00000000fcecf899: 00000000 00000000 00000000 00000000 ................
00000000db8c0dae: 4faefce0 ff19c7d1 4faefce0 ff19c7d1 ...O.......O....
0000000032668b0a: 00000000 00000000 00000000 ffffffff ................
00000000cc6ef532: 00000000 00000000 00000000 00000000 ................
0000000028cb991b: 00000020 00000000 00000000 00000000 ...............
00000000abf344ba: 00000000 ff19c7d1 4faefd28 ff19c7d1 ........(..O....
000000001f067d6e: 4faefd28 ff19c7d1 ffffffe0 0000000f (..O............
000000001b198ad0: 4faefd40 ff19c7d1 4faefd40 ff19c7d1 @..O....@..O....
0000000020823a1c: c157e8e0 ffffffff 4faefd50 ff19c7d1 ..W.....P..O....
00000000867ea328: 4faefd60 ff19c7d1 4faefd60 ff19c7d1 `..O....`..O....
00000000fc255883: 4fa96ef0 ff19c7d1 00000000 00000000 .n.O............
00000000ad283562: 000001f0 000001f0 00000000 00000000 ................
00000000d2eaf928: 00000000 00000000 00000000 00000000 ................
000000007defd392: 00000000 00000000 4faefc30 00000000 ........0..O....
00000000483b557e: 00000000 00000021 ....!...
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0
RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010
R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0
R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 652 (00000000883b74e0): orphan list check failed!
00000000883b74e0: 0001f30a 00000004 00000000 00000000 ................
00000000375125f0: 00000004 000372f2 00000000 00000000 .....r..........
00000000d6b46257: 00000000 00000000 00000000 00000000 ................
000000001d643f09: 00000000 00000000 00000000 0000028b ................
00000000632a5f8b: 00000000 00000000 00000000 00000001 ................
00000000459a1071: 4faee190 ff19c7d1 4faee190 ff19c7d1 ...O.......O....
0000000095c747de: 00000000 00000000 00084000 80000004 .........@......
000000002b066f50: 00000000 00000000 4faee1b8 ff19c7d1 ...........O....
00000000126afc32: 4faee1b8 ff19c7d1 00000000 00000000 ...O............
000000009d2c52e9: 00000000 00000000 4faef998 ff19c7d1 ...........O....
0000000068cbdc45: 6dbb9720 ff19c7d1 00002040 00000000 ..m....@ ......
000000007aef869b: 00000000 00000000 4faee1f8 ff19c7d1 ...........O....
00000000ae94ecf5: 4faee1f8 ff19c7d1 00000000 00000000 ...O............
0000000024fc8ed1: 00000000 00000000 00000000 00000000 ................
000000004ccfeef0: 4faee220 ff19c7d1 4faee220 ff19c7d1 ..O.... ..O....
0000000053e61dd7: 00000000 00000000 00000000 00000000 ................
000000003433fd67: 000881a4 00000000 00000000 00000280 ................
000000002764dd5a: 00000000 00000000 00000000 00000000 ................
0000000065e583a5: c15dea40 ffffffff 5afa3800 ff19c7d1 @.]......8.Z....
0000000073fc9bbf: 4faee3b8 ff19c7d1 5e25f9c0 ff19c7d1 ...O......%^....
000000005ac7e4ce: 0000028c 00000000 00000001 00000000 ................
0000000099568b1b: 00002040 00000000 6982857d 00000000 @ ......}..i....
000000007928114e: 00000000 00000000 6982857d 00000000 ........}..i....
0000000089927763: 00000000 00000000 6982857d 00000000 ........}..i....
000000008f5f2692: 00000000 00000000 00000000 00000000 ................
00000000bffe1bb0: 0000000c 00000000 00000020 00000000 ........ .......
00000000787fa84a: 00000060 00000000 00000000 00000000 `...............
00000000bb50f68f: 4faee2f0 ff19c7d1 4faee2f0 ff19c7d1 ...O.......O....
0000000097e69499: 00000000 00000000 00000000 00000000 ................
00000000f6148914: 001c6801 00000001 00000000 00000000 .h..............
00000000eb26c406: 00000000 00000000 00000000 00000000 ................
00000000a10d6523: 4faee330 ff19c7d1 4faee330 ff19c7d1 0..O....0..O....
00000000f709a69b: 00000000 00000000 00000000 00000000 ................
000000003dabf151: 4faee350 ff19c7d1 4faee350 ff19c7d1 P..O....P..O....
000000000adfdc4b: 4faee360 ff19c7d1 4faee360 ff19c7d1 `..O....`..O....
000000001d36d5e0: 4faee370 ff19c7d1 4faee370 ff19c7d1 p..O....p..O....
000000002181e967: 00000000 00000000 00000000 00000000 ................
00000000064a8d1a: 00000002 00000000 00000000 00000000 ................
00000000f72498dc: 00000000 00000000 c15deb40 ffffffff ........@.].....
00000000e35fcf84: 00000000 00000000 4faee240 ff19c7d1 ........@..O....
0000000046f38361: 00000000 00000021 00000000 00000000 ....!...........
00000000f839b790: 00000000 00000000 00000000 00000000 ................
00000000063710ff: 00000000 00000000 00000000 00000000 ................
00000000a8780071: 00000000 00000000 4faee3f8 ff19c7d1 ...........O....
000000005beee1ae: 4faee3f8 ff19c7d1 00000000 00000000 ...O............
000000009e7024cd: 00000000 00000000 00000000 00000000 ................
00000000063ca87e: 00000000 00000000 00000000 00000000 ................
000000009d3f4e1f: c15dca60 ffffffff 00000010 00000000 `.].............
00000000631a583c: 00000000 006200ca 4faee448 ff19c7d1 ......b.H..O....
00000000857556c2: 4faee448 ff19c7d1 00000000 00000000 H..O............
00000000a0c9ace4: 00000000 00000000 00000000 00000000 ................
00000000d60f1979: 00000000 00000000 00000000 00000000 ................
000000004547defc: 00000000 00000000 4faee488 ff19c7d1 ...........O....
000000005f9c97de: 4faee488 ff19c7d1 00000000 00000000 ...O............
00000000895b5e06: caa89bbb 00000000 00000000 00000000 ................
00000000b4013d11: 00000000 00000000 00000000 00000000 ................
00000000c87ddaba: 00000000 00000000 00000000 00000000 ................
000000006ea361b0: 00000000 00000000 6982857d 00000000 ........}..i....
00000000b720280d: 134f388d 00000000 00000000 00000000 .8O.............
0000000002aad829: 4faee4f0 ff19c7d1 4faee4f0 ff19c7d1 ...O.......O....
00000000ea300293: 00000000 00000000 00000000 00000000 ................
00000000138ab811: 00000000 00000000 00000000 00000000 ................
000000001fa23a70: 4faee520 ff19c7d1 4faee520 ff19c7d1 ..O.... ..O....
00000000f705a7dc: 00000000 00000000 00000000 ffffffff ................
0000000075225c1e: 00000000 ffffffff 00000000 00000000 ................
0000000027cee4e2: 00000020 ff19c7d1 00000000 00000000 ...............
000000007d710a4c: 00000000 00000000 4faee568 ff19c7d1 ........h..O....
0000000080c0b086: 4faee568 ff19c7d1 ffffffe0 0000000f h..O............
00000000595243de: 4faee580 ff19c7d1 4faee580 ff19c7d1 ...O.......O....
000000003ff62cb8: c157e8e0 ffffffff 69828518 00000000 ..W........i....
00000000484b2936: 387af90c 00000000 00000000 00000000 ..z8............
00000000b76a4d90: 0000000c 00000000 00000000 00000000 ................
00000000367652be: 000001f0 000001f0 00000000 00000000 ................
000000004d036ba8: 00000000 00000000 00000000 00000000 ................
00000000b7c542d3: 00000000 00000000 00000000 00000000 ................
0000000002c5b245: 00000000 00000000 ........
CPU: 1 PID: 193017 Comm: umount Kdump: loaded Tainted: G OE -------- - - 4.18.0-553.89.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
? srso_alias_return_thunk+0x5/0xfcdfd
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.33+0x8e/0x280 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? class_disconnect_exports+0x2d6/0x2f0 [obdclass]
class_cleanup+0x326/0x7d0 [obdclass]
class_process_config+0x3bb/0x2040 [obdclass]
? srso_alias_return_thunk+0x5/0xfcdfd
? __kmalloc+0x113/0x250
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x10a/0x570 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x14a0 [ptlrpc]
? srso_alias_return_thunk+0x5/0xfcdfd
? fsnotify_sb_delete+0x138/0x1c0
? __dentry_kill+0x121/0x170
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xf4/0x100
do_syscall_64+0x1cb/0x1d0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7fd6a7d968fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffec4fc80d8 EFLAGS: 00000202 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 000055da49dbe400 RCX: 00007fd6a7d968fb
RDX: 0000000000000001 RSI: 0000000000000001 RDI: 000055da49dc3dd0
RBP: 0000000000000001 R08: 000055da49dc4960 R09: 000055da49dbb010
R10: 0000000000000000 R11: 0000000000000202 R12: 000055da49dc3dd0
R13: 00007fd6a8c19184 R14: 000055da49dbe5e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): sb orphan head is 652
sb_info orphan list:
inode dm-3:652 at 000000003433fd67: mode 100644, nlink 1, next 651
inode dm-3:651 at 0000000000752f26: mode 100644, nlink 1, next 650
inode dm-3:650 at 0000000013111064: mode 100644, nlink 1, next 649
inode dm-3:649 at 00000000d0f6fe0b: mode 100644, nlink 1, next 648
inode dm-3:648 at 0000000012f35321: mode 100644, nlink 1, next 647
inode dm-3:647 at 00000000dc40ec5a: mode 100644, nlink 1, next 646
inode dm-3:646 at 00000000860da577: mode 100644, nlink 1, next 645
inode dm-3:645 at 0000000005dd4dd0: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
sanity test 257: xattr locks are not lost
kernel BUG at /tmp/rpmbuild-lustre-jenkins-xWFq17Cn/BUILD/lustre-2.16.61_40_g0660e94/ldiskfs/super.c:1186!
invalid opcode: 0000 [#1] SMP PTI
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
RIP: 0010:ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
Code: 85 00 04 00 00 48 8b 40 68 83 60 60 fb 0f b7 85 a0 00 00 00 66 41 89 44 24 3a 41 f6 45 50 01 0f 85 3e fd ff ff e9 2c fd ff ff <0f> 0b 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 8d af
RSP: 0018:ffffa8ae49ac7a78 EFLAGS: 00010216
RAX: ffff95e05ef2d398 RBX: ffff95e07d392720 RCX: 0000000000000000
RDX: 0000000000000000 RSI: ffff95e17bd1e698 RDI: ffff95e17bd1e698
RBP: ffff95e07d392000 R08: 0000000000000000 R09: c0000000ffff7fff
R10: 0000000000000001 R11: ffffa8ae49ac7890 R12: ffff95e07d392720
R13: ffff95e142c8d800 R14: ffffffffc12d6218 R15: ffff95e0a8dddf40
FS: 00007f983496d080(0000) GS:ffff95e17bd00000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00005598bbc8d838 CR3: 000000001ddfc001 CR4: 00000000001706e0
Call Trace:
? __die_body+0x1a/0x60
? die+0x2a/0x50
? do_trap+0xe7/0x110
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? do_invalid_op+0x36/0x40
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
? invalid_op+0x14/0x20
? ldiskfs_put_super+0x3b3/0x3c0 [ldiskfs]
generic_shutdown_super+0x6c/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0x80000161
Lustre: DEBUG MARKER: grep -c /mnt/lustre-mds1' ' /proc/mounts || true
Lustre: DEBUG MARKER: umount -d /mnt/lustre-mds1
Lustre: Failing over lustre-MDT0000
LustreError: 806297:0:(osd_handler.c:2458:osd_drop_preallocated_space()) lustre-MDT0000: can't truncate: rc=-30
LustreError: 775124:0:(llog_cat.c:443:llog_cat_close()) lustre-OST0000-osc-MDT0000: failure destroying log during cleanup: rc = -30
LustreError: 775124:0:(llog_cat.c:443:llog_cat_close()) Skipped 3 previous similar messages
LustreError: 806297:0:(obd_class.h:479:obd_check_dev()) Device 18 not setup
LustreError: 806297:0:(obd_class.h:479:obd_check_dev()) Skipped 23 previous similar messages
LDISKFS-fs (dm-3): Inode 213 (000000002ce492e7): orphan list check failed!
000000002ce492e7: 0001f30a 00000004 00000000 00000000 ................
00000000ea2e1939: 00000004 00038a2d 00000000 00000000 ....-...........
0000000073b11470: 00000000 00000000 00000000 00000000 ................
000000006d89151b: 00000000 00000000 00000000 00000000 ................
00000000e5f9d754: 00000000 00000000 00000000 00000001 ................
0000000092808c84: 54f0d350 ffff95e0 54f0d350 ffff95e0 P..T....P..T....
0000000080f95d5f: 00000000 00000000 00084000 80000004 .........@......
000000007be0976f: 00000000 00000000 54f0d378 ffff95e0 ........x..T....
000000007f13d503: 54f0d378 ffff95e0 00000000 00000000 x..T............
0000000099d6a43d: 00000000 00000000 7d392720 ffff95e0 ........ '9}....
00000000d1f98eb6: 54f0f4d8 ffff95e0 00002400 00000000 ...T.....$......
00000000e9564a15: 00000000 00000000 54f0d3b8 ffff95e0 ...........T....
00000000a93ed055: 54f0d3b8 ffff95e0 00000000 00000000 ...T............
00000000331101e2: 00000000 00000000 00000000 00000000 ................
000000004d82d6e4: 54f0d3e0 ffff95e0 54f0d3e0 ffff95e0 ...T.......T....
0000000082046a26: 00000000 00000000 00000000 00000000 ................
000000007789655b: 000881a4 00000000 00000000 00000080 ................
00000000bab06023: 00000000 00000000 00000000 00000000 ................
00000000e9b1a590: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
000000005ccd11df: 54f0d578 ffff95e0 7c926c40 ffff95e0 x..T....@l.|....
00000000cddb6daa: 000000d5 00000000 00000001 00000000 ................
00000000cb957b04: 00002400 00000000 691ccee5 00000000 .$.........i....
0000000032d6b6bd: 00000000 00000000 691ccf36 00000000 ........6..i....
0000000033d24073: 00000000 00000000 691ccee5 00000000 ...........i....
000000002412a55c: 00000000 00000000 00000000 00000000 ................
00000000313adf93: 0000000c 00000000 00000020 00000000 ........ .......
000000003f8c0133: 00000060 00000000 00000000 00000000 `...............
00000000cedc653d: 54f0d4b0 ffff95e0 54f0d4b0 ffff95e0 ...T.......T....
00000000ffbf3cb3: 00000000 00000000 00000000 00000000 ................
000000004316b164: 00a08ae0 00000001 00000000 00000000 ................
0000000037530aa4: 00000000 00000000 00000000 00000000 ................
0000000027dede92: 54f0d4f0 ffff95e0 54f0d4f0 ffff95e0 ...T.......T....
00000000adfecf9a: 00000000 00000000 00000000 00000000 ................
00000000a5fb0e95: 54f0d510 ffff95e0 54f0d510 ffff95e0 ...T.......T....
00000000ef5d5d86: 54f0d520 ffff95e0 54f0d520 ffff95e0 ..T.... ..T....
000000004312f25f: 54f0d530 ffff95e0 54f0d530 ffff95e0 0..T....0..T....
000000002ae903f9: 00000000 00000000 00000000 00000000 ................
00000000b3036504: 00000002 00000000 00000000 00000000 ................
000000007a847b4c: 00000000 00000000 c12d0100 ffffffff ..........-.....
0000000042ec2d42: 00000000 00000000 54f0d400 ffff95e0 ...........T....
00000000520dd9ca: 00000000 00000021 00000000 00000000 ....!...........
0000000015ea23a0: 00000000 00000000 00000000 00000000 ................
000000001d79296f: 00000000 00000000 00000000 00000000 ................
00000000ee9cb434: 00000000 00000000 54f0d5b8 ffff95e0 ...........T....
0000000087e44304: 54f0d5b8 ffff95e0 00000000 00000000 ...T............
000000002c1432ad: 00000000 00000000 00000000 00000000 ................
00000000a3b92a66: 00000000 00000000 00000000 00000000 ................
00000000788ccde0: c12d0ba0 ffffffff 00000010 00000000 ..-.............
000000008895fadb: 00000000 006200ca 54f0d608 ffff95e0 ......b....T....
00000000453856ce: 54f0d608 ffff95e0 00000000 00000000 ...T............
00000000fbae9779: 00000000 00000000 00000000 00000000 ................
000000003d020e3d: 00000000 00000000 00000000 00000000 ................
0000000091804ac9: 00000000 00000000 54f0d648 ffff95e0 ........H..T....
000000009d5973b9: 54f0d648 ffff95e0 00000000 00000000 H..T............
00000000f1075a10: 915f82a4 00000000 00000000 00000000 .._.............
00000000d09a15d8: 00000000 00000000 00000000 00000000 ................
0000000031b442a0: 00000000 00000000 00000000 00000000 ................
00000000af166f6b: 00000000 00000000 691ccee5 00000000 ...........i....
00000000213b1e04: 3185b268 00000000 00000000 00000000 h..1............
00000000e06828aa: 54f0d6b0 ffff95e0 54f0d6b0 ffff95e0 ...T.......T....
00000000980f4e79: 00000000 ffff95e0 00000000 00000000 ................
00000000b12bf7a0: 00000000 00000000 00000000 00000000 ................
0000000090ec5357: 54f0d6e0 ffff95e0 54f0d6e0 ffff95e0 ...T.......T....
00000000b49569f6: 00000000 00000000 00000000 ffffffff ................
00000000fb5c9dd5: 00000000 00000000 00000000 00000000 ................
000000000de3c126: 00000020 00000000 00000000 00000000 ...............
000000006e902942: 00000000 ffffffff 54f0d728 ffff95e0 ........(..T....
00000000ef6b6f70: 54f0d728 ffff95e0 ffffffe0 0000000f (..T............
0000000074962f89: 54f0d740 ffff95e0 54f0d740 ffff95e0 @..T....@..T....
00000000c5c683a2: c1277db0 ffffffff 00000000 00000000 .}'.............
00000000ec2495cf: 691ccadd 00000000 3900a3bc 00000000 ...i.......9....
000000001e7c64a1: 691ccadd 00000000 00000000 00000000 ...i............
000000009161ac4b: 00001b7c 00001b7c 00000000 00000000 |...|...........
00000000aea19de1: 00000000 00000000 00000000 00000000 ................
00000000c581e76f: 00000000 00000000 00000060 00000000 ........`.......
00000000e426296d: 00000000 00000000 ........
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 274 (00000000c892ffad): orphan list check failed!
00000000c892ffad: 0001f30a 00000004 00000000 00000000 ................
00000000d4ff1fbf: 00000004 00038a31 00000000 00000000 ....1...........
00000000b436e146: 00000000 00000000 00000000 00000000 ................
000000006278d98e: 00000000 00000000 00000000 000000d5 ................
00000000e597f19c: 00000000 00000000 00000000 00000001 ................
00000000c113043d: 54f0f490 ffff95e0 54f0f490 ffff95e0 ...T.......T....
0000000061b1fa61: 00000000 00000000 00084000 80000004 .........@......
0000000056bfe9f2: 00000000 00000000 54f0f4b8 ffff95e0 ...........T....
00000000ad46f8fd: 54f0f4b8 ffff95e0 00000000 00000000 ...T............
00000000d1c82c51: 00000000 00000000 54f0d398 ffff95e0 ...........T....
00000000b4e35d44: 54f0f998 ffff95e0 00002400 00000000 ...T.....$......
0000000040903d0a: 00000000 00000000 54f0f4f8 ffff95e0 ...........T....
00000000395d021d: 54f0f4f8 ffff95e0 00000000 00000000 ...T............
000000007496a44d: 00000000 00000000 00000000 00000000 ................
0000000092ac4d0b: 54f0f520 ffff95e0 54f0f520 ffff95e0 ..T.... ..T....
00000000e4055535: 00000000 00000000 00000000 00000000 ................
00000000b047a7e0: 000881a4 00000000 00000000 00000080 ................
00000000b3da6988: 00000000 00000000 00000000 00000000 ................
0000000008cee986: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
000000006329ccc0: 54f0f6b8 ffff95e0 52862840 ffff95e0 ...T....@(.R....
000000005b058486: 00000112 00000000 00000001 00000000 ................
000000005e6e93fb: 00002400 00000000 691ccee5 00000000 .$.........i....
00000000e6a7245a: 00000000 00000000 691ccf31 00000000 ........1..i....
00000000d10e80be: 00000000 00000000 691ccee5 00000000 ...........i....
00000000ba4ef7ae: 00000000 00000000 00000000 00000000 ................
00000000a51737ff: 0000000c 00000000 00000020 00000000 ........ .......
0000000093985b7a: 00000060 00000000 00000000 00000000 `...............
00000000d627566a: 54f0f5f0 ffff95e0 54f0f5f0 ffff95e0 ...T.......T....
000000000cd0f16d: 00000000 00000000 00000000 00000000 ................
000000007f8f264e: 00a08ae4 00000001 00000000 00000000 ................
000000005a1216e4: 00000000 00000000 00000000 00000000 ................
00000000364934ff: 54f0f630 ffff95e0 54f0f630 ffff95e0 0..T....0..T....
00000000e850f010: 00000000 00000000 00000000 00000000 ................
00000000a213ff6f: 54f0f650 ffff95e0 54f0f650 ffff95e0 P..T....P..T....
0000000008af9bfe: 54f0f660 ffff95e0 54f0f660 ffff95e0 `..T....`..T....
00000000db1e82fc: 54f0f670 ffff95e0 54f0f670 ffff95e0 p..T....p..T....
0000000031821b21: 00000000 00000000 00000000 00000000 ................
00000000be7408f2: 00000002 00000000 00000000 00000000 ................
00000000c185a751: 00000000 00000000 c12d0100 ffffffff ..........-.....
00000000e98f1400: 00000000 00000000 54f0f540 ffff95e0 ........@..T....
00000000b108df54: 00000000 00000021 00000000 00000000 ....!...........
000000002961c8f0: 00000000 00000000 00000000 00000000 ................
00000000a247ca83: 00000000 00000000 00000000 00000000 ................
0000000089e0bbd9: 00000000 00000000 54f0f6f8 ffff95e0 ...........T....
000000008e0f3853: 54f0f6f8 ffff95e0 00000000 00000000 ...T............
000000001280a341: 00000000 00000000 00000000 00000000 ................
00000000973961cc: 00000000 00000000 00000000 00000000 ................
00000000ee00dec4: c12d0ba0 ffffffff 00000010 00000000 ..-.............
0000000069cf255a: 00000000 006200ca 54f0f748 ffff95e0 ......b.H..T....
00000000bcf21e72: 54f0f748 ffff95e0 00000000 00000000 H..T............
00000000296bf3a5: 00000000 00000000 00000000 00000000 ................
00000000c84759fb: 00000000 00000000 00000000 00000000 ................
000000005dbd2792: 00000000 00000000 54f0f788 ffff95e0 ...........T....
0000000041f8f475: 54f0f788 ffff95e0 00000000 00000000 ...T............
00000000e55c2cb3: 3088b857 00000000 00000000 00000000 W..0............
00000000345bb882: 00000000 00000000 00000000 00000000 ................
000000005b1f5966: 00000000 00000000 00000000 00000000 ................
0000000079dfd26c: 00000000 00000021 691ccee5 00000000 ....!......i....
0000000024dfc6c0: 31b37996 00000000 00000000 00000000 .y.1............
00000000d68e065d: 54f0f7f0 ffff95e0 54f0f7f0 ffff95e0 ...T.......T....
00000000f6acd9cc: 00000000 00000000 00000000 00000000 ................
00000000b5fc37a3: 00000000 00000000 00000000 00000000 ................
00000000c087ab8e: 54f0f820 ffff95e0 54f0f820 ffff95e0 ..T.... ..T....
00000000aa8e96b7: 00000000 00000000 00000000 ffffffff ................
000000001fcc71b9: 00000000 ffffffff 00000000 00000000 ................
000000001b9eccc9: 00000020 006200ca 00000000 00000000 .....b.........
000000000dd799bf: 00000000 ffff95e0 54f0f868 ffff95e0 ........h..T....
00000000c5567b7d: 54f0f868 ffff95e0 ffffffe0 0000000f h..T............
000000007d34a46d: 54f0f880 ffff95e0 54f0f880 ffff95e0 ...T.......T....
00000000b383f6c6: c1277db0 ffffffff 54f0f898 ffff95e0 .}'........T....
000000001423ca22: 54f0f898 ffff95e0 00000000 00000000 ...T............
000000009cbcd7f0: 00000000 00000000 00000000 00000000 ................
000000009496f976: 00001b6b 00001b6b 00000000 00000000 k...k...........
00000000bc3a8ee4: 00000000 00000000 00000000 00000000 ................
00000000dd5b8362: 00000000 00000000 00000000 00000000 ................
000000008eb6c884: 00000000 00000000 ........
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 287 (00000000607af172): orphan list check failed!
00000000607af172: 0001f30a 00000004 00000000 00000000 ................
000000007c9e3a47: 00000004 00038a35 00000000 00000000 ....5...........
00000000e44c1412: 00000000 00000000 00000000 00000000 ................
00000000ad032634: 00000000 00000000 00000000 00000112 ................
000000003145e0f9: 00000000 00000000 00000000 00000001 ................
00000000b36bee4b: 54f0f950 ffff95e0 54f0f950 ffff95e0 P..T....P..T....
0000000032417e9d: 00000000 00000000 00084000 80000004 .........@......
0000000017734e68: 00000000 00000000 54f0f978 ffff95e0 ........x..T....
000000005e382f36: 54f0f978 ffff95e0 00000000 00000000 x..T............
00000000e3c4227d: 00000000 00000000 54f0f4d8 ffff95e0 ...........T....
00000000eb6bfedd: 54f0ced8 ffff95e0 00002400 00000000 ...T.....$......
00000000bde3841e: 00000000 00000000 54f0f9b8 ffff95e0 ...........T....
000000005390171b: 54f0f9b8 ffff95e0 00000000 00000000 ...T............
0000000057a464d2: 00000000 00000000 00000000 00000000 ................
00000000aad584a5: 54f0f9e0 ffff95e0 54f0f9e0 ffff95e0 ...T.......T....
00000000e5ae730e: 00000000 00000000 00000000 00000000 ................
00000000c5e81a3a: 000881a4 00000000 00000000 00000080 ................
000000005045b681: 00000000 00000000 00000000 00000000 ................
0000000018fbeb62: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
00000000bc797a62: 54f0fb78 ffff95e0 5e78e180 ffff95e0 x..T......x^....
000000009c8c1d9b: 0000011f 00000000 00000001 00000000 ................
00000000c25e80c4: 00002400 00000000 691ccee5 00000000 .$.........i....
000000000704d8b1: 00000000 00000000 691ccf31 00000000 ........1..i....
00000000d4bf51a1: 00000000 00000000 691ccee5 00000000 ...........i....
00000000eb54dac9: 00000000 00000000 00000000 00000000 ................
00000000cb677c37: 0000000c 00000000 00000020 00000000 ........ .......
00000000382fd95d: 00000060 00000000 00000000 00000000 `...............
00000000a30eb030: 54f0fab0 ffff95e0 54f0fab0 ffff95e0 ...T.......T....
000000003d43b74e: 00000000 00000000 00000000 00000000 ................
00000000d9bca3a9: 00a08ae6 00000001 00000000 00000000 ................
00000000a9cd49ac: 00000000 00000000 00000000 00000000 ................
00000000527eb9d7: 54f0faf0 ffff95e0 54f0faf0 ffff95e0 ...T.......T....
000000002ce3840b: 00000000 00000000 00000000 00000000 ................
0000000007359edd: 54f0fb10 ffff95e0 54f0fb10 ffff95e0 ...T.......T....
00000000e9a7f684: 54f0fb20 ffff95e0 54f0fb20 ffff95e0 ..T.... ..T....
00000000342720aa: 54f0fb30 ffff95e0 54f0fb30 ffff95e0 0..T....0..T....
000000001ad0a8bf: 00000000 00000000 00000000 00000000 ................
00000000d8f25451: 00000002 00000000 00000000 00000000 ................
00000000cc277967: 00000000 00000000 c12d0100 ffffffff ..........-.....
00000000560261c2: 00000000 00000000 54f0fa00 ffff95e0 ...........T....
0000000031ffa001: 00000000 00000021 00000000 00000000 ....!...........
00000000c7085316: 00000000 00000000 00000000 00000000 ................
000000007306eb29: 00000000 00000000 00000000 00000000 ................
0000000065564a45: 00000000 00000000 54f0fbb8 ffff95e0 ...........T....
00000000b008709c: 54f0fbb8 ffff95e0 00000000 00000000 ...T............
0000000053bbc980: 00000000 00000000 00000000 00000000 ................
00000000a6901567: 00000000 00000000 00000000 00000000 ................
00000000dfa9fb4c: c12d0ba0 ffffffff 00000010 00000000 ..-.............
00000000f3b4eb93: 00000000 006200ca 54f0fc08 ffff95e0 ......b....T....
000000005b143a3f: 54f0fc08 ffff95e0 00000000 00000000 ...T............
00000000a070db0e: 00000000 00000000 00000000 00000000 ................
0000000020b3ce27: 00000000 00000000 00000000 00000000 ................
000000002e8a1dc4: 00000000 00000000 54f0fc48 ffff95e0 ........H..T....
000000006b4e1b1d: 54f0fc48 ffff95e0 00000000 00000000 H..T............
0000000011bec33a: d455278e 00000000 00000000 00000000 .'U.............
00000000874c9053: 00000000 00000000 00000000 00000000 ................
000000004f13f98b: 00000000 00000000 00000000 00000000 ................
00000000b8d3db02: 00000000 00000000 691ccee5 00000000 ...........i....
00000000e2f3cf53: 31d1fe5e 00000000 00000000 00000000 ^..1............
00000000baa5138f: 54f0fcb0 ffff95e0 54f0fcb0 ffff95e0 ...T.......T....
000000006558bbd0: 00000000 00000000 00000000 00000000 ................
00000000c573f9e4: 00000000 00000000 00000000 00000000 ................
0000000068b30e82: 54f0fce0 ffff95e0 54f0fce0 ffff95e0 ...T.......T....
00000000a433211c: 00000000 00000000 00000000 ffffffff ................
00000000c82dbc2b: 00000000 00000000 00000000 00000000 ................
0000000028aef925: 00000020 ffff95e0 00000000 00000000 ...............
000000000029ea8d: 00000000 ffff95e0 54f0fd28 ffff95e0 ........(..T....
00000000b1c7ceeb: 54f0fd28 ffff95e0 ffffffe0 0000000f (..T............
0000000054e5869c: 54f0fd40 ffff95e0 54f0fd40 ffff95e0 @..T....@..T....
000000008c955a63: c1277db0 ffffffff 00000000 00000000 .}'.............
000000002eb4fc27: 00000000 00000000 8264bba0 ffffffff ..........d.....
00000000a7c549ea: 00000000 00000000 00000000 00000000 ................
0000000020bff75c: 00001b6b 00001b6b 00000000 00000000 k...k...........
0000000092aaa4e8: 00000000 00000000 00000000 00000000 ................
000000003d85c0bd: 00000000 00000000 00000000 00000000 ................
000000004b2a40a4: 00000000 00000000 ........
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 291 (000000008a6e3658): orphan list check failed!
000000008a6e3658: 0001f30a 00000004 00000000 00000000 ................
00000000cbed7604: 00000004 00038a39 00000000 00000000 ....9...........
00000000756bfdc0: 00000000 00000000 00000000 00000000 ................
000000005bff7a18: 00000000 00000000 00000000 0000011f ................
0000000075ee038f: 00000000 00000000 00000000 00000001 ................
000000005c1516a0: 54f0ce90 ffff95e0 54f0ce90 ffff95e0 ...T.......T....
00000000e9981fb7: 00000000 00000000 00084000 80000004 .........@......
00000000402ff93e: 00000000 00000000 54f0ceb8 ffff95e0 ...........T....
00000000a96dabf1: 54f0ceb8 ffff95e0 00000000 00000000 ...T............
0000000048e82bf3: 00000000 00000000 54f0f998 ffff95e0 ...........T....
00000000d5e5e870: 54f0ca18 ffff95e0 000023c0 00000000 ...T.....#......
00000000e285e260: 00000000 00000000 54f0cef8 ffff95e0 ...........T....
00000000c6de429e: 54f0cef8 ffff95e0 00000000 00000000 ...T............
00000000d19ecede: 00000000 00000000 00000000 00000000 ................
00000000244a8d14: 54f0cf20 ffff95e0 54f0cf20 ffff95e0 ..T.... ..T....
00000000c7ba59ad: 00000000 00000000 00000000 00000000 ................
00000000641496b4: 000881a4 00000000 00000000 00000080 ................
00000000ebdac5da: 00000000 00000000 00000000 00000000 ................
00000000e257a4e0: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
000000002d7b2b28: 54f0d0b8 ffff95e0 44851540 ffff95e1 ...T....@..D....
000000001671695b: 00000123 00000000 00000001 00000000 #...............
00000000e7e5cf7c: 000023c0 00000000 691ccee5 00000000 .#.........i....
00000000988676ee: 00000000 00000000 691ccf2d 00000000 ........-..i....
00000000f6097621: 00000000 00000000 691ccee5 00000000 ...........i....
000000008a3ee9da: 00000000 00000000 00000000 00000000 ................
00000000b808f8d5: 0000000c 00000000 00000020 00000000 ........ .......
00000000713e493c: 00000060 00000000 00000000 00000000 `...............
000000001e1312c9: 54f0cff0 ffff95e0 54f0cff0 ffff95e0 ...T.......T....
00000000c6bc27fc: 00000000 00000000 00000000 00000000 ................
000000004dd14eb6: 00a08ae8 00000001 00000000 00000000 ................
00000000c0c06877: 00000000 00000000 00000000 00000000 ................
00000000fa206fa6: 54f0d030 ffff95e0 54f0d030 ffff95e0 0..T....0..T....
00000000f3cb04ba: 00000000 00000000 00000000 00000000 ................
000000004a8c3ee6: 54f0d050 ffff95e0 54f0d050 ffff95e0 P..T....P..T....
0000000047a850a7: 54f0d060 ffff95e0 54f0d060 ffff95e0 `..T....`..T....
0000000075304ced: 54f0d070 ffff95e0 54f0d070 ffff95e0 p..T....p..T....
0000000081d6e479: 00000000 00000000 00000000 00000000 ................
000000006eed76ca: 00000002 00000000 00000000 00000000 ................
00000000bd364634: 00000000 00000000 c12d0100 ffffffff ..........-.....
00000000e97f03ee: 00000000 00000000 54f0cf40 ffff95e0 ........@..T....
000000007980b665: 00000000 00000021 00000000 00000000 ....!...........
00000000f2fe9e77: 00000000 00000000 00000000 00000000 ................
0000000082acbc95: 00000000 00000000 00000000 00000000 ................
00000000b1575e47: 00000000 00000000 54f0d0f8 ffff95e0 ...........T....
000000009cdb0d03: 54f0d0f8 ffff95e0 00000000 00000000 ...T............
00000000d4cd6d06: 00000000 00000000 00000000 00000000 ................
000000001fca13de: 00000000 00000000 00000000 00000000 ................
0000000097417c9c: c12d0ba0 ffffffff 00000010 00000000 ..-.............
0000000093b20b1f: 00000000 006200ca 54f0d148 ffff95e0 ......b.H..T....
000000000f1d01c6: 54f0d148 ffff95e0 00000000 00000000 H..T............
0000000052321c67: 00000000 00000000 00000000 00000000 ................
0000000055f99927: 00000000 00000000 00000000 00000000 ................
00000000c898093b: 00000000 00000000 54f0d188 ffff95e0 ...........T....
0000000093d488fb: 54f0d188 ffff95e0 00000000 00000000 ...T............
00000000e25bd65b: 044f0d2e 00000000 00000000 00000000 ..O.............
0000000006ee86ac: 00000000 00000000 00000000 00000000 ................
000000008424c952: 00000000 00000000 00000000 00000000 ................
0000000091246078: 00000000 00000000 691ccee5 00000000 ...........i....
000000004b50569f: 31ffc58b 00000000 00000000 00000000 ...1............
00000000fb281758: 54f0d1f0 ffff95e0 54f0d1f0 ffff95e0 ...T.......T....
00000000318f424a: 00000000 00000000 00000000 00000000 ................
00000000a97a037b: 00000000 00000000 00000000 00000000 ................
00000000321f9657: 54f0d220 ffff95e0 54f0d220 ffff95e0 ..T.... ..T....
00000000fab82b0b: 00000000 00000000 00000000 ffffffff ................
00000000b8e8ae5b: 00000000 00000000 00000000 00000000 ................
000000008ec1be5c: 00000020 ffff95e0 00000000 00000000 ...............
0000000016b78225: 00000000 00000000 54f0d268 ffff95e0 ........h..T....
0000000052dc1c86: 54f0d268 ffff95e0 ffffffe0 0000000f h..T............
000000005eaf617d: 54f0d280 ffff95e0 54f0d280 ffff95e0 ...T.......T....
00000000e71fad2c: c1277db0 ffffffff 8096cb30 ffff95e0 .}'.....0.......
00000000d1ddb8c9: 00000000 00000000 00000000 00000000 ................
0000000032bb0560: 00000000 00000000 00000000 00000000 ................
00000000f8ad75fb: 00001b64 00001b64 00000000 00000000 d...d...........
000000003bf08d59: 00000000 00000000 00000000 00000000 ................
00000000a407f6dc: 00000000 00000000 00000000 00000000 ................
0000000018c2edad: 00000000 00000000 ........
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 336 (000000005a7b7ab5): orphan list check failed!
000000005a7b7ab5: 0001f30a 00000004 00000000 00000000 ................
00000000b9a9f0dc: 00000004 00038a3d 00000000 00000000 ....=...........
00000000c9d82d76: 00000000 00000000 00000000 00000000 ................
00000000669235a1: 00000000 00000000 00000000 00000123 ............#...
00000000c0d067ee: 00000000 00000000 00000000 00000001 ................
000000005571e39c: 54f0c9d0 ffff95e0 54f0c9d0 ffff95e0 ...T.......T....
00000000cdcee909: 00000000 00000000 00084000 80000004 .........@......
000000003df4c2f3: 00000000 00000000 54f0c9f8 ffff95e0 ...........T....
000000003c926a83: 54f0c9f8 ffff95e0 00000000 00000000 ...T............
000000007b34daf7: 00000000 00000000 54f0ced8 ffff95e0 ...........T....
00000000c8c7ba05: 5ed57998 ffff95e0 000023c0 00000000 .y.^.....#......
00000000ccdd8581: 00000000 00000000 54f0ca38 ffff95e0 ........8..T....
00000000802f8c75: 54f0ca38 ffff95e0 00000000 00000000 8..T............
00000000af24b9cc: 00000000 00000000 00000000 00000000 ................
00000000728d3c91: 54f0ca60 ffff95e0 54f0ca60 ffff95e0 `..T....`..T....
00000000eca1b45e: 00000000 00000000 00000000 00000000 ................
00000000cb171e83: 000881a4 00000000 00000000 00000080 ................
0000000013bb68b9: 00000000 00000000 00000000 00000000 ................
00000000da5da0ee: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
000000007fdd4237: 54f0cbf8 ffff95e0 44851240 ffff95e1 ...T....@..D....
00000000c3e93160: 00000150 00000000 00000001 00000000 P...............
00000000feac20a5: 000023c0 00000000 691ccee5 00000000 .#.........i....
0000000051726e55: 00000000 00000000 691ccf31 00000000 ........1..i....
000000008c106c52: 00000000 00000000 691ccee5 00000000 ...........i....
0000000094ab745e: 00000000 00000000 00000000 00000000 ................
00000000c6d54460: 0000000c 00000000 00000020 00000000 ........ .......
000000000375e2c7: 00000060 00000000 00000000 00000000 `...............
00000000d0e28e12: 54f0cb30 ffff95e0 54f0cb30 ffff95e0 0..T....0..T....
00000000601c87fb: 00000000 00000000 00000000 00000000 ................
00000000d72e5946: 00a08aea 00000001 00000000 00000000 ................
000000002b70fcf0: 00000000 00000000 00000000 00000000 ................
0000000099a5304f: 54f0cb70 ffff95e0 54f0cb70 ffff95e0 p..T....p..T....
0000000092678ff8: 00000000 00000000 00000000 00000000 ................
000000004ddb7d51: 54f0cb90 ffff95e0 54f0cb90 ffff95e0 ...T.......T....
0000000046df7f07: 54f0cba0 ffff95e0 54f0cba0 ffff95e0 ...T.......T....
0000000067c0a5cd: 54f0cbb0 ffff95e0 54f0cbb0 ffff95e0 ...T.......T....
0000000087c4d847: 00000000 00000000 00000000 00000000 ................
000000007dc6c546: 00000002 00000000 00000000 00000000 ................
00000000480e7406: 00000000 00000000 c12d0100 ffffffff ..........-.....
0000000053beb200: 00000000 00000000 54f0ca80 ffff95e0 ...........T....
0000000076f12c5e: 00000000 00000021 00000000 00000000 ....!...........
00000000f685f314: 00000000 00000000 00000000 00000000 ................
0000000035d0c4b8: 00000000 00000000 00000000 00000000 ................
00000000f773bfa7: 00000000 00000000 54f0cc38 ffff95e0 ........8..T....
00000000bf123c6b: 54f0cc38 ffff95e0 00000000 00000000 8..T............
00000000fee8372f: 00000000 00000000 00000000 00000000 ................
000000007daa735d: 00000000 00000000 00000000 00000000 ................
0000000091da0f84: c12d0ba0 ffffffff 00000010 00000000 ..-.............
000000007f88fa9c: 00000000 006200ca 54f0cc88 ffff95e0 ......b....T....
000000005052346f: 54f0cc88 ffff95e0 00000000 00000000 ...T............
000000005d4cf598: 00000000 00000000 00000000 00000000 ................
0000000042b075a4: 00000000 00000000 00000000 00000000 ................
000000005d955de0: 00000000 00000000 54f0ccc8 ffff95e0 ...........T....
000000007eafec50: 54f0ccc8 ffff95e0 00000000 00000000 ...T............
000000004fa07261: 0eafeb3a 00000000 00000000 00000000 :...............
0000000047347eca: 00000000 00000000 00000000 00000000 ................
0000000020a3fdb7: 00000000 00000000 00000000 00000000 ................
000000005dfeb0e7: 00000000 ffffffff 691ccee5 00000000 ...........i....
0000000094fc1b4d: 320f07f0 00000000 00000000 00000021 ...2........!...
00000000446e286f: 54f0cd30 ffff95e0 54f0cd30 ffff95e0 0..T....0..T....
00000000ee967fc9: 00000000 00000000 00000000 00000000 ................
0000000030e7d4dd: 00000000 00000000 00000000 00000000 ................
00000000429c20ef: 54f0cd60 ffff95e0 54f0cd60 ffff95e0 `..T....`..T....
0000000072b64f88: 00000000 00000000 00000000 ffffffff ................
00000000331efe6d: 00000000 00000000 00000000 00000000 ................
000000007db192a0: 00000020 00000000 00000000 00000000 ...............
0000000052e7c24e: 00000000 00000000 54f0cda8 ffff95e0 ...........T....
000000004372e922: 54f0cda8 ffff95e0 ffffffe0 0000000f ...T............
000000007b5aeaac: 54f0cdc0 ffff95e0 54f0cdc0 ffff95e0 ...T.......T....
000000006a1d961b: c1277db0 ffffffff 00000000 00000000 .}'.............
00000000469524bd: 00000000 00000000 00000000 00000000 ................
00000000d9a7d769: 54f0cdf0 ffff95e0 00000000 00000000 ...T............
000000004efdb759: 00001b6b 00001b6b 00000000 00000000 k...k...........
00000000f885f12e: 00000000 00000000 00000000 00000000 ................
00000000cc03f17e: 00000000 00000000 00000000 00000000 ................
00000000ffc968c0: b423c745 9e2c759f E.#..u,.
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 430 (0000000077f757ec): orphan list check failed!
0000000077f757ec: 0001f30a 00000004 00000000 00000000 ................
00000000780282e5: 00000004 00038a41 00000000 00000000 ....A...........
00000000ed437647: 00000000 00000000 00000000 00000000 ................
00000000baa0965d: 00000000 00000000 00000000 00000150 ............P...
00000000a4fd9eaa: 00000000 00000000 00000000 00000001 ................
000000005d890ca8: 5ed57950 ffff95e0 5ed57950 ffff95e0 Py.^....Py.^....
0000000071968bb9: 00000000 00000000 00084000 80000004 .........@......
00000000aeced2c6: 00000000 00000000 5ed57978 ffff95e0 ........xy.^....
00000000de50b8da: 5ed57978 ffff95e0 00000000 00000000 xy.^............
00000000efccfeb7: 00000000 00000000 54f0ca18 ffff95e0 ...........T....
00000000f81116f7: 5ed56b58 ffff95e0 000023c0 00000000 Xk.^.....#......
00000000cc489894: 00000000 00000000 5ed579b8 ffff95e0 .........y.^....
0000000028e95735: 5ed579b8 ffff95e0 00000000 00000000 .y.^............
000000009bf8721e: 00000000 00000000 00000000 00000000 ................
00000000b90ec91f: 5ed579e0 ffff95e0 5ed579e0 ffff95e0 .y.^.....y.^....
0000000060bbe537: 00000000 00000000 00000000 00000000 ................
00000000d77b5111: 000881a4 00000000 00000000 00000080 ................
0000000014cc8514: 00000000 00000000 00000000 00000000 ................
00000000b343e07f: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
00000000755249dc: 5ed57b78 ffff95e0 439053c0 ffff95e1 x{.^.....S.C....
000000001ac2e91a: 000001ae 00000000 00000001 00000000 ................
00000000ac285595: 000023c0 00000000 691ccee5 00000000 .#.........i....
00000000db702d26: 00000000 00000000 691ccf31 00000000 ........1..i....
00000000d61c16ed: 00000000 00000000 691ccee5 00000000 ...........i....
00000000380562d4: 00000000 00000000 00000000 00000000 ................
000000001cdec3c2: 0000000c 00000000 00000020 00000000 ........ .......
000000006c5aa240: 00000060 00000000 00000000 00000000 `...............
00000000d55caa8f: 5ed57ab0 ffff95e0 5ed57ab0 ffff95e0 .z.^.....z.^....
000000001028ef84: 00000000 00000000 00000000 00000000 ................
000000009e8e1836: 00a08aec 00000001 00000000 00000000 ................
000000005e802c87: 00000000 00000000 00000000 00000000 ................
00000000d89ea02b: 5ed57af0 ffff95e0 5ed57af0 ffff95e0 .z.^.....z.^....
00000000966dcd20: 00000000 00000000 00000000 00000000 ................
000000009aa655b2: 5ed57b10 ffff95e0 5ed57b10 ffff95e0 .{.^.....{.^....
000000008ad87996: 5ed57b20 ffff95e0 5ed57b20 ffff95e0 {.^.... {.^....
0000000016053e3d: 5ed57b30 ffff95e0 5ed57b30 ffff95e0 0{.^....0{.^....
00000000ccd52f8a: 00000000 00000000 00000000 00000000 ................
0000000063e355d0: 00000002 00000000 00000000 00000000 ................
000000009abf6e5c: 00000000 00000000 c12d0100 ffffffff ..........-.....
00000000c0c027e6: 00000000 00000000 5ed57a00 ffff95e0 .........z.^....
00000000014044db: 00000000 00000021 00000000 00000000 ....!...........
00000000ea6524e8: 00000000 00000000 00000000 00000000 ................
0000000034b1a144: 00000000 00000000 00000000 00000000 ................
000000006c25158c: 00000000 00000000 5ed57bb8 ffff95e0 .........{.^....
000000008bc91470: 5ed57bb8 ffff95e0 00000000 00000000 .{.^............
00000000773536d2: 00000000 00000000 00000000 00000000 ................
00000000903fd7f2: 00000000 00000000 00000000 00000000 ................
00000000826cc2fd: c12d0ba0 ffffffff 00000010 00000000 ..-.............
000000005a3427c8: 00000000 006200ca 5ed57c08 ffff95e0 ......b..|.^....
0000000035258623: 5ed57c08 ffff95e0 00000000 00000000 .|.^............
000000006c169a65: 00000000 00000000 00000000 00000000 ................
000000006bde382f: 00000000 00000000 00000000 00000000 ................
000000000e875aa3: 00000000 00000000 5ed57c48 ffff95e0 ........H|.^....
00000000f5357f9e: 5ed57c48 ffff95e0 00000000 00000000 H|.^............
0000000040627a57: 92cc31af 00000000 00000000 00000000 .1..............
0000000048f7798a: 00000000 00000000 00000000 00000000 ................
00000000a3576986: 00000000 00000000 00000000 00000000 ................
0000000025db0389: 00000000 00000000 691ccee5 00000000 ...........i....
00000000e65828b2: 323ccf1d 00000000 00000000 fffffb95 ..<2............
00000000af187bd2: 5ed57cb0 ffff95e0 5ed57cb0 ffff95e0 .|.^.....|.^....
00000000c0af0b95: 00000000 ffff95e0 00000000 00000000 ................
00000000ba5c22f9: 00000000 00000000 00000000 00000000 ................
00000000a356e893: 5ed57ce0 ffff95e0 5ed57ce0 ffff95e0 .|.^.....|.^....
00000000e6e5adcf: 00000000 00000000 00000000 ffffffff ................
000000009884bc27: 00000000 00000000 00000000 00000000 ................
0000000076ce8bd2: 00000020 fffffb95 00000000 00000000 ...............
000000000d72bad3: 00000000 00000000 5ed57d28 ffff95e0 ........(}.^....
00000000a58313fa: 5ed57d28 ffff95e0 ffffffe0 0000000f (}.^............
00000000f21e6832: 5ed57d40 ffff95e0 5ed57d40 ffff95e0 @}.^....@}.^....
0000000048cd602e: c1277db0 ffffffff 00000000 00000000 .}'.............
00000000890a54fc: 00000000 00000000 00000021 00000000 ........!.......
000000004c20035e: 5ed57d68 ffff95e0 00000000 00000000 h}.^............
00000000f4f5b1ee: 00001b6b 00001b6b 00000000 00000000 k...k...........
00000000875c0395: 00000000 00000000 00000000 00000000 ................
00000000d433e883: 00000000 00000000 00000000 00000000 ................
000000009b9fdfbc: 5ed57db0 ffff95e0 .}.^....
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 440 (00000000ca9e2390): orphan list check failed!
00000000ca9e2390: 0001f30a 00000004 00000000 00000000 ................
00000000df1dd538: 00000004 00038a45 00000000 00000000 ....E...........
000000000527466d: 00000000 00000000 00000000 00000000 ................
00000000abec9476: 00000000 00000000 00000000 000001ae ................
00000000fafa664f: 00000000 00000000 00000000 00000001 ................
000000007433bf36: 5ed56b10 ffff95e0 5ed56b10 ffff95e0 .k.^.....k.^....
00000000d389f8e6: 00000000 00000000 00084000 80000004 .........@......
000000008e48e133: 00000000 00000000 5ed56b38 ffff95e0 ........8k.^....
000000004633c6fb: 5ed56b38 ffff95e0 00000000 00000000 8k.^............
0000000082595949: 00000000 00000000 5ed57998 ffff95e0 .........y.^....
000000002ed56420: 5ed54558 ffff95e0 000023c0 00000000 XE.^.....#......
0000000034900f09: 00000000 00000000 5ed56b78 ffff95e0 ........xk.^....
0000000037494c82: 5ed56b78 ffff95e0 00000000 00000000 xk.^............
00000000d2a67e6c: 00000000 00000000 00000000 00000000 ................
0000000010200359: 5ed56ba0 ffff95e0 5ed56ba0 ffff95e0 .k.^.....k.^....
000000000ae32ba6: 00000000 00000000 00000000 00000000 ................
00000000a562c9c2: 000881a4 00000000 00000000 00000080 ................
000000006eb81764: 00000000 00000000 00000000 00000000 ................
0000000068ac36fd: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
00000000f6110b2a: 5ed56d38 ffff95e0 44fa5180 ffff95e1 8m.^.....Q.D....
00000000ae31fcbf: 000001b8 00000000 00000001 00000000 ................
000000005b64bdd9: 000023c0 00000000 691ccee5 00000000 .#.........i....
00000000664e0cb6: 00000000 00000000 691ccf31 00000000 ........1..i....
00000000c8dbacae: 00000000 00000000 691ccee5 00000000 ...........i....
000000001a8978a4: 00000000 00000000 00000000 00000000 ................
0000000048a379ef: 0000000c 00000000 00000020 00000000 ........ .......
000000004ff265fc: 00000060 00000000 00000000 00000000 `...............
0000000041055348: 5ed56c70 ffff95e0 5ed56c70 ffff95e0 pl.^....pl.^....
0000000019765085: 00000000 00000000 00000000 00000000 ................
00000000f6ea7e7a: 00a08aee 00000001 00000000 00000000 ................
00000000ccbd1206: 00000000 00000000 00000000 00000000 ................
00000000ab59e296: 5ed56cb0 ffff95e0 5ed56cb0 ffff95e0 .l.^.....l.^....
000000009ed0448b: 00000000 00000000 00000000 00000000 ................
00000000464302b3: 5ed56cd0 ffff95e0 5ed56cd0 ffff95e0 .l.^.....l.^....
00000000641b7868: 5ed56ce0 ffff95e0 5ed56ce0 ffff95e0 .l.^.....l.^....
00000000cf2b0a71: 5ed56cf0 ffff95e0 5ed56cf0 ffff95e0 .l.^.....l.^....
000000001d94d2b7: 00000000 00000000 00000000 00000000 ................
0000000068b78958: 00000002 00000000 00000000 00000000 ................
0000000072a62160: 00000000 00000000 c12d0100 ffffffff ..........-.....
000000007ffc53b0: 00000000 00000000 5ed56bc0 ffff95e0 .........k.^....
000000009e7b8a92: 00000000 00000021 00000000 00000000 ....!...........
00000000d073e9e3: 00000000 00000000 00000000 00000000 ................
0000000005288a75: 00000000 00000000 00000000 00000000 ................
00000000599ab276: 00000000 00000000 5ed56d78 ffff95e0 ........xm.^....
0000000066228ed5: 5ed56d78 ffff95e0 00000000 00000000 xm.^............
000000007e075702: 00000000 00000000 00000000 00000000 ................
000000008c4069d2: 00000000 00000000 00000000 00000000 ................
000000001dd07f98: c12d0ba0 ffffffff 00000010 00000000 ..-.............
00000000ba5492eb: 00000000 006200ca 5ed56dc8 ffff95e0 ......b..m.^....
00000000ede1bf74: 5ed56dc8 ffff95e0 00000000 00000000 .m.^............
000000008e889e23: 00000000 00000000 00000000 00000000 ................
000000006acd6970: 00000000 00000000 00000000 00000000 ................
0000000087e027a2: 00000000 00000000 5ed56e08 ffff95e0 .........n.^....
00000000e02ad7d4: 5ed56e08 ffff95e0 00000000 00000000 .n.^............
000000009a9c2204: f97997d9 00000000 00000000 00000000 ..y.............
00000000b9d51ee9: 00000000 00000000 00000000 00000000 ................
00000000b1de449e: 00000000 00000000 00000000 00000000 ................
00000000b3bd7d0f: 00000000 00000000 691ccee5 00000000 ...........i....
0000000013348221: 325b53e6 00000000 00000000 a16b9bca .S[2..........k.
000000004b22acf4: 5ed56e70 ffff95e0 5ed56e70 ffff95e0 pn.^....pn.^....
00000000af3fbcf0: 00000000 ffff95e0 00000000 00000000 ................
000000009a1fadb1: 00000000 00000000 00000000 00000000 ................
000000008a85f261: 5ed56ea0 ffff95e0 5ed56ea0 ffff95e0 .n.^.....n.^....
00000000ed87fb15: 00000000 00000000 00000000 ffffffff ................
0000000094e88552: 00000000 00000000 00000000 00000000 ................
000000000e81372c: 00000020 196b9bca 00000000 00000000 .....k.........
000000001197e037: 00000000 00000000 5ed56ee8 ffff95e0 .........n.^....
00000000ece177b2: 5ed56ee8 ffff95e0 ffffffe0 0000000f .n.^............
0000000034bb9133: 5ed56f00 ffff95e0 5ed56f00 ffff95e0 .o.^.....o.^....
000000004e444094: c1277db0 ffffffff 81274080 fffffb95 .}'......@'.....
000000002389351a: 00038eb0 00000000 00001000 00000000 ................
000000009ee2c30a: 89d02000 ffff95e0 00000000 00000000 . ..............
000000003fbd8173: 00001b6b 00001b6b 00000000 00000000 k...k...........
00000000da28ca2e: 00000000 00000000 00000000 00000000 ................
00000000955193dc: 00000000 00000000 00000000 00000000 ................
0000000092116dc5: 00000021 00000000 !.......
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 441 (00000000cef1c530): orphan list check failed!
00000000cef1c530: 0001f30a 00000004 00000000 00000000 ................
00000000e6fb27f2: 00000004 00038a49 00000000 00000000 ....I...........
000000004da6032a: 00000000 00000000 00000000 00000000 ................
00000000b4ee18f4: 00000000 00000000 00000000 000001b8 ................
0000000040e5adba: 00000000 00000000 00000000 00000001 ................
00000000f06ca9fb: 5ed54510 ffff95e0 5ed54510 ffff95e0 .E.^.....E.^....
0000000062f30195: 00000000 00000000 00084000 80000004 .........@......
00000000cf2d242d: 00000000 00000000 5ed54538 ffff95e0 ........8E.^....
00000000e006983d: 5ed54538 ffff95e0 00000000 00000000 8E.^............
000000000ffd4a61: 00000000 00000000 5ed56b58 ffff95e0 ........Xk.^....
00000000a273633d: 5ef2d398 ffff95e0 000023c0 00000000 ...^.....#......
000000004334d963: 00000000 00000000 5ed54578 ffff95e0 ........xE.^....
00000000f698a969: 5ed54578 ffff95e0 00000000 00000000 xE.^............
000000005639e5ef: 00000000 00000000 00000000 00000000 ................
000000002cc0f0e9: 5ed545a0 ffff95e0 5ed545a0 ffff95e0 .E.^.....E.^....
00000000ca7f20ac: 00000000 00000000 00000000 00000000 ................
00000000e430bab2: 000881a4 00000000 00000000 00000080 ................
000000008779acff: 00000000 00000000 00000000 00000000 ................
00000000673875ab: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
00000000fb6cb654: 5ed54738 ffff95e0 456c5780 ffff95e1 8G.^.....WlE....
00000000a7914dcb: 000001b9 00000000 00000001 00000000 ................
0000000084162977: 000023c0 00000000 691ccee5 00000000 .#.........i....
00000000dbc449f8: 00000000 00000000 691ccf2d 00000000 ........-..i....
000000007e641e51: 00000000 00000000 691ccee5 00000000 ...........i....
000000001632f74d: 00000000 00000000 00000000 00000000 ................
000000007f99fc2a: 0000000c 00000000 00000020 00000000 ........ .......
000000004191d7bd: 00000060 00000000 00000000 00000000 `...............
000000005ebc2549: 5ed54670 ffff95e0 5ed54670 ffff95e0 pF.^....pF.^....
000000005e7ff03a: 00000000 00000000 00000000 00000000 ................
000000001ddcd2ae: 00a08af0 00000001 00000000 00000000 ................
00000000df58a83e: 00000000 00000000 00000000 00000000 ................
000000009aaca14f: 5ed546b0 ffff95e0 5ed546b0 ffff95e0 .F.^.....F.^....
00000000e711cef5: 00000000 00000000 00000000 00000000 ................
00000000f1b50b8e: 5ed546d0 ffff95e0 5ed546d0 ffff95e0 .F.^.....F.^....
000000003deac964: 5ed546e0 ffff95e0 5ed546e0 ffff95e0 .F.^.....F.^....
00000000cbe64a1c: 5ed546f0 ffff95e0 5ed546f0 ffff95e0 .F.^.....F.^....
00000000380aac06: 00000000 00000000 00000000 00000000 ................
00000000f8854e3d: 00000002 00000000 00000000 00000000 ................
00000000ea175dea: 00000000 00000000 c12d0100 ffffffff ..........-.....
000000009eaffa50: 00000000 00000000 5ed545c0 ffff95e0 .........E.^....
00000000a0eee750: 00000000 00000021 00000000 00000000 ....!...........
000000009a5c4e42: 00000000 00000000 00000000 00000000 ................
00000000d8fdab72: 00000000 00000000 00000000 00000000 ................
0000000028f4da12: 00000000 00000000 5ed54778 ffff95e0 ........xG.^....
00000000da22dc10: 5ed54778 ffff95e0 00000000 00000000 xG.^............
00000000c7efff45: 00000000 00000000 00000000 00000000 ................
000000003dba95dd: 00000000 00000000 00000000 00000000 ................
000000002e1db883: c12d0ba0 ffffffff 00000010 00000000 ..-.............
00000000f959c8cd: 00000000 006200ca 5ed547c8 ffff95e0 ......b..G.^....
0000000094e1a962: 5ed547c8 ffff95e0 00000000 00000000 .G.^............
00000000759218a6: 00000000 00000000 00000000 00000000 ................
000000008fb24e59: 00000000 00000000 00000000 00000000 ................
00000000cc68b32d: 00000000 00000000 5ed54808 ffff95e0 .........H.^....
0000000086b31057: 5ed54808 ffff95e0 00000000 00000000 .H.^............
0000000097cea915: 32f8161b 00000000 00000000 00000000 ...2............
00000000e1952e10: 00000000 00000000 00000000 00000000 ................
000000003f2b9392: 00000000 00000000 00000000 00000000 ................
00000000b67282ad: 00000000 994d9bca 691ccee5 00000000 ......M....i....
000000007218d69d: 3279d8ae 00000000 00000000 ffff95e0 ..y2............
000000006f44c90b: 5ed54870 ffff95e0 5ed54870 ffff95e0 pH.^....pH.^....
00000000eb1c4614: 00000000 00000000 00000000 00000000 ................
00000000debd8ee2: 00000000 00000000 00000000 00000000 ................
00000000af19e05c: 5ed548a0 ffff95e0 5ed548a0 ffff95e0 .H.^.....H.^....
00000000669992e2: 00000000 00000000 00000000 ffffffff ................
0000000054829ceb: 00000000 00000000 00000000 00000000 ................
00000000e145d0b7: 00000020 ffff95e0 00000000 00000000 ...............
00000000c42b3ff9: 00000000 00000000 5ed548e8 ffff95e0 .........H.^....
00000000dcbc2d3e: 5ed548e8 ffff95e0 ffffffe0 0000000f .H.^............
0000000046bf2d19: 5ed54900 ffff95e0 5ed54900 ffff95e0 .I.^.....I.^....
000000002ed6835c: c1277db0 ffffffff 87ac2000 ffff95e0 .}'...... ......
00000000aa4b5a2d: c723699f e94c9bca 00000000 00000000 .i#...L.........
000000002c8478e7: 00000000 00000000 00000000 00000000 ................
0000000072fc2ffa: 00001b62 00001b62 00000000 00000000 b...b...........
000000009ea973e7: 00000000 00000000 00000000 00000000 ................
00000000485e7ec1: 00000000 00000000 811eb180 00000000 ................
0000000091529a36: 00038d7c 00000000 |.......
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): Inode 3177 (00000000b193ad84): orphan list check failed!
00000000b193ad84: 0001f30a 00010004 00000000 00000000 ................
00000000c86d9d93: 00036f55 00030000 0000000c 00000004 Uo..............
00000000124f6f8a: 00038dd2 00000010 00000004 00038a5c ............\...
00000000b274a826: 00000014 00000004 00038a61 000001b9 ........a.......
00000000ae07f498: 00000000 00000000 00000000 00000001 ................
0000000096a4881d: 5ef2d350 ffff95e0 5ef2d350 ffff95e0 P..^....P..^....
00000000284da230: 00000000 00000000 00084000 80000004 .........@......
00000000dca7fb5b: 00000000 00000000 5ef2d378 ffff95e0 ........x..^....
000000004d5569d2: 5ef2d378 ffff95e0 00000000 00000000 x..^............
0000000001e44ce1: 00000000 00000000 5ed54558 ffff95e0 ........XE.^....
00000000b4492793: 7d392720 ffff95e0 00200038 00000000 '9}....8. .....
000000001e068621: 00000000 00000000 5ef2d3b8 ffff95e0 ...........^....
00000000c0f5a6f1: 5ef2d3b8 ffff95e0 00000000 00000000 ...^............
0000000071bce5ed: 00000000 00000000 00000000 00000000 ................
00000000c41284de: 5ef2d3e0 ffff95e0 5ef2d3e0 ffff95e0 ...^.......^....
00000000bc2e15d5: 00000000 00000000 00000000 00000000 ................
0000000047099d7a: 000881a4 00000000 00000000 00000080 ................
000000005feb6c3d: 00000000 00000000 00000000 00000000 ................
000000006dbf7835: c12d0000 ffffffff 42c8d800 ffff95e1 ..-........B....
000000008ab6d62b: 5ef2d578 ffff95e0 9435c980 ffff95e0 x..^......5.....
0000000045e0de52: 00000c69 00000000 00000001 00000000 i...............
000000006a7633d4: 00200038 00000000 691ccf24 00000000 8. .....$..i....
000000009a0ede61: 00000000 00000000 691ccfd1 00000000 ...........i....
000000003b3730e6: 00000000 00000000 691ccf24 00000000 ........$..i....
000000007862339f: 00000000 00000000 00000000 00000000 ................
00000000a095f999: 0000000c 00000000 00001028 00000000 ........(.......
000000005d5dd20a: 00000060 00000000 00000000 00000000 `...............
00000000c59a73f7: 5ef2d4b0 ffff95e0 5ef2d4b0 ffff95e0 ...^.......^....
0000000018ca890d: 00000000 00000000 00000000 00000000 ................
000000007b3e5a18: 00a3c72d 00000001 00000000 00000000 -...............
00000000aabf118d: 00000000 00000000 00000000 00000000 ................
0000000067e28f5d: 5ef2d4f0 ffff95e0 5ef2d4f0 ffff95e0 ...^.......^....
00000000af32dd40: 00000000 00000000 00000000 00000000 ................
0000000084168210: 5ef2d510 ffff95e0 5ef2d510 ffff95e0 ...^.......^....
00000000db8edc38: 5ef2d520 ffff95e0 5ef2d520 ffff95e0 ..^.... ..^....
00000000afe45284: 5ef2d530 ffff95e0 5ef2d530 ffff95e0 0..^....0..^....
000000007306a98c: 00000000 00000000 00000000 00000000 ................
000000003c3ee3b0: 00000002 00000000 00000000 00000000 ................
00000000760843a3: 00000000 00000000 c12d0100 ffffffff ..........-.....
00000000a23b0bab: 00000000 00000000 5ef2d400 ffff95e0 ...........^....
000000005c842bc0: 00000000 00000021 00000000 00000000 ....!...........
00000000bfcd9638: 00000000 00000000 00000000 00000000 ................
00000000e23e1312: 00000000 00000000 00000000 00000000 ................
00000000de1367ca: 00000000 00000000 5ef2d5b8 ffff95e0 ...........^....
00000000919380ad: 5ef2d5b8 ffff95e0 00000000 00000000 ...^............
0000000078229268: 00000000 00000000 00000000 00000000 ................
00000000f26e7a65: 00000000 00000000 00000000 00000000 ................
000000009eb86ad8: c12d0ba0 ffffffff 00000010 00000000 ..-.............
0000000014c8ad01: 00000000 006200ca 5ef2d608 ffff95e0 ......b....^....
00000000ddb6e62f: 5ef2d608 ffff95e0 00000000 00000000 ...^............
00000000832e373c: 00000000 00000000 00000000 00000000 ................
00000000785f86ec: 00000000 00000000 00000000 00000000 ................
0000000049ae97e6: 00000000 00000000 5ef2d648 ffff95e0 ........H..^....
00000000012230e7: 5ef2d648 ffff95e0 00000000 00000000 H..^............
0000000024231026: 3aa00385 00000000 00000000 00000000 ...:............
0000000030a6cdc6: 00000000 00000000 00000000 00000000 ................
00000000090f84a4: 00000000 00000000 00000000 00000000 ................
000000003985c2a1: 00000000 00000000 691ccf24 00000000 ........$..i....
000000002c79faa2: 0756867a 00000000 00000000 00000000 z.V.............
00000000e8025876: 5ef2d6b0 ffff95e0 5ef2d6b0 ffff95e0 ...^.......^....
0000000019d77bdf: 00000000 00000000 00000000 00000000 ................
00000000c77c3f85: 00000000 00000000 00000000 00000000 ................
00000000bf91b85b: 5ef2d6e0 ffff95e0 5ef2d6e0 ffff95e0 ...^.......^....
00000000ac7de1d4: 00000000 00000000 00000000 ffffffff ................
000000000d25e798: 00000000 00000000 00000000 00000000 ................
000000007e74e821: 00000020 00000000 00000000 00000000 ...............
00000000aaa8bd47: 00000000 00000000 5ef2d728 ffff95e0 ........(..^....
0000000044bf9980: 5ef2d728 ffff95e0 ffffffe0 0000000f (..^............
LustreError: 611332:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-MDT0000: not available for connect from fd33:3981:3213:f010:0:5254:8a:7683@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
000000006087970a: 5ef2d740 ffff95e0 5ef2d740 ffff95e0 @..^....@..^....
000000006581a28f: c1277db0 ffffffff 00000000 00000000 .}'.............
00000000abf0c7d8: 00000000 00000000 00000000 00000000 ................
000000009c8e8f25: 00000000 00000000 00000000 00000000 ................
00000000174581fe: 00001daa 00001daa 00000000 00000000 ................
000000000ba2e901: 00000000 00000000 00000000 00000000 ................
000000003609c097: 00000000 00000000 00000000 00000000 ................
00000000c8961e96: 00000000 00000000 ........
CPU: 1 PID: 806297 Comm: umount Kdump: loaded Tainted: G W OE -------- - - 4.18.0-553.76.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
ldiskfs_destroy_inode+0xb2/0xc0 [ldiskfs]
LustreError: 611332:0:(ldlm_lib.c:1179:target_handle_connect()) Skipped 15 previous similar messages
dispose_list+0x48/0x70
evict_inodes+0x160/0x1b0
generic_shutdown_super+0x37/0x110
kill_block_super+0x21/0x50
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
osd_umount+0x7d/0x1b0 [osd_ldiskfs]
osd_device_fini+0x1b8/0x210 [osd_ldiskfs]
obd_precleanup.isra.32+0x8e/0x280 [obdclass]
? class_disconnect_exports+0x187/0x2f0 [obdclass]
class_cleanup+0x326/0x7e0 [obdclass]
class_process_config+0x3bb/0x2060 [obdclass]
? class_manual_cleanup+0x191/0x730 [obdclass]
class_manual_cleanup+0x26b/0x730 [obdclass]
osd_obd_disconnect+0x12c/0x140 [osd_ldiskfs]
lustre_put_lsi_free+0x107/0x270 [obdclass]
lustre_put_lsi+0x17c/0x1e0 [obdclass]
server_put_super+0x263/0x1490 [ptlrpc]
? fsnotify_sb_delete+0x138/0x1c0
generic_shutdown_super+0x6c/0x110
kill_anon_super+0x14/0x30
deactivate_locked_super+0x34/0x70
cleanup_mnt+0x3b/0x70
task_work_run+0x8a/0xb0
exit_to_usermode_loop+0xef/0x100
do_syscall_64+0x195/0x1a0
entry_SYSCALL_64_after_hwframe+0x66/0xcb
RIP: 0033:0x7f98338c68fb
Code: ff d0 48 89 c7 b8 3c 00 00 00 0f 05 48 8b 0d 84 65 39 00 f7 d8 64 89 01 48 83 c8 ff c3 66 90 f3 0f 1e fa b8 a6 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 5d 65 39 00 f7 d8 64 89 01 48
RSP: 002b:00007ffd299040d8 EFLAGS: 00000246 ORIG_RAX: 00000000000000a6
RAX: 0000000000000000 RBX: 00005561d55b5400 RCX: 00007f98338c68fb
RDX: 0000000000000001 RSI: 0000000000000000 RDI: 00005561d55badd0
RBP: 0000000000000000 R08: 00005561d55bb960 R09: 00005561d55b2010
R10: 0000000000000000 R11: 0000000000000246 R12: 00005561d55badd0
R13: 00007f9834749184 R14: 00005561d55b55e0 R15: 00000000ffffffff
LDISKFS-fs (dm-3): sb orphan head is 3177
sb_info orphan list:
inode dm-3:3177 at 0000000047099d7a: mode 100644, nlink 1, next 441
inode dm-3:441 at 00000000e430bab2: mode 100644, nlink 1, next 440
inode dm-3:440 at 00000000a562c9c2: mode 100644, nlink 1, next 430
inode dm-3:430 at 00000000d77b5111: mode 100644, nlink 1, next 336
inode dm-3:336 at 00000000cb171e83: mode 100644, nlink 1, next 291
inode dm-3:291 at 00000000641496b4: mode 100644, nlink 1, next 287
inode dm-3:287 at 00000000c5e81a3a: mode 100644, nlink 1, next 274
inode dm-3:274 at 00000000b047a7e0: mode 100644, nlink 1, next 213
inode dm-3:213 at 000000007789655b: mode 100644, nlink 1, next 0
------------[ cut here ]------------
Link to test
Return to new crashes list