| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Link and date |
|---|---|---|---|
| sanityn test 80b: Accessing directory during migration | LustreError: 2507444:0:(osd_handler.c:4142:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 2507444:0:(osd_handler.c:4142:osd_destroy()) LBUG CPU: 1 PID: 2507444 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1.el9_7_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef9/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 2507444:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2507444:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 2507444:0:(osd_handler.c:4775:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x17:0x0], maybe an upgraded file? (LU-3915) LustreError: 2507446:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2507446:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 2507446:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 2507446:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 2520276:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2520276:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 2520276:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 2520276:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 1 previous similar message Lustre: 2507446:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry LustreError: 2507446:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0x68:0x0]/link_file failed: rc = -2 LustreError: 2507446:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 2519737:0:(osd_handler.c:4775:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x43:0x0], maybe an upgraded file? (LU-3915) LustreError: 2507445:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2507445:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 3 previous similar messages Lustre: 2507445:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry LustreError: 2507444:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 2507444:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 16 previous similar messages Lustre: 2507445:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry Lustre: 2507445:0:(mdd_dir.c:5011:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 2507446:0:(osd_handler.c:4775:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0xfd:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-09-05 11:57) |
| sanityn test 80b: Accessing directory during migration | LustreError: 403011:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 403011:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 1 PID: 403011 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1.el9_7_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef9/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 416930:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 416930:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 416931:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2400032e0:0x2f:0x0]/source_file failed: rc = -2 LustreError: 416931:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 403013:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 403013:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 403012:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 403012:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 403012:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 403012:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 3 previous similar messages Lustre: 416931:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0xd:0x0]/file4 is open, migrate only dentry LustreError: 403013:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 403013:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 9 previous similar messages LustreError: 403013:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 403013:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 10 previous similar messages LustreError: 416931:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 416931:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 7 previous similar messages LustreError: 416931:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 416931:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 7 previous similar messages Lustre: 403013:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry Lustre: 403012:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x30:0x0]/file4 is open, migrate only dentry LustreError: 416931:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 416931:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 416931:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 416931:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages Lustre: 403013:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x3c:0x0]/file4 is open, migrate only dentry LustreError: 403011:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e4:0x14b:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-09-02 01:41) |
| sanityn test 80b: Accessing directory during migration | LustreError: 620056:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 620056:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 1 PID: 620056 Comm: mdt_io00_004 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1.el9_7_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef9/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 576127:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 576127:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 620054:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2400032e0:0x59:0x0]/source_file failed: rc = -2 LustreError: 620054:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 4 previous similar messages LustreError: 576127:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 576127:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 4 previous similar messages LustreError: 616503:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd5:0x34:0x0], maybe an upgraded file? (LU-3915) LustreError: 576127:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 576127:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 576127:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 576127:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 6 previous similar messages LustreError: 616503:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd5:0x5c:0x0], maybe an upgraded file? (LU-3915) LustreError: 620054:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 620054:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 620054:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 620054:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 620056:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd5:0x8d:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-08-26 08:53) |
| sanityn test 80b: Accessing directory during migration | LustreError: 621154:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 621154:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 1 PID: 621154 Comm: mdt_io00_003 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1.el9_7_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef9/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 577451:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016396:0x83a:0x0], maybe an upgraded file? (LU-3915) LustreError: 577450:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 577450:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 577450:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2400032e0:0x2f:0x0]/source_file failed: rc = -2 LustreError: 577450:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 577450:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 577450:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 577452:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 577452:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 4 previous similar messages LustreError: 577452:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 577452:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 577452:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 577452:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 577450:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 577450:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 15 previous similar messages LustreError: 577450:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 577450:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 15 previous similar messages LustreError: 577452:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016396:0x946:0x0], maybe an upgraded file? (LU-3915) Lustre: 577451:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0002: [0x280000bd1:0x33:0x0]/file4 is open, migrate only dentry LustreError: 577451:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 577451:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 50 previous similar messages LustreError: 577451:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 577451:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 53 previous similar messages Lustre: 577451:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0000: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry Lustre: 577450:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0x6c:0x0]/file3 is open, migrate only dentry LustreError: 621154:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 621154:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 113 previous similar messages LustreError: 621154:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 621154:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 121 previous similar messages Lustre: 577450:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0000: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry Lustre: 577450:0:(mdd_dir.c:5011:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 621154:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016396:0xc30:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-08-22 12:13) |
| sanityn test 80b: Accessing directory during migration | LustreError: 402994:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 402994:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 0 PID: 402994 Comm: mdt_io00_001 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1.el9_7_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef9/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 417147:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 417147:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 417147:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 417147:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 417147:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 417147:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages Lustre: 402994:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0x9:0x0]/file3 is open, migrate only dentry LustreError: 417149:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 417149:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 417149:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 417149:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 4 previous similar messages LustreError: 402995:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 402995:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 21 previous similar messages LustreError: 402995:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 402995:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 23 previous similar messages Lustre: 402993:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry LustreError: 417147:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 417147:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 35 previous similar messages LustreError: 417147:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 417147:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 37 previous similar messages Lustre: 417149:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0x37:0x0]/file4 is open, migrate only dentry LustreError: 417147:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd3:0x12c:0x0], maybe an upgraded file? (LU-3915) LustreError: 417147:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016391:0xa8b:0x0]/source_file failed: rc = -2 LustreError: 417147:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 48 previous similar messages LustreError: 417149:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 417149:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 48 previous similar messages Lustre: 402995:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0003: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry Lustre: 402994:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0003: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry Lustre: 402994:0:(mdd_dir.c:5011:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 402993:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 402993:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 74 previous similar messages LustreError: 402993:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 402993:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 81 previous similar messages LustreError: 402994:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd3:0x29b:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-08-15 09:13) |
| sanityn test 80b: Accessing directory during migration | LustreError: 402657:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 402657:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 0 PID: 402657 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1.el9_7_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef9/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136e/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x149/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e8/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x104/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2b/0x50 </TASK> | Lustre: 402657:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd0:0xc:0x0]/file3 is open, migrate only dentry LustreError: 402658:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 402658:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 402658:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 402658:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 402658:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 402658:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 4 previous similar messages LustreError: 402658:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 402658:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 4 previous similar messages LustreError: 416324:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x4a:0x0], maybe an upgraded file? (LU-3915) LustreError: 402658:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 402658:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 8 previous similar messages LustreError: 402658:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 402658:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 9 previous similar messages Lustre: 402657:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry Lustre: 402657:0:(mdd_dir.c:5011:mdd_migrate_object()) Skipped 3 previous similar messages LustreError: 416324:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 416324:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 26 previous similar messages LustreError: 416324:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 416324:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 30 previous similar messages LustreError: 416324:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x108:0x0], maybe an upgraded file? (LU-3915) Autotest: Test running for 210 minutes (lustre-reviews_review-dne-part-5_129325.30) Lustre: 416324:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0x33:0x0]/file3 is open, migrate only dentry LustreError: 402659:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x17b:0x0], maybe an upgraded file? (LU-3915) LustreError: 402659:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 402659:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 41 previous similar messages LustreError: 402659:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 402659:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 46 previous similar messages LustreError: 402657:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x1f1:0x0], maybe an upgraded file? (LU-3915) Lustre: 416329:0:(out_handler.c:884:out_tx_end()) lustre-MDT0001-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-kPhqEily/BUILD/lustre-2.17.57_1_g8a1b9ec/lustre/ptlrpc/../target/out_handler.c:562: rc = -2 LustreError: 416329:0:(out_handler.c:893:out_tx_end()) lustre-MDT0001-osd: undo for /tmp/rpmbuild-lustre-jenkins-kPhqEily/BUILD/lustre-2.17.57_1_g8a1b9ec/lustre/ptlrpc/../target/out_handler.c:408: rc = -524 Lustre: 402658:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0001: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry LustreError: 402657:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x254:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-08-14 05:56) |
| sanityn test 80b: Accessing directory during migration | LustreError: 578237:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 578237:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 0 PID: 578237 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1.el9_7_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef9/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 578238:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2400032e0:0x1c:0x0]/source_file failed: rc = -2 LustreError: 623259:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 623259:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 623259:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 623259:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 578237:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 578237:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 578237:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 578237:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 5 previous similar messages Lustre: 578237:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0xe:0x0]/file4 is open, migrate only dentry LustreError: 578237:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016396:0x90b:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-08-12 12:19) |
| sanityn test 80b: Accessing directory during migration | LustreError: 584090:0:(osd_handler.c:4142:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 584090:0:(osd_handler.c:4142:osd_destroy()) LBUG CPU: 1 PID: 584090 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1.el9_7_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef9/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 584092:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 584092:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 584090:0:(osd_handler.c:4775:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd6:0x5:0x0], maybe an upgraded file? (LU-3915) LustreError: 584090:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000bd0:0x3e:0x0]/source_file failed: rc = -2 LustreError: 584090:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 15 previous similar messages LustreError: 628557:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 628557:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 15 previous similar messages LustreError: 628557:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 628557:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 7 previous similar messages LustreError: 584092:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 584092:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 7 previous similar messages LustreError: 584090:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 584090:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 7 previous similar messages LustreError: 584090:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 584090:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 9 previous similar messages LustreError: 584091:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 584091:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 16 previous similar messages LustreError: 584091:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 584091:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 21 previous similar messages LustreError: 628561:0:(mdd_object.c:3951:mdd_close()) lustre-MDD0002: failed to get lu_attr of [0x280000bd0:0x10c:0x0]: rc = -2 Lustre: 584090:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0x24:0x0]/file4 is open, migrate only dentry LustreError: 628557:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 628557:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 56 previous similar messages LustreError: 628557:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 628557:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 58 previous similar messages Lustre: 584092:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0x3d:0x0]/file3 is open, migrate only dentry LustreError: 584080:0:(mdd_object.c:3951:mdd_close()) lustre-MDD0002: failed to get lu_attr of [0x280000bd0:0x2e7:0x0]: rc = -2 Lustre: 584090:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0002: [0x280000bd0:0xb:0x0]/migrate_dir is open, migrate only dentry LustreError: 628557:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 628557:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) Skipped 49 previous similar messages LustreError: 628557:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x280000bd0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 628557:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 54 previous similar messages LustreError: 584080:0:(mdd_object.c:3951:mdd_close()) lustre-MDD0000: failed to get lu_attr of [0x200016391:0xc13:0x0]: rc = -2 LustreError: 584090:0:(osd_handler.c:4775:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd6:0x2ef:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-08-04 17:14) |
| sanityn test 80b: Accessing directory during migration | LustreError: 586042:0:(osd_handler.c:4142:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 586042:0:(osd_handler.c:4142:osd_destroy()) LBUG CPU: 0 UID: 0 PID: 586042 Comm: mdt_io00_001 Kdump: loaded Tainted: G W OE ------ --- 6.12.0-124.56.1.el10_1_lustre.x86_64 #1 PREEMPT(voluntary) Tainted: [W]=WARN, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x3c8/0x750 [osd_ldiskfs] lod_sub_destroy+0x1d1/0x3a0 [lod] lod_destroy+0x221/0xaf0 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1d1/0x3a0 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 mdd_migrate_create+0x428/0x850 [mdd] mdd_migrate_object+0xe49/0x1190 [mdd] ? mdd_migrate+0x18/0x30 [mdd] mdd_migrate+0x18/0x30 [mdd] mdt_reint_migrate+0x1601/0x2790 [mdt] ? srso_alias_return_thunk+0x5/0xfbef5 mdt_reint_rec+0x11d/0x270 [mdt] mdt_reint_internal+0x4c8/0x8a0 [mdt] mdt_reint+0x61/0x120 [mdt] tgt_handle_request0.isra.0+0x124/0x810 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 tgt_request_handle+0x232/0xd50 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x293/0xda0 [ptlrpc] ? lprocfs_counter_add+0x12a/0x190 [obdclass] ptlrpc_main+0xaeb/0xed0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | LustreError: 586042:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 586042:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2800013a0:0xb:0x0]/migrate_dir failed: rc = -1 LustreError: 586041:0:(mdd_dir.c:4927:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 586041:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2800013a0:0xb:0x0]/migrate_dir failed: rc = -1 Lustre: 650207:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0x6:0x0]/file4 is open, migrate only dentry Lustre: 586042:0:(mdd_dir.c:5011:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0xc:0x0]/file4 is open, migrate only dentry LustreError: 586042:0:(osd_handler.c:4775:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016396:0xa48:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-07-24 00:07) |
| sanityn test 80b: Accessing directory during migration | LustreError: 403802:0:(osd_handler.c:4142:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 403802:0:(osd_handler.c:4142:osd_destroy()) LBUG CPU: 0 PID: 403802 Comm: mdt_io00_001 Kdump: loaded Tainted: G OE ------ --- 5.14.0-687.17.1.el9_8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x33/0x50 lbug_with_loc+0x3a/0x80 [libcfs] osd_destroy+0x5fe/0x710 [osd_ldiskfs] ? update_records_destroy_pack+0x2c/0x40 [ptlrpc] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x222/0xb00 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x430/0x870 [mdd] mdd_migrate_object+0xdb8/0x1130 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x121/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1224/0x1df0 [mdt] mdt_reint_rec+0x119/0x280 [mdt] mdt_reint_internal+0x4b1/0xa10 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x156/0x820 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 tgt_request_handle+0x3b7/0xd40 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e2/0xd80 [ptlrpc] ? lprocfs_counter_add+0x121/0x180 [obdclass] ptlrpc_main+0x983/0xe50 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x122/0x240 ? __pfx_kthread+0x10/0x10 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 403802:0:(osd_handler.c:4775:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x3:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-07-23 12:21) |
| sanityn test 80b: Accessing directory during migration | LustreError: 596526:0:(osd_handler.c:4169:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 596526:0:(osd_handler.c:4169:osd_destroy()) LBUG CPU: 0 UID: 0 PID: 596526 Comm: mdt_io00_004 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.45.1.el10_1_lustre.ddn1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x3ba/0x700 [osd_ldiskfs] lod_sub_destroy+0x20e/0x530 [lod] lod_destroy+0x21b/0xa80 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x20e/0x530 [lod] mdd_migrate_create+0x3fc/0x970 [mdd] mdd_migrate_object+0x7f5/0x1390 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x11b/0x190 [obdclass] ? mdd_migrate+0x18/0x30 [mdd] mdd_migrate+0x18/0x30 [mdd] mdt_reint_migrate+0x14df/0x2520 [mdt] ? srso_alias_return_thunk+0x5/0xfbef5 mdt_reint_rec+0x11d/0x270 [mdt] mdt_reint_internal+0x4c8/0x8a0 [mdt] mdt_reint+0x61/0x120 [mdt] tgt_handle_request0.isra.0+0x124/0x810 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 tgt_request_handle+0x232/0xd50 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x350/0xdb0 [ptlrpc] ? lprocfs_counter_add+0x11b/0x190 [obdclass] ptlrpc_main+0xb97/0xfe0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK> | LustreError: 7903:0:(mdt_reint.c:2611:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -114 LustreError: 439949:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 439949:0:(mdt_reint.c:2611:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 439949:0:(mdt_reint.c:2611:mdt_reint_migrate()) Skipped 5 previous similar messages LustreError: 83638:0:(mdd_object.c:3974:mdd_close()) lustre-MDD0003: failed to get lu_attr of [0x2c0000411:0x2f1:0x0]: rc = -2 Lustre: 7903:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0003: [0x2c0000400:0xd6:0x0]/file3 is open, migrate only dentry LustreError: 439949:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 439949:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 10 previous similar messages LustreError: 439949:0:(mdt_reint.c:2611:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 439949:0:(mdt_reint.c:2611:mdt_reint_migrate()) Skipped 23 previous similar messages LustreError: 7902:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 7902:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 7902:0:(mdt_reint.c:2611:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 7902:0:(mdt_reint.c:2611:mdt_reint_migrate()) Skipped 34 previous similar messages LustreError: 7902:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000414:0x98c:0x0], maybe an upgraded file? (LU-3915) Lustre: 7902:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0003: [0x2c0000400:0xe3:0x0]/file1 is open, migrate only dentry LustreError: 7902:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 7902:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 14 previous similar messages Lustre: 7902:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0003: [0x2c0000411:0x2cd:0x0]/migrate_dir is open, migrate only dentry LustreError: 7903:0:(mdt_reint.c:2611:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 7903:0:(mdt_reint.c:2611:mdt_reint_migrate()) Skipped 55 previous similar messages LustreError: 596526:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000414:0x9eb:0x0], maybe an upgraded file? (LU-3915) LustreError: 596526:0:(osd_handler.c:4782:osd_ref_del()) Skipped 1 previous similar message LustreError: 11430:0:(out_handler.c:862:out_tx_end()) lustre-MDT0001-osd: undo for /tmp/rpmbuild-lustre-jenkins-svjrLpfW/BUILD/lustre-2.16.0_ddn53_3_g53020b7/lustre/ptlrpc/../../lustre/target/out_handler.c:394: rc = -524 LustreError: 7902:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 7902:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 33 previous similar messages Lustre: 7902:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0001: [0x2c0000411:0x2cd:0x0]/migrate_dir is open, migrate only dentry LustreError: 7902:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000414:0xa4b:0x0], maybe an upgraded file? (LU-3915) LustreError: 83642:0:(out_handler.c:862:out_tx_end()) lustre-MDT0001-osd: undo for /tmp/rpmbuild-lustre-jenkins-svjrLpfW/BUILD/lustre-2.16.0_ddn53_3_g53020b7/lustre/ptlrpc/../../lustre/target/out_handler.c:394: rc = -524 LustreError: 83642:0:(out_handler.c:862:out_tx_end()) Skipped 2 previous similar messages LustreError: 439949:0:(mdt_reint.c:2611:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 439949:0:(mdt_reint.c:2611:mdt_reint_migrate()) Skipped 115 previous similar messages LustreError: 7902:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 7902:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 55 previous similar messages Lustre: 596526:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0003: [0x2c0000400:0x13e:0x0]/file4 is open, migrate only dentry Lustre: 596526:0:(mdd_dir.c:4792:mdd_migrate_object()) Skipped 3 previous similar messages LustreError: 596526:0:(mdt_reint.c:2611:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 596526:0:(mdt_reint.c:2611:mdt_reint_migrate()) Skipped 243 previous similar messages LustreError: 596526:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 596526:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 87 previous similar messages LustreError: 596526:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000414:0xcde:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-07-12 04:55) |
| sanityn test 80b: Accessing directory during migration | LustreError: 408705:0:(osd_handler.c:4139:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 408705:0:(osd_handler.c:4139:osd_destroy()) LBUG CPU: 1 PID: 408705 Comm: mdt_io00_001 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 408704:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000bd0:0xf:0x0]/source_file failed: rc = -2 LustreError: 408705:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 408704:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x8fb:0x0]/migrate_dir failed: rc = -1 LustreError: 408704:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 5 previous similar messages LustreError: 446676:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 446676:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 4 previous similar messages LustreError: 408706:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x15:0x0], maybe an upgraded file? (LU-3915) LustreError: 408705:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 408705:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 8 previous similar messages LustreError: 408705:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x8fb:0x0]/migrate_dir failed: rc = -1 LustreError: 408705:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 10 previous similar messages LustreError: 408706:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x98f:0x0]/source_file failed: rc = -2 LustreError: 408706:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 12 previous similar messages LustreError: 408705:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 408705:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 10 previous similar messages LustreError: 446679:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x90:0x0], maybe an upgraded file? (LU-3915) Lustre: 412080:0:(out_handler.c:884:out_tx_end()) lustre-MDT0000-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-vrWD1pIV/BUILD/lustre-2.17.54_43_g592d733/lustre/ptlrpc/../target/out_handler.c:562: rc = -2 LustreError: 412080:0:(out_handler.c:893:out_tx_end()) lustre-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-vrWD1pIV/BUILD/lustre-2.17.54_43_g592d733/lustre/ptlrpc/../target/out_handler.c:408: rc = -524 Lustre: 446676:0:(mdd_dir.c:5010:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0x1a:0x0]/file3 is open, migrate only dentry LustreError: 408706:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x8fb:0x0]/migrate_dir failed: rc = -1 LustreError: 408706:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 24 previous similar messages LustreError: 408704:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 408704:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 22 previous similar messages LustreError: 408705:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x9bc:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-07-05 03:34) |
| sanityn test 80b: Accessing directory during migration | LustreError: 326265:0:(osd_handler.c:4139:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 326265:0:(osd_handler.c:4139:osd_destroy()) LBUG CPU: 1 PID: 326265 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1a5/0x340 [lod] lod_destroy+0x26d/0xa60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1a5/0x340 [lod] mdd_migrate_create+0x414/0x7c0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 326267:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 326267:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2000013a1:0x8f0:0x0]/migrate_dir failed: rc = -1 Lustre: 326267:0:(mdd_dir.c:5010:mdd_migrate_object()) lustre-MDD0002: [0x280000bd1:0x3:0x0]/file3 is open, migrate only dentry LustreError: 326267:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 326267:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 326267:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2000013a1:0x8f0:0x0]/migrate_dir failed: rc = -1 LustreError: 326267:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 326265:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd3:0x19:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-06-16 02:23) |
| sanityn test 80b: Accessing directory during migration | LustreError: 404101:0:(osd_handler.c:4139:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 404101:0:(osd_handler.c:4139:osd_destroy()) LBUG CPU: 1 PID: 404101 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.55.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26d/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3fb/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1da0 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 404101:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 404101:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x8c8:0x0]/migrate_dir failed: rc = -1 Lustre: 404102:0:(mdd_dir.c:5010:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x6:0x0]/file1 is open, migrate only dentry LustreError: 413328:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x8d0:0x0]/source_file failed: rc = -2 LustreError: 413328:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 413330:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 413330:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 413328:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 413328:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 8 previous similar messages LustreError: 413328:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x8c8:0x0]/migrate_dir failed: rc = -1 LustreError: 413328:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 9 previous similar messages LustreError: 413330:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 413330:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 13 previous similar messages LustreError: 413330:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x8c8:0x0]/migrate_dir failed: rc = -1 LustreError: 413330:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 14 previous similar messages LustreError: 404101:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 404101:0:(mdd_dir.c:4926:mdd_migrate_cmd_check()) Skipped 31 previous similar messages LustreError: 404101:0:(mdt_reint.c:2642:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x8c8:0x0]/migrate_dir failed: rc = -1 LustreError: 404101:0:(mdt_reint.c:2642:mdt_reint_migrate()) Skipped 32 previous similar messages Lustre: 413328:0:(mdd_dir.c:5010:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x27:0x0]/file3 is open, migrate only dentry LustreError: 404101:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd3:0xd9:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-06-12 01:30) |
| sanityn test 80b: Accessing directory during migration | LustreError: 396777:0:(osd_handler.c:4139:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 396777:0:(osd_handler.c:4139:osd_destroy()) LBUG CPU: 0 PID: 396777 Comm: mdt_io00_002 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.47.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3fb/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1d90 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 396775:0:(mdd_dir.c:4893:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 396775:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x800:0x0]/migrate_dir failed: rc = -1 LustreError: 399461:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x5:0x0], maybe an upgraded file? (LU-3915) LustreError: 396775:0:(mdd_dir.c:4893:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 396775:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x800:0x0]/migrate_dir failed: rc = -1 LustreError: 396775:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 396777:0:(mdd_dir.c:4893:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 396777:0:(mdd_dir.c:4893:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 396777:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x800:0x0]/migrate_dir failed: rc = -1 LustreError: 396777:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 2 previous similar messages LustreError: 396776:0:(mdd_dir.c:4893:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 396776:0:(mdd_dir.c:4893:mdd_migrate_cmd_check()) Skipped 12 previous similar messages LustreError: 396776:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x800:0x0]/migrate_dir failed: rc = -1 LustreError: 396776:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 13 previous similar messages Lustre: 405928:0:(mdd_dir.c:4977:mdd_migrate_object()) lustre-MDD0001: [0x200016b61:0x800:0x0]/migrate_dir is open, migrate only dentry LustreError: 396777:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000bd0:0x110:0x0]/target_file failed: rc = -2 LustreError: 396777:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 35 previous similar messages LustreError: 396776:0:(mdd_dir.c:4893:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 396776:0:(mdd_dir.c:4893:mdd_migrate_cmd_check()) Skipped 35 previous similar messages LustreError: 396777:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0xa6:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-06-05 20:18) |
| sanityn test 80b: Accessing directory during migration | LustreError: 389763:0:(osd_handler.c:4139:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 389763:0:(osd_handler.c:4139:osd_destroy()) LBUG CPU: 1 PID: 389763 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.47.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3fb/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1d90 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 424928:0:(mdd_dir.c:4889:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 424928:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x800:0x0]/migrate_dir failed: rc = -1 LustreError: 389763:0:(mdd_dir.c:4889:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 389763:0:(mdd_dir.c:4889:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 389763:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x800:0x0]/migrate_dir failed: rc = -1 LustreError: 389763:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 389765:0:(mdd_dir.c:4889:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 389765:0:(mdd_dir.c:4889:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 389765:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x800:0x0]/migrate_dir failed: rc = -1 LustreError: 389765:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 3 previous similar messages Lustre: 424928:0:(mdd_dir.c:4973:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x7:0x0]/file4 is open, migrate only dentry Lustre: 424928:0:(mdd_dir.c:4973:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0xc:0x0]/file4 is open, migrate only dentry LustreError: 424928:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x863:0x0]/link_file failed: rc = -2 LustreError: 424928:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 15 previous similar messages LustreError: 389764:0:(mdd_dir.c:4889:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 389764:0:(mdd_dir.c:4889:mdd_migrate_cmd_check()) Skipped 15 previous similar messages LustreError: 389763:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x4e:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-06-03 01:22) |
| sanityn test 80b: Accessing directory during migration | LustreError: 387669:0:(osd_handler.c:4139:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 387669:0:(osd_handler.c:4139:osd_destroy()) LBUG CPU: 1 PID: 387669 Comm: mdt_io00_002 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.47.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3fb/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1d90 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 387668:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 387668:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x88c:0x0]/migrate_dir failed: rc = -1 Lustre: 387669:0:(mdd_dir.c:4992:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x3:0x0]/file4 is open, migrate only dentry LustreError: 387669:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 387669:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 387669:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x88c:0x0]/migrate_dir failed: rc = -1 LustreError: 387669:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 4 previous similar messages Lustre: 387668:0:(mdd_dir.c:4992:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x6:0x0]/file1 is open, migrate only dentry LustreError: 423585:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2800013a0:0x4a:0x0]/target_file failed: rc = -2 LustreError: 423585:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 18 previous similar messages LustreError: 387667:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 387667:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) Skipped 18 previous similar messages LustreError: 423585:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 423585:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x88c:0x0]/migrate_dir failed: rc = -1 LustreError: 423585:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 5 previous similar messages Lustre: 423585:0:(mdd_dir.c:4992:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x19:0x0]/file4 is open, migrate only dentry Lustre: 423585:0:(mdd_dir.c:4992:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 387667:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 387667:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) Skipped 49 previous similar messages LustreError: 387667:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x88c:0x0]/migrate_dir failed: rc = -1 LustreError: 387667:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 51 previous similar messages Lustre: 387668:0:(mdd_dir.c:4992:mdd_migrate_object()) lustre-MDD0000: [0x200016b61:0x88c:0x0]/migrate_dir is open, migrate only dentry LustreError: 423590:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 423590:0:(mdd_dir.c:4908:mdd_migrate_cmd_check()) Skipped 56 previous similar messages LustreError: 423590:0:(mdt_reint.c:2634:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x88c:0x0]/migrate_dir failed: rc = -1 LustreError: 423590:0:(mdt_reint.c:2634:mdt_reint_migrate()) Skipped 61 previous similar messages LustreError: 387668:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x188:0x0], maybe an upgraded file? (LU-3915) LustreError: 387669:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x1ae:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-06-01 16:21) |
| sanityn test 80b: Accessing directory during migration | LustreError: 5147:0:(osd_handler.c:4169:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 5147:0:(osd_handler.c:4169:osd_destroy()) LBUG CPU: 1 PID: 5147 Comm: mdt_io00_001 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-570.62.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x266/0xa10 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xf26/0x1500 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x109/0x170 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x132b/0x1d10 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2ca/0xda0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0xa7b/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 277678:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -114 LustreError: 5148:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 418723:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -114 LustreError: 418723:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 8 previous similar messages LustreError: 418723:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 418723:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 418723:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 418723:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 418723:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 13 previous similar messages Lustre: 5148:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0x86:0x0]/file4 is open, migrate only dentry LustreError: 418723:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -114 LustreError: 418723:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 23 previous similar messages LustreError: 418723:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 418723:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 12 previous similar messages LustreError: 418723:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd6:0x14fe:0x0], maybe an upgraded file? (LU-3915) Lustre: 418723:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x2c0000411:0x2cd:0x0]/migrate_dir is open, migrate only dentry LustreError: 5148:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -114 LustreError: 5148:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 69 previous similar messages LustreError: 418723:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 418723:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 30 previous similar messages Lustre: 5148:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x2c0000411:0x2cd:0x0]/migrate_dir is open, migrate only dentry Lustre: 5148:0:(mdd_dir.c:4792:mdd_migrate_object()) Skipped 2 previous similar messages LustreError: 5148:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd6:0x15b1:0x0], maybe an upgraded file? (LU-3915) LustreError: 418724:0:(out_handler.c:862:out_tx_end()) lustre-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-agn9Urq6/BUILD/lustre-2.16.0_ddn50_8_g0bc5014/lustre/ptlrpc/../../lustre/target/out_handler.c:394: rc = -524 LustreError: 5147:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 5147:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 109 previous similar messages LustreError: 5147:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 5147:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 51 previous similar messages Lustre: 5147:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0002: [0x280000bd4:0x58:0x0]/file3 is open, migrate only dentry Lustre: 5147:0:(mdd_dir.c:4792:mdd_migrate_object()) Skipped 1 previous similar message Lustre: 5147:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0xdd:0x0]/file4 is open, migrate only dentry LustreError: 5147:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000411:0x2cd:0x0]/migrate_dir failed: rc = -1 LustreError: 5147:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 188 previous similar messages LustreError: 277678:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 277678:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 98 previous similar messages LustreError: 277678:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd6:0x1724:0x0], maybe an upgraded file? (LU-3915) LustreError: 5147:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd6:0x1771:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-05-21 15:22) |
| sanityn test 80b: Accessing directory during migration | LustreError: 208318:0:(osd_handler.c:4169:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 208318:0:(osd_handler.c:4169:osd_destroy()) LBUG CPU: 1 PID: 208318 Comm: mdt_io00_003 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-570.62.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x266/0xa10 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xf26/0x1500 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x109/0x170 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x132b/0x1d10 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2ca/0xda0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0xa7b/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 208318:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 208318:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000404:0x2c6:0x0]/migrate_dir failed: rc = -1 LustreError: 11964:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 11964:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 11964:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000404:0x2c6:0x0]/migrate_dir failed: rc = -1 LustreError: 11964:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 5 previous similar messages Lustre: 11964:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0002: [0x280000400:0xf:0x0]/file4 is open, migrate only dentry LustreError: 208318:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000405:0x1469:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-05-15 23:32) |
| sanityn test 80b: Accessing directory during migration | LustreError: 387559:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 387559:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 0 PID: 387559 Comm: mdt_io00_001 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.42.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1d90 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9be/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 387558:0:(mdd_dir.c:4805:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 387558:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x88c:0x0]/migrate_dir failed: rc = -1 LustreError: 423124:0:(mdd_dir.c:4805:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 423124:0:(mdd_dir.c:4805:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 423124:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x88c:0x0]/migrate_dir failed: rc = -1 LustreError: 423124:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 387559:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0xf:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-05-09 09:19) |
| sanityn test 80b: Accessing directory during migration | LustreError: 362177:0:(osd_handler.c:4139:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 362177:0:(osd_handler.c:4139:osd_destroy()) LBUG CPU: 0 PID: 362177 Comm: mdt_io00_002 Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1d90 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 362177:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 362177:0:(mdt_reint.c:2631:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x918:0x0]/migrate_dir failed: rc = -1 Lustre: 362176:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b61:0x918:0x0]/migrate_dir is open, migrate only dentry LustreError: 362177:0:(osd_handler.c:4772:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0xc:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-05-05 13:49) |
| sanityn test 80b: Accessing directory during migration | LustreError: 331622:0:(osd_handler.c:4169:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 331622:0:(osd_handler.c:4169:osd_destroy()) LBUG CPU: 1 PID: 331622 Comm: mdt_io00_003 Kdump: loaded Tainted: G OE ------ --- 5.14.0-611.42.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x50 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x266/0xa10 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xf26/0x1500 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x109/0x170 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x132b/0x1d10 [mdt] ? __entry_text_end+0x1026f9/0x1026fd mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x146/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2ca/0xda0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0xa7a/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0x101/0x110 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x28/0x50 </TASK> | LustreError: 6572:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000411:0x2da:0x0]/migrate_dir failed: rc = -114 LustreError: 331622:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 331622:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000411:0x2da:0x0]/migrate_dir failed: rc = -1 LustreError: 331622:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 6 previous similar messages LustreError: 6573:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 6573:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 7 previous similar messages LustreError: 6573:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000411:0x2da:0x0]/migrate_dir failed: rc = -1 LustreError: 6573:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 42 previous similar messages LustreError: 6573:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 6573:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 13 previous similar messages LustreError: 331622:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000411:0x2da:0x0]/migrate_dir failed: rc = -1 LustreError: 331622:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 28 previous similar messages Lustre: 331622:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0001: [0x2c0000411:0x2da:0x0]/migrate_dir is open, migrate only dentry LustreError: 331622:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 331622:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 17 previous similar messages Lustre: 6571:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0001: [0x240002b10:0xed:0x0]/file4 is open, migrate only dentry Lustre: 6571:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0003: [0x2c0000400:0xf3:0x0]/file4 is open, migrate only dentry Lustre: 6571:0:(mdd_dir.c:4792:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 6571:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000411:0x2da:0x0]/migrate_dir failed: rc = -1 LustreError: 6571:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 82 previous similar messages LustreError: 6571:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 6571:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 26 previous similar messages Lustre: 6571:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0003: [0x2c0000400:0x100:0x0]/file4 is open, migrate only dentry LustreError: 6573:0:(mdt_reint.c:2610:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000411:0x2da:0x0]/migrate_dir failed: rc = -1 LustreError: 6573:0:(mdt_reint.c:2610:mdt_reint_migrate()) Skipped 98 previous similar messages LustreError: 6571:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 6571:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 40 previous similar messages Lustre: 6571:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0001: [0x2c0000411:0x2da:0x0]/migrate_dir is open, migrate only dentry LustreError: 6561:0:(mdd_object.c:3963:mdd_close()) lustre-MDD0003: failed to get lu_attr of [0x2c0000411:0x5fd:0x0]: rc = -2 LustreError: 331622:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000414:0xb1b:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-05-02 08:07) |
| sanityn test 80b: Accessing directory during migration | LustreError: 360724:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 360724:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 1 PID: 360724 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1d90 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 369176:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 369176:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x7f6:0x0]/migrate_dir failed: rc = -1 LustreError: 360725:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 360725:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 360725:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x7f6:0x0]/migrate_dir failed: rc = -1 LustreError: 360725:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 2 previous similar messages LustreError: 360726:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 360726:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 10 previous similar messages LustreError: 360726:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x7f6:0x0]/migrate_dir failed: rc = -1 LustreError: 360726:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 11 previous similar messages Lustre: 369176:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0xd:0x0]/file4 is open, migrate only dentry LustreError: 360724:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 360724:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 8 previous similar messages LustreError: 360724:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x7f6:0x0]/migrate_dir failed: rc = -1 LustreError: 360724:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 8 previous similar messages LustreError: 369180:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2400032e0:0xe5:0x0]/source_file failed: rc = -2 LustreError: 369180:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 29 previous similar messages LustreError: 360725:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x85:0x0], maybe an upgraded file? (LU-3915) LustreError: 360724:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 360724:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 29 previous similar messages Lustre: 360725:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0001: [0x200016b61:0x7f6:0x0]/migrate_dir is open, migrate only dentry LustreError: 360725:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x7f6:0x0]/migrate_dir failed: rc = -1 LustreError: 360725:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 43 previous similar messages Lustre: 360725:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0x38:0x0]/file3 is open, migrate only dentry LustreError: 360726:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x115:0x0], maybe an upgraded file? (LU-3915) LustreError: 369180:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 369180:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 45 previous similar messages Lustre: 369176:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x200016b61:0x7f6:0x0]/migrate_dir is open, migrate only dentry Lustre: 369180:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x200016b61:0x7f6:0x0]/migrate_dir is open, migrate only dentry Lustre: 369180:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 360724:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x20a:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-04-24 15:10) |
| sanityn test 80b: Accessing directory during migration | LustreError: 339458:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 339458:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 0 PID: 339458 Comm: mdt_io00_001 Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1d90 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 339457:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 339457:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x894:0x0]/migrate_dir failed: rc = -1 Lustre: 339450:0:(out_handler.c:877:out_tx_end()) lustre-MDT0001-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-aPMHDTb9/BUILD/lustre-2.17.52_53_gb67c3e2/lustre/ptlrpc/../target/out_handler.c:559: rc = -2 LustreError: 339450:0:(out_handler.c:886:out_tx_end()) lustre-MDT0001-osd: undo for /tmp/rpmbuild-lustre-jenkins-aPMHDTb9/BUILD/lustre-2.17.52_53_gb67c3e2/lustre/ptlrpc/../target/out_handler.c:407: rc = -524 LustreError: 347176:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 347176:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 7 previous similar messages LustreError: 347176:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x894:0x0]/migrate_dir failed: rc = -1 LustreError: 347176:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 7 previous similar messages LustreError: 339457:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 339457:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 15 previous similar messages LustreError: 339457:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x894:0x0]/migrate_dir failed: rc = -1 LustreError: 339457:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 15 previous similar messages LustreError: 339457:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 339457:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 339457:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x894:0x0]/migrate_dir failed: rc = -1 LustreError: 339457:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 2 previous similar messages LustreError: 339459:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x78:0x0], maybe an upgraded file? (LU-3915) LustreError: 347176:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0xa1:0x0], maybe an upgraded file? (LU-3915) LustreError: 339459:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 339459:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 10 previous similar messages LustreError: 339459:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x894:0x0]/migrate_dir failed: rc = -1 LustreError: 339459:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 12 previous similar messages LustreError: 339458:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0xb4:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-04-23 08:52) |
| sanityn test 80b: Accessing directory during migration | LustreError: 369948:0:(osd_handler.c:4141:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 369948:0:(osd_handler.c:4141:osd_destroy()) LBUG CPU: 0 PID: 369948 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x136b/0x1d90 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 369950:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000bd0:0xf:0x0]/source_file failed: rc = -2 LustreError: 369933:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0xd:0x0], maybe an upgraded file? (LU-3915) LustreError: 369950:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 369950:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x829:0x0]/migrate_dir failed: rc = -1 LustreError: 379062:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 379062:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 379062:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x829:0x0]/migrate_dir failed: rc = -1 LustreError: 379062:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 4 previous similar messages Lustre: 369948:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0xb:0x0]/file4 is open, migrate only dentry LustreError: 379062:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 379062:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 14 previous similar messages LustreError: 379062:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x829:0x0]/migrate_dir failed: rc = -1 LustreError: 379062:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 15 previous similar messages LustreError: 379270:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 379270:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 11 previous similar messages LustreError: 379062:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x87:0x0], maybe an upgraded file? (LU-3915) LustreError: 379062:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x829:0x0]/migrate_dir failed: rc = -1 LustreError: 379062:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 21 previous similar messages LustreError: 379062:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 379062:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 17 previous similar messages Lustre: 369950:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x26:0x0]/file4 is open, migrate only dentry Lustre: 369948:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x2e:0x0]/file4 is open, migrate only dentry LustreError: 369934:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0xf9:0x0], maybe an upgraded file? (LU-3915) LustreError: 369948:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x124:0x0], maybe an upgraded file? (LU-3915) LustreError: 369948:0:(mdt_reint.c:2620:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2800013a0:0x1c7:0x0]/source_file failed: rc = -2 LustreError: 369948:0:(mdt_reint.c:2620:mdt_reint_migrate()) Skipped 36 previous similar messages LustreError: 369950:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 369950:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 27 previous similar messages LustreError: 369948:0:(osd_handler.c:4774:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x1b8:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-04-20 18:21) |
| sanityn test 80b: Accessing directory during migration | LustreError: 330928:0:(osd_handler.c:4147:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 330928:0:(osd_handler.c:4147:osd_destroy()) LBUG CPU: 0 PID: 330928 Comm: mdt_io00_000 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1379/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 330930:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 330930:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x49d:0x0]/migrate_dir failed: rc = -1 LustreError: 330929:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 330929:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 4 previous similar messages LustreError: 330929:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x49d:0x0]/migrate_dir failed: rc = -1 LustreError: 330929:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 4 previous similar messages LustreError: 359881:0:(osd_handler.c:4781:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x23:0x0], maybe an upgraded file? (LU-3915) LustreError: 359881:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2400032e0:0x4e:0x0]/source_file failed: rc = -2 LustreError: 359881:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 11 previous similar messages LustreError: 330928:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 330928:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 10 previous similar messages LustreError: 330929:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2400032e0:0x88:0x0]/target_file failed: rc = -2 LustreError: 330929:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 5 previous similar messages LustreError: 330930:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 330930:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 3 previous similar messages Lustre: 330929:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0xd:0x0]/file1 is open, migrate only dentry LustreError: 359881:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2800013a0:0xdb:0x0]/target_file failed: rc = -2 LustreError: 359881:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 16 previous similar messages LustreError: 330930:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 330930:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 11 previous similar messages LustreError: 330928:0:(osd_handler.c:4781:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x113:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-03-25 15:54) |
| sanityn test 80b: Accessing directory during migration | LustreError: 394367:0:(osd_handler.c:4147:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 394367:0:(osd_handler.c:4147:osd_destroy()) LBUG CPU: 0 PID: 394367 Comm: mdt_io00_003 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1379/0x1e00 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 362732:0:(osd_handler.c:4781:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x4bd:0x0], maybe an upgraded file? (LU-3915) LustreError: 362732:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2400032e0:0x1f:0x0]/source_file failed: rc = -2 LustreError: 362732:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 362734:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 362734:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 362734:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4df:0x0]/migrate_dir failed: rc = -1 LustreError: 362734:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 3 previous similar messages Lustre: 362732:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x200016b61:0x4df:0x0]/migrate_dir is open, migrate only dentry LustreError: 362733:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 362733:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 362733:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4df:0x0]/migrate_dir failed: rc = -1 LustreError: 362733:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 2 previous similar messages LustreError: 394367:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 394367:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 6 previous similar messages LustreError: 394367:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4df:0x0]/migrate_dir failed: rc = -1 LustreError: 394367:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 6 previous similar messages Lustre: 362734:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b61:0x4df:0x0]/migrate_dir is open, migrate only dentry LustreError: 394367:0:(osd_handler.c:4781:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x578:0x0], maybe an upgraded file? (LU-3915) LustreError: 362732:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 362732:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 29 previous similar messages LustreError: 362732:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4df:0x0]/migrate_dir failed: rc = -1 LustreError: 362732:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 32 previous similar messages Lustre: 362732:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x22:0x0]/file4 is open, migrate only dentry Lustre: 362732:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 394367:0:(osd_handler.c:4781:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x5cf:0x0], maybe an upgraded file? (LU-3915) Lustre: 363671:0:(out_handler.c:877:out_tx_end()) lustre-MDT0002-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-lKhrpqx6/BUILD/lustre-2.17.51_23_g0d753e9/lustre/ptlrpc/../target/out_handler.c:559: rc = -2 LustreError: 363671:0:(out_handler.c:886:out_tx_end()) lustre-MDT0002-osd: undo for /tmp/rpmbuild-lustre-jenkins-lKhrpqx6/BUILD/lustre-2.17.51_23_g0d753e9/lustre/ptlrpc/../target/out_handler.c:407: rc = -524 Lustre: 394367:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x200016b61:0x4df:0x0]/migrate_dir is open, migrate only dentry LustreError: 362734:0:(osd_handler.c:4781:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x63d:0x0], maybe an upgraded file? (LU-3915) LustreError: 394369:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 394369:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 41 previous similar messages LustreError: 394369:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4df:0x0]/migrate_dir failed: rc = -1 LustreError: 394369:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 45 previous similar messages LustreError: 394367:0:(osd_handler.c:4781:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x6bb:0x0], maybe an upgraded file? (LU-3915) Lustre: 362724:0:(out_handler.c:877:out_tx_end()) lustre-MDT0000-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-lKhrpqx6/BUILD/lustre-2.17.51_23_g0d753e9/lustre/ptlrpc/../target/out_handler.c:559: rc = -2 LustreError: 362724:0:(out_handler.c:886:out_tx_end()) lustre-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-lKhrpqx6/BUILD/lustre-2.17.51_23_g0d753e9/lustre/ptlrpc/../target/out_handler.c:407: rc = -524 LustreError: 362724:0:(out_handler.c:886:out_tx_end()) Skipped 2 previous similar messages LustreError: 362732:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 362732:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 82 previous similar messages LustreError: 362732:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4df:0x0]/migrate_dir failed: rc = -1 LustreError: 362732:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 89 previous similar messages LustreError: 362734:0:(osd_handler.c:4781:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x806:0x0], maybe an upgraded file? (LU-3915) LustreError: 362734:0:(osd_handler.c:4781:osd_ref_del()) Skipped 1 previous similar message Lustre: 394365:0:(out_handler.c:877:out_tx_end()) lustre-MDT0002-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-lKhrpqx6/BUILD/lustre-2.17.51_23_g0d753e9/lustre/ptlrpc/../target/out_handler.c:559: rc = -2 LustreError: 394365:0:(out_handler.c:886:out_tx_end()) lustre-MDT0002-osd: undo for /tmp/rpmbuild-lustre-jenkins-lKhrpqx6/BUILD/lustre-2.17.51_23_g0d753e9/lustre/ptlrpc/../target/out_handler.c:407: rc = -524 LustreError: 394365:0:(out_handler.c:886:out_tx_end()) Skipped 2 previous similar messages | Link to test (2026-03-24 07:47) |
| sanityn test 80b: Accessing directory during migration | LustreError: 376160:0:(osd_handler.c:4172:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 376160:0:(osd_handler.c:4172:osd_destroy()) LBUG CPU: 1 PID: 376160 Comm: mdt_io00_003 Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Lustre: 376160:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0001: [0x2400032e0:0x13:0x0]/file3 is open, migrate only dentry LustreError: 367625:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 367625:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x419:0x0]/migrate_dir failed: rc = -1 LustreError: 367625:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 367625:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x419:0x0]/migrate_dir failed: rc = -1 LustreError: 367624:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 367624:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 367624:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x419:0x0]/migrate_dir failed: rc = -1 LustreError: 367624:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 2 previous similar messages LustreError: 376160:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 376160:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 376160:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x419:0x0]/migrate_dir failed: rc = -1 LustreError: 376160:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 3 previous similar messages Lustre: 376160:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0001: [0x200016b61:0x419:0x0]/migrate_dir is open, migrate only dentry LustreError: 376368:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x555:0x0]/source_file failed: rc = -2 LustreError: 376368:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 4 previous similar messages LustreError: 376368:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 376368:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 4 previous similar messages LustreError: 367624:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x65f:0x0]/source_file failed: rc = -2 LustreError: 367624:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 14 previous similar messages LustreError: 376160:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 376160:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 11 previous similar messages Lustre: 367624:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0x5c:0x0]/file3 is open, migrate only dentry LustreError: 376160:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x213:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-03-23 12:17) |
| sanityn test 80b: Accessing directory during migration | LustreError: 336781:0:(osd_handler.c:4147:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 336781:0:(osd_handler.c:4147:osd_destroy()) LBUG CPU: 1 PID: 336781 Comm: mdt_io00_000 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1379/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 336781:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000bd0:0x9:0x0]/source_file failed: rc = -2 LustreError: 336782:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 336783:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 336783:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4fa:0x0]/migrate_dir failed: rc = -1 LustreError: 336783:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 365595:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 365595:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 365595:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4fa:0x0]/migrate_dir failed: rc = -1 LustreError: 365595:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 6 previous similar messages Lustre: 336783:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0xa:0x0]/file3 is open, migrate only dentry LustreError: 336781:0:(osd_handler.c:4765:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x510:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-03-11 03:11) |
| sanityn test 80b: Accessing directory during migration | LustreError: 331010:0:(osd_handler.c:4147:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 331010:0:(osd_handler.c:4147:osd_destroy()) LBUG CPU: 0 PID: 331010 Comm: mdt_io00_002 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1379/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 331009:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 331009:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x417:0x0]/migrate_dir failed: rc = -1 LustreError: 331009:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 331009:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 7 previous similar messages LustreError: 331009:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x417:0x0]/migrate_dir failed: rc = -1 LustreError: 331009:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 8 previous similar messages LustreError: 330996:0:(osd_handler.c:4765:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x37:0x0], maybe an upgraded file? (LU-3915) LustreError: 331010:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2800013a0:0x7f:0x0]/source_file failed: rc = -2 LustreError: 331010:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 331010:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 331010:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 331010:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x417:0x0]/migrate_dir failed: rc = -1 LustreError: 331010:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 5 previous similar messages LustreError: 331008:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 331008:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 5 previous similar messages Lustre: 359810:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b61:0x417:0x0]/migrate_dir is open, migrate only dentry LustreError: 359811:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x417:0x0]/migrate_dir failed: rc = -1 LustreError: 359811:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 21 previous similar messages LustreError: 359810:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 359810:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 20 previous similar messages LustreError: 331010:0:(osd_handler.c:4765:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0xe6:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-03-08 03:48) |
| sanityn test 80b: Accessing directory during migration | LustreError: 355674:0:(osd_handler.c:4147:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 355674:0:(osd_handler.c:4147:osd_destroy()) LBUG CPU: 0 PID: 355674 Comm: mdt_io00_001 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1379/0x1e00 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 355675:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 355675:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4b1:0x0]/migrate_dir failed: rc = -1 LustreError: 355675:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4c5:0x0]/source_file failed: rc = -2 LustreError: 355675:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 2 previous similar messages LustreError: 386913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 386913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 355675:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 355675:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 355675:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4b1:0x0]/migrate_dir failed: rc = -1 LustreError: 355675:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 6 previous similar messages LustreError: 386913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 386913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 10 previous similar messages LustreError: 386913:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4b1:0x0]/migrate_dir failed: rc = -1 LustreError: 386913:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 10 previous similar messages LustreError: 355674:0:(osd_handler.c:4765:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x59:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-03-06 07:40) |
| sanityn test 80b: Accessing directory during migration | LustreError: 114417:0:(osd_handler.c:4169:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 114417:0:(osd_handler.c:4169:osd_destroy()) LBUG CPU: 1 PID: 114417 Comm: mdt_io00_003 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1e1/0x4b0 [lod] lod_destroy+0x266/0xa10 [lod] ? lod_sub_ref_del+0x1e1/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xf26/0x1500 [mdd] ? lprocfs_counter_add+0x109/0x170 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x132e/0x1d10 [mdt] mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x14a/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2cd/0xda0 [ptlrpc] ptlrpc_main+0xa7b/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | LustreError: 114417:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 114417:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000412:0x2d2:0x0]/migrate_dir failed: rc = -1 LustreError: 114417:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 114417:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 12 previous similar messages LustreError: 114417:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000412:0x2d2:0x0]/migrate_dir failed: rc = -1 LustreError: 114417:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 15 previous similar messages LustreError: 4831:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000412:0x2d2:0x0]/migrate_dir failed: rc = -114 LustreError: 4831:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 22 previous similar messages LustreError: 4831:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 4831:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 10 previous similar messages LustreError: 4829:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000412:0x2d2:0x0]/migrate_dir failed: rc = -1 LustreError: 4829:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 35 previous similar messages LustreError: 4829:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 4829:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 10 previous similar messages Autotest: Test running for 190 minutes (lustre-b_es-reviews_review-dne-part-5_27337.91) Lustre: 4829:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0x83:0x0]/file3 is open, migrate only dentry LustreError: 4829:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000412:0x2d2:0x0]/migrate_dir failed: rc = -1 LustreError: 4829:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 66 previous similar messages LustreError: 4831:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 4831:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 49 previous similar messages Lustre: 4829:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x200016390:0x9c:0x0]/file4 is open, migrate only dentry Lustre: 4831:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0002: [0x2c0000412:0x2d2:0x0]/migrate_dir is open, migrate only dentry LustreError: 4831:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000bd4:0x449:0x0]/file2 failed: rc = -114 LustreError: 4831:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 167 previous similar messages LustreError: 114417:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 114417:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 66 previous similar messages Lustre: 4831:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x2c0000412:0x2d2:0x0]/migrate_dir is open, migrate only dentry Lustre: 4828:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0002: [0x2c0000412:0x2d2:0x0]/migrate_dir is open, migrate only dentry Lustre: 4828:0:(mdd_dir.c:4792:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 4828:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000412:0x2d2:0x0]/migrate_dir failed: rc = -1 LustreError: 4828:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 284 previous similar messages LustreError: 4828:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 4828:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 140 previous similar messages LustreError: 114417:0:(osd_handler.c:4782:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd6:0x16c0:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-02-27 19:27) |
| sanityn test 80b: Accessing directory during migration | LustreError: 357155:0:(osd_handler.c:4172:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 357155:0:(osd_handler.c:4172:osd_destroy()) LBUG CPU: 1 PID: 357155 Comm: mdt_io00_003 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 357155:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 357155:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4de:0x0]/migrate_dir failed: rc = -1 LustreError: 327911:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 327911:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 327911:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4de:0x0]/migrate_dir failed: rc = -1 LustreError: 327911:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 6 previous similar messages LustreError: 327911:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 327911:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 327911:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4de:0x0]/migrate_dir failed: rc = -1 LustreError: 327911:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 5 previous similar messages LustreError: 357155:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x4e2:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-02-26 14:45) |
| sanityn test 80b: Accessing directory during migration | LustreError: 820019:0:(osd_handler.c:4224:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 820019:0:(osd_handler.c:4224:osd_destroy()) LBUG CPU: 0 PID: 820019 Comm: mdt_io00_001 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x266/0xa10 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xf26/0x1500 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x109/0x170 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x132b/0x1d10 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2ca/0xda0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0xa7b/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 820020:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0002b14:0x2c8:0x0]/migrate_dir failed: rc = -114 LustreError: 820020:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 573 previous similar messages LustreError: 820020:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 880321:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 880321:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 11 previous similar messages Lustre: 820020:0:(osd_handler.c:2188:osd_trans_start()) lustre-MDT0002: credits 2740 > trans_max 2528 Lustre: 820020:0:(osd_handler.c:2080:osd_trans_dump_creds()) create: 3/12/0, destroy: 2/8/0 Lustre: 820020:0:(osd_handler.c:2080:osd_trans_dump_creds()) Skipped 9 previous similar messages Lustre: 820020:0:(osd_handler.c:2087:osd_trans_dump_creds()) attr_set: 2/2/0, xattr_set: 12/2423/0 Lustre: 820020:0:(osd_handler.c:2087:osd_trans_dump_creds()) Skipped 9 previous similar messages Lustre: 820020:0:(osd_handler.c:2094:osd_trans_dump_creds()) write: 5/58/0, punch: 0/0/0, quota 0/0/0 Lustre: 820020:0:(osd_handler.c:2094:osd_trans_dump_creds()) Skipped 9 previous similar messages Lustre: 820020:0:(osd_handler.c:2104:osd_trans_dump_creds()) insert: 12/215/0, delete: 5/11/0 Lustre: 820020:0:(osd_handler.c:2104:osd_trans_dump_creds()) Skipped 9 previous similar messages Lustre: 820020:0:(osd_handler.c:2111:osd_trans_dump_creds()) ref_add: 5/5/0, ref_del: 5/5/0 Lustre: 820020:0:(osd_handler.c:2111:osd_trans_dump_creds()) Skipped 9 previous similar messages CPU: 0 PID: 820020 Comm: mdt_io00_002 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 osd_trans_start+0x676/0x6d0 [osd_ldiskfs] top_trans_start+0x196/0x4d0 [ptlrpc] mdd_migrate_object+0x85a/0x1500 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x109/0x170 [obdclass] ? srso_alias_return_thunk+0x5/0xfbef5 ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x132b/0x1d10 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2ca/0xda0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0xa7b/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> LustreError: 880321:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 880321:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 23 previous similar messages LustreError: 880321:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2800032e4:0x2c6:0x0]/source_file failed: rc = -2 LustreError: 880321:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 103 previous similar messages LustreError: 820020:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 820020:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 9 previous similar messages LustreError: 880321:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 880321:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 21 previous similar messages Lustre: 880321:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x2c0002b14:0x2c8:0x0]/migrate_dir is open, migrate only dentry LustreError: 820018:0:(mdt_reint.c:2597:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0002b14:0x2c8:0x0]/migrate_dir failed: rc = -1 LustreError: 820018:0:(mdt_reint.c:2597:mdt_reint_migrate()) Skipped 128 previous similar messages Lustre: 820018:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x2c0002b14:0x2c8:0x0]/migrate_dir is open, migrate only dentry Lustre: 820018:0:(mdd_dir.c:4792:mdd_migrate_object()) Skipped 1 previous similar message Lustre: 820019:0:(mdd_dir.c:4792:mdd_migrate_object()) lustre-MDD0000: [0x2c0002b14:0x2c8:0x0]/migrate_dir is open, migrate only dentry Lustre: 820019:0:(mdd_dir.c:4792:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 820018:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 820018:0:(mdd_dir.c:4709:mdd_migrate_cmd_check()) Skipped 49 previous similar messages LustreError: 820019:0:(osd_handler.c:4842:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800032e6:0x15d1:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-02-23 22:18) |
| sanityn test 80b: Accessing directory during migration | LustreError: 364056:0:(osd_handler.c:4172:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 364056:0:(osd_handler.c:4172:osd_destroy()) LBUG CPU: 1 PID: 364056 Comm: mdt_io00_004 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 335103:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 335103:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 335103:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 335103:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 6 previous similar messages LustreError: 335103:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 335103:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 7 previous similar messages LustreError: 335103:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 335103:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 13 previous similar messages LustreError: 335103:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 335103:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 13 previous similar messages LustreError: 335102:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 335102:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 25 previous similar messages LustreError: 335102:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 335102:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 25 previous similar messages Lustre: 335102:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b61:0x42b:0x0]/migrate_dir is open, migrate only dentry LustreError: 364050:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 364050:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 19 previous similar messages LustreError: 364050:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 364050:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 22 previous similar messages LustreError: 364050:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 364050:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 46 previous similar messages LustreError: 364050:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 364050:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 50 previous similar messages LustreError: 364050:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x121:0x0], maybe an upgraded file? (LU-3915) Lustre: 364050:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0x39:0x0]/file4 is open, migrate only dentry Lustre: 364056:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b61:0x42b:0x0]/migrate_dir is open, migrate only dentry LustreError: 364050:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x207:0x0], maybe an upgraded file? (LU-3915) LustreError: 335102:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 335102:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 76 previous similar messages LustreError: 335102:0:(mdt_reint.c:2619:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 335102:0:(mdt_reint.c:2619:mdt_reint_migrate()) Skipped 90 previous similar messages LustreError: 335102:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x233:0x0], maybe an upgraded file? (LU-3915) Lustre: 336711:0:(out_handler.c:877:out_tx_end()) lustre-MDT0000-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-b0OO5cLa/BUILD/lustre-2.17.50_152_g5102495/lustre/ptlrpc/../../lustre/target/out_handler.c:559: rc = -2 LustreError: 336711:0:(out_handler.c:886:out_tx_end()) lustre-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-b0OO5cLa/BUILD/lustre-2.17.50_152_g5102495/lustre/ptlrpc/../../lustre/target/out_handler.c:407: rc = -524 LustreError: 335102:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x298:0x0], maybe an upgraded file? (LU-3915) LustreError: 335102:0:(osd_handler.c:4790:osd_ref_del()) Skipped 1 previous similar message LustreError: 335092:0:(mdd_object.c:3928:mdd_close()) lustre-MDD0000: failed to get lu_attr of [0x200016b61:0x93d:0x0]: rc = -2 LustreError: 364056:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a3:0x350:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-02-17 20:23) |
| sanityn test 80b: Accessing directory during migration | LustreError: 359948:0:(osd_handler.c:4172:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 359948:0:(osd_handler.c:4172:osd_destroy()) LBUG CPU: 1 PID: 359948 Comm: mdt_io00_000 Kdump: loaded Tainted: G OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 359950:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 359950:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x507:0x0]/migrate_dir failed: rc = -1 LustreError: 359950:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 359950:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 359950:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x507:0x0]/migrate_dir failed: rc = -1 LustreError: 359950:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 359949:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 359949:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 4 previous similar messages LustreError: 359949:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x507:0x0]/migrate_dir failed: rc = -1 LustreError: 359949:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 4 previous similar messages LustreError: 359950:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2400032e0:0xb0:0x0]/target_file failed: rc = -2 LustreError: 359950:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 8 previous similar messages LustreError: 359950:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 359950:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 7 previous similar messages Lustre: 359949:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0001: [0x200016b61:0x507:0x0]/migrate_dir is open, migrate only dentry Lustre: 359949:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x200016b61:0x507:0x0]/migrate_dir is open, migrate only dentry Lustre: 359950:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x200016b61:0x507:0x0]/migrate_dir is open, migrate only dentry LustreError: 359950:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x82:0x0], maybe an upgraded file? (LU-3915) LustreError: 359948:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000bd0:0x112:0x0]/source_file failed: rc = -2 LustreError: 359948:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 27 previous similar messages LustreError: 359949:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 359949:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 23 previous similar messages Lustre: 359949:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0x26:0x0]/file3 is open, migrate only dentry Lustre: 359949:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 359950:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x10f:0x0], maybe an upgraded file? (LU-3915) LustreError: 359950:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x507:0x0]/migrate_dir failed: rc = -1 LustreError: 359950:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 39 previous similar messages LustreError: 359949:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 359949:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 38 previous similar messages Autotest: Test running for 225 minutes (lustre-reviews_review-dne-part-5_121602.55) Lustre: 359948:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x54:0x0]/file3 is open, migrate only dentry LustreError: 359949:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2800013a0:0x3e9:0x0]/source_file failed: rc = -2 LustreError: 359949:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 92 previous similar messages LustreError: 359948:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 359948:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 75 previous similar messages LustreError: 359948:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x28c:0x0], maybe an upgraded file? (LU-3915) Lustre: 359948:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x79:0x0]/file3 is open, migrate only dentry LustreError: 359948:0:(osd_handler.c:4790:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd4:0x2e8:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-02-12 14:32) |
| sanityn test 80b: Accessing directory during migration | LustreError: 328993:0:(osd_handler.c:4169:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 328993:0:(osd_handler.c:4169:osd_destroy()) LBUG CPU: 1 PID: 328993 Comm: mdt_io00_001 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 328994:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 328994:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4b7:0x0]/migrate_dir failed: rc = -1 LustreError: 328994:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 328994:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4b7:0x0]/migrate_dir failed: rc = -1 LustreError: 358163:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 358163:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 358163:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4b7:0x0]/migrate_dir failed: rc = -1 LustreError: 358163:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 328994:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 328994:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 328994:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4b7:0x0]/migrate_dir failed: rc = -1 LustreError: 328994:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 6 previous similar messages Lustre: 358163:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x200016b61:0x4b7:0x0]/migrate_dir is open, migrate only dentry LustreError: 358164:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 358164:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 6 previous similar messages LustreError: 358164:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4b7:0x0]/migrate_dir failed: rc = -1 LustreError: 358164:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 10 previous similar messages LustreError: 328994:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 328994:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 38 previous similar messages LustreError: 328994:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4b7:0x0]/migrate_dir failed: rc = -1 LustreError: 328994:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 42 previous similar messages Lustre: 328994:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b61:0x4b7:0x0]/migrate_dir is open, migrate only dentry Lustre: 328994:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 355994:0:(mdd_object.c:3928:mdd_close()) lustre-MDD0000: failed to get lu_attr of [0x200016b61:0x7fe:0x0]: rc = -2 LustreError: 328993:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 328993:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 37 previous similar messages LustreError: 328993:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4b7:0x0]/migrate_dir failed: rc = -1 LustreError: 328993:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 45 previous similar messages Lustre: 328993:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x87:0x0]/file4 is open, migrate only dentry LustreError: 328993:0:(osd_handler.c:4787:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x7f3:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-02-08 11:29) |
| sanityn test 80b: Accessing directory during migration | LustreError: 356094:0:(osd_handler.c:4174:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 356094:0:(osd_handler.c:4174:osd_destroy()) LBUG CPU: 0 PID: 356094 Comm: mdt_io00_004 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 356087:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 356087:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x494:0x0]/migrate_dir failed: rc = -1 LustreError: 326841:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 326841:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x494:0x0]/migrate_dir failed: rc = -1 LustreError: 326830:0:(mdd_object.c:3928:mdd_close()) lustre-MDD0000: failed to get lu_attr of [0x200016b61:0x525:0x0]: rc = -2 LustreError: 326840:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 326840:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 7 previous similar messages LustreError: 326840:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x494:0x0]/migrate_dir failed: rc = -1 LustreError: 326840:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 8 previous similar messages LustreError: 331554:0:(mdd_object.c:3928:mdd_close()) lustre-MDD0000: failed to get lu_attr of [0x200016b61:0x57c:0x0]: rc = -2 Lustre: 326840:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x200016b61:0x494:0x0]/migrate_dir is open, migrate only dentry LustreError: 356087:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 356087:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 356087:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x494:0x0]/migrate_dir failed: rc = -1 LustreError: 356087:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 5 previous similar messages LustreError: 326840:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 326840:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 7 previous similar messages LustreError: 326840:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x494:0x0]/migrate_dir failed: rc = -1 LustreError: 326840:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 8 previous similar messages LustreError: 326840:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 326840:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 19 previous similar messages LustreError: 326840:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x494:0x0]/migrate_dir failed: rc = -1 LustreError: 326840:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 20 previous similar messages Lustre: 326840:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x200016b61:0x494:0x0]/migrate_dir is open, migrate only dentry Lustre: 326840:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 326830:0:(mdd_object.c:3928:mdd_close()) lustre-MDD0000: failed to get lu_attr of [0x200016b61:0x77a:0x0]: rc = -2 Lustre: 326840:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x6a:0x0]/file4 is open, migrate only dentry Lustre: 326840:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 1 previous similar message Lustre: 356094:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x87:0x0]/file3 is open, migrate only dentry Lustre: 356094:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 356094:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 356094:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 32 previous similar messages LustreError: 356094:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x494:0x0]/migrate_dir failed: rc = -1 LustreError: 356094:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 40 previous similar messages LustreError: 356094:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x7b9:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-01-31 13:41) |
| sanityn test 80b: Accessing directory during migration | LustreError: 341144:0:(osd_handler.c:4174:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 341144:0:(osd_handler.c:4174:osd_destroy()) LBUG CPU: 1 PID: 341144 Comm: mdt_io00_003 Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 332926:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332926:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 341144:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x450:0x0]/target_file failed: rc = -2 LustreError: 341144:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 341144:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 341144:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 1 previous similar message LustreError: 332926:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2800013a0:0x49:0x0]/target_file failed: rc = -2 LustreError: 332926:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 10 previous similar messages LustreError: 332926:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332926:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 8 previous similar messages LustreError: 332926:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332926:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 16 previous similar messages LustreError: 332926:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 332926:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 17 previous similar messages LustreError: 332927:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332927:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 28 previous similar messages LustreError: 332927:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 332927:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 29 previous similar messages LustreError: 332927:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0xe7:0x0], maybe an upgraded file? (LU-3915) Lustre: 332917:0:(out_handler.c:877:out_tx_end()) lustre-MDT0003-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-jvnTOacG/BUILD/lustre-2.17.50_72_g378a63d/lustre/ptlrpc/../../lustre/target/out_handler.c:559: rc = -2 LustreError: 332917:0:(out_handler.c:886:out_tx_end()) lustre-MDT0003-osd: undo for /tmp/rpmbuild-lustre-jenkins-jvnTOacG/BUILD/lustre-2.17.50_72_g378a63d/lustre/ptlrpc/../../lustre/target/out_handler.c:407: rc = -524 Lustre: 332927:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0x27:0x0]/file4 is open, migrate only dentry LustreError: 341146:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x118:0x0], maybe an upgraded file? (LU-3915) Lustre: 332918:0:(out_handler.c:877:out_tx_end()) lustre-MDT0003-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-jvnTOacG/BUILD/lustre-2.17.50_72_g378a63d/lustre/ptlrpc/../../lustre/target/out_handler.c:559: rc = -2 LustreError: 332918:0:(out_handler.c:886:out_tx_end()) lustre-MDT0003-osd: undo for /tmp/rpmbuild-lustre-jenkins-jvnTOacG/BUILD/lustre-2.17.50_72_g378a63d/lustre/ptlrpc/../../lustre/target/out_handler.c:407: rc = -524 LustreError: 332918:0:(out_handler.c:886:out_tx_end()) Skipped 2 previous similar messages LustreError: 341146:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 341146:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 45 previous similar messages LustreError: 341146:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x42b:0x0]/migrate_dir failed: rc = -1 LustreError: 341146:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 50 previous similar messages Lustre: 332926:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0003: [0x200016b61:0x42b:0x0]/migrate_dir is open, migrate only dentry LustreError: 332927:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2400032e0:0x3a6:0x0]/target_file failed: rc = -2 LustreError: 332927:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 75 previous similar messages LustreError: 332927:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332927:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 70 previous similar messages LustreError: 332911:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x2e8:0x0], maybe an upgraded file? (LU-3915) LustreError: 332911:0:(osd_handler.c:4792:osd_ref_del()) Skipped 1 previous similar message LustreError: 341144:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x2400032e5:0x33a:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-01-28 12:04) |
| sanityn test 80b: Accessing directory during migration | LustreError: 385999:0:(osd_handler.c:4174:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 385999:0:(osd_handler.c:4174:osd_destroy()) LBUG CPU: 1 PID: 385999 Comm: mdt_io00_004 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-570.62.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102739/0x10273d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Lustre: 354363:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0x3:0x0]/file3 is open, migrate only dentry LustreError: 385994:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 385994:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4f3:0x0]/migrate_dir failed: rc = -1 Lustre: 354364:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0x8:0x0]/file4 is open, migrate only dentry LustreError: 354364:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 354364:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 11 previous similar messages LustreError: 354364:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4f3:0x0]/migrate_dir failed: rc = -1 LustreError: 354364:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 11 previous similar messages Lustre: 385994:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b61:0x4f3:0x0]/migrate_dir is open, migrate only dentry Lustre: 385994:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 2 previous similar messages LustreError: 354363:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x534:0x0], maybe an upgraded file? (LU-3915) Lustre: 354355:0:(out_handler.c:877:out_tx_end()) lustre-MDT0002-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-oghYb4ZV/BUILD/lustre-2.17.50_62_g56ee267/lustre/ptlrpc/../../lustre/target/out_handler.c:559: rc = -2 LustreError: 354355:0:(out_handler.c:886:out_tx_end()) lustre-MDT0002-osd: undo for /tmp/rpmbuild-lustre-jenkins-oghYb4ZV/BUILD/lustre-2.17.50_62_g56ee267/lustre/ptlrpc/../../lustre/target/out_handler.c:407: rc = -524 LustreError: 354363:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2800013a0:0xcb:0x0]/source_file failed: rc = -2 LustreError: 354363:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 12 previous similar messages LustreError: 354364:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 354364:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 11 previous similar messages LustreError: 354364:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 354364:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 4 previous similar messages LustreError: 354364:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4f3:0x0]/migrate_dir failed: rc = -1 LustreError: 354364:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 5 previous similar messages Lustre: 354363:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x2b:0x0]/file4 is open, migrate only dentry LustreError: 354363:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x5b6:0x0], maybe an upgraded file? (LU-3915) LustreError: 354363:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 354363:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 354363:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4f3:0x0]/migrate_dir failed: rc = -1 LustreError: 354363:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 5 previous similar messages Lustre: 354364:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0x4a:0x0]/file4 is open, migrate only dentry Lustre: 354364:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 354364:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 354364:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 31 previous similar messages LustreError: 354364:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4f3:0x0]/migrate_dir failed: rc = -1 LustreError: 354364:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 32 previous similar messages LustreError: 385998:0:(mdd_object.c:3928:mdd_close()) lustre-MDD0000: failed to get lu_attr of [0x200016b61:0x8ab:0x0]: rc = -2 Lustre: 385999:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0x8b:0x0]/file4 is open, migrate only dentry Lustre: 385999:0:(mdd_dir.c:4873:mdd_migrate_object()) Skipped 5 previous similar messages LustreError: 354363:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 354363:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 89 previous similar messages LustreError: 354363:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x4f3:0x0]/migrate_dir failed: rc = -1 LustreError: 354363:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 90 previous similar messages LustreError: 354362:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x80b:0x0], maybe an upgraded file? (LU-3915) LustreError: 354362:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x8c9:0x0], maybe an upgraded file? (LU-3915) LustreError: 354353:0:(mdd_object.c:3928:mdd_close()) lustre-MDD0000: failed to get lu_attr of [0x200016b61:0xbb1:0x0]: rc = -2 LustreError: 354363:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200016b66:0x922:0x0], maybe an upgraded file? (LU-3915) | Link to test (2026-01-19 18:04) |
| sanityn test 80b: Accessing directory during migration | LustreError: 327912:0:(osd_handler.c:4174:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 327912:0:(osd_handler.c:4174:osd_destroy()) LBUG CPU: 1 PID: 327912 Comm: mdt_io00_001 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | LustreError: 327913:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2400032e0:0x1f:0x0]/link_file failed: rc = -2 LustreError: 327913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 357055:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x4b2:0x0]/link_file failed: rc = -2 LustreError: 357055:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 6 previous similar messages LustreError: 327913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 327913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 327912:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2800013a0:0x4d:0x0]/link_file failed: rc = -2 LustreError: 327912:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 327912:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 357055:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 357055:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 16 previous similar messages LustreError: 357055:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x48f:0x0]/migrate_dir failed: rc = -1 LustreError: 357055:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 18 previous similar messages Lustre: 327913:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0002: [0x2800013a1:0x21:0x0]/file4 is open, migrate only dentry LustreError: 357055:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 357055:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 357055:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200016b61:0x48f:0x0]/migrate_dir failed: rc = -1 LustreError: 357055:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 3 previous similar messages Lustre: 327913:0:(mdd_dir.c:4873:mdd_migrate_object()) lustre-MDD0000: [0x200016b60:0x33:0x0]/file3 is open, migrate only dentry LustreError: 327913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 327913:0:(mdd_dir.c:4789:mdd_migrate_cmd_check()) Skipped 37 previous similar messages LustreError: 327913:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200016b61:0x48f:0x0]/migrate_dir failed: rc = -1 LustreError: 327913:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 44 previous similar messages LustreError: 327912:0:(osd_handler.c:4792:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x2800013a2:0x26f:0x0], maybe an upgraded file? (LU-3915) | Link to test (2025-12-19 06:34) |
| sanityn test 80b: Accessing directory during migration | LustreError: 122682:0:(osd_handler.c:4044:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 122682:0:(osd_handler.c:4044:osd_destroy()) LBUG CPU: 0 PID: 122682 Comm: mdt_io00_003 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x266/0xa10 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xf26/0x1500 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x109/0x170 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x132b/0x1d10 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4e4/0x850 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2ca/0xda0 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0xa7b/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Lustre: 5446:0:(mdd_dir.c:4755:mdd_migrate_object()) lustre-MDD0000: [0x2000153f5:0xbb9:0x0]/file3 is open, migrate only dentry LustreError: 122682:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 122682:0:(mdt_reint.c:2581:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000412:0x2d4:0x0]/migrate_dir failed: rc = -1 LustreError: 5446:0:(mdt_reint.c:2581:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2000153f5:0xbec:0x0]/target_file failed: rc = -2 LustreError: 5446:0:(mdt_reint.c:2581:mdt_reint_migrate()) Skipped 17 previous similar messages LustreError: 5446:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 5446:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 381178:0:(mdt_reint.c:2581:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000412:0x326:0x0]/source_file failed: rc = -2 LustreError: 381178:0:(mdt_reint.c:2581:mdt_reint_migrate()) Skipped 30 previous similar messages LustreError: 381178:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 381178:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) Skipped 15 previous similar messages LustreError: 381178:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 381178:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) Skipped 6 previous similar messages LustreError: 381178:0:(mdt_reint.c:2581:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000412:0x2d4:0x0]/migrate_dir failed: rc = -1 LustreError: 381178:0:(mdt_reint.c:2581:mdt_reint_migrate()) Skipped 7 previous similar messages LustreError: 381178:0:(mdt_reint.c:2581:mdt_reint_migrate()) lustre-MDT0002: migrate [0x240002b13:0xf326:0x0]/source_file failed: rc = -2 LustreError: 381178:0:(mdt_reint.c:2581:mdt_reint_migrate()) Skipped 20 previous similar messages LustreError: 5446:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 5446:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) Skipped 15 previous similar messages Lustre: 381178:0:(mdd_dir.c:4755:mdd_migrate_object()) lustre-MDD0002: [0x280000bd3:0x44:0x0]/file4 is open, migrate only dentry Lustre: 381178:0:(mdd_dir.c:4755:mdd_migrate_object()) Skipped 1 previous similar message LustreError: 122682:0:(mdt_reint.c:2581:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000412:0x2d4:0x0]/migrate_dir failed: rc = -1 LustreError: 122682:0:(mdt_reint.c:2581:mdt_reint_migrate()) Skipped 77 previous similar messages LustreError: 381178:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 381178:0:(mdd_dir.c:4672:mdd_migrate_cmd_check()) Skipped 30 previous similar messages Lustre: 5446:0:(mdd_dir.c:4755:mdd_migrate_object()) lustre-MDD0002: [0x2c0000412:0x2d4:0x0]/migrate_dir is open, migrate only dentry LustreError: 122682:0:(osd_handler.c:4657:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd7:0x165c:0x0], maybe an upgraded file? (LU-3915) | Link to test (2025-11-28 14:02) |
| sanityn test 80b: Accessing directory during migration | LustreError: 340572:0:(osd_handler.c:4158:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 340572:0:(osd_handler.c:4158:osd_destroy()) LBUG CPU: 1 PID: 340572 Comm: mdt_io00_004 Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-2.el9_5.1 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x4b8/0x630 [osd_ldiskfs] lod_sub_destroy+0x1de/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? srso_alias_return_thunk+0x5/0xfbef5 ? lod_sub_ref_del+0x1de/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xef5/0x1170 [mdd] ? srso_alias_return_thunk+0x5/0xfbef5 ? lprocfs_counter_add+0x117/0x180 [obdclass] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1381/0x1e00 [mdt] ? __entry_text_end+0x102749/0x10274d mdt_reint_rec+0x119/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x147/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e5/0xd80 [ptlrpc] ? srso_alias_return_thunk+0x5/0xfbef5 ptlrpc_main+0x9bf/0xea0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xdd/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x29/0x50 </TASK> | Lustre: 332378:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0001: [0x2400032e0:0x13:0x0]/file3 is open, migrate only dentry LustreError: 332378:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000bd0:0x9:0x0]/source_file failed: rc = -2 LustreError: 332378:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332378:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x51e:0x0]/migrate_dir failed: rc = -1 LustreError: 332378:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 6 previous similar messages LustreError: 332378:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332378:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 6 previous similar messages LustreError: 332377:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332377:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 332377:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x51e:0x0]/migrate_dir failed: rc = -1 LustreError: 332377:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 5 previous similar messages LustreError: 340569:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 340569:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 13 previous similar messages LustreError: 340569:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x200016b61:0x51e:0x0]/migrate_dir failed: rc = -1 LustreError: 340569:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 13 previous similar messages Lustre: 332377:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0001: [0x2400032e1:0x25:0x0]/file4 is open, migrate only dentry Lustre: 332377:0:(mdd_dir.c:4823:mdd_migrate_object()) Skipped 2 previous similar messages LustreError: 332377:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332377:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 29 previous similar messages LustreError: 332377:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x51e:0x0]/migrate_dir failed: rc = -1 LustreError: 332377:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 29 previous similar messages LustreError: 332378:0:(osd_handler.c:4776:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd5:0xe9:0x0], maybe an upgraded file? (LU-3915) LustreError: 340569:0:(osd_handler.c:4776:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd5:0x125:0x0], maybe an upgraded file? (LU-3915) Lustre: 340569:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0003: [0x2c0000bd1:0x44:0x0]/file4 is open, migrate only dentry LustreError: 340569:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 340569:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 58 previous similar messages LustreError: 340569:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x51e:0x0]/migrate_dir failed: rc = -1 LustreError: 340569:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 61 previous similar messages Lustre: 340572:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0001: [0x200016b61:0x51e:0x0]/migrate_dir is open, migrate only dentry Lustre: 340569:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0001: [0x200016b61:0x51e:0x0]/migrate_dir is open, migrate only dentry LustreError: 332377:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 332377:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 75 previous similar messages LustreError: 332377:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x200016b61:0x51e:0x0]/migrate_dir failed: rc = -1 LustreError: 332377:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 85 previous similar messages LustreError: 340572:0:(osd_handler.c:4776:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000bd5:0x504:0x0], maybe an upgraded file? (LU-3915) | Link to test (2025-11-27 13:07) |
| sanityn test 80b: Accessing directory during migration | LustreError: 337467:0:(osd_handler.c:4079:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 337467:0:(osd_handler.c:4079:osd_destroy()) LBUG CPU: 0 PID: 337467 Comm: mdt_io00_004 Kdump: loaded Tainted: G OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1e1/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? lod_sub_ref_del+0x1e1/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xf4d/0x11c0 [mdd] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1384/0x1e00 [mdt] mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x14a/0x770 [ptlrpc] tgt_request_handle+0x3fd/0xd00 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e8/0xd80 [ptlrpc] ptlrpc_main+0x9e3/0xed0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | LustreError: 117335:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 117335:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000410:0x3bb:0x0]/migrate_dir failed: rc = -1 LustreError: 117335:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 117335:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 117335:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000410:0x3bb:0x0]/migrate_dir failed: rc = -1 LustreError: 117335:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 3 previous similar messages LustreError: 50938:0:(mdd_object.c:3889:mdd_close()) lustre-MDD0003: failed to get lu_attr of [0x2c0000410:0x426:0x0]: rc = -2 Lustre: 9058:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0003: [0x2c0000410:0x3bb:0x0]/migrate_dir is open, migrate only dentry LustreError: 9058:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 9058:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 6 previous similar messages LustreError: 9058:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000410:0x3bb:0x0]/migrate_dir failed: rc = -1 LustreError: 9058:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 6 previous similar messages Lustre: 117335:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0003: [0x2c0000410:0x3bb:0x0]/migrate_dir is open, migrate only dentry Lustre: 117335:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0003: [0x2c0000400:0xe9:0x0]/file3 is open, migrate only dentry LustreError: 117335:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 117335:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 21 previous similar messages LustreError: 117335:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000410:0x3bb:0x0]/migrate_dir failed: rc = -1 LustreError: 117335:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 21 previous similar messages Lustre: 117335:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0001: [0x240002b11:0xf4:0x0]/source_file is open, migrate only dentry LustreError: 9058:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 9058:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 25 previous similar messages LustreError: 9058:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000410:0x3bb:0x0]/migrate_dir failed: rc = -1 LustreError: 9058:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 26 previous similar messages Lustre: 9058:0:(mdd_dir.c:4823:mdd_migrate_object()) lustre-MDD0003: [0x2c0000410:0x3bb:0x0]/migrate_dir is open, migrate only dentry Lustre: 9058:0:(mdd_dir.c:4823:mdd_migrate_object()) Skipped 4 previous similar messages LustreError: 337467:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 337467:0:(mdd_dir.c:4740:mdd_migrate_cmd_check()) Skipped 52 previous similar messages LustreError: 337467:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000410:0x3bb:0x0]/migrate_dir failed: rc = -1 LustreError: 337467:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 54 previous similar messages LustreError: 337467:0:(osd_handler.c:4692:osd_ref_del()) lustre-MDT0001: nlink == 0 on [0x240002b15:0x1721:0x0], maybe an upgraded file? (LU-3915) | Link to test (2025-09-10 21:02) |
| sanityn test 80b: Accessing directory during migration | LustreError: 6109:0:(osd_handler.c:3964:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 6109:0:(osd_handler.c:3964:osd_destroy()) LBUG CPU: 0 PID: 6109 Comm: mdt_io00_001 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.40.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1e1/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? lod_sub_ref_del+0x1e1/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xf45/0x11c0 [mdd] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1384/0x1e00 [mdt] mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4ea/0x9b0 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x14a/0x770 [ptlrpc] tgt_request_handle+0x1eb/0xb80 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2e8/0xd80 [ptlrpc] ptlrpc_main+0xa7b/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | LustreError: 93263:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 93263:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000410:0x3a7:0x0]/migrate_dir failed: rc = -1 LustreError: 6111:0:(osd_handler.c:4577:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd7:0x1481:0x0], maybe an upgraded file? (LU-3915) Lustre: 8043:0:(out_handler.c:877:out_tx_end()) lustre-MDT0000-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-gfYSYCH5/BUILD/lustre-2.16.56_57_g2283689/lustre/ptlrpc/../../lustre/target/out_handler.c:559: rc = -2 LustreError: 8043:0:(out_handler.c:886:out_tx_end()) lustre-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-gfYSYCH5/BUILD/lustre-2.16.56_57_g2283689/lustre/ptlrpc/../../lustre/target/out_handler.c:407: rc = -524 LustreError: 6111:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2000153f4:0xcd9:0x0]/source_file failed: rc = -2 LustreError: 6111:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 2 previous similar messages LustreError: 6111:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 6111:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 6111:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000410:0x3a7:0x0]/migrate_dir failed: rc = -1 LustreError: 6111:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 6111:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 6111:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 6109:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000410:0x3a7:0x0]/migrate_dir failed: rc = -1 LustreError: 6109:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 12 previous similar messages LustreError: 6111:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 6111:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) Skipped 10 previous similar messages LustreError: 93263:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000410:0x3a7:0x0]/migrate_dir failed: rc = -1 LustreError: 93263:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 10 previous similar messages Lustre: 6109:0:(mdd_dir.c:4824:mdd_migrate_object()) lustre-MDD0002: [0x280000bd4:0x1d:0x0]/file1 is open, migrate only dentry LustreError: 336389:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 336389:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) Skipped 9 previous similar messages LustreError: 6111:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 6111:0:(mdd_dir.c:4741:mdd_migrate_cmd_check()) Skipped 23 previous similar messages LustreError: 6111:0:(mdt_reint.c:2562:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000410:0x3a7:0x0]/migrate_dir failed: rc = -1 LustreError: 6111:0:(mdt_reint.c:2562:mdt_reint_migrate()) Skipped 25 previous similar messages Lustre: 336389:0:(mdd_dir.c:4824:mdd_migrate_object()) lustre-MDD0002: [0x2c0000410:0x3a7:0x0]/migrate_dir is open, migrate only dentry LustreError: 6111:0:(osd_handler.c:4577:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd7:0x15c6:0x0], maybe an upgraded file? (LU-3915) Lustre: 53104:0:(out_handler.c:877:out_tx_end()) lustre-MDT0000-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-gfYSYCH5/BUILD/lustre-2.16.56_57_g2283689/lustre/ptlrpc/../../lustre/target/out_handler.c:559: rc = -2 LustreError: 53104:0:(out_handler.c:886:out_tx_end()) lustre-MDT0000-osd: undo for /tmp/rpmbuild-lustre-jenkins-gfYSYCH5/BUILD/lustre-2.16.56_57_g2283689/lustre/ptlrpc/../../lustre/target/out_handler.c:407: rc = -524 LustreError: 53104:0:(out_handler.c:886:out_tx_end()) Skipped 2 previous similar messages LustreError: 6109:0:(osd_handler.c:4577:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000bd7:0x15ec:0x0], maybe an upgraded file? (LU-3915) | Link to test (2025-07-09 10:44) |
| sanityn test 80b: Accessing directory during migration | LustreError: 343165:0:(osd_handler.c:3964:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 343165:0:(osd_handler.c:3964:osd_destroy()) LBUG CPU: 1 PID: 343165 Comm: mdt_io00_003 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-503.26.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1e1/0x4b0 [lod] lod_destroy+0x26c/0xb60 [lod] ? lod_sub_ref_del+0x1e1/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xe89/0x1320 [mdd] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1265/0x1bf0 [mdt] mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4e4/0x850 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x14a/0x770 [ptlrpc] tgt_request_handle+0x1eb/0xb80 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2cd/0xd20 [ptlrpc] ptlrpc_main+0xa7b/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | LustreError: 343165:0:(mdt_reint.c:2511:mdt_reint_migrate()) lustre-MDT0002: migrate [0x200000404:0xbbf:0x0]/file1 failed: rc = -16 LustreError: 343165:0:(mdt_reint.c:2511:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 300841:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 300841:0:(mdt_reint.c:2511:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000404:0x2c7:0x0]/migrate_dir failed: rc = -114 LustreError: 300841:0:(mdt_reint.c:2511:mdt_reint_migrate()) Skipped 13 previous similar messages LustreError: 300841:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 300841:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 300840:0:(mdt_reint.c:2511:mdt_reint_migrate()) lustre-MDT0000: migrate [0x200000404:0xc55:0x0]/source_file failed: rc = -2 LustreError: 300840:0:(mdt_reint.c:2511:mdt_reint_migrate()) Skipped 7 previous similar messages LustreError: 300840:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 300840:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 300840:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) Skipped 8 previous similar messages LustreError: 300840:0:(mdt_reint.c:2511:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000404:0x2c7:0x0]/migrate_dir failed: rc = -1 LustreError: 300840:0:(mdt_reint.c:2511:mdt_reint_migrate()) Skipped 26 previous similar messages LustreError: 300840:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 343165:0:(mdt_reint.c:2511:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000404:0x423:0x0]/target_file failed: rc = -2 LustreError: 343165:0:(mdt_reint.c:2511:mdt_reint_migrate()) Skipped 51 previous similar messages LustreError: 300840:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 300840:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) Skipped 43 previous similar messages LustreError: 343165:0:(mdt_reint.c:2511:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000404:0x577:0x0]/file3 failed: rc = -16 LustreError: 343165:0:(mdt_reint.c:2511:mdt_reint_migrate()) Skipped 110 previous similar messages LustreError: 300840:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 300840:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) Skipped 40 previous similar messages LustreError: 300840:0:(osd_handler.c:4577:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200000405:0x10c7:0x0], maybe an upgraded file? (LU-3915) Lustre: 300832:0:(out_handler.c:909:out_tx_end()) lustre-MDT0002-osd: error during execution of #4 from /tmp/rpmbuild-lustre-jenkins-mCnDu4de/BUILD/lustre-2.16.52_122_g02cb6be/lustre/ptlrpc/../../lustre/target/out_handler.c:582: rc = -2 LustreError: 300832:0:(out_handler.c:918:out_tx_end()) lustre-MDT0002-osd: undo for /tmp/rpmbuild-lustre-jenkins-mCnDu4de/BUILD/lustre-2.16.52_122_g02cb6be/lustre/ptlrpc/../../lustre/target/out_handler.c:422: rc = -524 LustreError: 343165:0:(osd_handler.c:4577:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200000405:0x1152:0x0], maybe an upgraded file? (LU-3915) | Link to test (2025-03-26 06:14) |
| sanityn test 80b: Accessing directory during migration | LustreError: 2345798:0:(osd_handler.c:4026:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 2345798:0:(osd_handler.c:4026:osd_destroy()) LBUG CPU: 0 PID: 2345798 Comm: mdt_io00_004 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-427.42.1_lustre.ddn1.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x43 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1e1/0x4b0 [lod] lod_destroy+0x266/0xa10 [lod] ? lod_sub_ref_del+0x1e1/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xe84/0x1130 [mdd] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1224/0x1bb0 [mdt] mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4e4/0x850 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x14a/0x770 [ptlrpc] tgt_request_handle+0x1eb/0xb80 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2cd/0xd20 [ptlrpc] ptlrpc_main+0xa7e/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | LustreError: 2077479:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2077479:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000404:0x5052:0x0]/migrate_dir failed: rc = -1 LustreError: 2077479:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 2097275:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0000: migrate [0x280000404:0x5052:0x0]/migrate_dir failed: rc = -114 LustreError: 2097275:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 7 previous similar messages LustreError: 2097275:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2097275:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) Skipped 2 previous similar messages LustreError: 2097275:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000404:0x50d1:0x0]/source_file failed: rc = -114 LustreError: 2097275:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 7 previous similar messages LustreError: 2097275:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2077479:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2077479:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) Skipped 6 previous similar messages LustreError: 2097275:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0000: migrate [0x280000404:0x5052:0x0]/migrate_dir failed: rc = -1 LustreError: 2097275:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 15 previous similar messages LustreError: 2097275:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2097275:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) Skipped 5 previous similar messages LustreError: 2077479:0:(osd_handler.c:4639:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000405:0x153d:0x0], maybe an upgraded file? (LU-3915) LustreError: 2077479:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0002: migrate [0x280000404:0x5052:0x0]/migrate_dir failed: rc = -1 LustreError: 2077479:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 49 previous similar messages LustreError: 2077479:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 2077479:0:(mdd_dir.c:4614:mdd_migrate_cmd_check()) Skipped 17 previous similar messages LustreError: 2345798:0:(osd_handler.c:4639:osd_ref_del()) lustre-MDT0002: nlink == 0 on [0x280000405:0x15b1:0x0], maybe an upgraded file? (LU-3915) | Link to test (2025-03-21 15:02) |
| sanityn test 80b: Accessing directory during migration | LustreError: 346108:0:(osd_handler.c:4024:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 346108:0:(osd_handler.c:4024:osd_destroy()) LBUG CPU: 0 PID: 346108 Comm: mdt_io00_003 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-427.42.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x58 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1e1/0x4b0 [lod] lod_destroy+0x266/0xa00 [lod] ? lod_sub_ref_del+0x1e1/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] mdd_migrate_object+0xe84/0x1130 [mdd] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1224/0x1bb0 [mdt] mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4e4/0x850 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x14a/0x770 [ptlrpc] tgt_request_handle+0x1eb/0xb80 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2cd/0xd20 [ptlrpc] ptlrpc_main+0xa7e/0xfa0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | LustreError: 346108:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000404:0x2c0:0x0]/migrate_dir failed: rc = -114 LustreError: 346108:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 346108:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 301504:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 301504:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 346108:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000404:0x2c0:0x0]/migrate_dir failed: rc = -114 LustreError: 346108:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 21 previous similar messages LustreError: 301504:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 301504:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) Skipped 13 previous similar messages LustreError: 346108:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000404:0x2c0:0x0]/migrate_dir failed: rc = -1 LustreError: 346108:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 49 previous similar messages LustreError: 301504:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 301504:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) Skipped 15 previous similar messages LustreError: 571656:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000404:0x2c0:0x0]/migrate_dir failed: rc = -1 LustreError: 571656:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 106 previous similar messages LustreError: 571656:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 571656:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) Skipped 62 previous similar messages LustreError: 346108:0:(osd_handler.c:4637:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200000405:0xeeb:0x0], maybe an upgraded file? (LU-3915) LustreError: 301504:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000404:0x2c0:0x0]/migrate_dir failed: rc = -1 LustreError: 301504:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 207 previous similar messages LustreError: 346108:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 346108:0:(mdd_dir.c:4452:mdd_migrate_cmd_check()) Skipped 97 previous similar messages LustreError: 346108:0:(osd_handler.c:4637:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200000405:0xfd4:0x0], maybe an upgraded file? (LU-3915) | Link to test (2024-12-24 00:43) |
| sanityn test 80b: Accessing directory during migration | LustreError: 300567:0:(osd_handler.c:4018:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 300567:0:(osd_handler.c:4018:osd_destroy()) LBUG CPU: 1 PID: 300567 Comm: mdt_io00_002 Kdump: loaded Tainted: G W OE ------- --- 5.14.0-362.24.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x58 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1e1/0x4b0 [lod] lod_destroy+0x266/0xa00 [lod] ? lod_sub_ref_del+0x1e1/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] ? asm_sysvec_call_function_single+0x16/0x20 mdd_migrate_object+0xe84/0x1130 [mdd] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1224/0x1bb0 [mdt] mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4e4/0x850 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x14a/0x770 [ptlrpc] tgt_request_handle+0x1eb/0xb80 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2cd/0xd20 [ptlrpc] ptlrpc_main+0xaa0/0xfe0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | LustreError: 461458:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0000: migrate [0x2c0000404:0x2b5:0x0]/migrate_dir failed: rc = -114 LustreError: 461458:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 1 previous similar message LustreError: 300567:0:(mdd_dir.c:4472:mdd_migrate_cmd_check()) lustre-MDD0002: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 3 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 300567:0:(mdd_dir.c:4472:mdd_migrate_cmd_check()) lustre-MDD0000: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 461458:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0002: migrate [0x2c0000404:0x2b5:0x0]/migrate_dir failed: rc = -1 LustreError: 461458:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 10 previous similar messages LustreError: 300567:0:(osd_handler.c:4631:osd_ref_del()) lustre-MDT0000: nlink == 0 on [0x200000405:0xf80:0x0], maybe an upgraded file? (LU-3915) | Link to test (2024-09-25 10:45) |
| sanityn test 80b: Accessing directory during migration | LustreError: 453714:0:(osd_handler.c:4017:osd_destroy()) ASSERTION( !lu_object_is_dying(dt->do_lu.lo_header) ) failed: LustreError: 453714:0:(osd_handler.c:4017:osd_destroy()) LBUG CPU: 1 PID: 453714 Comm: mdt_io00_003 Kdump: loaded Tainted: G OE ------- --- 5.14.0-362.24.1_lustre.el9.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: <TASK> dump_stack_lvl+0x34/0x48 lbug_with_loc.cold+0x5/0x58 [libcfs] osd_destroy+0x477/0x5f0 [osd_ldiskfs] lod_sub_destroy+0x1e1/0x4b0 [lod] lod_destroy+0x266/0xa00 [lod] ? lod_sub_ref_del+0x1e1/0x4b0 [lod] mdd_migrate_create+0x3f9/0x8f0 [mdd] ? __ldiskfs_journal_start_sb+0x111/0x130 [ldiskfs] mdd_migrate_object+0xe84/0x1130 [mdd] ? mdd_migrate+0x14/0x20 [mdd] mdd_migrate+0x14/0x20 [mdd] mdt_reint_migrate+0x1224/0x1bb0 [mdt] mdt_reint_rec+0x11c/0x270 [mdt] mdt_reint_internal+0x4e4/0x850 [mdt] mdt_reint+0x59/0x110 [mdt] tgt_handle_request0+0x14a/0x770 [ptlrpc] tgt_request_handle+0x1eb/0xb80 [ptlrpc] ptlrpc_server_handle_request.isra.0+0x2cd/0xd20 [ptlrpc] ptlrpc_main+0xaa0/0xfe0 [ptlrpc] ? __pfx_ptlrpc_main+0x10/0x10 [ptlrpc] kthread+0xe0/0x100 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x2c/0x50 </TASK> | LustreError: 289544:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 289544:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000404:0x2c1:0x0]/migrate_dir failed: rc = -1 LustreError: 289543:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 2 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 289543:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) Skipped 3 previous similar messages LustreError: 289543:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000404:0x2c1:0x0]/migrate_dir failed: rc = -1 LustreError: 289543:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 10 previous similar messages LustreError: 453714:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 453714:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) Skipped 15 previous similar messages LustreError: 453714:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000404:0x2c1:0x0]/migrate_dir failed: rc = -1 LustreError: 453714:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 33 previous similar messages LustreError: 289543:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 289543:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) Skipped 19 previous similar messages LustreError: 308258:0:(mdd_object.c:3881:mdd_close()) lustre-MDD0003: failed to get lu_attr of [0x2c0000404:0x329:0x0]: rc = -2 LustreError: 536286:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000404:0x34f:0x0]/source_file failed: rc = -114 LustreError: 536286:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 21 previous similar messages LustreError: 536286:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 536286:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) Skipped 13 previous similar messages LustreError: 289543:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0001: migrate [0x2c0000404:0x2c1:0x0]/migrate_dir failed: rc = -1 LustreError: 289543:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 69 previous similar messages LustreError: 289543:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) lustre-MDD0001: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 0 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 289543:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) Skipped 38 previous similar messages LustreError: 289543:0:(mdt_reint.c:2531:mdt_reint_migrate()) lustre-MDT0003: migrate [0x2c0000404:0x2c1:0x0]/migrate_dir failed: rc = -1 LustreError: 289543:0:(mdt_reint.c:2531:mdt_reint_migrate()) Skipped 129 previous similar messages LustreError: 453714:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) lustre-MDD0003: 'migrate_dir' migration was interrupted, run 'lfs migrate -m 1 -c 1 -H crush migrate_dir' to finish migration: rc = -1 LustreError: 453714:0:(mdd_dir.c:4467:mdd_migrate_cmd_check()) Skipped 92 previous similar messages LustreError: 453714:0:(osd_handler.c:4627:osd_ref_del()) lustre-MDT0003: nlink == 0 on [0x2c0000405:0xc06:0x0], maybe an upgraded file? (LU-3915) | Link to test (2024-08-29 10:07) |