Edit new crash report

Reason	Crashing Function	Where to cut Backtrace	Reports Count
ASSERTION( len > 0 ) failed	__ptlrpc_prep_bulk_page	__ptlrpc_prep_bulk_page osc_brw_prep_request osc_build_rpc osc_send_write_rpc osc_check_rpcs __osc_io_unplug brw_queue_work process_one_work worker_thread kthread ret_from_fork ret_from_fork_asm	9

Failing Test	Full Crash	Messages before crash	Comment
sanity-quota test 1i: Quota pools: different limit and usage relations	LustreError: 217947:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 217947:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 1 UID: 0 PID: 217947 Comm: kworker/1:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe5e/0x2750 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] osc_check_rpcs+0xa0/0x5f0 [osc] ? brw_queue_work+0x36/0x110 [osc] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x174/0x330 worker_thread+0x256/0x3a0 ? srso_alias_return_thunk+0x5/0xfbef5 ? __pfx_worker_thread+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>	Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:200 MB\) Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB) Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-.pools.qpool1 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-.pools.qpool1 \| Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write... Lustre: DEBUG MARKER: Write... Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write out of block quota ... Lustre: DEBUG MARKER: Write out of block quota ...	Link to test
ost-pools test 23b: OST pools and OOS	LustreError: 577362:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 577362:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 0 UID: 0 PID: 577362 Comm: kworker/0:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe5e/0x2750 [osc] ? srso_alias_return_thunk+0x5/0xfbef5 ? osc_req_attr_set+0xc0/0x5c0 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] ? srso_alias_return_thunk+0x5/0xfbef5 osc_check_rpcs+0xa0/0x5f0 [osc] ? cl_env_new+0x11c/0x230 [obdclass] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x174/0x330 worker_thread+0x256/0x3a0 ? __pfx_worker_thread+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>	Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-.pools.testpool \| Lustre: lustre-OST0001-osc-ff36c5d7c2c2d000: disconnect after 21s idle Lustre: Skipped 3 previous similar messages Autotest: Test running for 180 minutes (lustre-reviews_review-dne-zfs-part-6_125451.71)	Link to test
sanity-quota test 1a: Block hard limit (normal use and out of quota)	LustreError: 34320:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 34320:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 1 UID: 0 PID: 34320 Comm: kworker/1:1 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe5e/0x2750 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] osc_check_rpcs+0xa0/0x5f0 [osc] ? brw_queue_work+0x36/0x110 [osc] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x174/0x330 worker_thread+0x256/0x3a0 ? srso_alias_return_thunk+0x5/0xfbef5 ? __pfx_worker_thread+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>	Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:10 MB\) Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB) Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write... Lustre: DEBUG MARKER: Write... Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write out of block quota ... Lustre: DEBUG MARKER: Write out of block quota ...	Link to test
conf-sanity testing /usr/lib64/lustre/tests/disk2_9-ldiskfs.tar.bz2 upgrade with writeconf	LustreError: 282480:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 282480:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 0 UID: 0 PID: 282480 Comm: kworker/0:1 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe5e/0x2750 [osc] ? srso_alias_return_thunk+0x5/0xfbef5 ? osc_req_attr_set+0xc0/0x5c0 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] ? srso_alias_return_thunk+0x5/0xfbef5 osc_check_rpcs+0xa0/0x5f0 [osc] ? cl_env_new+0x11c/0x230 [obdclass] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x174/0x330 worker_thread+0x256/0x3a0 ? srso_alias_return_thunk+0x5/0xfbef5 ? __pfx_worker_thread+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>		Link to test
conf-sanity test 32h: pool quota upgrade test	LustreError: 280381:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 280381:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 1 UID: 0 PID: 280381 Comm: kworker/1:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe5e/0x2750 [osc] ? srso_alias_return_thunk+0x5/0xfbef5 ? osc_req_attr_set+0xc0/0x5c0 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] ? srso_alias_return_thunk+0x5/0xfbef5 osc_check_rpcs+0xa0/0x5f0 [osc] ? cl_env_new+0x11c/0x230 [obdclass] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x174/0x330 worker_thread+0x256/0x3a0 ? srso_alias_return_thunk+0x5/0xfbef5 ? __pfx_worker_thread+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>	LNet: 1 local NIs in recovery (showing 1): 10.240.42.59@tcp Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool \| Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool \| Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool \| Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool \| Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool \|	Link to test
ost-pools test 23b: OST pools and OOS	LustreError: 816272:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 816272:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 1 UID: 0 PID: 816272 Comm: kworker/1:0 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe61/0x2750 [osc] ? osc_req_attr_set+0xc3/0x5c0 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] osc_check_rpcs+0xa0/0x5f0 [osc] ? cl_env_new+0x11c/0x230 [obdclass] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x177/0x330 worker_thread+0x256/0x3a0 ? __pfx_worker_thread+0x10/0x10 kthread+0xfd/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x34/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>	Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-.pools.testpool \| Lustre: lustre-OST0001-osc-ffff9d23877f8800: disconnect after 24s idle Lustre: Skipped 4 previous similar messages Autotest: Test running for 185 minutes (lustre-reviews_review-dne-zfs-part-6_125419.71)	Link to test
sanity-quota test 1i: Quota pools: different limit and usage relations	LustreError: 39409:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 39409:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 1 UID: 0 PID: 39409 Comm: kworker/1:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe5e/0x2750 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] osc_check_rpcs+0xa0/0x5f0 [osc] ? brw_queue_work+0x36/0x110 [osc] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x174/0x330 worker_thread+0x256/0x3a0 ? srso_alias_return_thunk+0x5/0xfbef5 ? __pfx_worker_thread+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>	Lustre: lustre-OST0000-osc-ff262c80c3e83800: disconnect after 21s idle Lustre: Skipped 90 previous similar messages Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:200 MB\) Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB) Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-.pools.qpool1 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-.pools.qpool1 \| Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write... Lustre: DEBUG MARKER: Write... Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write out of block quota ... Lustre: DEBUG MARKER: Write out of block quota ...	Link to test
sanity-quota test 1a: Block hard limit (normal use and out of quota)	LustreError: 145692:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 145692:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 1 UID: 0 PID: 145692 Comm: kworker/1:1 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe5e/0x2750 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] osc_check_rpcs+0xa0/0x5f0 [osc] ? brw_queue_work+0x36/0x110 [osc] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x174/0x330 worker_thread+0x256/0x3a0 ? srso_alias_return_thunk+0x5/0xfbef5 ? __pfx_worker_thread+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>	Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:10 MB\) Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB) Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write... Lustre: DEBUG MARKER: Write...	Link to test
conf-sanity test 32h: pool quota upgrade test	LustreError: 221761:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed: LustreError: 221761:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG CPU: 0 UID: 0 PID: 221761 Comm: kworker/0:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary) Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Workqueue: events brw_queue_work [osc] Call Trace: <TASK> dump_stack_lvl+0x4e/0x70 lbug_with_loc.cold+0x5/0x50 [libcfs] __ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc] osc_brw_prep_request+0xe5e/0x2750 [osc] ? srso_alias_return_thunk+0x5/0xfbef5 ? osc_req_attr_set+0xc0/0x5c0 [osc] osc_build_rpc+0x78a/0x1780 [osc] osc_send_write_rpc+0x272/0x420 [osc] ? srso_alias_return_thunk+0x5/0xfbef5 osc_check_rpcs+0xa0/0x5f0 [osc] ? cl_env_new+0x11c/0x230 [obdclass] __osc_io_unplug+0x80/0xa0 [osc] brw_queue_work+0x64/0x110 [osc] process_one_work+0x174/0x330 worker_thread+0x256/0x3a0 ? srso_alias_return_thunk+0x5/0xfbef5 ? __pfx_worker_thread+0x10/0x10 kthread+0xfa/0x240 ? __pfx_kthread+0x10/0x10 ret_from_fork+0x31/0x50 ? __pfx_kthread+0x10/0x10 ret_from_fork_asm+0x1a/0x30 </TASK>	LNet: 1 local NIs in recovery (showing 1): 10.240.44.241@tcp Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool 2>/dev/null \|\| echo foo Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool \| Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool \| Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-.pools.testpool \| Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool \|	Link to test

Failing Test

Full Crash

Messages before crash

Comment

sanity-quota test 1i: Quota pools: different limit and usage relations

LustreError: 217947:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 217947:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 1 UID: 0 PID: 217947 Comm: kworker/1:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe5e/0x2750 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
osc_check_rpcs+0xa0/0x5f0 [osc]
? brw_queue_work+0x36/0x110 [osc]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x174/0x330
worker_thread+0x256/0x3a0
? srso_alias_return_thunk+0x5/0xfbef5
? __pfx_worker_thread+0x10/0x10
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:200 MB\)
Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.qpool1 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.qpool1 |
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write...
Lustre: DEBUG MARKER: Write...
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write out of block quota ...
Lustre: DEBUG MARKER: Write out of block quota ...

Link to test

ost-pools test 23b: OST pools and OOS

LustreError: 577362:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 577362:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 0 UID: 0 PID: 577362 Comm: kworker/0:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe5e/0x2750 [osc]
? srso_alias_return_thunk+0x5/0xfbef5
? osc_req_attr_set+0xc0/0x5c0 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
? srso_alias_return_thunk+0x5/0xfbef5
osc_check_rpcs+0xa0/0x5f0 [osc]
? cl_env_new+0x11c/0x230 [obdclass]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x174/0x330
worker_thread+0x256/0x3a0
? __pfx_worker_thread+0x10/0x10
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.testpool |
Lustre: lustre-OST0001-osc-ff36c5d7c2c2d000: disconnect after 21s idle
Lustre: Skipped 3 previous similar messages
Autotest: Test running for 180 minutes (lustre-reviews_review-dne-zfs-part-6_125451.71)

Link to test

sanity-quota test 1a: Block hard limit (normal use and out of quota)

LustreError: 34320:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 34320:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 1 UID: 0 PID: 34320 Comm: kworker/1:1 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe5e/0x2750 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
osc_check_rpcs+0xa0/0x5f0 [osc]
? brw_queue_work+0x36/0x110 [osc]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x174/0x330
worker_thread+0x256/0x3a0
? srso_alias_return_thunk+0x5/0xfbef5
? __pfx_worker_thread+0x10/0x10
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:10 MB\)
Lustre: DEBUG MARKER: User quota (block hardlimit:10 MB)
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write...
Lustre: DEBUG MARKER: Write...
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write out of block quota ...
Lustre: DEBUG MARKER: Write out of block quota ...

Link to test

conf-sanity testing /usr/lib64/lustre/tests/disk2_9-ldiskfs.tar.bz2 upgrade with writeconf

LustreError: 282480:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 282480:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 0 UID: 0 PID: 282480 Comm: kworker/0:1 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe5e/0x2750 [osc]
? srso_alias_return_thunk+0x5/0xfbef5
? osc_req_attr_set+0xc0/0x5c0 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
? srso_alias_return_thunk+0x5/0xfbef5
osc_check_rpcs+0xa0/0x5f0 [osc]
? cl_env_new+0x11c/0x230 [obdclass]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x174/0x330
worker_thread+0x256/0x3a0
? srso_alias_return_thunk+0x5/0xfbef5
? __pfx_worker_thread+0x10/0x10
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

Link to test

conf-sanity test 32h: pool quota upgrade test

LustreError: 280381:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 280381:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 1 UID: 0 PID: 280381 Comm: kworker/1:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe5e/0x2750 [osc]
? srso_alias_return_thunk+0x5/0xfbef5
? osc_req_attr_set+0xc0/0x5c0 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
? srso_alias_return_thunk+0x5/0xfbef5
osc_check_rpcs+0xa0/0x5f0 [osc]
? cl_env_new+0x11c/0x230 [obdclass]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x174/0x330
worker_thread+0x256/0x3a0
? srso_alias_return_thunk+0x5/0xfbef5
? __pfx_worker_thread+0x10/0x10
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

LNet: 1 local NIs in recovery (showing 1): 10.240.42.59@tcp
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |

Link to test

ost-pools test 23b: OST pools and OOS

LustreError: 816272:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 816272:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 1 UID: 0 PID: 816272 Comm: kworker/1:0 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe61/0x2750 [osc]
? osc_req_attr_set+0xc3/0x5c0 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
osc_check_rpcs+0xa0/0x5f0 [osc]
? cl_env_new+0x11c/0x230 [obdclass]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x177/0x330
worker_thread+0x256/0x3a0
? __pfx_worker_thread+0x10/0x10
kthread+0xfd/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x34/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.testpool |
Lustre: lustre-OST0001-osc-ffff9d23877f8800: disconnect after 24s idle
Lustre: Skipped 4 previous similar messages
Autotest: Test running for 185 minutes (lustre-reviews_review-dne-zfs-part-6_125419.71)

Link to test

sanity-quota test 1i: Quota pools: different limit and usage relations

LustreError: 39409:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 39409:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 1 UID: 0 PID: 39409 Comm: kworker/1:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe5e/0x2750 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
osc_check_rpcs+0xa0/0x5f0 [osc]
? brw_queue_work+0x36/0x110 [osc]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x174/0x330
worker_thread+0x256/0x3a0
? srso_alias_return_thunk+0x5/0xfbef5
? __pfx_worker_thread+0x10/0x10
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

Lustre: lustre-OST0000-osc-ff262c80c3e83800: disconnect after 21s idle
Lustre: Skipped 90 previous similar messages
Lustre: DEBUG MARKER: /usr/sbin/lctl mark User quota \(block hardlimit:200 MB\)
Lustre: DEBUG MARKER: User quota (block hardlimit:200 MB)
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.qpool1 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.lustre-*.pools.qpool1 |
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write...
Lustre: DEBUG MARKER: Write...
Lustre: DEBUG MARKER: /usr/sbin/lctl mark Write out of block quota ...
Lustre: DEBUG MARKER: Write out of block quota ...

Link to test

sanity-quota test 1a: Block hard limit (normal use and out of quota)

LustreError: 145692:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 145692:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 1 UID: 0 PID: 145692 Comm: kworker/1:1 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe5e/0x2750 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
osc_check_rpcs+0xa0/0x5f0 [osc]
? brw_queue_work+0x36/0x110 [osc]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x174/0x330
worker_thread+0x256/0x3a0
? srso_alias_return_thunk+0x5/0xfbef5
? __pfx_worker_thread+0x10/0x10
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

Link to test

conf-sanity test 32h: pool quota upgrade test

LustreError: 221761:0:(client.c:279:__ptlrpc_prep_bulk_page()) ASSERTION( len > 0 ) failed:
LustreError: 221761:0:(client.c:279:__ptlrpc_prep_bulk_page()) LBUG
CPU: 0 UID: 0 PID: 221761 Comm: kworker/0:2 Kdump: loaded Tainted: G OE ------ --- 6.12.0-124.8.1.el10_1.x86_64 #1 PREEMPT(voluntary)
Tainted: [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014
Workqueue: events brw_queue_work [osc]
Call Trace:
<TASK>
dump_stack_lvl+0x4e/0x70
lbug_with_loc.cold+0x5/0x50 [libcfs]
__ptlrpc_prep_bulk_page+0x1c1/0x250 [ptlrpc]
osc_brw_prep_request+0xe5e/0x2750 [osc]
? srso_alias_return_thunk+0x5/0xfbef5
? osc_req_attr_set+0xc0/0x5c0 [osc]
osc_build_rpc+0x78a/0x1780 [osc]
osc_send_write_rpc+0x272/0x420 [osc]
? srso_alias_return_thunk+0x5/0xfbef5
osc_check_rpcs+0xa0/0x5f0 [osc]
? cl_env_new+0x11c/0x230 [obdclass]
__osc_io_unplug+0x80/0xa0 [osc]
brw_queue_work+0x64/0x110 [osc]
process_one_work+0x174/0x330
worker_thread+0x256/0x3a0
? srso_alias_return_thunk+0x5/0xfbef5
? __pfx_worker_thread+0x10/0x10
kthread+0xfa/0x240
? __pfx_kthread+0x10/0x10
ret_from_fork+0x31/0x50
? __pfx_kthread+0x10/0x10
ret_from_fork_asm+0x1a/0x30
</TASK>

LNet: 1 local NIs in recovery (showing 1): 10.240.44.241@tcp
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool 2>/dev/null || echo foo
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |
Lustre: DEBUG MARKER: lctl get_param -n lov.t32fs-*.pools.testpool |

Link to test

Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below):
Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below):
Limit to a test: (Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Editing crashreport #74938

Added fields:

Failures list (last 100):