Editing crashreport #73475

ReasonCrashing FunctionWhere to cut BacktraceReports Count
LBUGtgt_grant_incomingtgt_grant_incoming
tgt_grant_prepare_write
ofd_preprw_write
ofd_preprw
obd_preprw
tgt_brw_write
tgt_request_handle
ptlrpc_server_handle_request
ptlrpc_main
kthread
ret_from_fork
3

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
sanity-quota test 58: project ID should be kept for new mirrors created by FID
LustreError: 175923:0:(tgt_grant.c:562:tgt_grant_incoming()) LBUG
LustreError: 170338:0:(tgt_grant.c:562:tgt_grant_incoming()) LBUG
CPU: 0 PID: 175923 Comm: ll_ost_io00_010 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.50.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
tgt_grant_incoming.isra.10+0x576/0x580 [ptlrpc]
tgt_grant_prepare_write+0x314/0x5d0 [ptlrpc]
ofd_preprw_write.isra.28+0xcd/0x15f0 [ofd]
ofd_preprw+0x541/0x930 [ofd]
obd_preprw+0x14f/0x290 [ptlrpc]
tgt_brw_write+0xdde/0x1f80 [ptlrpc]
? tgt_request_preprocess.isra.30+0xd3/0x8c0 [ptlrpc]
tgt_request_handle+0x3f4/0x1b80 [ptlrpc]
ptlrpc_server_handle_request+0x27b/0xcd0 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xc81/0x1560 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
CPU: 1 PID: 170338 Comm: ll_ost_io00_007 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.50.1.el8_lustre.x86_64 #1
Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=+quota+trace
Lustre: DEBUG MARKER: /usr/sbin/lctl dl
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled
Lustre: DEBUG MARKER: /usr/sbin/lctl dl
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0001.quota_slave.enabled
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
LustreError: 170338:0:(tgt_grant.c:747:tgt_grant_check()) lustre-OST0000: cli e1b37159-ed52-4e0c-af80-82c2f62d7e8f claims 1703936 GRANT, real grant 0
LustreError: 170338:0:(tgt_grant.c:747:tgt_grant_check()) Skipped 1 previous similar message
LustreError: 170338:0:(tgt_grant.c:747:tgt_grant_check()) lustre-OST0000: cli e1b37159-ed52-4e0c-af80-82c2f62d7e8f claims 1703936 GRANT, real grant 0
LustreError: 170338:0:(tgt_grant.c:747:tgt_grant_check()) Skipped 5 previous similar messages
LustreError: 176020:0:(tgt_grant.c:747:tgt_grant_check()) lustre-OST0000: cli e1b37159-ed52-4e0c-af80-82c2f62d7e8f claims 1703936 GRANT, real grant 0
LustreError: 176020:0:(tgt_grant.c:747:tgt_grant_check()) Skipped 7 previous similar messages
LustreError: 165407:0:(tgt_grant.c:747:tgt_grant_check()) lustre-OST0000: cli e1b37159-ed52-4e0c-af80-82c2f62d7e8f claims 1703936 GRANT, real grant 0
LustreError: 165407:0:(tgt_grant.c:747:tgt_grant_check()) Skipped 23 previous similar messages
LustreError: 175923:0:(tgt_grant.c:560:tgt_grant_incoming()) lustre-OST0000: cli e1b37159-ed52-4e0c-af80-82c2f62d7e8f/ffff893860608000 dirty 1703936 pend 1703936 grant -1703936
Link to test
sanity-quota test 58: project ID should be kept for new mirrors created by FID
LustreError: 176458:0:(tgt_grant.c:559:tgt_grant_incoming()) LBUG
CPU: 1 PID: 176458 Comm: ll_ost_io00_011 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.51.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
tgt_grant_incoming.isra.9+0x576/0x580 [ptlrpc]
tgt_grant_prepare_write+0x314/0x5d0 [ptlrpc]
ofd_preprw_write.isra.28+0xcd/0x15f0 [ofd]
ofd_preprw+0x53d/0x930 [ofd]
obd_preprw+0x14f/0x290 [ptlrpc]
tgt_brw_write+0xdde/0x1f80 [ptlrpc]
? tgt_request_preprocess.isra.30+0xd3/0x8c0 [ptlrpc]
tgt_request_handle+0x3f4/0x1b80 [ptlrpc]
ptlrpc_server_handle_request+0x2ca/0xd70 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xc81/0x1560 [ptlrpc]
? __schedule+0x2d9/0x870
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=+quota+trace
Lustre: DEBUG MARKER: /usr/sbin/lctl dl
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled
Lustre: DEBUG MARKER: /usr/sbin/lctl dl
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0001.quota_slave.enabled
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Autotest: Test running for 95 minutes (lustre-reviews_review-zfs_114377.25)
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
LustreError: 165630:0:(tgt_grant.c:745:tgt_grant_check()) lustre-OST0001: cli 2f32f45f-f8c9-48e0-ad60-6bcdf65e3433 claims 1703936 GRANT, real grant 0
LustreError: 170865:0:(tgt_grant.c:745:tgt_grant_check()) lustre-OST0001: cli 2f32f45f-f8c9-48e0-ad60-6bcdf65e3433 claims 1703936 GRANT, real grant 0
LustreError: 170865:0:(tgt_grant.c:745:tgt_grant_check()) Skipped 6 previous similar messages
LustreError: 176458:0:(tgt_grant.c:745:tgt_grant_check()) lustre-OST0001: cli 2f32f45f-f8c9-48e0-ad60-6bcdf65e3433 claims 1703936 GRANT, real grant 0
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
LustreError: 176455:0:(tgt_grant.c:745:tgt_grant_check()) lustre-OST0001: cli 2f32f45f-f8c9-48e0-ad60-6bcdf65e3433 claims 1703936 GRANT, real grant 0
LustreError: 176455:0:(tgt_grant.c:745:tgt_grant_check()) Skipped 7 previous similar messages
LustreError: 176458:0:(tgt_grant.c:557:tgt_grant_incoming()) lustre-OST0001: cli 2f32f45f-f8c9-48e0-ad60-6bcdf65e3433/ffff8b7678a1a000 dirty 11927552 pend 11927552 grant -1703936
Link to test
sanity-quota test 58: project ID should be kept for new mirrors created by FID
LustreError: 164749:0:(tgt_grant.c:559:tgt_grant_incoming()) LBUG
LustreError: 175262:0:(tgt_grant.c:559:tgt_grant_incoming()) LBUG
CPU: 0 PID: 164749 Comm: ll_ost_io00_001 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.50.1.el8_lustre.x86_64 #1
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x41/0x60
lbug_with_loc.cold.8+0x5/0x43 [libcfs]
tgt_grant_incoming.isra.9+0x576/0x580 [ptlrpc]
tgt_grant_prepare_write+0x314/0x5d0 [ptlrpc]
ofd_preprw_write.isra.28+0xcd/0x15f0 [ofd]
ofd_preprw+0x541/0x930 [ofd]
obd_preprw+0x14f/0x290 [ptlrpc]
tgt_brw_write+0xdde/0x1f80 [ptlrpc]
? tgt_request_preprocess.isra.30+0xd3/0x8c0 [ptlrpc]
tgt_request_handle+0x3f4/0x1b80 [ptlrpc]
ptlrpc_server_handle_request+0x27b/0xcd0 [ptlrpc]
? lprocfs_counter_add+0x117/0x180 [obdclass]
ptlrpc_main+0xc81/0x1560 [ptlrpc]
? ptlrpc_wait_event+0x5b0/0x5b0 [ptlrpc]
kthread+0x134/0x150
? set_kthread_struct+0x50/0x50
ret_from_fork+0x35/0x40
CPU: 1 PID: 175262 Comm: ll_ost_io00_011 Kdump: loaded Tainted: P OE -------- - - 4.18.0-553.50.1.el8_lustre.x86_64 #1
Lustre: DEBUG MARKER: lctl set_param fail_val=0 fail_loc=0
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: /usr/sbin/lctl set_param -n debug=+quota+trace
Lustre: DEBUG MARKER: /usr/sbin/lctl dl
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0000.quota_slave.enabled
Lustre: DEBUG MARKER: /usr/sbin/lctl dl
Lustre: DEBUG MARKER: /usr/sbin/lctl get_param -n osd-zfs.lustre-OST0001.quota_slave.enabled
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
Lustre: DEBUG MARKER: lctl set_param -n osd*.*OS*.force_sync=1
LustreError: 175256:0:(tgt_grant.c:745:tgt_grant_check()) lustre-OST0000: cli 295701fc-6d75-4a1f-bf17-eb5dde2d8b5a claims 1703936 GRANT, real grant 0
LustreError: 175262:0:(tgt_grant.c:745:tgt_grant_check()) lustre-OST0000: cli 295701fc-6d75-4a1f-bf17-eb5dde2d8b5a claims 1703936 GRANT, real grant 0
LustreError: 175262:0:(tgt_grant.c:745:tgt_grant_check()) Skipped 6 previous similar messages
LustreError: 164749:0:(tgt_grant.c:557:tgt_grant_incoming()) lustre-OST0000: cli 295701fc-6d75-4a1f-bf17-eb5dde2d8b5a/ffff90ba464b9800 dirty 11927552 pend 11927552 grant -1703936
Link to test
Return to new crashes list