Editing crashreport #73272

ReasonCrashing FunctionWhere to cut BacktraceReports Count
BUG: unable to handle kernel paging requeststrchrlibcfs_strnid
nidtbl_tnl2entry
mgs_get_ir_logs
mgs_config_read
tgt_request_handle
ptlrpc_server_handle_request
ptlrpc_main
kthread
1

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
sanity test 276: Race between mount and obd_statfs
BUG: unable to handle kernel paging request at ffff88011614c000
IP: [<ffffffff813fdf60>] strchr+0x20/0x40
PGD 23c1067 PUD 23c4067 PMD 13ed3a067 PTE 800000011614c060
Oops: 0000 [#1] SMP DEBUG_PAGEALLOC
Modules linked in: dm_flakey dm_mod lustre(OE) osp(OE) ofd(OE) lod(OE) mdt(OE) mdd(OE) mgs(OE) osd_ldiskfs(OE) ldiskfs(OE) lquota(OE) lfsck(OE) mgc(OE) mdc(OE) lov(OE) osc(OE) lmv(OE) fid(OE) fld(OE) ptlrpc_gss(OE) ptlrpc(OE) obdclass(OE) ksocklnd(OE) lnet(OE) libcfs(OE) zfs(PO) zunicode(PO) zzstd(O) zlua(O) zcommon(PO) znvpair(PO) zavl(PO) icp(PO) spl(O) crc_t10dif crct10dif_generic rpcsec_gss_krb5 sb_edac edac_core iosf_mbi kvm_intel kvm irqbypass crc32_pclmul ghash_clmulni_intel squashfs aesni_intel lrw gf128mul glue_helper ablk_helper cryptd pcspkr i2c_piix4 i2c_core binfmt_misc ip_tables ext4 mbcache jbd2 ata_generic pata_acpi crct10dif_pclmul crct10dif_common crc32c_intel ata_piix serio_raw libata [last unloaded: obdecho]
CPU: 1 PID: 19588 Comm: ll_mgs_0001 Kdump: loaded Tainted: P OE ------------ 3.10.0-7.9-debug #1
Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS 1.16.2-1.fc38 04/01/2014
task: ffff8800804c2220 ti: ffff8800858a4000 task.ti: ffff8800858a4000
RIP: 0010:[<ffffffff813fdf60>] [<ffffffff813fdf60>] strchr+0x20/0x40
RSP: 0018:ffff8800858a7a90 EFLAGS: 00010296
RAX: 000000000000005a RBX: ffff8800858a7aec RCX: 0000000000000200
RDX: 0000000000000040 RSI: 0000000000000040 RDI: ffff88011614c000
RBP: ffff8800858a7a90 R08: 000000000000ffff R09: 000000000000ffff
R10: 0000000000000000 R11: ffff8800858a7916 R12: ffff88011614be0c
R13: ffff88011614bc00 R14: ffff880076f81000 R15: ffff88011614be0c
FS: 0000000000000000(0000) GS:ffff88013e280000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffff88011614c000 CR3: 0000000001c10000 CR4: 0000000000160fe0
Call Trace:
[<ffffffffa0301c14>] libcfs_strnid+0x34/0x220 [lnet]
[<ffffffffa0f117ba>] nidtbl_tnl2entry+0xda/0x260 [mgs]
[<ffffffffa0f13f86>] mgs_get_ir_logs+0xff6/0x15b0 [mgs]
[<ffffffffa0ee9868>] mgs_config_read+0xd8/0x1e0 [mgs]
[<ffffffffa08c961e>] tgt_request_handle+0x74e/0x1a60 [ptlrpc]
[<ffffffffa0807d87>] ptlrpc_server_handle_request+0x257/0xcd0 [ptlrpc]
[<ffffffffa0809b71>] ptlrpc_main+0xc61/0x1640 [ptlrpc]
[<ffffffff810dbb51>] ? put_prev_entity+0x31/0x400
[<ffffffff81410a79>] ? do_raw_spin_unlock+0x49/0x90
[<ffffffff817e8dce>] ? _raw_spin_unlock_irq+0xe/0x30
[<ffffffffa0808f10>] ? ptlrpc_wait_event+0x630/0x630 [ptlrpc]
[<ffffffff810ba114>] kthread+0xe4/0xf0
[<ffffffff810ba030>] ? kthread_create_on_node+0x140/0x140
[<ffffffff817f3e5d>] ret_from_fork_nospec_begin+0x7/0x21
[<ffffffff810ba030>] ? kthread_create_on_node+0x140/0x140
Lustre: Failing over lustre-OST0000
LustreError: 2481:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup
Lustre: server umount lustre-OST0000 complete
LustreError: lustre-OST0000-osc-MDT0000: operation ost_statfs to node 0@lo failed: rc = -107
LustreError: Skipped 1 previous similar message
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: 3814:0:(mgc_request_server.c:550:mgc_llog_local_copy()) MGC192.168.202.134@tcp: no remote llog for lustre-sptlrpc, check MGS config
LustreError: 3841:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup
Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
LustreError: 5252:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup
Lustre: server umount lustre-OST0000 complete
LustreError: 3345:0:(ldlm_lib.c:1113:target_handle_connect()) lustre-OST0000: not available for connect from 192.168.202.34@tcp (no target). If you are running an HA pair check that the target is mounted on the other server.
LustreError: 3345:0:(ldlm_lib.c:1113:target_handle_connect()) Skipped 7 previous similar messages
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
LustreError: 6638:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup
LustreError: 6638:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message
Lustre: lustre-OST0000-osc-MDT0001: Connection to lustre-OST0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete
Lustre: Skipped 10 previous similar messages
Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
LustreError: 10891:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup
LustreError: 10891:0:(obd_class.h:479:obd_check_dev()) Skipped 1 previous similar message
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180
Lustre: Skipped 1 previous similar message
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
LustreError: 16491:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup
LustreError: 16491:0:(obd_class.h:479:obd_check_dev()) Skipped 5 previous similar messages
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: lustre-OST0000: Imperative Recovery enabled, recovery window shrunk from 60-180 down to 60-180
Lustre: Skipped 3 previous similar messages
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
LustreError: 27623:0:(obd_class.h:479:obd_check_dev()) Device 22 not setup
LustreError: 27623:0:(obd_class.h:479:obd_check_dev()) Skipped 3 previous similar messages
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Lustre: Failing over lustre-OST0000
Lustre: server umount lustre-OST0000 complete
LDISKFS-fs (dm-2): file extents enabled, maximum tree depth=5
LDISKFS-fs (dm-2): mounted filesystem with ordered data mode. Opts: user_xattr,acl,no_mbcache,nodelalloc
Lustre: DEBUG MARKER: oleg234-server.virtnet: executing set_default_debug all all
Link to test
Return to new crashes list