Editing crashreport #70788

ReasonCrashing FunctionWhere to cut BacktraceReports Count
Kernel panic - not syncing: Out of memorypanic
out_of_memory
__alloc_pages_slowpath
__alloc_pages_nodemask
alloc_pages_vma
__read_swap_cache_async
read_swap_cache_async
swap_cluster_readahead
swapin_readahead
do_swap_page
__handle_mm_fault
handle_mm_fault
do_user_addr_fault
__do_page_fault
do_page_fault
do_async_page_fault
async_page_fault
1

Added fields:

Match messages in logs
(every line would be required to be present in log output
Copy from "Messages before crash" column below):
Match messages in full crash
(every line would be required to be present in crash log output
Copy from "Full Crash" column below):
Limit to a test:
(Copy from below "Failing text"):
Delete these reports as invalid (real bug in review or some such)
Bug or comment:
Extra info:

Failures list (last 100):

Failing TestFull CrashMessages before crashComment
sanity-benchmark test iozone: iozone
Kernel panic - not syncing: Out of memory: system-wide panic_on_oom is enabled
CPU: 0 PID: 379 Comm: wpa_supplicant Kdump: loaded Tainted: G OE 5.4.0-110-generic #124-Ubuntu
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x6d/0x8b
panic+0x101/0x2e3
out_of_memory.cold+0x2f/0x83
__alloc_pages_slowpath+0xd5e/0xe50
? __switch_to_asm+0x40/0x70
? __switch_to_asm+0x34/0x70
? __switch_to_asm+0x40/0x70
__alloc_pages_nodemask+0x2d0/0x320
alloc_pages_vma+0x7f/0x220
__read_swap_cache_async+0x161/0x230
read_swap_cache_async+0x2b/0x70
swap_cluster_readahead+0x23f/0x2e0
? remove_wait_queue+0x47/0x50
? poll_freewait+0x4a/0xa0
swapin_readahead+0x5c/0x470
? pagecache_get_page+0x2d/0x300
? __switch_to_asm+0x34/0x70
do_swap_page+0x3fb/0x9f0
__handle_mm_fault+0x73b/0x7a0
handle_mm_fault+0xca/0x200
do_user_addr_fault+0x1f9/0x450
__do_page_fault+0x58/0x90
? swap_cluster_readahead+0x23f/0x2e0
do_page_fault+0x2c/0xe0
do_async_page_fault+0x39/0x70
async_page_fault+0x34/0x40
RIP: 0010:copy_user_generic_string+0x2c/0x40
Lustre: DEBUG MARKER: /usr/sbin/lctl mark min OST has 7244596kB available, using 5725456kB file size
Lustre: DEBUG MARKER: min OST has 7244596kB available, using 5725456kB file size
obd_memory max: 1708896919, obd_memory current: 41210564
wpa_supplicant invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
CPU: 0 PID: 379 Comm: wpa_supplicant Kdump: loaded Tainted: G OE 5.4.0-110-generic #124-Ubuntu
Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011
Call Trace:
dump_stack+0x6d/0x8b
dump_header+0x4f/0x1eb
out_of_memory.cold+0xa/0x83
__alloc_pages_slowpath+0xd5e/0xe50
? __switch_to_asm+0x40/0x70
? __switch_to_asm+0x34/0x70
? __switch_to_asm+0x40/0x70
__alloc_pages_nodemask+0x2d0/0x320
alloc_pages_vma+0x7f/0x220
__read_swap_cache_async+0x161/0x230
read_swap_cache_async+0x2b/0x70
swap_cluster_readahead+0x23f/0x2e0
? remove_wait_queue+0x47/0x50
? poll_freewait+0x4a/0xa0
swapin_readahead+0x5c/0x470
? pagecache_get_page+0x2d/0x300
? __switch_to_asm+0x34/0x70
do_swap_page+0x3fb/0x9f0
__handle_mm_fault+0x73b/0x7a0
handle_mm_fault+0xca/0x200
do_user_addr_fault+0x1f9/0x450
__do_page_fault+0x58/0x90
? swap_cluster_readahead+0x23f/0x2e0
do_page_fault+0x2c/0xe0
do_async_page_fault+0x39/0x70
async_page_fault+0x34/0x40
RIP: 0010:copy_user_generic_string+0x2c/0x40
Code: 90 83 fa 08 72 27 89 f9 83 e1 07 74 15 83 e9 08 f7 d9 29 ca 8a 06 88 07 48 ff c6 48 ff c7 ff c9 75 f2 89 d1 c1 e9 03 83 e2 07 <f3> 48 a5 89 d1 f3 a4 31 c0 66 66 90 c3 0f 1f 80 00 00 00 00 66 66
RSP: 0000:ffffbe20c04c3d28 EFLAGS: 00010246
RAX: ffffbe20c04c3d98 RBX: 0000000000000008 RCX: 0000000000000001
RDX: 0000000000000000 RSI: ffffbe20c04c3d98 RDI: 000055ce6f8c71b0
RBP: ffffbe20c04c3eb0 R08: ffffbe20c04c3d30 R09: 0000000000000010
R10: 0000000000000000 R11: ffff94c2bfc2ff38 R12: 0000000000000000
R13: ffffbe20c04c3d80 R14: 000055ce6f8c71b0 R15: ffffbe20c04c3d80
? core_sys_select+0x23f/0x3b0
? kvm_clock_get_cycles+0x11/0x20
? ktime_get_ts64+0x4c/0xe0
kern_select+0xb8/0x110
__x64_sys_select+0x25/0x30
do_syscall_64+0x57/0x190
entry_SYSCALL_64_after_hwframe+0x44/0xa9
RIP: 0033:0x7fcefdc15f7a
Code: Bad RIP value.
RSP: 002b:00007ffffb619a18 EFLAGS: 00000246 ORIG_RAX: 0000000000000017
RAX: ffffffffffffffda RBX: 000055ce6f8c7480 RCX: 00007fcefdc15f7a
RDX: 000055ce6f8c7240 RSI: 000055ce6f8c71b0 RDI: 0000000000000005
RBP: 000055ce6f8c72d0 R08: 00007ffffb619a40 R09: 00007ffffb6199e8
R10: 000055ce6f8c72d0 R11: 0000000000000246 R12: 000055ce6f8c7240
R13: 000055ce6f8c71b0 R14: 000055ce6dd3cdd0 R15: 000055ce6dd3cd80
Mem-Info:
active_anon:0 inactive_anon:0 isolated_anon:0
Node 0 active_anon:0kB inactive_anon:0kB active_file:264700kB inactive_file:2368904kB unevictable:0kB isolated(anon):0kB isolated(file):2432kB mapped:444kB dirty:32256kB writeback:231936kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB all_unreclaimable? yes
Node 0 DMA free:11108kB min:244kB low:304kB high:364kB active_anon:0kB inactive_anon:0kB active_file:564kB inactive_file:3568kB unevictable:0kB writepending:564kB present:15992kB managed:15360kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
lowmem_reserve[]: 0 2716 2716 2716 2716
Node 0 DMA32 free:43668kB min:44808kB low:56008kB high:67208kB active_anon:0kB inactive_anon:0kB active_file:264136kB inactive_file:2365228kB unevictable:0kB writepending:263628kB present:3129320kB managed:2847368kB mlocked:0kB kernel_stack:2912kB pagetables:2776kB bounce:0kB free_pcp:240kB local_pcp:240kB free_cma:0kB
lowmem_reserve[]: 0 0 0 0 0
Node 0 DMA: 3*4kB (UM) 3*8kB (U) 6*16kB (UM) 5*32kB (U) 1*64kB (M) 4*128kB (UM) 4*256kB (UM) 2*512kB (UM) 2*1024kB (UM) 1*2048kB (U) 1*4096kB (M) = 11108kB
Node 0 DMA32: 2065*4kB (UME) 1696*8kB (UME) 771*16kB (UME) 228*32kB (UME) 27*64kB (UM) 0*128kB 0*256kB 1*512kB (M) 0*1024kB 0*2048kB 0*4096kB = 43700kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
187803 total pagecache pages
0 pages in swap cache
Swap cache stats: add 31776, delete 31776, find 3993/6138
Free swap = 1983484kB
Total swap = 2097148kB
786328 pages RAM
0 pages HighMem/MovableOnly
70646 pages reserved
0 pages cma reserved
0 pages hwpoisoned
Tasks state (memory values in pages):
[ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[ 246] 0 246 13067 0 126976 337 -250 systemd-journal
[ 278] 0 278 1346 0 49152 47 0 blkmapd
[ 296] 0 296 5573 17 65536 417 -1000 systemd-udevd
[ 300] 0 300 794 1 40960 57 0 rpc.idmapd
[ 311] 100 311 8868 0 73728 240 0 systemd-network
[ 324] 110 324 1775 0 57344 128 0 rpcbind
[ 337] 0 337 59703 0 98304 322 0 accounts-daemon
[ 338] 103 338 1921 1 53248 221 -900 dbus-daemon
[ 339] 0 339 65528 0 139264 693 0 NetworkManager
[ 347] 0 347 20474 0 61440 106 0 irqbalance
[ 362] 0 362 8157 1 90112 2020 0 networkd-dispat
[ 363] 0 363 58181 0 90112 258 0 polkitd
[ 376] 104 376 56079 0 81920 379 0 rsyslogd
[ 378] 0 378 4348 1 73728 240 0 systemd-logind
[ 379] 0 379 3422 0 61440 187 0 wpa_supplicant
[ 400] 0 400 60342 0 102400 476 0 ModemManager
[ 522] 0 522 24975 1 73728 337 0 dhclient
[ 584] 101 584 6145 0 86016 1033 0 systemd-resolve
[ 703] 0 703 18069 0 118784 581 0 nmbd
[ 716] 112 716 3254 0 53248 80 0 chronyd
[ 717] 112 717 1208 0 53248 52 0 chronyd
[ 722] 0 722 3045 1 57344 229 -1000 sshd
[ 724] 0 724 7982 0 102400 6281 0 rpc.mountd
[ 730] 113 730 50657 0 61440 267 0 munged
[ 760] 0 760 22101 1 155648 764 0 smbd
[ 806] 0 806 154694 0 159744 679 0 automount
[ 809] 0 809 2424 0 53248 78 0 cron
[ 836] 0 836 21564 0 151552 752 0 smbd-notifyd
[ 837] 0 837 21562 0 143360 750 0 cleanupd
[ 872] 0 872 22069 1 147456 728 0 samba-bgqd
[ 893] 0 893 2127 0 49152 34 0 agetty
[ 900] 0 900 2184 0 49152 33 0 agetty
[ 999] 0 999 1982 1 53248 58 0 xinetd
[ 1300] 0 1300 9518 0 65536 120 0 master
[ 1307] 108 1307 9596 1 57344 126 0 qmgr
[ 1632] 0 1632 4733 1 73728 340 0 systemd
[ 1637] 0 1637 26013 0 86016 880 0 (sd-pam)
[ 1814] 0 1814 3455 1 69632 367 0 sshd
[ 1834] 0 1834 2456 0 45056 62 0 run_test_wrappe
[ 1835] 0 1835 2456 1 49152 70 0 run_test.sh
[ 2008] 0 2008 4007 1 65536 1619 0 bash
[ 84731] 108 84731 9583 0 73728 135 0 pickup
[ 89504] 0 89504 4007 0 65536 1619 0 bash
[ 89505] 0 89505 2100 0 45056 27 0 tee
[ 89624] 0 89624 3979 1 65536 1599 0 bash
[ 94001] 0 94001 4012 0 65536 1625 0 bash
[ 94002] 0 94002 2100 0 49152 26 0 tee
[ 94673] 500 94673 10861 23 94208 4294 0 iozone
[ 94674] 0 94674 2100 0 53248 27 0 tee
Link to test
Return to new crashes list