| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Comment |
|---|---|---|---|
| sanityn test 71c: check FIEMAP_EXTENT_LAST flag with different extents number | Kernel panic - not syncing: Out of memory: system-wide panic_on_oom is enabled CPU: 1 PID: 615 Comm: NetworkManager Kdump: loaded Tainted: P OE ------ --- 5.14.0-687.17.1.el9_8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x33/0x50 vpanic+0x129/0x2f0 panic+0x58/0x60 out_of_memory+0x2ae/0x330 __alloc_pages_slowpath.constprop.0+0xa70/0xc90 __alloc_pages+0x21c/0x250 alloc_pages_mpol+0x93/0x1f0 ? filemap_get_entry+0xe3/0x140 folio_alloc+0x12/0x30 __filemap_get_folio+0x189/0x2e0 filemap_fault+0x4d5/0x8b0 ? srso_alias_return_thunk+0x5/0xfbef5 ? srso_alias_return_thunk+0x5/0xfbef5 __do_fault+0x31/0x150 do_read_fault+0x11b/0x1c0 do_pte_missing+0x157/0x200 __handle_mm_fault+0x2fb/0x650 handle_mm_fault+0xfb/0x270 do_user_addr_fault+0x215/0x6a0 exc_page_fault+0x71/0x140 asm_exc_page_fault+0x22/0x30 RIP: 0033:0x563953a4e900 | obd_memory max: 167741775, obd_memory current: 148446463 obd_memory max: 167741775, obd_memory current: 148446463 obd_memory max: 167741775, obd_memory current: 148446463 obd_memory max: 167741775, obd_memory current: 148446463 obd_memory max: 167741775, obd_memory current: 148446463 obd_memory max: 167741775, obd_memory current: 148446463 obd_memory max: 167741775, obd_memory current: 148446463 obd_memory max: 167741775, obd_memory current: 148446463 NetworkManager invoked oom-killer: gfp_mask=0x140cca(GFP_HIGHUSER_MOVABLE|__GFP_COMP), order=0, oom_score_adj=0 CPU: 1 PID: 615 Comm: NetworkManager Kdump: loaded Tainted: P OE ------ --- 5.14.0-687.17.1.el9_8_lustre.x86_64 #1 Hardware name: Red Hat KVM/RHEL, BIOS 1.16.3-4.el9 04/01/2014 Call Trace: <TASK> dump_stack_lvl+0x33/0x50 dump_header+0x49/0x240 out_of_memory+0x289/0x330 __alloc_pages_slowpath.constprop.0+0xa70/0xc90 __alloc_pages+0x21c/0x250 alloc_pages_mpol+0x93/0x1f0 ? filemap_get_entry+0xe3/0x140 folio_alloc+0x12/0x30 __filemap_get_folio+0x189/0x2e0 filemap_fault+0x4d5/0x8b0 ? srso_alias_return_thunk+0x5/0xfbef5 ? srso_alias_return_thunk+0x5/0xfbef5 __do_fault+0x31/0x150 do_read_fault+0x11b/0x1c0 do_pte_missing+0x157/0x200 __handle_mm_fault+0x2fb/0x650 handle_mm_fault+0xfb/0x270 do_user_addr_fault+0x215/0x6a0 exc_page_fault+0x71/0x140 asm_exc_page_fault+0x22/0x30 RIP: 0033:0x563953a4e900 Code: Unable to access opcode bytes at 0x563953a4e8d6. RSP: 002b:00007fffa789c468 EFLAGS: 00010246 RAX: 0000000000000000 RBX: 600c10b5ab0f8817 RCX: 0000000000000017 RDX: 000000000065ba8c RSI: 0000563953b80c10 RDI: 0000563953d96c70 RBP: 00005639551ce000 R08: 0000000000000048 R09: 00000af5f5533d4e R10: 00007fffa7980080 R11: 00007fffa7980090 R12: 000056395526c5f0 R13: 0000563953b9fb90 R14: 00007fffa789c580 R15: 000009f56f7e7f91 </TASK> Mem-Info: active_anon:7 inactive_anon:22 isolated_anon:0 Node 0 active_anon:28kB inactive_anon:88kB active_file:120kB inactive_file:100kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:80kB dirty:8kB writeback:4kB shmem:8kB shmem_thp:0kB shmem_pmdmapped:0kB anon_thp:0kB writeback_tmp:0kB kernel_stack:9920kB pagetables:2036kB sec_pagetables:0kB all_unreclaimable? no Node 0 DMA free:14672kB boost:0kB min:280kB low:348kB high:416kB reserved_highatomic:0KB active_anon:0kB inactive_anon:0kB active_file:8kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB lowmem_reserve[]: 0 1678 3598 3598 3598 Node 0 DMA32 free:40368kB boost:2048kB min:33436kB low:41280kB high:49124kB reserved_highatomic:0KB active_anon:0kB inactive_anon:292kB active_file:20kB inactive_file:152kB unevictable:0kB writepending:0kB present:2080624kB managed:1752944kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB lowmem_reserve[]: 0 0 1920 1920 1920 Node 0 Normal free:18944kB boost:0kB min:35912kB low:44888kB high:53864kB reserved_highatomic:0KB active_anon:100kB inactive_anon:200kB active_file:284kB inactive_file:208kB unevictable:0kB writepending:264kB present:2097152kB managed:1972912kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB lowmem_reserve[]: 0 0 0 0 0 Node 0 DMA: 1*4kB (M) 2*8kB (ME) 3*16kB (UME) 2*32kB (ME) 3*64kB (UME) 2*128kB (ME) 3*256kB (UME) 2*512kB (ME) 2*1024kB (ME) 1*2048kB (E) 2*4096kB (M) = 14660kB Node 0 DMA32: 868*4kB (ME) 811*8kB (ME) 665*16kB (UME) 322*32kB (UME) 119*64kB (UME) 14*128kB (UME) 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 40312kB Node 0 Normal: 1004*4kB (UME) 580*8kB (UME) 244*16kB (UME) 99*32kB (UME) 23*64kB (ME) 0*128kB 1*256kB (E) 1*512kB (U) 1*1024kB (U) 0*2048kB 0*4096kB = 18992kB Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB 85 total pagecache pages 43 pages in swap cache Free swap = 3759324kB Total swap = 3807228kB 1048442 pages RAM 0 pages HighMem/MovableOnly 113138 pages reserved 0 pages cma reserved 0 pages hwpoisoned Unreclaimable slab info: Name Used Total ofd_obj 73KB 262KB osd_zapit_cache 15KB 15KB zfs_osd_obj 167KB 516KB vvp_thread_kmem 15KB 15KB vvp_session_kmem 7KB 7KB ll_thread_kmem 7KB 7KB lov_session_kmem 15KB 15KB lov_thread_kmem 7KB 7KB osc_session_kmem 7KB 7KB osc_thread_kmem 61KB 61KB tgt_fmd_cache 15KB 31KB tgt_session_kmem 62KB 62KB tgt_thread_kmem 226KB 226KB ldlm_glimpse_work_kmem 7KB 7KB interval_tree 166KB 444KB ldlm_locks 331KB 912KB ldlm_resources 166KB 448KB lnet_msg 71KB 71KB lnet_rspt 352KB 352KB lnet_small_MDs 12KB 31KB lnet_MEs 50KB 51KB ptlrpc_cache 709KB 710KB cl_env_kmem 3KB 3KB ll_obd_dev_cache 304KB 347KB bio-184 31KB 31KB bio-264 76KB 93KB zfs_znode_hold_cache 7KB 7KB zap_attr_long_cache 30KB 30KB zap_attr_cache 7KB 7KB zap_name 26KB 26KB dbuf_dirty_record_t 8800KB 8800KB dmu_buf_impl_t 9780KB 9780KB arc_buf_t 764KB 764KB zio_buf_comb_16384 4720KB 5312KB zio_buf_comb_12288 48KB 48KB zio_buf_comb_8192 3368KB 5088KB zio_buf_comb_6144 60KB 60KB zio_buf_comb_4096 224KB 320KB zio_buf_comb_3072 60KB 60KB zio_buf_comb_2048 64KB 64KB zio_buf_comb_1536 63KB 63KB zio_link_cache 13KB 27KB zio_cache 178KB 432KB zfs_btree_leaf_cache 2952KB 4960KB nfs_commit_data 15KB 15KB nfs_write_data 95KB 175KB nfs_read_data 31KB 31KB nfs_page 20KB 40KB rpc_buffers 64KB 64KB rpc_tasks 8KB 8KB ext4_system_zone 3KB 3KB ext4_io_end_vec 8KB 8KB jbd2_inode 8KB 8KB scsi_sense_cache 24KB 24KB bio-144 27KB 27KB fib6_nodes 8KB 8KB ip6_dst_cache 7KB 7KB PINGv6 15KB 15KB RAWv6 31KB 31KB UDPv6 63KB 63KB TCPv6 59KB 59KB mqueue_inode_cache 16KB 16KB kioctx 15KB 15KB aio_kiocb 7KB 7KB posix_timers_cache 7KB 7KB UNIX-STREAM 163KB 195KB UNIX 75KB 75KB tcp_bind_bucket 8KB 8KB ip_fib_trie 7KB 7KB ip_fib_alias 7KB 7KB ip_dst_cache 36KB 36KB PING 15KB 15KB RAW 15KB 15KB UDP 30KB 30KB tw_sock_TCP 7KB 7KB request_sock_TCP 7KB 7KB TCP 150KB 150KB hugetlbfs_inode_cache 7KB 7KB bio-272 18KB 18KB ep_head 8KB 8KB eventpoll_pwq 16KB 16KB eventpoll_epi 28KB 28KB inotify_inode_mark 15KB 15KB sgpool-128 160KB 160KB sgpool-64 64KB 64KB sgpool-32 32KB 32KB sgpool-16 16KB 16KB sgpool-8 8KB 8KB bio_integrity_data 3KB 3KB request_queue 31KB 31KB blkdev_ioc 7KB 7KB bio-208 32KB 56KB biovec-max 288KB 352KB biovec-128 64KB 64KB biovec-64 32KB 32KB biovec-16 8KB 8KB khugepaged_mm_slot 7KB 7KB user_namespace 7KB 7KB uid_cache 7KB 7KB dmaengine-unmap-256 30KB 30KB dmaengine-unmap-128 15KB 15KB dmaengine-unmap-16 3KB 3KB dmaengine-unmap-2 4KB 4KB audit_buffer 7KB 7KB skbuff_fclone_cache 96KB 96KB skbuff_head_cache 48KB 48KB configfs_dir_cache 3KB 3KB file_lock_cache 7KB 7KB file_lock_ctx 7KB 7KB fsnotify_mark_connector 8KB 8KB taskstats 15KB 15KB proc_dir_entry 228KB 228KB pde_opener 7KB 7KB seq_file 7KB 7KB sigqueue 7KB 7KB shmem_inode_cache 992KB 1054KB kernfs_iattrs_cache 15KB 15KB kernfs_node_cache 4444KB 4465KB mnt_cache 225KB 225KB filp 267KB 308KB names_cache 128KB 128KB net_namespace 60KB 60KB lsm_inode_cache 638KB 840KB lsm_file_cache 27KB 32KB key_jar 28KB 28KB uts_namespace 15KB 15KB nsproxy 7KB 7KB vma_lock 187KB 199KB vm_area_struct 960KB 960KB fs_cache 20KB 20KB files_cache 110KB 110KB signal_cache 724KB 771KB sighand_cache 1276KB 1330KB task_struct 5525KB 5710KB cred_jar 147KB 153KB anon_vma_chain 163KB 168KB anon_vma 180KB 182KB pid 129KB 133KB Acpi-Operand 118KB 118KB Acpi-ParseExt 7KB 7KB Acpi-Parse 7KB 7KB Acpi-State 23KB 23KB Acpi-Namespace 19KB 19KB numa_policy 3KB 3KB perf_event 30KB 30KB trace_event_file 189KB 189KB ftrace_event_field 274KB 274KB pool_workqueue 96KB 96KB maple_node 136KB 240KB task_group 79KB 79KB mm_struct 189KB 189KB vmap_area 455KB 523KB kmalloc-cg-8k 32KB 32KB kmalloc-cg-4k 96KB 96KB kmalloc-cg-2k 512KB 512KB kmalloc-cg-1k 128KB 128KB kmalloc-cg-512 32KB 32KB kmalloc-cg-256 12KB 12KB kmalloc-cg-192 27KB 27KB kmalloc-cg-128 8KB 8KB kmalloc-cg-96 7KB 7KB kmalloc-cg-64 8KB 8KB kmalloc-cg-32 8KB 8KB kmalloc-cg-16 8KB 8KB kmalloc-cg-8 16KB 16KB kmalloc-8k 6416KB 7392KB kmalloc-4k 14880KB 14880KB kmalloc-2k 2642KB 2752KB kmalloc-1k 8096KB 9392KB kmalloc-512 2541KB 4656KB kmalloc-256 593KB 748KB kmalloc-192 2630KB 2736KB kmalloc-128 398KB 888KB kmalloc-96 923KB 1626KB kmalloc-64 1272KB 1628KB kmalloc-32 386KB 680KB kmalloc-16 146KB 152KB kmalloc-8 54KB 56KB kmem_cache_node 24KB 24KB kmem_cache 88KB 88KB Tasks state (memory values in pages): [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 513] 0 513 7141 32 98304 320 -250 systemd-journal [ 527] 0 527 9185 64 94208 576 -1000 systemd-udevd [ 580] 32 580 3708 32 69632 224 0 rpcbind [ 581] 0 581 4963 41 57344 224 -1000 auditd [ 613] 81 613 2684 64 65536 128 -900 dbus-broker-lau [ 614] 81 614 1262 64 49152 64 -900 dbus-broker [ 615] 0 615 65206 64 147456 736 0 NetworkManager [ 618] 0 618 20687 32 61440 96 0 irqbalance [ 620] 0 620 5261 64 77824 320 0 systemd-logind [ 623] 997 623 21450 46 65536 160 0 chronyd [ 641] 0 641 20267 32 53248 32 0 rhsmcertd [ 643] 0 643 2974 64 65536 288 -1000 sshd [ 648] 996 648 20093 69 69632 320 0 munged [ 654] 0 654 14170 48 81920 224 0 gssproxy [ 680] 0 680 41279 32 86016 224 0 rsyslogd [ 682] 29 682 2857 39 53248 192 0 rpc.statd [ 724] 0 724 85089 68 118784 512 0 automount [ 733] 0 733 766 32 49152 32 0 agetty [ 734] 0 734 1408 32 49152 32 0 agetty [ 744] 0 744 2167 32 53248 192 0 crond [ 1215] 0 1215 4454 32 77824 512 0 sshd-session [ 1219] 0 1219 5667 64 86016 448 100 systemd [ 1221] 0 1221 26905 59 94208 896 100 (sd-pam) [ 1228] 0 1228 4519 32 77824 576 0 sshd-session [ 111425] 0 111425 4453 32 81920 480 0 sshd-session [ 111428] 0 111428 4518 75 81920 544 0 sshd-session [ 184632] 0 184632 4453 64 81920 448 0 sshd-session [ 184635] 0 184635 4551 43 81920 576 0 sshd-session [ 202030] 0 202030 1819 32 53248 64 0 bash [ 202063] 0 202063 1819 64 45056 64 0 bash [ 202064] 0 202064 1902 32 57344 384 0 tclsh | Link to test |