| Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
| Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
| Limit to a test: (Copy from below "Failing text"): | |
| Delete these reports as invalid (real bug in review or some such) | |
| Bug or comment: | |
| Extra info: |
| Failing Test | Full Crash | Messages before crash | Comment |
|---|---|---|---|
| obdfilter-survey test 1a: Object Storage Targets survey | Kernel panic - not syncing: Out of memory: system-wide panic_on_oom is enabled CPU: 1 PID: 433323 Comm: lctl Kdump: loaded Tainted: P OE --------- - - 4.18.0-513.9.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 panic+0xe7/0x2ac out_of_memory.cold.36+0x2f/0x7e __alloc_pages_slowpath+0xbf0/0xcd0 __alloc_pages_nodemask+0x2e2/0x330 alloc_pages_vma+0x7e/0x200 __read_swap_cache_async+0xf4/0x2b0 swap_cluster_readahead+0x178/0x2f0 swapin_readahead+0x5c/0x501 ? pagecache_get_page+0x30/0x310 do_swap_page+0x45b/0x710 ? pmd_devmap_trans_unstable+0x2e/0x40 ? handle_pte_fault+0x5d/0x880 __handle_mm_fault+0x552/0x6d0 ? class_handle_ioctl+0xac1/0x1e60 [obdclass] handle_mm_fault+0xca/0x2a0 __do_page_fault+0x1f0/0x460 do_page_fault+0x37/0x130 ? page_fault+0x8/0x30 page_fault+0x1e/0x30 RIP: 0033:0x7fbdecc64aec | Lustre: Echo OBD driver; http://www.lustre.org/ obd_memory max: 130011135, obd_memory current: 118551803 obd_memory max: 130011135, obd_memory current: 119193867 obd_memory max: 130011135, obd_memory current: 118893819 obd_memory max: 130011135, obd_memory current: 118878243 obd_memory max: 130011135, obd_memory current: 118878123 obd_memory max: 130011135, obd_memory current: 118878083 obd_memory max: 130011135, obd_memory current: 118844835 obd_memory max: 130011135, obd_memory current: 118844795 obd_memory max: 130011135, obd_memory current: 118844219 obd_memory max: 130011135, obd_memory current: 118844219 obd_memory max: 130011135, obd_memory current: 118842491 obd_memory max: 130011135, obd_memory current: 118842491 obd_memory max: 130011135, obd_memory current: 118842491 obd_memory max: 130011135, obd_memory current: 118842491 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118841883 obd_memory max: 130011135, obd_memory current: 118999579 obd_memory max: 130011135, obd_memory current: 118999579 obd_memory max: 130011135, obd_memory current: 118999579 obd_memory max: 130011135, obd_memory current: 118999579 obd_memory max: 130011135, obd_memory current: 118983283 obd_memory max: 130011135, obd_memory current: 119379195 obd_memory max: 130011135, obd_memory current: 119363475 lctl invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0 CPU: 1 PID: 433323 Comm: lctl Kdump: loaded Tainted: P OE --------- - - 4.18.0-513.9.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 dump_header+0x4a/0x1df out_of_memory.cold.36+0xa/0x7e __alloc_pages_slowpath+0xbf0/0xcd0 __alloc_pages_nodemask+0x2e2/0x330 alloc_pages_vma+0x7e/0x200 __read_swap_cache_async+0xf4/0x2b0 swap_cluster_readahead+0x178/0x2f0 swapin_readahead+0x5c/0x501 ? pagecache_get_page+0x30/0x310 do_swap_page+0x45b/0x710 ? pmd_devmap_trans_unstable+0x2e/0x40 ? handle_pte_fault+0x5d/0x880 __handle_mm_fault+0x552/0x6d0 ? class_handle_ioctl+0xac1/0x1e60 [obdclass] handle_mm_fault+0xca/0x2a0 __do_page_fault+0x1f0/0x460 do_page_fault+0x37/0x130 ? page_fault+0x8/0x30 page_fault+0x1e/0x30 RIP: 0033:0x7fbdecc64aec Code: 00 f0 41 0f b1 38 74 16 49 8d 38 48 81 ec 80 00 00 00 e8 37 6d 00 00 48 81 c4 80 00 00 00 41 8b 50 08 85 d2 0f 85 b6 01 00 00 <64> 8b 04 25 d0 02 00 00 41 89 40 08 41 83 40 0c 01 90 31 c0 48 83 RSP: 002b:00007ffd15e412c0 EFLAGS: 00010246 RAX: 0000000000000000 RBX: 00007ffd15e43b30 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000080 RDI: 0000000000000001 RBP: 0000000000000052 R08: 00007fbdedef8000 R09: 0000000000690b9e R10: 00007ffd15ff3000 R11: 0000000000000246 R12: 0000000000000052 R13: 00000000c008667e R14: 0000000000000000 R15: 0000000000000000 Mem-Info: active_anon:32 inactive_anon:82 isolated_anon:63 Node 0 active_anon:128kB inactive_anon:328kB active_file:112kB inactive_file:272kB unevictable:0kB isolated(anon):252kB isolated(file):0kB mapped:1220kB dirty:8kB writeback:56kB shmem:52kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:9504kB pagetables:16828kB all_unreclaimable? no Node 0 DMA free:10612kB min:256kB low:320kB high:384kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15992kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB lowmem_reserve[]: 0 2597 2597 2597 2597 Node 0 DMA32 free:47316kB min:44796kB low:55992kB high:67188kB active_anon:240kB inactive_anon:696kB active_file:412kB inactive_file:604kB unevictable:0kB writepending:64kB present:3129320kB managed:2694556kB mlocked:0kB bounce:0kB free_pcp:524kB local_pcp:168kB free_cma:0kB lowmem_reserve[]: 0 0 0 0 0 Node 0 DMA: 1*4kB (U) 0*8kB 1*16kB (U) 1*32kB (U) 1*64kB (U) 0*128kB 1*256kB (U) 0*512kB 0*1024kB 1*2048kB (M) 2*4096kB (M) = 10612kB Node 0 DMA32: 1362*4kB (UME) 968*8kB (UME) 635*16kB (MEH) 280*32kB (MEH) 109*64kB (MEH) 15*128kB (UM) 4*256kB (UM) 1*512kB (U) 4*1024kB (U) 0*2048kB 0*4096kB = 46840kB Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB 82 total pagecache pages 36 pages in swap cache Swap cache stats: add 36279, delete 36253, find 1715/5671 Free swap = 2723576kB Total swap = 2841596kB 786328 pages RAM 0 pages HighMem/MovableOnly 108849 pages reserved 0 pages hwpoisoned Unreclaimable slab info: Name Used Total echo_session_kmem 8KB 8KB echo_thread_kmem 140KB 140KB echo_object_kmem 7KB 7KB ofd_obj 106KB 164KB osd_zapit_cache 15KB 15KB zfs_osd_obj 215KB 332KB lqe_kmem 36KB 36KB vvp_thread_kmem 60KB 60KB vvp_session_kmem 27KB 27KB ll_thread_kmem 19KB 19KB lov_session_kmem 63KB 63KB lov_thread_kmem 19KB 19KB osc_session_kmem 34KB 34KB osc_thread_kmem 302KB 302KB ldlm_glimpse_work_kmem 3KB 3KB interval_tree 132KB 148KB interval_node 140KB 140KB ldlm_locks 74KB 102KB ldlm_resources 82KB 82KB lnet_msg 131KB 131KB lnet_rspt 31KB 31KB lnet_small_MDs 75KB 75KB lnet_MEs 118KB 118KB ptlrpc_cache 160KB 176KB tgt_fmd_cache 135KB 135KB tgt_session_kmem 78KB 78KB tgt_thread_kmem 246KB 246KB cl_env_kmem 15KB 15KB ll_obd_dev_cache 283KB 283KB zfs_znode_hold_cache 7KB 7KB zfs_znode_cache 31KB 31KB zil_zcw_cache 3KB 3KB zil_lwb_cache 7KB 7KB dmu_buf_impl_t 1560KB 1715KB arc_buf_t 231KB 231KB arc_buf_hdr_t_full 2558KB 2621KB dnode_t 3114KB 3937KB sa_cache 100KB 176KB abd_t 205KB 308KB lz4_cache 64KB 64KB zio_buf_comb_16384 3360KB 4544KB zio_buf_comb_12288 48KB 48KB zio_buf_comb_10240 48KB 48KB zio_buf_comb_8192 160KB 320KB zio_buf_comb_7168 64KB 64KB zio_buf_comb_6144 64KB 64KB zio_buf_comb_5120 64KB 64KB zio_buf_comb_4096 256KB 544KB zio_buf_comb_3584 63KB 63KB zio_buf_comb_3072 60KB 60KB zio_buf_comb_2560 60KB 60KB zio_buf_comb_2048 64KB 64KB zio_buf_comb_1536 126KB 126KB zio_buf_comb_1024 242KB 720KB zio_buf_comb_512 120KB 232KB zio_link_cache 163KB 163KB zio_cache 1916KB 1995KB zfs_btree_leaf_cache 2248KB 2688KB mod_hash_entries 3KB 3KB bio-200 36KB 36KB bio-272 112KB 123KB nfs_commit_data 15KB 15KB nfs_write_data 47KB 47KB nfs_read_data 31KB 31KB nfs_page 8KB 8KB fscache_cookie_jar 7KB 7KB rpc_buffers 64KB 64KB rpc_tasks 8KB 8KB ext4_system_zone 3KB 3KB jbd2_inode 40KB 40KB scsi_sense_cache 4KB 4KB bio-160 7KB 7KB fib6_nodes 8KB 8KB ip6_dst_cache 7KB 7KB RAWv6 15KB 15KB UDPv6 63KB 63KB TCPv6 61KB 61KB sgpool-128 32KB 32KB sgpool-64 32KB 32KB sgpool-32 16KB 16KB sgpool-16 8KB 8KB sgpool-8 4KB 4KB mqueue_inode_cache 16KB 16KB kioctx 31KB 31KB aio_kiocb 7KB 7KB bio-248 8KB 8KB posix_timers_cache 19KB 19KB UNIX 330KB 330KB tcp_bind_bucket 8KB 8KB ip_fib_trie 7KB 7KB ip_fib_alias 7KB 7KB ip_dst_cache 24KB 28KB RAW 31KB 31KB UDP 30KB 30KB tw_sock_TCP 7KB 7KB request_sock_TCP 7KB 7KB TCP 95KB 95KB hugetlbfs_inode_cache 7KB 7KB bio-280 11KB 11KB eventpoll_pwq 19KB 19KB eventpoll_epi 36KB 36KB inotify_inode_mark 7KB 7KB request_queue 63KB 63KB blkdev_ioc 35KB 35KB bio-224 100KB 100KB biovec-max 480KB 640KB biovec-128 64KB 64KB biovec-64 32KB 32KB biovec-16 8KB 8KB bio_integrity_payload 4KB 4KB khugepaged_mm_slot 7KB 7KB uid_cache 7KB 7KB dmaengine-unmap-256 30KB 30KB dmaengine-unmap-128 15KB 15KB dmaengine-unmap-16 3KB 3KB dmaengine-unmap-2 4KB 4KB audit_buffer 7KB 7KB skbuff_fclone_cache 70KB 70KB skbuff_head_cache 64KB 64KB configfs_dir_cache 3KB 3KB file_lock_cache 7KB 7KB file_lock_ctx 7KB 7KB fsnotify_mark_connector 7KB 7KB net_namespace 31KB 31KB task_delay_info 71KB 71KB taskstats 15KB 15KB proc_dir_entry 252KB 252KB pde_opener 7KB 7KB seq_file 8KB 8KB sigqueue 7KB 7KB shmem_inode_cache 859KB 859KB kernfs_iattrs_cache 15KB 15KB kernfs_node_cache 4317KB 4352KB mnt_cache 338KB 338KB filp 599KB 656KB names_cache 64KB 64KB avc_node 7KB 7KB lsm_inode_cache 1091KB 1712KB lsm_file_cache 76KB 76KB key_jar 24KB 24KB nsproxy 7KB 7KB vm_area_struct 3165KB 3165KB mm_struct 220KB 220KB fs_cache 16KB 16KB files_cache 110KB 110KB signal_cache 720KB 720KB sighand_cache 1206KB 1206KB task_struct 6000KB 6000KB cred_jar 196KB 196KB anon_vma_chain 672KB 672KB anon_vma 594KB 594KB pid 128KB 128KB Acpi-Operand 78KB 78KB Acpi-ParseExt 3KB 3KB Acpi-Parse 3KB 3KB Acpi-State 11KB 11KB Acpi-Namespace 19KB 19KB numa_policy 3KB 3KB perf_event 15KB 15KB trace_event_file 158KB 158KB ftrace_event_field 211KB 211KB pool_workqueue 8KB 8KB task_group 173KB 173KB vmap_area 239KB 364KB kmalloc-cg-4k 96KB 96KB kmalloc-cg-2k 96KB 96KB kmalloc-cg-1k 213KB 256KB kmalloc-cg-512 24KB 24KB kmalloc-cg-256 8KB 8KB kmalloc-cg-192 23KB 23KB kmalloc-cg-96 7KB 7KB kmalloc-cg-64 8KB 8KB kmalloc-cg-32 8KB 8KB kmalloc-cg-16 8KB 8KB kmalloc-cg-8 8KB 8KB kmalloc-8k 4080KB 4704KB kmalloc-4k 4740KB 5568KB kmalloc-2k 3700KB 3808KB kmalloc-1k 7469KB 7476KB kmalloc-512 4563KB 4648KB kmalloc-256 329KB 352KB kmalloc-192 2480KB 2606KB kmalloc-128 678KB 1044KB kmalloc-96 980KB 1031KB kmalloc-64 1062KB 1176KB kmalloc-32 1256KB 1420KB kmalloc-16 156KB 156KB kmalloc-8 52KB 52KB kmem_cache_node 24KB 24KB kmem_cache 149KB 149KB Tasks state (memory values in pages): [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 472] 0 472 22406 1 237568 266 0 systemd-journal [ 511] 0 511 24257 1 212992 307 -1000 systemd-udevd [ 565] 32 565 16813 0 176128 192 0 rpcbind [ 570] 0 570 14277 0 139264 162 -1000 auditd [ 597] 81 597 14145 1 155648 232 -900 dbus-daemon [ 599] 0 599 95191 0 380928 1214 0 NetworkManager [ 600] 70 600 14604 0 159744 193 0 avahi-daemon [ 601] 0 601 31228 0 139264 184 0 irqbalance [ 603] 0 603 20396 1 200704 240 0 systemd-logind [ 607] 995 607 35020 0 180224 191 0 chronyd [ 611] 70 611 14538 0 151552 109 0 avahi-daemon [ 627] 0 627 121324 174 438272 3737 0 tuned [ 628] 0 628 30232 0 294912 356 0 cupsd [ 629] 0 629 19163 1 192512 234 -1000 sshd [ 635] 0 635 28884 0 110592 141 0 rhsmcertd [ 636] 994 636 29757 0 147456 175 0 munged [ 671] 0 671 52381 0 192512 398 0 rsyslogd [ 672] 29 672 11292 0 126976 149 0 rpc.statd [ 700] 0 700 12230 1 131072 146 0 xinetd [ 897] 998 897 402491 0 344064 1779 0 polkitd [ 941] 0 941 26834 0 180224 251 0 master [ 943] 89 943 30855 0 233472 274 0 qmgr [ 944] 0 944 26275 1 176128 177 0 gssproxy [ 1009] 0 1009 104372 0 307200 475 0 automount [ 1013] 0 1013 6533 0 98304 50 0 atd [ 1016] 0 1016 6465 1 106496 218 0 crond [ 1032] 0 1032 2371 0 61440 37 0 agetty [ 1034] 0 1034 1729 0 57344 33 0 agetty [ 5542] 0 5542 22424 1 208896 384 0 systemd [ 5544] 0 5544 34226 0 286720 701 0 (sd-pam) [ 7476] 0 7476 31620 1 290816 316 0 sshd [ 7480] 0 7480 31654 1 286720 369 0 sshd [ 33258] 0 33258 31620 1 286720 316 0 sshd [ 33260] 0 33260 31620 1 282624 317 0 sshd [ 270258] 89 270258 30842 0 221184 272 0 pickup [ 287479] 0 287479 31620 1 299008 316 0 sshd [ 287481] 0 287481 31620 1 294912 317 0 sshd [ 402515] 0 402515 47788 0 417792 7987 0 sssd_kcm [ 402518] 0 402518 12109 0 135168 210 0 ssh [ 402571] 0 402571 31620 1 290816 315 0 sshd [ 402575] 0 402575 12109 0 131072 211 0 ssh [ 402576] 0 402576 31620 1 286720 316 0 sshd [ 402801] 0 402801 31620 1 290816 315 0 sshd [ 402836] 0 402836 12109 0 135168 211 0 ssh [ 402842] 0 402842 31620 1 282624 316 0 sshd [ 402843] 0 402843 12649 0 135168 214 0 ssh [ 402847] 0 402847 12109 0 131072 211 0 ssh [ 430005] 0 430005 31620 1 299008 315 0 sshd [ 430078] 0 430078 31620 1 294912 316 0 sshd [ 431044] 0 431044 31620 1 278528 316 0 sshd [ 431046] 0 431046 31620 1 274432 319 0 sshd [ 431240] 0 431240 2484 1 69632 116 0 bash [ 431329] 0 431329 10488 0 114688 101 0 vmstat [ 433257] 0 433257 2484 1 69632 116 0 bash [ 433304] 0 433304 2451 1 65536 75 0 bash [ 433305] 0 433305 8103 0 110592 85 0 lctl [ 433306] 0 433306 8103 26 98304 85 0 lctl [ 433307] 0 433307 8103 0 114688 87 0 lctl [ 433308] 0 433308 8103 0 106496 108 0 lctl [ 433309] 0 433309 8103 0 102400 88 0 lctl [ 433310] 0 433310 8103 0 98304 86 0 lctl [ 433311] 0 433311 8103 0 106496 86 0 lctl [ 433312] 0 433312 8103 0 102400 107 0 lctl [ 433313] 0 433313 8103 0 106496 100 0 lctl [ 433314] 0 433314 8103 0 102400 99 0 lctl [ 433315] 0 433315 8103 0 102400 90 0 lctl [ 433316] 0 433316 8103 0 102400 100 0 lctl [ 433317] 0 433317 8103 0 102400 103 0 lctl [ 433318] 0 433318 8103 0 102400 104 0 lctl [ 433319] 0 433319 8103 0 102400 90 0 lctl [ 433320] 0 433320 8103 0 102400 104 0 lctl [ 433321] 0 433321 8103 0 94208 87 0 lctl [ 433322] 0 433322 8103 0 94208 99 0 lctl [ 433323] 0 433323 8103 0 94208 104 0 lctl [ 433325] 0 433325 8103 0 94208 87 0 lctl [ 433326] 0 433326 8103 0 94208 89 0 lctl [ 433327] 0 433327 8103 0 94208 92 0 lctl [ 433328] 0 433328 8103 0 94208 98 0 lctl [ 433329] 0 433329 8103 0 98304 85 0 lctl [ 433330] 0 433330 8103 0 98304 89 0 lctl [ 433331] 0 433331 8103 7 98304 78 0 lctl [ 433332] 0 433332 8103 1 98304 93 0 lctl [ 433333] 0 433333 8103 1 98304 87 0 lctl [ 433334] 0 433334 8103 0 98304 93 0 lctl [ 433335] 0 433335 8103 0 98304 105 0 lctl [ 433336] 0 433336 8103 0 98304 97 0 lctl [ 433337] 0 433337 8103 0 106496 97 0 lctl [ 433338] 0 433338 8103 0 106496 101 0 lctl [ 433339] 0 433339 8103 1 106496 86 0 lctl [ 433340] 0 433340 8103 1 106496 86 0 lctl [ 433341] 0 433341 8103 0 106496 107 0 lctl [ 433342] 0 433342 8103 0 106496 99 0 lctl [ 433344] 0 433344 8103 0 106496 87 0 lctl [ 433345] 0 433345 8103 0 98304 107 0 lctl [ 433346] 0 433346 8103 0 98304 106 0 lctl [ 433348] 0 433348 8103 0 98304 113 0 lctl [ 433349] 0 433349 8103 0 98304 89 0 lctl [ 433350] 0 433350 8103 0 98304 112 0 lctl [ 433351] 0 433351 8103 0 98304 115 0 lctl [ 433352] 0 433352 8103 1 98304 83 0 lctl [ 433353] 0 433353 8103 0 94208 107 0 lctl [ 433354] 0 433354 8103 0 94208 91 0 lctl [ 433355] 0 433355 8103 0 94208 106 0 lctl [ 433356] 0 433356 8103 0 102400 106 0 lctl [ 433357] 0 433357 8103 0 98304 101 0 lctl [ 433358] 0 433358 8103 3 102400 82 0 lctl [ 433359] 0 433359 8103 0 98304 116 0 lctl [ 433361] 0 433361 8103 0 98304 113 0 lctl [ 433362] 0 433362 8103 0 102400 112 0 lctl [ 433363] 0 433363 8103 0 98304 104 0 lctl [ 433364] 0 433364 8103 0 102400 85 0 lctl [ 433365] 0 433365 8103 0 98304 100 0 lctl [ 433366] 0 433366 8103 2 102400 86 0 lctl [ 433367] 0 433367 8103 0 98304 114 0 lctl [ 433368] 0 433368 8103 0 102400 109 0 lctl [ 433369] 0 433369 8103 0 98304 87 0 lctl [ 433370] 0 433370 8103 0 102400 98 0 lctl [ 433371] 0 433371 8103 0 98304 100 0 lctl [ 433372] 0 433372 8103 0 94208 90 0 lctl [ 433373] 0 433373 8103 0 94208 97 0 lctl [ 433374] 0 433374 8103 0 94208 97 0 lctl [ 433375] 0 433375 8103 0 94208 89 0 lctl [ 433376] 0 433376 8103 0 94208 97 0 lctl | Link to test |