Match messages in logs (every line would be required to be present in log output Copy from "Messages before crash" column below): | |
Match messages in full crash (every line would be required to be present in crash log output Copy from "Full Crash" column below): | |
Limit to a test: (Copy from below "Failing text"): | |
Delete these reports as invalid (real bug in review or some such) | |
Bug or comment: | |
Extra info: |
Failing Test | Full Crash | Messages before crash | Comment |
---|---|---|---|
sanity-benchmark test bonnie: bonnie++ | Kernel panic - not syncing: Out of memory: system-wide panic_on_oom is enabled CPU: 1 PID: 606 Comm: irqbalance Kdump: loaded Tainted: P OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 panic+0xe7/0x2ac out_of_memory.cold.36+0x2f/0x7e __alloc_pages_slowpath+0xbe7/0xcd0 __alloc_pages_nodemask+0x2e2/0x330 pagecache_get_page+0xce/0x310 filemap_fault+0x6bc/0xa30 ? __mod_lruvec_page_state+0x5e/0x80 ? page_add_file_rmap+0x99/0x130 ? xas_load+0x8/0x80 ? find_get_entry+0xd6/0x1c0 ? page_swapcount+0x69/0x90 ? xas_load+0x8/0x80 ? xas_find+0x183/0x1c0 ? filemap_map_pages+0x271/0x410 ? page_trans_huge_map_swapcount+0x18e/0x230 ext4_filemap_fault+0x2c/0x40 [ext4] __do_fault+0x38/0xc0 handle_pte_fault+0x55d/0x880 __handle_mm_fault+0x453/0x6c0 handle_mm_fault+0xca/0x2a0 __do_page_fault+0x1f0/0x460 do_page_fault+0x37/0x130 ? page_fault+0x8/0x30 page_fault+0x1e/0x30 RIP: 0033:0x7fe3ffa949d0 | Lustre: DEBUG MARKER: /usr/sbin/lctl mark min OST has 7470080kB available, using 5444512kB file size Lustre: DEBUG MARKER: min OST has 7470080kB available, using 5444512kB file size obd_memory max: 281346803, obd_memory current: 150217759 obd_memory max: 281346803, obd_memory current: 150257063 obd_memory max: 281346803, obd_memory current: 150257063 obd_memory max: 281346803, obd_memory current: 150257063 obd_memory max: 281346803, obd_memory current: 150259303 obd_memory max: 281346803, obd_memory current: 151901647 obd_memory max: 281346803, obd_memory current: 151901647 obd_memory max: 281346803, obd_memory current: 151901647 obd_memory max: 281346803, obd_memory current: 151901647 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151919519 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 151913463 obd_memory max: 281346803, obd_memory current: 150951151 obd_memory max: 281346803, obd_memory current: 150951151 obd_memory max: 281346803, obd_memory current: 150945703 obd_memory max: 281346803, obd_memory current: 151037743 obd_memory max: 281346803, obd_memory current: 151018663 obd_memory max: 281346803, obd_memory current: 150996315 obd_memory max: 281346803, obd_memory current: 150998747 obd_memory max: 281346803, obd_memory current: 150993299 obd_memory max: 281346803, obd_memory current: 150993299 obd_memory max: 281346803, obd_memory current: 150993299 obd_memory max: 281346803, obd_memory current: 150996339 obd_memory max: 281346803, obd_memory current: 150995731 obd_memory max: 281346803, obd_memory current: 151006675 obd_memory max: 281346803, obd_memory current: 151006675 obd_memory max: 281346803, obd_memory current: 151006675 obd_memory max: 281346803, obd_memory current: 151012147 obd_memory max: 281346803, obd_memory current: 151012147 obd_memory max: 281346803, obd_memory current: 151012147 obd_memory max: 281346803, obd_memory current: 151012147 obd_memory max: 281346803, obd_memory current: 151012147 obd_memory max: 281346803, obd_memory current: 151024307 obd_memory max: 281346803, obd_memory current: 151024307 obd_memory max: 281346803, obd_memory current: 151024307 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151028795 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151025347 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151021339 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151082107 obd_memory max: 281346803, obd_memory current: 151174571 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151175275 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151183627 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151185067 obd_memory max: 281346803, obd_memory current: 151187307 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151188555 obd_memory max: 281346803, obd_memory current: 151304299 obd_memory max: 281346803, obd_memory current: 151308019 obd_memory max: 281346803, obd_memory current: 151308299 obd_memory max: 281346803, obd_memory current: 151308579 obd_memory max: 281346803, obd_memory current: 151308579 obd_memory max: 281346803, obd_memory current: 151308579 obd_memory max: 281346803, obd_memory current: 151317323 obd_memory max: 281346803, obd_memory current: 151340939 obd_memory max: 281346803, obd_memory current: 151354315 obd_memory max: 281346803, obd_memory current: 151373011 obd_memory max: 281346803, obd_memory current: 151383187 obd_memory max: 281346803, obd_memory current: 151367867 obd_memory max: 281346803, obd_memory current: 151364139 obd_memory max: 281346803, obd_memory current: 151385387 obd_memory max: 281346803, obd_memory current: 151359667 obd_memory max: 281346803, obd_memory current: 151361107 obd_memory max: 281346803, obd_memory current: 151343971 obd_memory max: 281346803, obd_memory current: 151344691 obd_memory max: 281346803, obd_memory current: 151344691 obd_memory max: 281346803, obd_memory current: 151339243 obd_memory max: 281346803, obd_memory current: 151339243 obd_memory max: 281346803, obd_memory current: 151333795 obd_memory max: 281346803, obd_memory current: 151333795 obd_memory max: 281346803, obd_memory current: 151333795 obd_memory max: 281346803, obd_memory current: 151333795 obd_memory max: 281346803, obd_memory current: 151379451 obd_memory max: 281346803, obd_memory current: 151378475 obd_memory max: 281346803, obd_memory current: 151379899 obd_memory max: 281346803, obd_memory current: 151385939 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151388739 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151387379 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151593311 obd_memory max: 281346803, obd_memory current: 151603775 obd_memory max: 281346803, obd_memory current: 151603775 obd_memory max: 281346803, obd_memory current: 151603775 obd_memory max: 281346803, obd_memory current: 151603775 obd_memory max: 281346803, obd_memory current: 151603775 obd_memory max: 281346803, obd_memory current: 151603775 obd_memory max: 281346803, obd_memory current: 151603775 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151610751 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151438447 obd_memory max: 281346803, obd_memory current: 151439167 obd_memory max: 281346803, obd_memory current: 151433831 obd_memory max: 281346803, obd_memory current: 151433831 obd_memory max: 281346803, obd_memory current: 151433831 obd_memory max: 281346803, obd_memory current: 151433831 obd_memory max: 281346803, obd_memory current: 151433831 obd_memory max: 281346803, obd_memory current: 151433831 obd_memory max: 281346803, obd_memory current: 151433831 obd_memory max: 281346803, obd_memory current: 151433831 obd_memory max: 281346803, obd_memory current: 151442279 obd_memory max: 281346803, obd_memory current: 151442999 obd_memory max: 281346803, obd_memory current: 151442999 obd_memory max: 281346803, obd_memory current: 151442999 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151436943 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151464287 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151467775 obd_memory max: 281346803, obd_memory current: 151476415 obd_memory max: 281346803, obd_memory current: 151476415 obd_memory max: 281346803, obd_memory current: 151476415 obd_memory max: 281346803, obd_memory current: 151480255 obd_memory max: 281346803, obd_memory current: 151480255 obd_memory max: 281346803, obd_memory current: 151480255 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 obd_memory max: 281346803, obd_memory current: 151474199 irqbalance invoked oom-killer: gfp_mask=0x6200ca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0 CPU: 1 PID: 606 Comm: irqbalance Kdump: loaded Tainted: P OE --------- - - 4.18.0-477.27.1.el8_lustre.x86_64 #1 Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 Call Trace: dump_stack+0x41/0x60 dump_header+0x4a/0x1df out_of_memory.cold.36+0xa/0x7e __alloc_pages_slowpath+0xbe7/0xcd0 __alloc_pages_nodemask+0x2e2/0x330 pagecache_get_page+0xce/0x310 filemap_fault+0x6bc/0xa30 ? __mod_lruvec_page_state+0x5e/0x80 ? page_add_file_rmap+0x99/0x130 ? xas_load+0x8/0x80 ? find_get_entry+0xd6/0x1c0 ? page_swapcount+0x69/0x90 ? xas_load+0x8/0x80 ? xas_find+0x183/0x1c0 ? filemap_map_pages+0x271/0x410 ? page_trans_huge_map_swapcount+0x18e/0x230 ext4_filemap_fault+0x2c/0x40 [ext4] __do_fault+0x38/0xc0 handle_pte_fault+0x55d/0x880 __handle_mm_fault+0x453/0x6c0 handle_mm_fault+0xca/0x2a0 __do_page_fault+0x1f0/0x460 do_page_fault+0x37/0x130 ? page_fault+0x8/0x30 page_fault+0x1e/0x30 RIP: 0033:0x7fe3ffa949d0 Code: Unable to access opcode bytes at RIP 0x7fe3ffa949a6. RSP: 002b:00007ffc645c21c8 EFLAGS: 00010246 RAX: 0000000000000000 RBX: 0000557efc12a790 RCX: 0000000000000000 RDX: 0000000000000001 RSI: 0000557efc12de0e RDI: 00000000000001e8 RBP: 0000557efe13e2c0 R08: 0000000000000000 R09: 000000000041912e R10: 000000000041912e R11: 00007ffc645cb000 R12: 0000557efc12f06b R13: 0000557efc12de0e R14: 0000000000000001 R15: 0000557efe143a00 Mem-Info: active_anon:13 inactive_anon:60 isolated_anon:61 Node 0 active_anon:52kB inactive_anon:240kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):244kB isolated(file):0kB mapped:1040kB dirty:0kB writeback:452kB shmem:20kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB kernel_stack:9536kB pagetables:6272kB all_unreclaimable? no Node 0 DMA free:10736kB min:256kB low:320kB high:384kB active_anon:20kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:16kB present:15992kB managed:15360kB mlocked:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB lowmem_reserve[]: 0 2609 2609 2609 2609 Node 0 DMA32 free:55928kB min:44796kB low:55992kB high:67188kB active_anon:160kB inactive_anon:276kB active_file:0kB inactive_file:208kB unevictable:0kB writepending:836kB present:3129320kB managed:2706896kB mlocked:0kB bounce:0kB free_pcp:380kB local_pcp:340kB free_cma:0kB lowmem_reserve[]: 0 0 0 0 0 Node 0 DMA: 3*4kB (M) 3*8kB (M) 3*16kB (M) 5*32kB (MH) 4*64kB (MH) 2*128kB (MH) 1*256kB (H) 1*512kB (M) 1*1024kB (M) 0*2048kB 2*4096kB (UM) = 10740kB Node 0 DMA32: 4961*4kB (UMEH) 2660*8kB (UMEH) 328*16kB (UMEH) 39*32kB (UMH) 3*64kB (UM) 9*128kB (U) 6*256kB (UH) 11*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 56132kB Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB 166 total pagecache pages 134 pages in swap cache Swap cache stats: add 20690, delete 20565, find 696/3699 Free swap = 2792136kB Total swap = 2853884kB 786328 pages RAM 0 pages HighMem/MovableOnly 105764 pages reserved 0 pages hwpoisoned Unreclaimable slab info: Name Used Total ofd_obj 114KB 204KB osd_zapit_cache 15KB 15KB zfs_osd_obj 250KB 466KB upd_kmem 7KB 7KB lqe_kmem 24KB 24KB vvp_thread_kmem 15KB 15KB vvp_session_kmem 7KB 7KB ll_thread_kmem 7KB 7KB lov_session_kmem 15KB 15KB lov_thread_kmem 7KB 7KB osc_session_kmem 7KB 7KB osc_thread_kmem 60KB 60KB ldlm_glimpse_work_kmem 7KB 7KB interval_tree 220KB 220KB interval_node 128KB 144KB ldlm_locks 136KB 173KB ldlm_resources 103KB 129KB lnet_msg 85KB 85KB lnet_rspt 23KB 43KB lnet_small_MDs 127KB 131KB lnet_MEs 118KB 118KB ptlrpc_cache 394KB 630KB tgt_fmd_cache 75KB 75KB tgt_session_kmem 133KB 149KB tgt_thread_kmem 216KB 216KB cl_env_kmem 3KB 3KB ll_obd_dev_cache 252KB 252KB zfs_znode_hold_cache 7KB 7KB zfs_znode_cache 31KB 31KB dmu_buf_impl_t 1486KB 2228KB arc_buf_t 157KB 278KB arc_buf_hdr_t_full 2630KB 6817KB dnode_t 3801KB 5549KB sa_cache 84KB 179KB abd_t 193KB 376KB lz4_cache 64KB 64KB zio_buf_comb_16384 3488KB 5376KB zio_buf_comb_12288 48KB 48KB zio_buf_comb_10240 48KB 48KB zio_buf_comb_8192 96KB 96KB zio_buf_comb_7168 64KB 64KB zio_buf_comb_6144 64KB 64KB zio_buf_comb_5120 64KB 64KB zio_buf_comb_4096 224KB 448KB zio_buf_comb_3584 63KB 63KB zio_buf_comb_3072 60KB 60KB zio_buf_comb_2560 60KB 60KB zio_buf_comb_2048 64KB 64KB zio_buf_comb_1536 94KB 94KB zio_buf_comb_1024 138KB 416KB zio_buf_comb_512 162KB 400KB zio_link_cache 155KB 155KB zio_cache 1545KB 1545KB zfs_btree_leaf_cache 2672KB 3968KB mod_hash_entries 3KB 3KB bio-200 44KB 44KB bio-272 101KB 101KB nfs_commit_data 15KB 15KB nfs_write_data 47KB 47KB nfs_read_data 31KB 31KB nfs_page 8KB 8KB fscache_cookie_jar 7KB 7KB rpc_buffers 64KB 64KB rpc_tasks 8KB 8KB ext4_system_zone 3KB 3KB jbd2_inode 40KB 40KB scsi_sense_cache 4KB 4KB bio-160 11KB 11KB fib6_nodes 8KB 8KB ip6_dst_cache 7KB 7KB RAWv6 15KB 15KB UDPv6 63KB 63KB TCPv6 61KB 61KB sgpool-128 32KB 32KB sgpool-64 32KB 32KB sgpool-32 16KB 16KB sgpool-16 8KB 8KB sgpool-8 4KB 4KB mqueue_inode_cache 16KB 16KB kioctx 31KB 31KB aio_kiocb 7KB 7KB bio-248 8KB 8KB posix_timers_cache 23KB 23KB UNIX 291KB 330KB tcp_bind_bucket 8KB 8KB ip_fib_trie 7KB 7KB ip_fib_alias 7KB 7KB ip_dst_cache 52KB 52KB RAW 31KB 31KB UDP 30KB 30KB tw_sock_TCP 7KB 7KB request_sock_TCP 7KB 7KB TCP 126KB 126KB hugetlbfs_inode_cache 7KB 7KB bio-280 11KB 11KB eventpoll_pwq 19KB 19KB eventpoll_epi 32KB 32KB inotify_inode_mark 7KB 7KB request_queue 63KB 63KB blkdev_ioc 35KB 35KB bio-224 96KB 96KB biovec-max 520KB 608KB biovec-128 64KB 64KB biovec-64 32KB 32KB biovec-16 8KB 8KB bio_integrity_payload 4KB 4KB khugepaged_mm_slot 7KB 7KB uid_cache 7KB 7KB dmaengine-unmap-256 30KB 30KB dmaengine-unmap-128 15KB 15KB dmaengine-unmap-16 3KB 3KB dmaengine-unmap-2 4KB 4KB audit_buffer 7KB 7KB skbuff_fclone_cache 118KB 118KB skbuff_head_cache 48KB 48KB file_lock_cache 7KB 7KB file_lock_ctx 7KB 7KB fsnotify_mark_connector 7KB 7KB net_namespace 31KB 31KB task_delay_info 55KB 55KB taskstats 15KB 15KB proc_dir_entry 244KB 244KB pde_opener 7KB 7KB seq_file 8KB 8KB sigqueue 7KB 7KB shmem_inode_cache 891KB 891KB kernfs_iattrs_cache 11KB 11KB kernfs_node_cache 4681KB 4681KB mnt_cache 252KB 252KB filp 417KB 540KB names_cache 64KB 64KB avc_node 7KB 7KB lsm_inode_cache 1113KB 1612KB lsm_file_cache 52KB 52KB key_jar 28KB 28KB nsproxy 7KB 7KB vm_area_struct 1203KB 1220KB mm_struct 189KB 189KB fs_cache 16KB 16KB files_cache 126KB 126KB signal_cache 723KB 750KB sighand_cache 1206KB 1237KB task_struct 6000KB 6000KB cred_jar 204KB 204KB anon_vma_chain 216KB 268KB anon_vma 233KB 263KB pid 92KB 92KB Acpi-Operand 78KB 78KB Acpi-ParseExt 3KB 3KB Acpi-Parse 3KB 3KB Acpi-State 11KB 11KB Acpi-Namespace 15KB 15KB numa_policy 3KB 3KB perf_event 15KB 15KB trace_event_file 154KB 154KB ftrace_event_field 211KB 211KB pool_workqueue 12KB 12KB task_group 173KB 173KB vmap_area 244KB 356KB kmalloc-cg-4k 96KB 96KB kmalloc-cg-2k 96KB 96KB kmalloc-cg-1k 177KB 208KB kmalloc-cg-512 16KB 16KB kmalloc-cg-256 8KB 8KB kmalloc-cg-192 19KB 19KB kmalloc-cg-96 7KB 7KB kmalloc-cg-64 8KB 8KB kmalloc-cg-32 8KB 8KB kmalloc-cg-16 8KB 8KB kmalloc-cg-8 8KB 8KB kmalloc-8k 4544KB 5184KB kmalloc-4k 5360KB 5792KB kmalloc-2k 3910KB 3968KB kmalloc-1k 10114KB 11476KB kmalloc-512 4439KB 9336KB kmalloc-256 334KB 764KB kmalloc-192 2267KB 2433KB kmalloc-128 572KB 1120KB kmalloc-96 1191KB 1775KB kmalloc-64 1089KB 1648KB kmalloc-32 1333KB 1884KB kmalloc-16 144KB 144KB kmalloc-8 52KB 52KB kmem_cache_node 24KB 24KB kmem_cache 149KB 149KB Tasks state (memory values in pages): [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name [ 472] 0 472 22386 0 229376 260 0 systemd-journal [ 508] 0 508 24265 1 212992 345 -1000 systemd-udevd [ 569] 32 569 16812 0 172032 194 0 rpcbind [ 573] 0 573 14276 0 131072 173 -1000 auditd [ 599] 70 599 14599 1 155648 173 0 avahi-daemon [ 601] 81 601 14139 1 163840 243 -900 dbus-daemon [ 602] 0 602 95184 0 368640 725 0 NetworkManager [ 606] 0 606 31227 0 143360 169 0 irqbalance [ 607] 0 607 20393 0 192512 248 0 systemd-logind [ 611] 70 611 14533 0 147456 109 0 avahi-daemon [ 612] 995 612 35015 0 180224 191 0 chronyd [ 623] 0 623 30231 0 262144 357 0 cupsd [ 627] 0 627 19162 1 188416 234 -1000 sshd [ 628] 0 628 121255 0 434176 3700 0 tuned [ 635] 994 635 29747 0 147456 187 0 munged [ 638] 0 638 10449 0 106496 136 0 rhsmcertd [ 669] 0 669 68765 0 180224 343 0 rsyslogd [ 672] 29 672 11291 0 122880 149 0 rpc.statd [ 714] 0 714 12229 1 126976 145 0 xinetd [ 890] 998 890 402486 0 335872 1779 0 polkitd [ 930] 0 930 26833 0 184320 269 0 master [ 931] 0 931 26274 1 180224 177 0 gssproxy [ 933] 89 933 30849 0 204800 273 0 qmgr [ 1001] 0 1001 102322 0 303104 470 0 automount [ 1005] 0 1005 6533 0 98304 50 0 atd [ 1006] 0 1006 6466 0 94208 219 0 crond [ 1025] 0 1025 2371 0 61440 36 0 agetty [ 1026] 0 1026 1729 0 53248 32 0 agetty [ 96266] 89 96266 30836 0 229376 293 0 pickup [ 96598] 0 96598 31609 1 294912 315 0 sshd [ 96602] 0 96602 22393 0 212992 377 0 systemd [ 96604] 0 96604 54784 0 299008 758 0 (sd-pam) [ 96610] 0 96610 31609 1 290816 320 0 sshd | Link to test |