Johannes Weiner 9e5f8bc41a mm: don't wake kswapd prematurely when watermark boosting is disabled ... [ Upstream commit 597c892038e08098b17ccfe65afd9677e6979800 ] On 2-node NUMA hosts we see bursts of kswapd reclaim and subsequent pressure spikes and stalls from cache refaults while there is plenty of free memory in the system. Usually, kswapd is woken up when all eligible nodes in an allocation are full. But the code related to watermark boosting can wake kswapd on one full node while the other one is mostly empty. This may be justified to fight fragmentation, but is currently unconditionally done whether watermark boosting is occurring or not. In our case, many of our workloads' throughput scales with available memory, and pure utilization is a more tangible concern than trends around longer-term fragmentation. As a result we generally disable watermark boosting. Wake kswapd only woken when watermark boosting is requested. Link: https://lkml.kernel.org/r/20201020175833.397286-1-hannes@cmpxchg.org Fixes: 1c30844d2dfe ("mm: reclaim small amounts of memory when an external fragmentation event occurs") Signed-off-by: Johannes Weiner <hannes@cmpxchg.org> Acked-by: Mel Gorman <mgorman@suse.de> Signed-off-by: Andrew Morton <akpm@linux-foundation.org> Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org> Signed-off-by: Sasha Levin <sashal@kernel.org>		2021-03-16 16:43:15 +08:00
..
kasan	kasan: disable branch tracing for core runtime	2021-03-16 16:28:20 +08:00
Kconfig	mm/zsmalloc.c: drop ZSMALLOC_PGTABLE_MAPPING	2021-03-16 16:42:15 +08:00
Kconfig.debug	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
Makefile	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
backing-dev.c	bdi: add a ->dev_name field to struct backing_dev_info	2021-03-16 16:27:44 +08:00
balloon_compaction.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
cleancache.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
cma.c	cma: don't quit at first error when activating reserved areas	2021-03-16 16:34:57 +08:00
cma.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
cma_debug.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
compaction.c	mm, compaction: make capture control handling safe wrt interrupts	2021-03-16 16:31:23 +08:00
debug.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
debug_page_ref.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
dmapool.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
early_ioremap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
fadvise.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
failslab.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
filemap.c	mm/error_inject: Fix allow_error_inject function signatures.	2021-03-16 16:38:34 +08:00
frame_vector.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
frontswap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
gup.c	mm/gup: fix gup_fast with dynamic page table folding	2021-03-16 16:37:40 +08:00
gup_benchmark.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
highmem.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
hmm.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
huge_memory.c	mm/userfaultfd: do not access vma->vm_mm after calling handle_userfault()	2021-03-16 16:41:32 +08:00
hugetlb.c	mm/hugetlb: fix a race between hugetlb sysctl handlers	2021-03-16 16:35:45 +08:00
hugetlb_cgroup.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
hwpoison-inject.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
init-mm.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
internal.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
interval_tree.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
khugepaged.c	mm: khugepaged: recalculate min_free_kbytes after memory hotplug as expected by khugepaged	2021-03-16 16:38:06 +08:00
kmemleak-test.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
kmemleak.c	mm/kmemleak.c: use address-of operator on section symbols	2021-03-16 16:37:10 +08:00
ksm.c	mm/ksm: fix NULL pointer dereference when KSM zero page is enabled	2021-03-16 16:26:56 +08:00
list_lru.c	mm: list_lru: set shrinker map bit when child nr_items is not zero	2021-03-16 16:42:05 +08:00
maccess.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
madvise.c	mm: validate pmd after splitting	2021-03-16 16:37:37 +08:00
memblock.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
memcontrol.c	mm: memcg/slab: fix root memcg vmstats	2021-03-16 16:41:32 +08:00
memfd.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
memory-failure.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
memory.c	mm: avoid data corruption on CoW fault into PFN-mapped VMA	2021-03-16 16:36:58 +08:00
memory_hotplug.c	mm: don't rely on system state to detect hot-plug operations	2021-03-16 16:37:50 +08:00
mempolicy.c	mm: mempolicy: fix potential pte_unmap_unlock pte error	2021-03-16 16:40:21 +08:00
mempool.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
memremap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
memtest.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
migrate.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mincore.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mlock.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mm_init.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mmap.c	mm/mmap.c: initialize align_offset explicitly for vm_unmapped_area	2021-03-16 16:37:12 +08:00
mmu_context.c	mm: fix kthread_use_mm() vs TLB invalidate	2021-03-16 16:34:57 +08:00
mmu_gather.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mmu_notifier.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mmzone.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mprotect.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mremap.c	mm: Fix mremap not considering huge pmd devmap	2021-03-16 16:28:43 +08:00
msync.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
nommu.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
oom_kill.c	mm, oom_adj: don't loop through tasks in __set_oom_adj when not necessary	2021-03-16 16:38:47 +08:00
page-writeback.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
page_alloc.c	mm: don't wake kswapd prematurely when watermark boosting is disabled	2021-03-16 16:43:15 +08:00
page_counter.c	mm/page_counter.c: fix protection usage propagation	2021-03-16 16:34:07 +08:00
page_ext.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
page_idle.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
page_io.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
page_isolation.c	mm/memory_hotplug: drain per-cpu pages again during memory offline	2021-03-16 16:36:22 +08:00
page_owner.c	mm/page_owner: change split_page_owner to take a count	2021-03-16 16:38:58 +08:00
page_poison.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
page_vma_mapped.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
pagewalk.c	mm: pagewalk: fix termination condition in walk_pte_range()	2021-03-16 16:36:50 +08:00
percpu-internal.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
percpu-km.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
percpu-stats.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
percpu-vm.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
percpu.c	percpu: fix first chunk size calculation for populated bitmap	2021-03-16 16:36:21 +08:00
pgtable-generic.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
process_vm_access.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
readahead.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
rmap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
rodata_test.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
shmem.c	shmem: fix possible deadlocks on shmlock_user_lock	2021-03-16 16:27:44 +08:00
shuffle.c	mm/shuffle: don't move pages between zones and don't read garbage memmaps	2021-03-16 16:34:57 +08:00
shuffle.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
slab.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
slab.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
slab_common.c	mm: memcg/slab: fix memory leak at non-root kmem_cache destroy	2021-03-16 16:32:38 +08:00
slob.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
slub.c	mm/slub: fix panic in slab_alloc_node()	2021-03-16 16:40:54 +08:00
sparse-vmemmap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
sparse.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
swap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
swap_cgroup.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
swap_slots.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
swap_state.c	mm/swap_state: fix a data race in swapin_nr_pages	2021-03-16 16:37:24 +08:00
swapfile.c	mm/swapfile: do not sleep with a spin lock held	2021-03-16 16:42:05 +08:00
truncate.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
usercopy.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
userfaultfd.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
util.c	mm: add kvfree_sensitive() for freeing sensitive data objects	2021-03-16 16:28:58 +08:00
vmacache.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
vmalloc.c	mm/vunmap: add cond_resched() in vunmap_pmd_range	2021-03-16 16:34:58 +08:00
vmpressure.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
vmscan.c	mm/vmscan.c: fix data races using kswapd_classzone_idx	2021-03-16 16:37:11 +08:00
vmstat.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
workingset.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
z3fold.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
zbud.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
zpool.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
zsmalloc.c	mm/zsmalloc.c: drop ZSMALLOC_PGTABLE_MAPPING	2021-03-16 16:42:15 +08:00
zswap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00