Daniel Borkmann ac616f7935 uaccess: Add strict non-pagefault kernel-space read function ... [upstream commit 75a1a607bb7e6d918be3aca11ec2214a275392f4] Add two new probe_kernel_read_strict() and strncpy_from_unsafe_strict() helpers which by default alias to the __probe_kernel_read() and the __strncpy_from_unsafe(), respectively, but can be overridden by archs which have non-overlapping address ranges for kernel space and user space in order to bail out with -EFAULT when attempting to probe user memory including non-canonical user access addresses [0]: 4-level page tables: user-space mem: 0x0000000000000000 - 0x00007fffffffffff non-canonical: 0x0000800000000000 - 0xffff7fffffffffff 5-level page tables: user-space mem: 0x0000000000000000 - 0x00ffffffffffffff non-canonical: 0x0100000000000000 - 0xfeffffffffffffff The idea is that these helpers are complementary to the probe_user_read() and strncpy_from_unsafe_user() which probe user-only memory. Both added helpers here do the same, but for kernel-only addresses. Both set of helpers are going to be used for BPF tracing. They also explicitly avoid throwing the splat for non-canonical user addresses from 00c42373d397 ("x86-64: add warning for non-canonical user access address dereferences"). For compat, the current probe_kernel_read() and strncpy_from_unsafe() are left as-is. [0] Documentation/x86/x86_64/mm.txt Signed-off-by: Daniel Borkmann <daniel@iogearbox.net> Signed-off-by: Alexei Starovoitov <ast@kernel.org> Cc: Linus Torvalds <torvalds@linux-foundation.org> Cc: Masami Hiramatsu <mhiramat@kernel.org> Cc: x86@kernel.org Link: https://lore.kernel.org/bpf/eefeefd769aa5a013531f491a71f0936779e916b.1572649915.git.daniel@iogearbox.net		2022-06-21 10:27:04 +08:00
..
kasan	kasan: fix incorrect arguments passing in kasan_add_zero_shadow	2021-04-12 12:51:39 +08:00
Kconfig	mm/zsmalloc.c: drop ZSMALLOC_PGTABLE_MAPPING	2021-03-16 16:42:15 +08:00
Kconfig.debug	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
Makefile	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
backing-dev.c	backport mm: fix abnormal reference count of blkio	2022-03-31 10:17:14 +08:00
balloon_compaction.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
cleancache.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
cma.c	cma: don't quit at first error when activating reserved areas	2021-03-16 16:34:57 +08:00
cma.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
cma_debug.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
compaction.c	mm/lru: replace pgdat lru_lock with lruvec lock	2021-10-29 06:51:21 +00:00
debug.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
debug_page_ref.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
dmapool.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
early_ioremap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
fadvise.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
failslab.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
filemap.c	mm: pagecache limit per cgroup support	2021-10-11 14:11:13 +08:00
frame_vector.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
frontswap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
gup.c	mm/gup: fix gup_fast with dynamic page table folding	2021-03-16 16:37:40 +08:00
gup_benchmark.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
highmem.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
hmm.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
huge_memory.c	mm: enable transparent hugepage by default	2021-10-29 08:50:28 +00:00
hugetlb.c	hugetlbfs: hugetlb_fault_mutex_hash() cleanup	2021-04-12 12:53:21 +08:00
hugetlb_cgroup.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
hwpoison-inject.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
init-mm.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
internal.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
interval_tree.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
khugepaged.c	mm: khugepaged: recalculate min_free_kbytes after memory hotplug as expected by khugepaged	2021-03-16 16:38:06 +08:00
kmemleak-test.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
kmemleak.c	mm/kmemleak.c: use address-of operator on section symbols	2021-03-16 16:37:10 +08:00
ksm.c	mm/ksm: fix NULL pointer dereference when KSM zero page is enabled	2021-03-16 16:26:56 +08:00
list_lru.c	mm: list_lru: set shrinker map bit when child nr_items is not zero	2021-03-16 16:42:05 +08:00
maccess.c	uaccess: Add strict non-pagefault kernel-space read function	2022-06-21 10:27:04 +08:00
madvise.c	mm: validate pmd after splitting	2021-03-16 16:37:37 +08:00
memblock.c	memblock: do not start bottom-up allocations with kernel_end	2021-04-12 12:51:54 +08:00
memcontrol.c	mem: memcontrol: add cond_resched in memcg_numa_stat_show	2022-06-17 10:21:34 +08:00
memfd.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
memory-failure.c	mm/memory-failure: unnecessary amount of unmapping	2021-05-20 16:08:01 +08:00
memory.c	sli/memory: Add memory latency account	2021-10-29 06:51:52 +00:00
memory_hotplug.c	mm: don't rely on system state to detect hot-plug operations	2021-03-16 16:37:50 +08:00
mempolicy.c	mm: mempolicy: fix potential pte_unmap_unlock pte error	2021-03-16 16:40:21 +08:00
mempool.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
memremap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
memtest.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
migrate.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mincore.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mlock.c	mm/lru: revise the comments of lru_lock	2021-10-29 06:51:21 +00:00
mm_init.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mmap.c	mm/mmap.c: initialize align_offset explicitly for vm_unmapped_area	2021-03-16 16:37:12 +08:00
mmu_context.c	mm: fix kthread_use_mm() vs TLB invalidate	2021-03-16 16:34:57 +08:00
mmu_gather.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mmu_notifier.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
mmzone.c	mm/lru: replace pgdat lru_lock with lruvec lock	2021-10-29 06:51:21 +00:00
mprotect.c	mm: Add 'mprotect' hook to struct vm_operations_struct	2021-07-12 08:56:46 +00:00
mremap.c	mm: Fix mremap not considering huge pmd devmap	2021-03-16 16:28:43 +08:00
msync.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
nommu.c	mm: Implement no-MMU variant of vmalloc_user_node_flags	2021-03-16 16:43:58 +08:00
oom_kill.c	mm, oom_adj: don't loop through tasks in __set_oom_adj when not necessary	2021-03-16 16:38:47 +08:00
page-writeback.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
page_alloc.c	sli: remove the page_alloc trace item	2022-04-18 21:07:19 +08:00
page_counter.c	mm/page_counter.c: fix protection usage propagation	2021-03-16 16:34:07 +08:00
page_ext.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
page_idle.c	mm: page_idle_get_page() does not need lru_lock	2021-10-29 06:51:21 +00:00
page_io.c	swap: fix swapfile read/write offset	2021-04-12 12:52:50 +08:00
page_isolation.c	mm/memory_hotplug: drain per-cpu pages again during memory offline	2021-03-16 16:36:22 +08:00
page_owner.c	mm/page_owner: change split_page_owner to take a count	2021-03-16 16:38:58 +08:00
page_poison.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
page_vma_mapped.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
pagewalk.c	mm: pagewalk: fix termination condition in walk_pte_range()	2021-03-16 16:36:50 +08:00
percpu-internal.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
percpu-km.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
percpu-stats.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
percpu-vm.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
percpu.c	percpu: fix first chunk size calculation for populated bitmap	2021-03-16 16:36:21 +08:00
pgtable-generic.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
process_vm_access.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
readahead.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
rmap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
rodata_test.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
shmem.c	sli/memory: Add memory latency account	2021-10-29 06:51:52 +00:00
shuffle.c	mm/shuffle: don't move pages between zones and don't read garbage memmaps	2021-03-16 16:34:57 +08:00
shuffle.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
slab.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
slab.h	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
slab_common.c	mm: memcg/slab: fix memory leak at non-root kmem_cache destroy	2021-03-16 16:32:38 +08:00
slob.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
slub.c	Revert "mm, slub: consider rest of partial list if acquire_slab() fails"	2021-04-12 12:52:58 +08:00
sparse-vmemmap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
sparse.c	mm/sparse: add the missing sparse_buffer_fini() in error branch	2021-05-20 16:08:01 +08:00
swap.c	Revert "mm/page_alloc: allow high-order pages on the per-cpu lists"	2022-03-30 12:26:29 +08:00
swap_cgroup.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
swap_slots.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
swap_state.c	mm/lru: replace pgdat lru_lock with lruvec lock	2021-10-29 06:51:21 +00:00
swapfile.c	swap: fix swapfile read/write offset	2021-04-12 12:52:50 +08:00
truncate.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
usercopy.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
userfaultfd.c	hugetlbfs: hugetlb_fault_mutex_hash() cleanup	2021-04-12 12:53:21 +08:00
util.c	mm: add kvfree_sensitive() for freeing sensitive data objects	2021-03-16 16:28:58 +08:00
vmacache.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
vmalloc.c	bpf: Add mmap() support for BPF_MAP_TYPE_ARRAY	2021-03-16 16:43:58 +08:00
vmpressure.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
vmscan.c	tqos/mm: set the default value of pagecache_limit_global to zero.	2022-03-16 12:44:28 +08:00
vmstat.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
workingset.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
z3fold.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
zbud.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
zpool.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00
zsmalloc.c	zsmalloc: account the number of compacted pages correctly	2021-04-12 12:52:50 +08:00
zswap.c	Init Repo base on linux 5.4.32 long term, and add base tlinux kernel interfaces.	2021-03-16 11:01:34 +08:00