Chunguang Xu 43c1da6894 blk-wbt: improve waking of tasks ... commit <ffa358dcaae1f2f00926484e712e06daa8953cb4> commit <b78820937b4762b7d30b807d7156bec1d89e4dd3> commit <c45e6a037a536530bd25781ac7c989e52deb2a63> commit <38cfb5a45ee013bfab5d1ae4c4738815e744b440> We have two potential issues: 1) After commit 2887e41b910b, we only wake one process at the time when we finish an IO. We really want to wake up as many tasks as can queue IO. Before this commit, we woke up everyone, which could cause a thundering herd issue. 2) A task can potentially consume two wakeups, causing us to (in practice) miss a wakeup. Fix both by providing our own wakeup function, which stops __wake_up_common() from waking up more tasks if we fail to get a queueing token. With the strict ordering we have on the wait list, this wakes the right tasks and the right amount of tasks. Signed-off-by: Chunguang Xu <brookxu@tencent.com>		2020-09-11 14:22:55 +08:00
..
partitions	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
Kconfig	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
Kconfig.iosched	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
Makefile	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
badblocks.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bfq-cgroup.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bfq-iosched.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bfq-iosched.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bfq-wf2q.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bio-integrity.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bio.c	block: bio_iov_iter_get_pages: pin more pages for multi-segment IOs	2020-05-29 10:40:50 +08:00
blk-cgroup.c	cgroup: add switch for subsystem stats isolated	2020-07-16 14:52:41 +08:00
blk-core.c	cgroup: blkio: adjust block io bps limit by weight	2020-03-11 11:11:46 +08:00
blk-exec.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-flush.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-integrity.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-ioc.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-lib.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-map.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-merge.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-cpumap.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-debugfs.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-debugfs.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-pci.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-rdma.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-sched.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-sched.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-sysfs.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-tag.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-tag.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq-virtio.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-mq.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-settings.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-softirq.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-stat.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-stat.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-sysfs.c	cgroup: blkio: adjust block io bps limit by weight	2020-03-11 11:11:46 +08:00
blk-tag.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-throttle.c	cgroup: blkio: adjust block io bps limit by weight	2020-03-11 11:11:46 +08:00
blk-timeout.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-wbt.c	blk-wbt: improve waking of tasks	2020-09-11 14:22:55 +08:00
blk-wbt.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk-zoned.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
blk.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bounce.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bsg-lib.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
bsg.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
cfq-iosched.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
cmdline-parser.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
compat_ioctl.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
deadline-iosched.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
elevator.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
genhd.c	cgroup: add switch for subsystem stats isolated	2020-07-16 14:52:41 +08:00
ioctl.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
ioprio.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
kyber-iosched.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
mq-deadline.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
noop-iosched.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
opal_proto.h	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
partition-generic.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
scsi_ioctl.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
sed-opal.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00
t10-pi.c	Init Repo base on 4.14.105 long term, and add base tlinux kernel interfaces	2020-01-02 10:51:04 +08:00