QEMU With E2K User Support
Go to file
Roman Pen 0ed93d84ed linux-aio: process completions from ioq_submit()
In order to reduce completion latency it makes sense to harvest completed
requests ASAP.  Very fast backend device can complete requests just after
submission, so it is worth trying to check ring buffer in order to peek
completed requests directly after io_submit() has been called.

Indeed, this patch reduces the completions latencies and increases the
overall throughput, e.g. the following is the percentiles of number of
completed requests at once:

        1th 10th  20th  30th  40th  50th  60th  70th  80th  90th  99.99th
Before    2    4    42   112   128   128   128   128   128   128    128
 After    1    1     4    14    33    45    47    48    50    51    108

That means, that before the current patch is applied the ring buffer is
observed as full (128 requests were consumed at once) in 60% of calls.

After patch is applied the distribution of number of completed requests
is "smoother" and the queue (requests in-flight) is almost never full.

The fio read results are the following (write results are almost the
same and are not showed here):

  Before
  ------
job: (groupid=0, jobs=8): err= 0: pid=2227: Tue Jul 19 11:29:50 2016
  Description  : [Emulation of Storage Server Access Pattern]
  read : io=54681MB, bw=1822.7MB/s, iops=179779, runt= 30001msec
    slat (usec): min=172, max=16883, avg=338.35, stdev=109.66
    clat (usec): min=1, max=21977, avg=1051.45, stdev=299.29
     lat (usec): min=317, max=22521, avg=1389.83, stdev=300.73
    clat percentiles (usec):
     |  1.00th=[  346],  5.00th=[  596], 10.00th=[  708], 20.00th=[  852],
     | 30.00th=[  932], 40.00th=[  996], 50.00th=[ 1048], 60.00th=[ 1112],
     | 70.00th=[ 1176], 80.00th=[ 1256], 90.00th=[ 1384], 95.00th=[ 1496],
     | 99.00th=[ 1800], 99.50th=[ 1928], 99.90th=[ 2320], 99.95th=[ 2672],
     | 99.99th=[ 4704]
    bw (KB  /s): min=205229, max=553181, per=12.50%, avg=233278.26, stdev=18383.51

  After
  ------
job: (groupid=0, jobs=8): err= 0: pid=2220: Tue Jul 19 11:31:51 2016
  Description  : [Emulation of Storage Server Access Pattern]
  read : io=57637MB, bw=1921.2MB/s, iops=189529, runt= 30002msec
    slat (usec): min=169, max=20636, avg=329.61, stdev=124.18
    clat (usec): min=2, max=19592, avg=988.78, stdev=251.04
     lat (usec): min=381, max=21067, avg=1318.42, stdev=243.58
    clat percentiles (usec):
     |  1.00th=[  310],  5.00th=[  580], 10.00th=[  748], 20.00th=[  876],
     | 30.00th=[  908], 40.00th=[  948], 50.00th=[ 1012], 60.00th=[ 1064],
     | 70.00th=[ 1080], 80.00th=[ 1128], 90.00th=[ 1224], 95.00th=[ 1288],
     | 99.00th=[ 1496], 99.50th=[ 1608], 99.90th=[ 1960], 99.95th=[ 2256],
     | 99.99th=[ 5408]
    bw (KB  /s): min=212149, max=390160, per=12.49%, avg=245746.04, stdev=11606.75

Throughput increased from 1822MB/s to 1921MB/s, average completion latencies
decreased from 1051us to 988us.

Signed-off-by: Roman Pen <roman.penyaev@profitbricks.com>
Message-id: 1468931263-32667-4-git-send-email-roman.penyaev@profitbricks.com
Cc: Stefan Hajnoczi <stefanha@redhat.com>
Cc: Paolo Bonzini <pbonzini@redhat.com>
Cc: qemu-devel@nongnu.org
Signed-off-by: Stefan Hajnoczi <stefanha@redhat.com>
2016-09-13 11:00:56 +01:00
audio trace-events: fix first line comment in trace-events 2016-08-12 10:36:01 +01:00
backends fix qemu exit on memory hotplug when allocation fails at prealloc time 2016-08-02 12:03:58 +02:00
block linux-aio: process completions from ioq_submit() 2016-09-13 11:00:56 +01:00
bsd-user Fix bsd-user build after d915b7bb 2016-08-24 16:42:40 +01:00
contrib Clean up ill-advised or unusual header guards 2016-07-12 16:20:46 +02:00
crypto crypto: report enum strings instead of values in errors 2016-09-12 12:00:52 +01:00
default-configs dma: Add Xilinx Zynq devcfg device model 2016-07-04 13:15:22 +01:00
disas disas: Fix ATTRIBUTE_UNUSED define clash with ALSA headers 2016-07-19 16:40:39 +01:00
docs trace: add syslog tracing backend 2016-09-05 13:47:01 -04:00
dtc@65cc4d2748
fpu softfloat: Fix warn about implicit conversion from int to int8_t 2016-08-15 16:15:38 +01:00
fsdev Clean up #include "..." vs <...> and header guards 2016-07-12 16:04:36 +01:00
gdb-xml
hw vhost-vsock: add virtio sockets device 2016-09-10 00:28:08 +03:00
include vhost-vsock: add virtio sockets device 2016-09-10 00:28:08 +03:00
io trace-events: fix first line comment in trace-events 2016-08-12 10:36:01 +01:00
libdecnumber
linux-headers linux-headers: update 2016-09-05 15:15:16 +02:00
linux-user ppc: Stop dumping state on all exceptions in linux-user 2016-09-07 12:40:12 +10:00
migration trace-events: fix first line comment in trace-events 2016-08-12 10:36:01 +01:00
nbd nbd-server: Use a separate BlockBackend 2016-09-05 19:06:47 +02:00
net Revert "Change net/socket.c to use socket_*() functions" 2016-08-30 16:28:46 +02:00
pc-bios Update OpenBIOS images to c5542f2 built from submodule. 2016-09-12 08:14:50 +01:00
pixman@87eea99e44
po Added Bulgarian translation 2016-07-01 16:06:57 +01:00
qapi blockdev-backup: added support for data compression 2016-09-05 19:06:48 +02:00
qga qga: free remaining leaking state 2016-09-08 17:57:32 +04:00
qobject json-streamer: fix double-free on exiting during a parse 2016-07-12 18:31:27 +02:00
qom trace-events: fix first line comment in trace-events 2016-08-12 10:36:01 +01:00
replay replay: Use new QAPI cloning 2016-07-06 10:52:04 +02:00
roms Update OpenBIOS images to c5542f2 built from submodule. 2016-09-12 08:14:50 +01:00
scripts trace: add syslog tracing backend 2016-09-05 13:47:01 -04:00
slirp slirp: Rename "struct arphdr" to "struct slirp_arphdr" 2016-08-16 12:17:36 +01:00
stubs First (big) chunk of s390x updates: 2016-09-06 16:17:19 +01:00
target-alpha target-*: Clean up cpu.h header guards 2016-07-12 16:19:16 +02:00
target-arm target-arm: Fix lpae bit in FSR on an alignment fault 2016-09-06 19:52:17 +01:00
target-cris Clean up decorations and whitespace around header guards 2016-07-12 16:20:46 +02:00
target-i386 target-i386: present virtual L3 cache info for vcpus 2016-09-09 20:58:34 +03:00
target-lm32 target-*: Clean up cpu.h header guards 2016-07-12 16:19:16 +02:00
target-m68k target-*: Clean up cpu.h header guards 2016-07-12 16:19:16 +02:00
target-microblaze target-*: Clean up cpu.h header guards 2016-07-12 16:19:16 +02:00
target-mips target-mips: fix EntryHi.EHINV being cleared on TLB exception 2016-07-28 11:24:02 +01:00
target-moxie target-*: Clean up cpu.h header guards 2016-07-12 16:19:16 +02:00
target-openrisc Clean up header guards that don't match their file name 2016-07-12 16:19:16 +02:00
target-ppc ppc: Improve a few more helper flags 2016-09-07 12:40:12 +10:00
target-s390x s390x/cpumodel: implement QMP interface "query-cpu-model-baseline" 2016-09-06 17:06:51 +02:00
target-sh4 target-sh4: Use glib allocator in movcal helper 2016-07-22 11:33:24 +01:00
target-sparc trace-events: fix first line comment in trace-events 2016-08-12 10:36:01 +01:00
target-tilegx Clean up header guards that don't match their file name 2016-07-12 16:19:16 +02:00
target-tricore Clean up decorations and whitespace around header guards 2016-07-12 16:20:46 +02:00
target-unicore32 target-*: Clean up cpu.h header guards 2016-07-12 16:19:16 +02:00
target-xtensa Clean up header guards that don't match their file name 2016-07-12 16:19:16 +02:00
tcg tcg: Lower indirect registers in a separate pass 2016-08-05 21:44:40 +05:30
tests Merge qcrypto 2016/09/12 v1 2016-09-12 12:48:47 +01:00
trace trace: Avoid implicit bool->integer conversions 2016-09-05 13:47:02 -04:00
ui ui: fix refresh of VNC server surface 2016-08-30 11:20:24 +01:00
util coroutine: Assert that no locks are held on termination 2016-09-05 19:06:48 +02:00
.dir-locals.el
.exrc
.gitignore Add optionrom compatible with fw_cfg DMA version 2016-07-14 15:50:52 +02:00
.gitmodules
.mailmap
.travis.yml .travis.yml: Disable IRC build status updates from forks 2016-07-18 16:40:58 +01:00
accel.c
aio-posix.c aio-posix: remove useless parameter 2016-07-18 15:10:52 +01:00
aio-win32.c aio-posix: remove useless parameter 2016-07-18 15:10:52 +01:00
arch_init.c
async.c aio-posix: remove useless parameter 2016-07-18 15:10:52 +01:00
balloon.c
block.c nbd-server: Use a separate BlockBackend 2016-09-05 19:06:47 +02:00
blockdev-nbd.c nbd-server: Allow node name for nbd-server-add 2016-09-05 19:06:47 +02:00
blockdev.c blockdev-backup: added support for data compression 2016-09-05 19:06:48 +02:00
blockjob.c block jobs: Improve error message for missing job ID 2016-09-05 19:06:48 +02:00
bootdevice.c error: Remove NULL checks on error_propagate() calls 2016-06-20 16:38:13 +02:00
bt-host.c
bt-vhci.c
Changelog
CODING_STYLE CODING_STYLE, checkpatch: update line length rules 2016-08-10 12:22:33 +02:00
configure vhost-vsock: add virtio sockets device 2016-09-10 00:28:08 +03:00
COPYING
COPYING.LIB
cpu-exec-common.c cpu-exec: Rename cpu_resume_from_signal() to cpu_loop_exit_noexc() 2016-06-09 15:55:02 +01:00
cpu-exec.c cpu-exec: Move down some declarations in cpu_exec() 2016-07-17 09:59:22 +02:00
cpus.c seqlock: rename write_lock/unlock to write_begin/end 2016-06-11 22:59:34 +00:00
cputlb.c cputlb: Add address parameter to VICTIM_TLB_HIT 2016-07-08 13:04:41 -07:00
device_tree.c
device-hotplug.c
disas.c
dma-helpers.c dma-helpers: dma_blk_io() cancel support 2016-06-28 13:08:31 +01:00
dump.c error: Remove NULL checks on error_propagate() calls 2016-06-20 16:38:13 +02:00
exec.c exec: Ensure the only one cpu_index allocation method is used 2016-09-05 16:01:55 -03:00
gdbstub.c linux-user pull request for June 2016 2016-06-08 18:34:32 +01:00
HACKING Disable warn about left shifts of negative values 2016-08-09 22:57:36 +02:00
hmp-commands-info.hx trace: Add QAPI/QMP interfaces to query and control per-vCPU tracing state 2016-07-18 18:23:12 +01:00
hmp-commands.hx drive-backup: added support for data compression 2016-09-05 19:06:48 +02:00
hmp.c block: Allow node name for 'qemu-io' HMP command 2016-09-05 19:06:48 +02:00
hmp.h trace: Allow event name pattern in "info trace-events" 2016-07-18 18:23:12 +01:00
iohandler.c
ioport.c
iothread.c
kvm-all.c error: Fix error_printf() calls lacking newlines 2016-08-08 09:01:27 +02:00
kvm-stub.c kvm-irqchip: do explicit commit when update irq 2016-07-21 20:44:19 +03:00
LICENSE
main-loop.c main-loop: check return value before using pointer 2016-07-12 18:31:27 +02:00
MAINTAINERS MAINTAINERS: Add Host Memory Backends section 2016-08-02 08:22:02 -03:00
Makefile build-sys: fix building with make CFLAGS=.. argument 2016-08-09 22:57:36 +02:00
Makefile.objs intel_iommu: add support for split irqchip 2016-07-21 20:43:49 +03:00
Makefile.target s390x/cpumodel: generate CPU feature lists for CPU models 2016-09-06 17:06:49 +02:00
memory_mapping.c
memory.c memory: Assert that memory_region_init_rom_device() ops aren't NULL 2016-07-04 13:06:35 +01:00
module-common.c
monitor.c monitor: fix crash when leaving qemu with spice audio 2016-08-08 14:16:11 +02:00
numa.c numa: do not leak NumaOptions 2016-08-07 23:59:59 +04:00
os-posix.c use g_path_get_dirname instead of dirname 2016-07-17 09:59:21 +02:00
os-win32.c
page_cache.c coccinelle: Remove unnecessary variables for function return value 2016-06-20 16:38:13 +02:00
qapi-schema.json s390x/cpumodel: implement QMP interface "query-cpu-model-baseline" 2016-09-06 17:06:51 +02:00
qdev-monitor.c
qdict-test-data.txt
qemu-bridge-helper.c
qemu-char.c char: fix waiting for TLS and telnet connection 2016-08-16 11:50:55 +01:00
qemu-doc.texi
qemu-ga.texi
qemu-img-cmds.hx qemu-img bench: Add --flush-interval 2016-06-08 10:21:09 +02:00
qemu-img.c block: remove BlockDriver.bdrv_write_compressed 2016-09-05 19:06:48 +02:00
qemu-img.texi trace: enable tracing in qemu-img 2016-06-28 21:14:12 +01:00
qemu-io-cmds.c block: switch blk_write_compressed() to byte-based interface 2016-09-05 19:06:47 +02:00
qemu-io.c trace: enable tracing in qemu-io 2016-06-28 21:14:12 +01:00
qemu-nbd.c nbd-server: Use a separate BlockBackend 2016-09-05 19:06:47 +02:00
qemu-nbd.texi trace: enable tracing in qemu-nbd 2016-06-28 21:14:12 +01:00
qemu-option-trace.texi doc: move text describing --trace to specific .texi file 2016-06-28 21:14:12 +01:00
qemu-options-wrapper.h
qemu-options.h Clean up ill-advised or unusual header guards 2016-07-12 16:20:46 +02:00
qemu-options.hx Reorganize help output of '-display' option 2016-08-03 18:44:57 +02:00
qemu-seccomp.c
qemu-tech.texi
qemu-timer.c timer: set vm_clock disabled default 2016-08-09 22:57:36 +02:00
qemu.nsi
qemu.sasl
qmp-commands.hx Block layer patches 2016-09-06 17:18:17 +01:00
qmp.c qmp: add QMP interface "query-cpu-model-baseline" 2016-09-06 17:06:51 +02:00
qtest.c qtest.c: Allow zero size in memset qtest commands 2016-09-09 11:16:18 +01:00
README Revert e5dfc5e8e("Move README to markdown") 2016-07-21 10:46:41 +01:00
rules.mak s390x/cpumodel: generate CPU feature lists for CPU models 2016-09-06 17:06:49 +02:00
softmmu_template.h cputlb: Fix for self-modifying writes across page boundaries 2016-07-08 13:05:07 -07:00
spice-qemu-char.c
tcg-runtime.c
tci.c
thread-pool.c coroutine: move entry argument to qemu_coroutine_create 2016-07-13 13:26:02 +02:00
thunk.c thunk: Rename args and fields in host-target bitmask conversion code 2016-06-07 18:19:24 +03:00
tpm.c
trace-events xen: handle inbound migration of VMs without ioreq server pages 2016-08-12 16:38:30 -07:00
translate-all.c translate: early exit in tb_flush if there is no tcg 2016-08-30 13:30:55 +01:00
translate-all.h trace: Add per-vCPU tracing states for events with the 'vcpu' property 2016-07-18 18:23:12 +01:00
translate-common.c
user-exec.c user-exec: Remove unused code for OSX hosts 2016-06-26 13:17:20 +03:00
VERSION Open 2.8 development tree 2016-09-05 11:38:54 +01:00
version.rc
vl.c vl: Delay initialization of memory backends 2016-09-05 16:03:47 -03:00
xen-common-stub.c
xen-common.c
xen-hvm-stub.c
xen-hvm.c xen: handle inbound migration of VMs without ioreq server pages 2016-08-12 16:38:30 -07:00
xen-mapcache.c os-posix: include sys/mman.h 2016-06-16 18:39:03 +02:00

         QEMU README
         ===========

QEMU is a generic and open source machine & userspace emulator and
virtualizer.

QEMU is capable of emulating a complete machine in software without any
need for hardware virtualization support. By using dynamic translation,
it achieves very good performance. QEMU can also integrate with the Xen
and KVM hypervisors to provide emulated hardware while allowing the
hypervisor to manage the CPU. With hypervisor support, QEMU can achieve
near native performance for CPUs. When QEMU emulates CPUs directly it is
capable of running operating systems made for one machine (e.g. an ARMv7
board) on a different machine (e.g. an x86_64 PC board).

QEMU is also capable of providing userspace API virtualization for Linux
and BSD kernel interfaces. This allows binaries compiled against one
architecture ABI (e.g. the Linux PPC64 ABI) to be run on a host using a
different architecture ABI (e.g. the Linux x86_64 ABI). This does not
involve any hardware emulation, simply CPU and syscall emulation.

QEMU aims to fit into a variety of use cases. It can be invoked directly
by users wishing to have full control over its behaviour and settings.
It also aims to facilitate integration into higher level management
layers, by providing a stable command line interface and monitor API.
It is commonly invoked indirectly via the libvirt library when using
open source applications such as oVirt, OpenStack and virt-manager.

QEMU as a whole is released under the GNU General Public License,
version 2. For full licensing details, consult the LICENSE file.


Building
========

QEMU is multi-platform software intended to be buildable on all modern
Linux platforms, OS-X, Win32 (via the Mingw64 toolchain) and a variety
of other UNIX targets. The simple steps to build QEMU are:

  mkdir build
  cd build
  ../configure
  make

Complete details of the process for building and configuring QEMU for
all supported host platforms can be found in the qemu-tech.html file.
Additional information can also be found online via the QEMU website:

  http://qemu-project.org/Hosts/Linux
  http://qemu-project.org/Hosts/W32


Submitting patches
==================

The QEMU source code is maintained under the GIT version control system.

   git clone git://git.qemu-project.org/qemu.git

When submitting patches, the preferred approach is to use 'git
format-patch' and/or 'git send-email' to format & send the mail to the
qemu-devel@nongnu.org mailing list. All patches submitted must contain
a 'Signed-off-by' line from the author. Patches should follow the
guidelines set out in the HACKING and CODING_STYLE files.

Additional information on submitting patches can be found online via
the QEMU website

  http://qemu-project.org/Contribute/SubmitAPatch
  http://qemu-project.org/Contribute/TrivialPatches


Bug reporting
=============

The QEMU project uses Launchpad as its primary upstream bug tracker. Bugs
found when running code built from QEMU git or upstream released sources
should be reported via:

  https://bugs.launchpad.net/qemu/

If using QEMU via an operating system vendor pre-built binary package, it
is preferable to report bugs to the vendor's own bug tracker first. If
the bug is also known to affect latest upstream code, it can also be
reported via launchpad.

For additional information on bug reporting consult:

  http://qemu-project.org/Contribute/ReportABug


Contact
=======

The QEMU community can be contacted in a number of ways, with the two
main methods being email and IRC

 - qemu-devel@nongnu.org
   http://lists.nongnu.org/mailman/listinfo/qemu-devel
 - #qemu on irc.oftc.net

Information on additional methods of contacting the community can be
found online via the QEMU website:

  http://qemu-project.org/Contribute/StartHere

-- End