QEMU With E2K User Support
Go to file
Emilio G. Cota 42bd32287f tb hash: hash phys_pc, pc, and flags with xxhash
For some workloads such as arm bootup, tb_phys_hash is performance-critical.
The is due to the high frequency of accesses to the hash table, originated
by (frequent) TLB flushes that wipe out the cpu-private tb_jmp_cache's.
More info:
  https://lists.nongnu.org/archive/html/qemu-devel/2016-03/msg05098.html

To dig further into this I modified an arm image booting debian jessie to
immediately shut down after boot. Analysis revealed that quite a bit of time
is unnecessarily spent in tb_phys_hash: the cause is poor hashing that
results in very uneven loading of chains in the hash table's buckets;
the longest observed chain had ~550 elements.

The appended addresses this with two changes:

1) Use xxhash as the hash table's hash function. xxhash is a fast,
   high-quality hashing function.

2) Feed the hashing function with not just tb_phys, but also pc and flags.

This improves performance over using just tb_phys for hashing, since that
resulted in some hash buckets having many TB's, while others getting very few;
with these changes, the longest observed chain on a single hash bucket is
brought down from ~550 to ~40.

Tests show that the other element checked for in tb_find_physical,
cs_base, is always a match when tb_phys+pc+flags are a match,
so hashing cs_base is wasteful. It could be that this is an ARM-only
thing, though. UPDATE:
On Tue, Apr 05, 2016 at 08:41:43 -0700, Richard Henderson wrote:
> The cs_base field is only used by i386 (in 16-bit modes), and sparc (for a TB
> consisting of only a delay slot).
> It may well still turn out to be reasonable to ignore cs_base for hashing.

BTW, after this change the hash table should not be called "tb_hash_phys"
anymore; this is addressed later in this series.

This change gives consistent bootup time improvements. I tested two
host machines:
- Intel Xeon E5-2690: 11.6% less time
- Intel i7-4790K: 19.2% less time

Increasing the number of hash buckets yields further improvements. However,
using a larger, fixed number of buckets can degrade performance for other
workloads that do not translate as many blocks (600K+ for debian-jessie arm
bootup). This is dealt with later in this series.

Reviewed-by: Sergey Fedorov <sergey.fedorov@linaro.org>
Reviewed-by: Richard Henderson <rth@twiddle.net>
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
Signed-off-by: Emilio G. Cota <cota@braap.org>
Message-Id: <1465412133-3029-8-git-send-email-cota@braap.org>
Signed-off-by: Richard Henderson <rth@twiddle.net>
2016-06-11 23:10:19 +00:00
audio audio: pa: Set volume of recording stream instead of recording device 2016-06-03 11:13:38 +02:00
backends rng-random: rename RndRandom to RngRandom 2016-05-23 12:18:43 +05:30
block block: Don't emulate natively supported pwritev flags 2016-06-08 10:21:09 +02:00
bsd-user cpu: Eliminate cpudef_init(), cpudef_setup() 2016-05-23 19:47:37 -03:00
contrib qemu-common: stop including qemu/host-utils.h from qemu-common.h 2016-05-19 16:42:28 +02:00
crypto crypto: Use DIV_ROUND_UP 2016-06-07 18:19:24 +03:00
default-configs net: Introduce e1000e device emulation 2016-06-02 10:42:29 +08:00
disas tci: do not include exec/exec-all.h 2016-05-20 15:07:46 +01:00
docs docs/multi-thread-compression: Fix wrong command string 2016-06-07 18:19:24 +03:00
dtc@65cc4d2748
fpu target-tricore: Add FPU infrastructure 2016-03-23 09:22:48 +01:00
fsdev all: Remove unnecessary glib.h includes 2016-06-07 18:19:24 +03:00
gdb-xml target-ppc: gdbstub: Add VSX support 2016-01-30 23:37:38 +11:00
hw cpu-exec: Rename cpu_resume_from_signal() to cpu_loop_exit_noexc() 2016-06-09 15:55:02 +01:00
include tb hash: hash phys_pc, pc, and flags with xxhash 2016-06-11 23:10:19 +00:00
io io: avoid double-free when closing QIOChannelBuffer 2016-05-26 11:31:09 +05:30
libdecnumber libdecnumber: Clean up includes 2016-02-16 14:29:27 +00:00
linux-headers update Linux headers to 4.6 2016-04-05 11:46:52 +02:00
linux-user linux-user pull request for June 2016 2016-06-08 18:34:32 +01:00
migration migration/block: Convert saving to BlockBackend 2016-06-08 10:21:08 +02:00
nbd nbd: Don't trim unrequested bytes 2016-05-29 09:11:10 +02:00
net net: handle optional VLAN header in checksum computation. 2016-06-02 10:42:46 +08:00
pc-bios s390-ccw.img: rebuild image 2016-05-17 15:50:29 +02:00
pixman@87eea99e44
po po/Makefile: call rm -f directly 2016-06-07 18:02:49 +03:00
qapi all: Remove unnecessary glib.h includes 2016-06-07 18:19:24 +03:00
qga qga: Remove unnecessary glib.h includes 2016-06-07 18:19:24 +03:00
qobject qdict: fix unbounded stack warning for qdict_array_entries 2016-05-18 15:04:26 +03:00
qom tcg: Remove needless CPUState::current_tb 2016-05-12 14:06:42 -10:00
replay replay: Clean up includes 2016-06-07 18:19:23 +03:00
roms Update OpenBIOS images 2016-04-18 09:38:55 +01:00
scripts linux-user pull request for June 2016 2016-06-08 18:34:32 +01:00
slirp slirp: Use DIV_ROUND_UP 2016-06-07 18:19:25 +03:00
stubs qemu-common: stop including qemu/host-utils.h from qemu-common.h 2016-05-19 16:42:28 +02:00
target-alpha target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-arm virtio: move bi-endian target support to a single location 2016-06-07 15:39:28 +03:00
target-cris target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-i386 target-i386: Move user-mode exception actions out of user-exec.c 2016-06-09 15:55:02 +01:00
target-lm32 cpu-exec: Rename cpu_resume_from_signal() to cpu_loop_exit_noexc() 2016-06-09 15:55:02 +01:00
target-m68k target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-microblaze target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-mips target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-moxie target-moxie: Remove unused struct elements 2016-06-07 18:02:49 +03:00
target-openrisc target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-ppc pc, pci, virtio: new features, cleanups, fixes 2016-06-07 15:30:25 +01:00
target-s390x cpu-exec: Rename cpu_resume_from_signal() to cpu_loop_exit_noexc() 2016-06-09 15:55:02 +01:00
target-sh4 target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-sparc target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-tilegx cpu: move exec-all.h inclusion out of cpu.h 2016-05-19 16:42:29 +02:00
target-tricore target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-unicore32 target-*: dfilter support for in_asm 2016-06-05 09:26:24 -07:00
target-xtensa cpu-exec: Rename cpu_resume_from_signal() to cpu_loop_exit_noexc() 2016-06-09 15:55:02 +01:00
tcg cpu: move exec-all.h inclusion out of cpu.h 2016-05-19 16:42:29 +02:00
tests Block layer patches 2016-06-08 17:17:16 +01:00
trace Fix some typos found by codespell 2016-05-18 15:04:27 +03:00
ui console: ignore ui_info updates which don't actually update something 2016-06-10 11:16:18 +02:00
util trivial patches for 2016-06-07 2016-06-07 16:34:45 +01:00
.dir-locals.el Add .dir-locals.el file to configure emacs coding style 2015-10-08 19:46:01 +03:00
.exrc
.gitignore .gitignore: Ignore docker source copy 2016-06-01 17:27:35 +08:00
.gitmodules
.mailmap
.travis.yml .travis.yml: make -j3 2016-04-05 10:08:15 +01:00
accel.c accel: make configure_accelerator return void 2016-05-18 15:04:27 +03:00
aio-posix.c aio-posix: Skip external nodes in aio_dispatch 2016-04-22 16:43:59 +02:00
aio-win32.c all: Clean up includes 2016-02-04 17:41:30 +00:00
arch_init.c cpu: Eliminate cpudef_init(), cpudef_setup() 2016-05-23 19:47:37 -03:00
async.c include/qemu/osdep.h: Don't include qapi/error.h 2016-03-22 22:20:15 +01:00
balloon.c all: Clean up includes 2016-02-04 17:41:30 +00:00
block.c block: assert that bs->request_alignment is a power of 2 2016-06-08 10:21:09 +02:00
blockdev-nbd.c nbd: enable use of TLS with nbd-server-start command 2016-02-16 17:17:49 +01:00
blockdev.c blockdev: clean up error handling in do_open_tray 2016-06-08 10:21:09 +02:00
blockjob.c blockjob: Remove BlockJob.bs 2016-05-25 19:04:21 +02:00
bootdevice.c explicitly include hw/qdev-core.h 2016-05-19 16:42:27 +02:00
bt-host.c all: Clean up includes 2016-02-04 17:41:30 +00:00
bt-vhci.c all: Clean up includes 2016-02-04 17:41:30 +00:00
Changelog
CODING_STYLE
configure linux-user pull request for June 2016 2016-06-08 18:34:32 +01:00
COPYING
COPYING.LIB
cpu-exec-common.c cpu-exec: Rename cpu_resume_from_signal() to cpu_loop_exit_noexc() 2016-06-09 15:55:02 +01:00
cpu-exec.c tb hash: hash phys_pc, pc, and flags with xxhash 2016-06-11 23:10:19 +00:00
cpus.c seqlock: rename write_lock/unlock to write_begin/end 2016-06-11 22:59:34 +00:00
cputlb.c memory: split memory_region_from_host from qemu_ram_addr_from_host 2016-05-29 09:11:12 +02:00
device_tree.c qemu-common: stop including qemu/bswap.h from qemu-common.h 2016-05-19 16:42:28 +02:00
device-hotplug.c blockdev: Split monitor reference from BB creation 2016-03-17 15:47:56 +01:00
disas.c all: Clean up includes 2016-02-04 17:41:30 +00:00
dma-helpers.c dma-helpers: change BlockBackend to opaque value in DMAIOFunc 2016-05-25 19:04:11 +02:00
dump.c util: move declarations out of qemu-common.h 2016-03-22 22:20:17 +01:00
exec.c cpu-exec: Rename cpu_resume_from_signal() to cpu_loop_exit_noexc() 2016-06-09 15:55:02 +01:00
gdbstub.c linux-user pull request for June 2016 2016-06-08 18:34:32 +01:00
HACKING HACKING: Add a section on error handling and reporting 2016-02-09 13:19:49 +01:00
hmp-commands-info.hx Dump: add hmp command "info dump" 2016-02-22 18:40:28 +01:00
hmp-commands.hx migration: define 'tls-creds' and 'tls-hostname' migration parameters 2016-05-26 11:32:10 +05:30
hmp.c migration: define 'tls-creds' and 'tls-hostname' migration parameters 2016-05-26 11:32:10 +05:30
hmp.h Dump: add hmp command "info dump" 2016-02-22 18:40:28 +01:00
iohandler.c iohandler: Introduce iohandler_get_aio_context 2016-04-22 16:43:42 +02:00
ioport.c hw: remove pio_addr_t 2016-05-19 16:42:30 +02:00
iothread.c all: Clean up includes 2016-02-04 17:41:30 +00:00
kvm-all.c kvm: API to obtain max supported mem slots 2016-06-07 10:17:45 +10:00
kvm-stub.c cpu: Reclaim vCPU objects 2016-05-30 14:03:59 +10:00
LICENSE
main-loop.c util: move declarations out of qemu-common.h 2016-03-22 22:20:17 +01:00
MAINTAINERS -----BEGIN PGP SIGNATURE----- 2016-06-02 14:26:57 +01:00
Makefile Makefile: Derive "PKGVERSION" from "git describe" by default 2016-06-07 14:14:39 +02:00
Makefile.objs migration: Move qjson.[ch] to migration/ 2016-05-23 14:16:09 +05:30
Makefile.target Makefile: add dependency on scripts/hxtool 2016-06-07 14:14:38 +02:00
memory_mapping.c all: Remove unnecessary glib.h includes 2016-06-07 18:19:24 +03:00
memory.c exec: hide mr->ram_addr from qemu_get_ram_ptr users 2016-05-29 09:11:12 +02:00
module-common.c all: Clean up includes 2016-02-04 17:41:30 +00:00
monitor.c monitor: Typo fix 2016-06-07 18:19:23 +03:00
numa.c qapi: Don't special-case simple union wrappers 2016-03-18 10:29:26 +01:00
os-posix.c util: move declarations out of qemu-common.h 2016-03-22 22:20:17 +01:00
os-win32.c all: Clean up includes 2016-02-04 17:41:30 +00:00
page_cache.c all: Remove unnecessary glib.h includes 2016-06-07 18:19:24 +03:00
qapi-schema.json migration: define 'tls-creds' and 'tls-hostname' migration parameters 2016-05-26 11:32:10 +05:30
qdev-monitor.c util: move declarations out of qemu-common.h 2016-03-22 22:20:17 +01:00
qdict-test-data.txt Introduce QDict test data file 2009-09-04 09:37:34 -05:00
qemu-bridge-helper.c all: Remove unnecessary glib.h includes 2016-06-07 18:19:24 +03:00
qemu-char.c char: get rid of qemu_char_get_next_serial 2016-06-06 16:59:32 +01:00
qemu-doc.texi Allow users to specify the vmdk virtual hardware version. 2016-05-12 15:22:08 +02:00
qemu-ga.texi docs: Style the command and its options in the synopsis 2016-01-26 15:58:11 +01:00
qemu-img-cmds.hx qemu-img bench: Add --flush-interval 2016-06-08 10:21:09 +02:00
qemu-img.c Block layer patches 2016-06-08 17:17:16 +01:00
qemu-img.texi qemu-img bench: Add --flush-interval 2016-06-08 10:21:09 +02:00
qemu-io-cmds.c block: Rename blk_write_zeroes() 2016-05-25 19:04:21 +02:00
qemu-io.c Use &error_fatal when initializing crypto on qemu-{img,io,nbd} 2016-05-20 14:28:55 -03:00
qemu-nbd.c Use &error_fatal when initializing crypto on qemu-{img,io,nbd} 2016-05-20 14:28:55 -03:00
qemu-nbd.texi qemu-nbd: allow specifying image as a set of options args 2016-02-22 09:50:04 +01:00
qemu-options-wrapper.h
qemu-options.h
qemu-options.hx * max-ram-below-4g improvement (Gerd) 2016-06-08 14:45:28 +01:00
qemu-seccomp.c seccomp: adding sysinfo system call to whitelist 2016-04-16 20:27:44 +02:00
qemu-tech.texi tcg: Rename tcg-target.c to tcg-target.inc.c 2016-02-23 08:30:38 -08:00
qemu-timer.c qemu-timer: Use DIV_ROUND_UP 2016-06-07 18:19:25 +03:00
qemu.nsi
qemu.sasl
qmp-commands.hx migration: Promote improved autoconverge commands out of experimental state 2016-05-23 16:05:09 +05:30
qmp.c Makefile: Derive "PKGVERSION" from "git describe" by default 2016-06-07 14:14:39 +02:00
qtest.c qemu-common: push cpu.h inclusion out of qemu-common.h 2016-05-19 16:42:29 +02:00
README README: fill out some useful quickstart information 2015-10-13 18:48:46 +02:00
rules.mak * max-ram-below-4g improvement (Gerd) 2016-06-08 14:45:28 +01:00
softmmu_template.h exec.c: Pass MemTxAttrs to iotlb_to_region so it uses the right AS 2016-01-21 14:15:05 +00:00
spice-qemu-char.c qapi: Don't special-case simple union wrappers 2016-03-18 10:29:26 +01:00
tcg-runtime.c all: Clean up includes 2016-02-04 17:41:30 +00:00
tci.c tci: do not include exec/exec-all.h 2016-05-20 15:07:46 +01:00
thread-pool.c all: Clean up includes 2016-02-04 17:41:30 +00:00
thunk.c thunk: Rename args and fields in host-target bitmask conversion code 2016-06-07 18:19:24 +03:00
tpm.c qapi: Don't special-case simple union wrappers 2016-03-18 10:29:26 +01:00
trace-events raw-posix: Convert to bdrv_co_pwrite_zeroes() 2016-06-08 10:21:08 +02:00
translate-all.c tb hash: hash phys_pc, pc, and flags with xxhash 2016-06-11 23:10:19 +00:00
translate-all.h user-exec: Push resume-from-signal code out to handle_cpu_signal() 2016-06-09 15:55:02 +01:00
translate-common.c include: move CPU-related definitions out of qemu-common.h 2016-05-19 13:08:04 +02:00
user-exec.c target-i386: Move user-mode exception actions out of user-exec.c 2016-06-09 15:55:02 +01:00
VERSION Open 2.7 development tree 2016-05-12 12:35:25 +01:00
version.rc
vl.c * max-ram-below-4g improvement (Gerd) 2016-06-08 14:45:28 +01:00
xen-common-stub.c xen: Clean up includes 2016-01-29 15:07:23 +00:00
xen-common.c xen: drop XenXC and associated interface wrappers 2016-02-10 12:01:24 +00:00
xen-hvm-stub.c fix MSI injection on Xen 2016-02-06 20:44:10 +02:00
xen-hvm.c xen: Use DIV_ROUND_UP 2016-06-07 18:19:24 +03:00
xen-mapcache.c xen: Clean up includes 2016-01-29 15:07:23 +00:00

         QEMU README
         ===========

QEMU is a generic and open source machine & userspace emulator and
virtualizer.

QEMU is capable of emulating a complete machine in software without any
need for hardware virtualization support. By using dynamic translation,
it achieves very good performance. QEMU can also integrate with the Xen
and KVM hypervisors to provide emulated hardware while allowing the
hypervisor to manage the CPU. With hypervisor support, QEMU can achieve
near native performance for CPUs. When QEMU emulates CPUs directly it is
capable of running operating systems made for one machine (e.g. an ARMv7
board) on a different machine (e.g. an x86_64 PC board).

QEMU is also capable of providing userspace API virtualization for Linux
and BSD kernel interfaces. This allows binaries compiled against one
architecture ABI (e.g. the Linux PPC64 ABI) to be run on a host using a
different architecture ABI (e.g. the Linux x86_64 ABI). This does not
involve any hardware emulation, simply CPU and syscall emulation.

QEMU aims to fit into a variety of use cases. It can be invoked directly
by users wishing to have full control over its behaviour and settings.
It also aims to facilitate integration into higher level management
layers, by providing a stable command line interface and monitor API.
It is commonly invoked indirectly via the libvirt library when using
open source applications such as oVirt, OpenStack and virt-manager.

QEMU as a whole is released under the GNU General Public License,
version 2. For full licensing details, consult the LICENSE file.


Building
========

QEMU is multi-platform software intended to be buildable on all modern
Linux platforms, OS-X, Win32 (via the Mingw64 toolchain) and a variety
of other UNIX targets. The simple steps to build QEMU are:

  mkdir build
  cd build
  ../configure
  make

Complete details of the process for building and configuring QEMU for
all supported host platforms can be found in the qemu-tech.html file.
Additional information can also be found online via the QEMU website:

  http://qemu-project.org/Hosts/Linux
  http://qemu-project.org/Hosts/W32


Submitting patches
==================

The QEMU source code is maintained under the GIT version control system.

   git clone git://git.qemu-project.org/qemu.git

When submitting patches, the preferred approach is to use 'git
format-patch' and/or 'git send-email' to format & send the mail to the
qemu-devel@nongnu.org mailing list. All patches submitted must contain
a 'Signed-off-by' line from the author. Patches should follow the
guidelines set out in the HACKING and CODING_STYLE files.

Additional information on submitting patches can be found online via
the QEMU website

  http://qemu-project.org/Contribute/SubmitAPatch
  http://qemu-project.org/Contribute/TrivialPatches


Bug reporting
=============

The QEMU project uses Launchpad as its primary upstream bug tracker. Bugs
found when running code built from QEMU git or upstream released sources
should be reported via:

  https://bugs.launchpad.net/qemu/

If using QEMU via an operating system vendor pre-built binary package, it
is preferable to report bugs to the vendor's own bug tracker first. If
the bug is also known to affect latest upstream code, it can also be
reported via launchpad.

For additional information on bug reporting consult:

  http://qemu-project.org/Contribute/ReportABug


Contact
=======

The QEMU community can be contacted in a number of ways, with the two
main methods being email and IRC

 - qemu-devel@nongnu.org
   http://lists.nongnu.org/mailman/listinfo/qemu-devel
 - #qemu on irc.oftc.net

Information on additional methods of contacting the community can be
found online via the QEMU website:

  http://qemu-project.org/Contribute/StartHere

-- End