QEMU With E2K User Support
Go to file
Stefan Hajnoczi 3009edff81 vhost-user: fix VHOST_USER_ADD/REM_MEM_REG truncation
QEMU currently truncates the mmap_offset field when sending
VHOST_USER_ADD_MEM_REG and VHOST_USER_REM_MEM_REG messages. The struct
layout looks like this:

  typedef struct VhostUserMemoryRegion {
      uint64_t guest_phys_addr;
      uint64_t memory_size;
      uint64_t userspace_addr;
      uint64_t mmap_offset;
  } VhostUserMemoryRegion;

  typedef struct VhostUserMemRegMsg {
      uint32_t padding;
      /* WARNING: there is a 32-bit hole here! */
      VhostUserMemoryRegion region;
  } VhostUserMemRegMsg;

The payload size is calculated as follows when sending the message in
hw/virtio/vhost-user.c:

  msg->hdr.size = sizeof(msg->payload.mem_reg.padding) +
      sizeof(VhostUserMemoryRegion);

This calculation produces an incorrect result of only 36 bytes.
sizeof(VhostUserMemRegMsg) is actually 40 bytes.

The consequence of this is that the final field, mmap_offset, is
truncated. This breaks x86_64 TCG guests on s390 hosts. Other guest/host
combinations may get lucky if either of the following holds:
1. The guest memory layout does not need mmap_offset != 0.
2. The host is little-endian and mmap_offset <= 0xffffffff so the
   truncation has no effect.

Fix this by extending the existing 32-bit padding field to 64-bit. Now
the padding reflects the actual compiler padding. This can be verified
using pahole(1).

Also document the layout properly in the vhost-user specification.  The
vhost-user spec did not document the exact layout. It would be
impossible to implement the spec without looking at the QEMU source
code.

Existing vhost-user frontends and device backends continue to work after
this fix has been applied. The only change in the wire protocol is that
QEMU now sets hdr.size to 40 instead of 36. If a vhost-user
implementation has a hardcoded size check for 36 bytes, then it will
fail with new QEMUs. Both QEMU and DPDK/SPDK don't check the exact
payload size, so they continue to work.

Fixes: f1aeb14b08 ("Transmit vhost-user memory regions individually")
Cc: Raphael Norwitz <raphael.norwitz@nutanix.com>
Cc: Cornelia Huck <cohuck@redhat.com>
Cc: Michael S. Tsirkin <mst@redhat.com>
Cc: Christian Borntraeger <borntraeger@de.ibm.com>
Signed-off-by: Stefan Hajnoczi <stefanha@redhat.com>
Message-Id: <20201109174355.1069147-1-stefanha@redhat.com>
Reviewed-by: Michael S. Tsirkin <mst@redhat.com>
Signed-off-by: Michael S. Tsirkin <mst@redhat.com>
Fixes: f1aeb14b08 ("Transmit vhost-user memory regions individually")
Reviewed-by: Cornelia Huck <cohuck@redhat.com>
Reviewed-by: Raphael Norwitz <raphael.norwitz@nutanix.com>
2020-11-12 09:19:40 -05:00
.github .github: Enable repo-lockdown bot to refuse GitHub pull requests 2020-04-07 16:19:18 +01:00
.gitlab-ci.d gitlab: skip checkpatch.pl checks if no commit delta on branch 2020-10-27 09:53:48 +00:00
accel Optimize across branches. 2020-10-30 19:47:54 +00:00
audio spice: move add_interface() to QemuSpiceOps. 2020-10-21 15:46:14 +02:00
authz authz: Fix Lesser GPL version number 2020-10-29 09:57:37 +00:00
backends cryptodev: Fix Lesser GPL version number 2020-10-27 16:48:49 +01:00
block block: Fix some code style problems, "foo* bar" should be "foo *bar" 2020-11-09 18:42:47 +01:00
bsd-user meson: bsd-user 2020-08-21 06:30:38 -04:00
capstone@f8b1b83301 capstone: Update to upstream "next" branch 2020-10-03 04:23:14 -05:00
chardev sockets: Make abstract UnixSocketAddress depend on CONFIG_LINUX 2020-11-03 13:17:25 +00:00
contrib vhost-user: fix VHOST_USER_ADD/REM_MEM_REG truncation 2020-11-12 09:19:40 -05:00
crypto crypto: Move the creation of the library to the main meson.build 2020-10-12 11:50:20 -04:00
default-configs hw/mips: Remove the 'r4k' machine 2020-11-03 16:51:13 +01:00
disas disas/capstone: Fix monitor disassembly of >32 bytes 2020-11-02 16:52:16 +00:00
docs vhost-user: fix VHOST_USER_ADD/REM_MEM_REG truncation 2020-11-12 09:19:40 -05:00
dtc@85e5d83984 Makefile: dtc: update, build the libfdt target 2020-06-16 14:49:05 +01:00
dump monitor: Use getter/setter functions for cur_mon 2020-10-09 07:08:19 +02:00
fpu softfloat: Define misc operations for bfloat16 2020-08-28 10:48:07 -07:00
fsdev Pull request trivial patches 20200919 2020-09-22 15:42:23 +01:00
gdb-xml target/avr: CPU class: Add GDB support 2020-07-10 17:58:32 +02:00
hw vhost-user: fix VHOST_USER_ADD/REM_MEM_REG truncation 2020-11-12 09:19:40 -05:00
include hw/misc/stm32f2xx_syscfg: Remove extraneous IRQ 2020-11-10 11:03:48 +00:00
io io: Don't use '#' flag of printf format 2020-10-29 09:57:37 +00:00
libdecnumber qemu/: fix some comment spelling errors 2020-09-17 20:35:43 +02:00
linux-headers linux-headers: update against 5.10-rc1 2020-11-01 12:30:51 -07:00
linux-user linux-user/sparc: Don't zero high half of PC, NPC, PSR in sigreturn 2020-11-10 07:54:22 +01:00
meson@776acd2a80 submodules: bump meson to 0.55.3 2020-10-17 10:45:42 -04:00
migration migration: Postpone the kick of the fault thread after recover 2020-11-02 18:25:48 +00:00
monitor console: make QMP/HMP screendump run in coroutine 2020-11-04 08:02:25 +01:00
nbd nbd: Add 'qemu-nbd -A' to expose allocation depth 2020-10-30 15:22:00 -05:00
net net: Add vhost-vdpa in show_netdevs() 2020-11-03 16:39:05 -05:00
pc-bios pc-bios/s390: update s390-ccw bios binaries 2020-11-04 06:59:34 -05:00
plugins Remove superfluous .gitignore files 2020-10-13 12:48:17 +02:00
po meson: convert po/ 2020-08-21 06:30:45 -04:00
python python/qemu/qmp.py: Fix settimeout operation 2020-10-20 15:00:06 -04:00
qapi block: Remove unused BlockDeviceMapEntry 2020-11-09 09:14:21 +01:00
qga qga: fix missing closedir() in qmp_guest_get_disks() 2020-11-09 14:07:14 -06:00
qobject qemu/: fix some comment spelling errors 2020-09-17 20:35:43 +02:00
qom qom: Add user_creatable_print_help_from_qdict() 2020-10-15 16:06:27 +02:00
replay replay: do not build if TCG is not available 2020-10-22 11:53:54 -04:00
roms roms/Makefile: Add qboot to .PHONY list 2020-11-04 08:25:17 +01:00
scripts scripts/oss-fuzz: give all fuzzers -target names 2020-11-10 08:51:30 +01:00
scsi qemu/atomic.h: rename atomic_ to qatomic_ 2020-09-23 16:07:44 +01:00
slirp@ce94eba204 slirp: update to latest stable-4.2 branch 2020-07-28 18:27:59 +04:00
softmmu pc,pci,vhost,virtio: fixes 2020-11-05 15:16:43 +00:00
storage-daemon qemu-storage-daemon: avoid compiling blockdev_ss twice 2020-10-23 13:42:16 +01:00
stubs * fix --disable-tcg builds (Claudio) 2020-10-26 15:49:11 +00:00
target target-arm queue: 2020-11-10 14:59:20 +00:00
tcg tcg: Revert "tcg/optimize: Flush data at labels not TCG_OPF_BB_END" 2020-11-04 10:35:40 -08:00
tests target-arm queue: 2020-11-10 14:59:20 +00:00
tools meson: vhost-user-gpu/virtiofsd: use absolute path 2020-11-03 09:42:53 -05:00
trace trace/simple: Enable tracing on startup only if the user specifies a trace option 2020-10-26 17:03:26 +00:00
ui misc bugfixes for 5.2 2020-11-04 22:13:02 +00:00
util pc,pci,vhost,virtio: fixes 2020-11-05 15:16:43 +00:00
.cirrus.yml block: enable libnfs on msys2/mingw in cirrus.yml 2020-11-09 15:44:21 +01:00
.dir-locals.el
.editorconfig meson: rename included C source files to .c.inc 2020-08-21 06:18:30 -04:00
.exrc
.gdbinit .gdbinit: load QEMU sub-commands when gdb starts 2017-06-07 14:38:45 +01:00
.gitignore Add *.pyc back to the .gitignore file 2020-09-23 19:09:56 +02:00
.gitlab-ci.yml gitlab: force enable docs build in Fedora, Ubuntu, Debian 2020-11-10 08:51:30 +01:00
.gitmodules gitmodules: add qemu.org vbootrom submodule 2020-09-23 13:44:59 +01:00
.gitpublish Add a git-publish configuration file 2018-03-05 09:03:17 +00:00
.mailmap .mailmap: Fix more contributor entries 2020-10-09 17:27:55 +01:00
.patchew.yml ci: store Patchew configuration in the tree 2019-06-03 14:03:02 +02:00
.readthedocs.yml readthedocs: build with Python 3.6 2020-10-05 16:30:45 +01:00
.shippable.yml shippable.yml: Remove the Debian9-based MinGW cross-compiler tests 2020-10-02 12:29:11 +01:00
.travis.yml ci: include configure and meson logs in all jobs if configure fails 2020-10-17 10:45:53 -04:00
CODING_STYLE.rst CODING_STYLE.rst: flesh out our naming conventions. 2020-09-10 10:34:58 +01:00
COPYING
COPYING.LIB COPYING.LIB: Synchronize the LGPL 2.1 with the version from gnu.org 2019-01-30 11:01:22 +01:00
Kconfig Makefile: simplify MINIKCONF rules 2020-07-10 18:02:21 -04:00
Kconfig.host configure: Fix build dependencies with vhost-vdpa. 2020-09-29 02:15:24 -04:00
LICENSE tcg/LICENSE: Remove out of date claim about TCG subdirectory licensing 2019-11-11 15:11:21 +01:00
MAINTAINERS docs/fuzz: rST-ify the fuzzing documentation 2020-11-10 08:51:29 +01:00
Makefile Pull request trivial branch 20201027 2020-10-30 15:49:35 +00:00
README.rst CHANGELOG: remove disused file 2020-10-27 16:48:50 +01:00
VERSION Update version for v5.2.0-rc1 release 2020-11-10 22:29:57 +00:00
block.c block: make bdrv_drop_intermediate() less wrong 2020-11-09 18:43:31 +01:00
blockdev-nbd.c nbd: Update qapi to support exporting multiple bitmaps 2020-10-30 15:10:15 -05:00
blockdev.c block: Convert 'block_resize' to coroutine 2020-10-09 07:08:20 +02:00
blockjob.c qemu/atomic.h: rename atomic_ to qatomic_ 2020-09-23 16:07:44 +01:00
configure configure: surface deprecated targets in the help output 2020-11-10 08:51:30 +01:00
cpu.c exec: split out non-softmmu-specific parts 2020-10-12 11:50:22 -04:00
cpus-common.c qemu/atomic.h: rename atomic_ to qatomic_ 2020-09-23 16:07:44 +01:00
disas.c disas: Enable capstone disassembly for s390x 2020-10-03 04:25:14 -05:00
exec-vary.c exec: Cache TARGET_PAGE_MASK for TARGET_PAGE_BITS_VARY 2019-10-28 10:35:20 +01:00
gdbstub.c replay: create temporary snapshot at debugger connection 2020-10-06 08:34:49 +02:00
gitdm.config contrib: gitdm: add a mapping for Janus Technologies 2019-03-12 19:31:29 +00:00
hmp-commands-info.hx replay: introduce info hmp/qmp command 2020-10-06 08:34:49 +02:00
hmp-commands.hx console: make QMP/HMP screendump run in coroutine 2020-11-04 08:02:25 +01:00
iothread.c qemu/atomic.h: rename atomic_ to qatomic_ 2020-09-23 16:07:44 +01:00
job-qmp.c trace: switch position of headers to what Meson requires 2020-08-21 06:18:24 -04:00
job.c trace: switch position of headers to what Meson requires 2020-08-21 06:18:24 -04:00
memory_ldst.c.inc fuzz: Add fuzzer callbacks to DMA-read functions 2020-10-26 09:53:53 +01:00
meson.build meson: always include contrib/libvhost-user 2020-11-09 18:34:21 +01:00
meson_options.txt configure: add option for virtiofsd 2020-10-26 18:35:32 +00:00
module-common.c all: Clean up includes 2016-02-04 17:41:30 +00:00
os-posix.c vl: relocate paths to data directories 2020-09-30 19:11:36 +02:00
os-win32.c vl: relocate paths to data directories 2020-09-30 19:11:36 +02:00
qemu-bridge-helper.c qemu-bridge-helper: relocate path to default ACL 2020-09-30 19:11:36 +02:00
qemu-edid.c qemu-edid: drop cast 2020-10-14 06:05:56 +02:00
qemu-img-cmds.hx qemu-img: add support for rate limit in qemu-img convert 2020-10-27 15:26:20 +01:00
qemu-img.c qemu-img convert: Free @sn_opts in all error cases 2020-11-03 16:24:56 +01:00
qemu-io-cmds.c qemu-io-cmds: Simplify help_oneline 2020-10-02 15:46:40 +02:00
qemu-io.c block: add missing socket_init() calls to tools 2020-09-02 16:47:39 -05:00
qemu-keymap.c Include qemu-common.h exactly where needed 2019-06-12 13:20:20 +02:00
qemu-nbd.c nbd: Add 'qemu-nbd -A' to expose allocation depth 2020-10-30 15:22:00 -05:00
qemu-options-wrapper.h qemu-img: remove references to GEN_DOCS 2018-05-20 08:35:54 +03:00
qemu-options.h Clean up ill-advised or unusual header guards 2016-07-12 16:20:46 +02:00
qemu-options.hx machine: remove deprecated -machine enforce-config-section option 2020-10-26 07:08:39 -04:00
qemu.nsi qemu.nsi: Install Sphinx documentation 2020-03-09 16:45:00 +00:00
qemu.sasl Default to GSSAPI (Kerberos) instead of DIGEST-MD5 for SASL 2017-05-09 14:41:47 +01:00
replication.c replication: Introduce new APIs to do replication operation 2016-09-13 11:00:56 +01:00
replication.h Include qemu/module.h where needed, drop it from qemu-common.h 2019-06-12 13:18:33 +02:00
thunk.c linux-user: Add strace support for printing arguments for ioctls used for terminals and serial lines 2020-08-27 12:29:50 +02:00
trace-events trace-events: Fix attribution of trace points to source 2020-09-09 17:17:58 +01:00
version.rc Use HTTPS for qemu.org and other domains 2017-11-21 13:34:13 +00:00

README.rst

===========
QEMU README
===========

QEMU is a generic and open source machine & userspace emulator and
virtualizer.

QEMU is capable of emulating a complete machine in software without any
need for hardware virtualization support. By using dynamic translation,
it achieves very good performance. QEMU can also integrate with the Xen
and KVM hypervisors to provide emulated hardware while allowing the
hypervisor to manage the CPU. With hypervisor support, QEMU can achieve
near native performance for CPUs. When QEMU emulates CPUs directly it is
capable of running operating systems made for one machine (e.g. an ARMv7
board) on a different machine (e.g. an x86_64 PC board).

QEMU is also capable of providing userspace API virtualization for Linux
and BSD kernel interfaces. This allows binaries compiled against one
architecture ABI (e.g. the Linux PPC64 ABI) to be run on a host using a
different architecture ABI (e.g. the Linux x86_64 ABI). This does not
involve any hardware emulation, simply CPU and syscall emulation.

QEMU aims to fit into a variety of use cases. It can be invoked directly
by users wishing to have full control over its behaviour and settings.
It also aims to facilitate integration into higher level management
layers, by providing a stable command line interface and monitor API.
It is commonly invoked indirectly via the libvirt library when using
open source applications such as oVirt, OpenStack and virt-manager.

QEMU as a whole is released under the GNU General Public License,
version 2. For full licensing details, consult the LICENSE file.


Building
========

QEMU is multi-platform software intended to be buildable on all modern
Linux platforms, OS-X, Win32 (via the Mingw64 toolchain) and a variety
of other UNIX targets. The simple steps to build QEMU are:


.. code-block:: shell

  mkdir build
  cd build
  ../configure
  make

Additional information can also be found online via the QEMU website:

* `<https://qemu.org/Hosts/Linux>`_
* `<https://qemu.org/Hosts/Mac>`_
* `<https://qemu.org/Hosts/W32>`_


Submitting patches
==================

The QEMU source code is maintained under the GIT version control system.

.. code-block:: shell

   git clone https://git.qemu.org/git/qemu.git

When submitting patches, one common approach is to use 'git
format-patch' and/or 'git send-email' to format & send the mail to the
qemu-devel@nongnu.org mailing list. All patches submitted must contain
a 'Signed-off-by' line from the author. Patches should follow the
guidelines set out in the CODING_STYLE.rst file.

Additional information on submitting patches can be found online via
the QEMU website

* `<https://qemu.org/Contribute/SubmitAPatch>`_
* `<https://qemu.org/Contribute/TrivialPatches>`_

The QEMU website is also maintained under source control.

.. code-block:: shell

  git clone https://git.qemu.org/git/qemu-web.git

* `<https://www.qemu.org/2017/02/04/the-new-qemu-website-is-up/>`_

A 'git-publish' utility was created to make above process less
cumbersome, and is highly recommended for making regular contributions,
or even just for sending consecutive patch series revisions. It also
requires a working 'git send-email' setup, and by default doesn't
automate everything, so you may want to go through the above steps
manually for once.

For installation instructions, please go to

*  `<https://github.com/stefanha/git-publish>`_

The workflow with 'git-publish' is:

.. code-block:: shell

  $ git checkout master -b my-feature
  $ # work on new commits, add your 'Signed-off-by' lines to each
  $ git publish

Your patch series will be sent and tagged as my-feature-v1 if you need to refer
back to it in the future.

Sending v2:

.. code-block:: shell

  $ git checkout my-feature # same topic branch
  $ # making changes to the commits (using 'git rebase', for example)
  $ git publish

Your patch series will be sent with 'v2' tag in the subject and the git tip
will be tagged as my-feature-v2.

Bug reporting
=============

The QEMU project uses Launchpad as its primary upstream bug tracker. Bugs
found when running code built from QEMU git or upstream released sources
should be reported via:

* `<https://bugs.launchpad.net/qemu/>`_

If using QEMU via an operating system vendor pre-built binary package, it
is preferable to report bugs to the vendor's own bug tracker first. If
the bug is also known to affect latest upstream code, it can also be
reported via launchpad.

For additional information on bug reporting consult:

* `<https://qemu.org/Contribute/ReportABug>`_


ChangeLog
=========

For version history and release notes, please visit
`<https://wiki.qemu.org/ChangeLog/>`_ or look at the git history for
more detailed information.


Contact
=======

The QEMU community can be contacted in a number of ways, with the two
main methods being email and IRC

* `<mailto:qemu-devel@nongnu.org>`_
* `<https://lists.nongnu.org/mailman/listinfo/qemu-devel>`_
* #qemu on irc.oftc.net

Information on additional methods of contacting the community can be
found online via the QEMU website:

* `<https://qemu.org/Contribute/StartHere>`_