mirror of
https://github.com/Motorhead1991/qemu.git
synced 2025-08-08 02:03:56 -06:00
Migration pull request
- Purge of ram_save_target_page_legacy - Cleanups to postcopy, json writer, migration states - New migration mode cpr-transfer - Fix for a -Werror=maybe-uninitialized instance in savevm -----BEGIN PGP SIGNATURE----- iQJEBAABCAAuFiEEqhtIsKIjJqWkw2TPx5jcdBvsMZ0FAmeaT8EQHGZhcm9zYXNA c3VzZS5kZQAKCRDHmNx0G+wxndXrEACTT+rdoEvOsNs4nM2a67GjxUoQZVTAWn+8 lYhhNZLA4E+qHwpHTDCwyfyvCe615r72+bF7QO1KTrYeXGJg4SPk5kbEhCDqqjEu SGqrlPwkC1x3WkTvb228iDddDQ8dccko3Sy6wAyz0o8dtp5p4iK+57qzB/84u94L y3zQ+owOo9OLnXgdfMpN99HGQSvPR7CbP/2L293IrMCuPDUo9XhI7ARNS/phbT3Z aDl10WGHKz1SJWOkPj137E6+xMKuCmOZDTufTcTaHfyliD04JRWgEZVnKJxKJDxd 9e+lzHvXuYfO7YO11fr7DttPRnLEfjipELVTxrudM92eZ95XwdL4+ggfBTGHt76P yFUrp7G8qsUjWd+DHPmoo6Gx71zPbE6v9J2NMn2/1k4WdPOYy7HTmDgCkRirRTvV irYkHtdSFFsj3c0g4P4mhOzXnvUkGXzgrjteM5hlLy3bjSeZz9VMZADjiGqFGVPb 6euPcLLa9oynkoP5UXmFd/9PjWcgnfIbQu2MVlIyWhjvTGZKSGecVZmH5pWTJuBV xCbab1jYprRFpUIAMo94rgvRQRosomS1+GjGndFkX5++dTTlFSqpDLSGcEnPSGRx o9n+IldNiqh2vjN1bj60pLfmrHN/F+hsGTsDJlW+kfeyBXBkGArg1rDjN5ae7GvD UZK0N+OG0g== =jwOI -----END PGP SIGNATURE----- Merge tag 'migration-20250129-pull-request' of https://gitlab.com/farosas/qemu into staging Migration pull request - Purge of ram_save_target_page_legacy - Cleanups to postcopy, json writer, migration states - New migration mode cpr-transfer - Fix for a -Werror=maybe-uninitialized instance in savevm # -----BEGIN PGP SIGNATURE----- # # iQJEBAABCAAuFiEEqhtIsKIjJqWkw2TPx5jcdBvsMZ0FAmeaT8EQHGZhcm9zYXNA # c3VzZS5kZQAKCRDHmNx0G+wxndXrEACTT+rdoEvOsNs4nM2a67GjxUoQZVTAWn+8 # lYhhNZLA4E+qHwpHTDCwyfyvCe615r72+bF7QO1KTrYeXGJg4SPk5kbEhCDqqjEu # SGqrlPwkC1x3WkTvb228iDddDQ8dccko3Sy6wAyz0o8dtp5p4iK+57qzB/84u94L # y3zQ+owOo9OLnXgdfMpN99HGQSvPR7CbP/2L293IrMCuPDUo9XhI7ARNS/phbT3Z # aDl10WGHKz1SJWOkPj137E6+xMKuCmOZDTufTcTaHfyliD04JRWgEZVnKJxKJDxd # 9e+lzHvXuYfO7YO11fr7DttPRnLEfjipELVTxrudM92eZ95XwdL4+ggfBTGHt76P # yFUrp7G8qsUjWd+DHPmoo6Gx71zPbE6v9J2NMn2/1k4WdPOYy7HTmDgCkRirRTvV # irYkHtdSFFsj3c0g4P4mhOzXnvUkGXzgrjteM5hlLy3bjSeZz9VMZADjiGqFGVPb # 6euPcLLa9oynkoP5UXmFd/9PjWcgnfIbQu2MVlIyWhjvTGZKSGecVZmH5pWTJuBV # xCbab1jYprRFpUIAMo94rgvRQRosomS1+GjGndFkX5++dTTlFSqpDLSGcEnPSGRx # o9n+IldNiqh2vjN1bj60pLfmrHN/F+hsGTsDJlW+kfeyBXBkGArg1rDjN5ae7GvD # UZK0N+OG0g== # =jwOI # -----END PGP SIGNATURE----- # gpg: Signature made Wed 29 Jan 2025 10:56:49 EST # gpg: using RSA key AA1B48B0A22326A5A4C364CFC798DC741BEC319D # gpg: issuer "farosas@suse.de" # gpg: Good signature from "Fabiano Rosas <farosas@suse.de>" [unknown] # gpg: aka "Fabiano Almeida Rosas <fabiano.rosas@suse.com>" [unknown] # gpg: WARNING: The key's User ID is not certified with a trusted signature! # gpg: There is no indication that the signature belongs to the owner. # Primary key fingerprint: AA1B 48B0 A223 26A5 A4C3 64CF C798 DC74 1BEC 319D * tag 'migration-20250129-pull-request' of https://gitlab.com/farosas/qemu: (42 commits) migration: refactor ram_save_target_page functions migration: Trivial cleanup on JSON writer of vmstate_save() migration: Merge precopy/postcopy on switchover start migration: Always set DEVICE state migration: Cleanup qemu_savevm_state_complete_precopy() migration: Unwrap qemu_savevm_state_complete_precopy() in postcopy migration: Notify COMPLETE once for postcopy migration: Take BQL slightly longer in postcopy_start() migration: Drop cached migration state in migration_maybe_pause() migration: Adjust locking in migration_maybe_pause() migration: Adjust postcopy bandwidth during switchover migration: Synchronize all CPU states only for non-iterable dump migration: Drop inactivate_disk param in qemu_savevm_state_complete* migration: Avoid two src-downtime-end tracepoints for postcopy migration: Optimize postcopy on downtime by avoiding JSON writer migration: Do not construct JSON description if suppressed migration: Remove postcopy implications in should_send_vmdesc() migration: cpr-transfer documentation migration-test: cpr-transfer tests/qtest: assert qmp connected ... Signed-off-by: Stefan Hajnoczi <stefanha@redhat.com>
This commit is contained in:
Stefan Hajnoczi
commit
9736ee382e
56 changed files with 1719 additions and 392 deletions
|
|
@ -5,7 +5,7 @@ CPR is the umbrella name for a set of migration modes in which the
|
|||
VM is migrated to a new QEMU instance on the same host. It is
|
||||
intended for use when the goal is to update host software components
|
||||
that run the VM, such as QEMU or even the host kernel. At this time,
|
||||
cpr-reboot is the only available mode.
|
||||
the cpr-reboot and cpr-transfer modes are available.
|
||||
|
||||
Because QEMU is restarted on the same host, with access to the same
|
||||
local devices, CPR is allowed in certain cases where normal migration
|
||||
|
|
@ -53,7 +53,7 @@ RAM is copied to the migration URI.
|
|||
Outgoing:
|
||||
* Set the migration mode parameter to ``cpr-reboot``.
|
||||
* Set the ``x-ignore-shared`` capability if desired.
|
||||
* Issue the ``migrate`` command. It is recommended the the URI be a
|
||||
* Issue the ``migrate`` command. It is recommended the URI be a
|
||||
``file`` type, but one can use other types such as ``exec``,
|
||||
provided the command captures all the data from the outgoing side,
|
||||
and provides all the data to the incoming side.
|
||||
|
|
@ -145,3 +145,183 @@ Caveats
|
|||
|
||||
cpr-reboot mode may not be used with postcopy, background-snapshot,
|
||||
or COLO.
|
||||
|
||||
cpr-transfer mode
|
||||
-----------------
|
||||
|
||||
This mode allows the user to transfer a guest to a new QEMU instance
|
||||
on the same host with minimal guest pause time, by preserving guest
|
||||
RAM in place, albeit with new virtual addresses in new QEMU. Devices
|
||||
and their pinned memory pages will also be preserved in a future QEMU
|
||||
release.
|
||||
|
||||
The user starts new QEMU on the same host as old QEMU, with command-
|
||||
line arguments to create the same machine, plus the ``-incoming``
|
||||
option for the main migration channel, like normal live migration.
|
||||
In addition, the user adds a second -incoming option with channel
|
||||
type ``cpr``. This CPR channel must support file descriptor transfer
|
||||
with SCM_RIGHTS, i.e. it must be a UNIX domain socket.
|
||||
|
||||
To initiate CPR, the user issues a migrate command to old QEMU,
|
||||
adding a second migration channel of type ``cpr`` in the channels
|
||||
argument. Old QEMU stops the VM, saves state to the migration
|
||||
channels, and enters the postmigrate state. Execution resumes in
|
||||
new QEMU.
|
||||
|
||||
New QEMU reads the CPR channel before opening a monitor, hence
|
||||
the CPR channel cannot be specified in the list of channels for a
|
||||
migrate-incoming command. It may only be specified on the command
|
||||
line.
|
||||
|
||||
Usage
|
||||
^^^^^
|
||||
|
||||
Memory backend objects must have the ``share=on`` attribute.
|
||||
|
||||
The VM must be started with the ``-machine aux-ram-share=on``
|
||||
option. This causes implicit RAM blocks (those not described by
|
||||
a memory-backend object) to be allocated by mmap'ing a memfd.
|
||||
Examples include VGA and ROM.
|
||||
|
||||
Outgoing:
|
||||
* Set the migration mode parameter to ``cpr-transfer``.
|
||||
* Issue the ``migrate`` command, containing a main channel and
|
||||
a cpr channel.
|
||||
|
||||
Incoming:
|
||||
* Start new QEMU with two ``-incoming`` options.
|
||||
* If the VM was running when the outgoing ``migrate`` command was
|
||||
issued, then QEMU automatically resumes VM execution.
|
||||
|
||||
Caveats
|
||||
^^^^^^^
|
||||
|
||||
cpr-transfer mode may not be used with postcopy, background-snapshot,
|
||||
or COLO.
|
||||
|
||||
memory-backend-epc is not supported.
|
||||
|
||||
The main incoming migration channel address cannot be a file type.
|
||||
|
||||
If the main incoming channel address is an inet socket, then the port
|
||||
cannot be 0 (meaning dynamically choose a port).
|
||||
|
||||
When using ``-incoming defer``, you must issue the migrate command to
|
||||
old QEMU before issuing any monitor commands to new QEMU, because new
|
||||
QEMU blocks waiting to read from the cpr channel before starting its
|
||||
monitor, and old QEMU does not write to the channel until the migrate
|
||||
command is issued. However, new QEMU does not open and read the
|
||||
main migration channel until you issue the migrate incoming command.
|
||||
|
||||
Example 1: incoming channel
|
||||
^^^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||
|
||||
In these examples, we simply restart the same version of QEMU, but
|
||||
in a real scenario one would start new QEMU on the incoming side.
|
||||
Note that new QEMU does not print the monitor prompt until old QEMU
|
||||
has issued the migrate command. The outgoing side uses QMP because
|
||||
HMP cannot specify a CPR channel. Some QMP responses are omitted for
|
||||
brevity.
|
||||
|
||||
::
|
||||
|
||||
Outgoing: Incoming:
|
||||
|
||||
# qemu-kvm -qmp stdio
|
||||
-object memory-backend-file,id=ram0,size=4G,
|
||||
mem-path=/dev/shm/ram0,share=on -m 4G
|
||||
-machine memory-backend=ram0
|
||||
-machine aux-ram-share=on
|
||||
...
|
||||
# qemu-kvm -monitor stdio
|
||||
-incoming tcp:0:44444
|
||||
-incoming '{"channel-type": "cpr",
|
||||
"addr": { "transport": "socket",
|
||||
"type": "unix", "path": "cpr.sock"}}'
|
||||
...
|
||||
{"execute":"qmp_capabilities"}
|
||||
|
||||
{"execute": "query-status"}
|
||||
{"return": {"status": "running",
|
||||
"running": true}}
|
||||
|
||||
{"execute":"migrate-set-parameters",
|
||||
"arguments":{"mode":"cpr-transfer"}}
|
||||
|
||||
{"execute": "migrate", "arguments": { "channels": [
|
||||
{"channel-type": "main",
|
||||
"addr": { "transport": "socket", "type": "inet",
|
||||
"host": "0", "port": "44444" }},
|
||||
{"channel-type": "cpr",
|
||||
"addr": { "transport": "socket", "type": "unix",
|
||||
"path": "cpr.sock" }}]}}
|
||||
|
||||
QEMU 10.0.50 monitor
|
||||
(qemu) info status
|
||||
VM status: running
|
||||
|
||||
{"execute": "query-status"}
|
||||
{"return": {"status": "postmigrate",
|
||||
"running": false}}
|
||||
|
||||
Example 2: incoming defer
|
||||
^^^^^^^^^^^^^^^^^^^^^^^^^
|
||||
|
||||
This example uses ``-incoming defer`` to hot plug a device before
|
||||
accepting the main migration channel. Again note you must issue the
|
||||
migrate command to old QEMU before you can issue any monitor
|
||||
commands to new QEMU.
|
||||
|
||||
|
||||
::
|
||||
|
||||
Outgoing: Incoming:
|
||||
|
||||
# qemu-kvm -monitor stdio
|
||||
-object memory-backend-file,id=ram0,size=4G,
|
||||
mem-path=/dev/shm/ram0,share=on -m 4G
|
||||
-machine memory-backend=ram0
|
||||
-machine aux-ram-share=on
|
||||
...
|
||||
# qemu-kvm -monitor stdio
|
||||
-incoming defer
|
||||
-incoming '{"channel-type": "cpr",
|
||||
"addr": { "transport": "socket",
|
||||
"type": "unix", "path": "cpr.sock"}}'
|
||||
...
|
||||
{"execute":"qmp_capabilities"}
|
||||
|
||||
{"execute": "device_add",
|
||||
"arguments": {"driver": "pcie-root-port"}}
|
||||
|
||||
{"execute":"migrate-set-parameters",
|
||||
"arguments":{"mode":"cpr-transfer"}}
|
||||
|
||||
{"execute": "migrate", "arguments": { "channels": [
|
||||
{"channel-type": "main",
|
||||
"addr": { "transport": "socket", "type": "inet",
|
||||
"host": "0", "port": "44444" }},
|
||||
{"channel-type": "cpr",
|
||||
"addr": { "transport": "socket", "type": "unix",
|
||||
"path": "cpr.sock" }}]}}
|
||||
|
||||
QEMU 10.0.50 monitor
|
||||
(qemu) info status
|
||||
VM status: paused (inmigrate)
|
||||
(qemu) device_add pcie-root-port
|
||||
(qemu) migrate_incoming tcp:0:44444
|
||||
(qemu) info status
|
||||
VM status: running
|
||||
|
||||
{"execute": "query-status"}
|
||||
{"return": {"status": "postmigrate",
|
||||
"running": false}}
|
||||
|
||||
Futures
|
||||
^^^^^^^
|
||||
|
||||
cpr-transfer mode is based on a capability to transfer open file
|
||||
descriptors from old to new QEMU. In the future, descriptors for
|
||||
vfio, iommufd, vhost, and char devices could be transferred,
|
||||
preserving those devices and their kernel state without interruption,
|
||||
even if they do not explicitly support live migration.
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue