ESX Virtualization

VMware ESXi, vSphere, VMware Backup, Hyper-V... how-to, videos....

Nakivo Backup and Replication - #1 Backup solution for Virtual, physical, cloud, NAS and SaaS

Menu
  • Certification
      • VCP-DCV vSphere 8
          • vcp2024-125.
        • Close
    • Close
  • VMware
    • Configuration Maximums
    • vSphere
      • vSphere 8.0
      • vSphere 7.0
      • vSphere 6.7
      • vSphere 6.5
      • vSphere 6.0
      • Close
    • VMworld
      • VMware EXPLORE 2024
      • VMware EXPLORE 2023
      • VMware EXPLORE 2022
      • VMworld 2019
      • VMworld 2018
      • VMworld 2017
      • VMworld 2016
      • VMworld 2015
      • VMworld 2014
      • VMworld 2013
      • VMworld 2012
      • VMworld 2011
      • Close
    • Close
  • Microsoft
    • Windows Server 2012
    • Windows Server 2016
    • Windows Server 2019
    • Close
  • Categories
    • Tips – VMware, Microsoft and General IT tips and definitions, What is this?, How this works?
    • Server Virtualization – VMware ESXi, ESXi Free Hypervizor, VMware vSphere Server Virtualization, VMware Cloud and Datacenter Virtualization
    • Backup – Virtualization Backup Solutions, VMware vSphere Backup and ESXi backup solutions.
    • Desktop Virtualization – Desktop Virtualization, VMware Workstation, VMware Fusion, VMware Horizon View, tips and tutorials
    • How To – ESXi Tutorials, IT and virtualization tutorials, VMware ESXi 4.x, ESXi 5.x and VMware vSphere. VMware Workstation and other IT tutorials.
    • Free – Free virtualization utilities, ESXi Free, Monitoring and free backup utilities for ESXi and Hyper-V. Free IT tools.
    • Videos – VMware Virtualization Videos, VMware ESXi Videos, ESXi 4.x, ESXi 5.x tips and videos.
    • Home Lab
    • Reviews – Virtualization Software and reviews, Disaster and backup recovery software reviews. Virtual infrastructure monitoring software review.
    • Close
  • Partners
    • NAKIVO
    • StarWind
    • Zerto
    • Xorux
    • Close
  • This Web
    • News
    • ESXi Lab
    • About
    • Advertise
    • Archives
    • Disclaimer
    • PDFs and Books
    • Close
  • Free
  • Privacy policy

What is VMware vMotion?

By Vladan SEGET | Last Updated: March 15, 2017

Shares

What is VMware vMotion? It is THE feature, the function, which “hooked” thousands of millions IT guys on the plane for using VMware for their IT infrastructure. It is kind of a holy grail of virtualization where a running VM moves to another host without interruption of service (of with just a few pings lost).

I still remember when I did my first setup of a vMotion, then open a DOS window and run a ping command to see how many packets will be lost during vMotion operation.

In this post, we will learn not only What is VMware vMotion, but also see different versions of vMotions (such as long distance vMotion or vMotion across country, or across datacenters) and will set up a multi-NIC vMotion allowing to maximize throughput and lower the migration time which is especially useful for VMs configured with a lot of VRAM.

The usual admin does not need to know in details what's happening behind the covers. For most situations, it is enough to know that VM moves from host to host without losing connection.

From a higher perspective, vMotion copies all the VM's memory pages to the target VM first, via a vMotion network. The target VM is called also shadow VM. This first copy operation is also called PreCopy. Since the source VM continues to change its memory, the process starts once again and copies any delta changes occurred since the las PreCopy.

Once all the copies are done, and there are no more changes to copy, the source VM process shuts down, the delta of the remaining memory is copied to the target VM, which is resumed. The last part is happening within milliseconds. The main part why we have to wait for vMotion to finish is because of the network. And that's why it is interesting to have multi-NIC vMotion.

vMotion across country (Long-distance vMotion)

A long-distance vMotion is present since vSphere 6.0. An RTT (round-trip time) latency of 150 milliseconds or less, between hosts. Your license must cover vMotion across long distances. The cross vCenter and long distance vMotion features require an Enterprise Plus license.

is Long-distance vMotion allowing to vMotion VMs from one data center to another (to remote site or cloud data center) and the requirements on this is to have a link with at least 150 ms RTT (previously 10 ms was necessary ).

The vMotion process is able to keep the VMs historical data (events, alarms, performance counters, etc.) and also properties like DRS groups, HA settings, which are in relation and tighten to vCenter.  It means that the VM can not only change compute (a host) but also network, management, and storage – at the same time. (until now we could change host and storage during vMotion process – correct me if I’m wrong)

Requirements:

  • vCenter 6 (both ends)
  • Single SSO domain (same SSO domain to use the UI). With an API it’s possible to use different SSO domain.
  • L2 connectivity for VM network
  • vMotion Network
  • 250 Mbps network bandwidth per vMotion operation

vMotion across vCenters:

  • VM UUID is maintained across vCenter server instances
  • Retain Alarms, Events, task and history
  • HA/DRS settings including Affinity/anti-affinity rules, isolation responses, automation level, start-up priority
  • VM resources (shares, reservations, limits)
  • Maintain MAC address of Virtual NIC
  • VM which leaves for another vCenter will keep its MAC address and this MAC address will not be reused in the source vCenter.

It’s possible to move VMs:

  • from VSS to VSS
  • from VSS to VDS
  • from VDS to VDS

vMotion Across vCenters

Allows to change compute, storage, networks, and management. In single operation you’re able to move a VM from vCenter 1 where this VM is placed on certain Host, lays on some datastore and is present in some resource pool, into a vCenter 2 where the VM lays on different datastore, is on a different host and it’s part of the different resource pool.

vMotion across vCenters

vMotion without shared storage (Shared Nothing vMotion)

This is part of vSphere since version 5.1. You no longer need shared storage to move a VM from and to a host. The process is the same as traditional vMotion but part of the process is also a storage vMotion. You'll need to choose to what host do you want to migrate to, what datastore, and a priority level.

Useful for cross-cluster migrations, when the target cluster machines might not have access to the source cluster's storage. Processes that are working on the virtual machine continue to run during the migration with vMotion.

Shared nothing vMotion

But, if you want to speed up the migration, it is better to shut down the VM as the amount of data to transfer will be less important and the transfer will put less pressure on your infrastructure.

Requirements:

  • The destination host must have access to the destination storage.
  • The hosts must be licensed for vMotion.
  • Virtual machine disks must be in persistent mode or be raw device mappings (RDMs). When you move a virtual machine with RDMs and do not convert those RDMs to VMDKs, the destination host must have access to the RDM LUNs.
  • ESXi 5.1 or later.
  • On each host, configure a VMkernel port group for vMotion. ( You can configure multiple NICs for vMotion by adding two or more NICs to the required standard or distributed switch.)
  • Make sure that VMs has access to the same subnets or VLANs on a source and destination hosts. This applies also to standard (traditional) vMotion.

Limitations: 

  • This type of vMotion counts against the limits for both vMotion and Storage vMotion, so it consumes both a network resource and 16 datastore resources

How to configure Multiple-NIC vMotion with Standard Switches

Requirements:

  • You'll need at least two dedicated network adapters for vMotion per host.
  • All VMkernel ports configured are in the same IP subnet/VLAN on all hosts

We might do a follow-up post for vDS switches where you can use a network I/O control for load balancing (NIOC) in case you don't use dedicated NICs for vMotion or you're using 10GbE NICs which share other types of traffic.

There are several ways to do it. One way can be by creating a separate vSwitch for vMotion or you can also have both VMkernel ports attached to the same vSwitch. We'll stick to the second option. As we already have one VMkernel port with a vMotion network configured, we'll just do the second one. The first VMKernel vMotion portgroup is called vmotion01 and it is using vmnic4 as an active adapter.

It looks like this through vSphere web client.

VMware vSphere Multi-nic vMotion

We're on 10.10.2.11 network with VLAN2.

Let's add second VMkernel and activate vMotion traffic.

Click the Add host networking icon.

Add host networking

And follow the assistant.

Multi-nic vMotion

Use existing standard switch is my option (you can create new vSwitch too), but as being said, other options exists.

Multi-nic vMotion with VMware vSphere - select target device

And then put some meaningful name for network label (simply vmotion02 in my case), pick a VLAN ID and check the vMotion service checkbox.

Multi-nic vMotion with VMware vSphere

And chose an IP address within the same range/VLAN as the first VMkernel port for vMotion.

Multi-nic vMotion with VMware vSphere - IP address

Then Select the vSwitch, select the VMkernel port, click the pencil icon and configure the teaming and failover this way:

  • vmotion01: I use vmnic4 as active – vmnic5 as standby
  • vmotion02: I use vmnic5 as active – vmnic4 as standby

Active - Standby config of multi-nic vmotion

Then rinse and repeat for each of your hosts within your cluster. That's where also you would like to have vSphere Distributed vSwitch (vDS) where you configure things only once, at the vDS level.

The multi-NIC vMotion has been documented in many places, and it is here since vSphere 5. The source I used was this VMware KB article – Multiple-NIC vMotion in vSphere – which also has 2 videos you can watch.

More from ESX Virtualization:

  • What is VMware Storage DRS (SDRS)?
  • What Is Erasure Coding?
  • What is VMware Orchestrated Restart?
  • What is VMware Cluster?
  • VMware vSphere Essentials Kit Term

Stay tuned through RSS, and social media channels (Twitter, FB, YouTube)

Shares
4.5/5 - (4 votes)

| Filed Under: How To, Server Virtualization, Tips Tagged With: What is VMware vMotion

About Vladan SEGET

This website is maintained by Vladan SEGET. Vladan is as an Independent consultant, professional blogger, vExpert x16, Veeam Vanguard x9, VCAP-DCA/DCD, ESX Virtualization site has started as a simple bookmarking site, but quickly found a large following of readers and subscribers.

Connect on: Facebook. Feel free to network via Twitter @vladan.

Comments

  1. David Lenrow says

    March 16, 2017 at 12:54 am

    Another answer to “What is vmotion?”: It’s the first sign that your application is probably better suited for containers. Dragging the entire operating system between datacenters and booting it is a huge waste if time and resources/bandwidth.

    • Vladan SEGET says

      March 20, 2017 at 2:38 pm

      David, In any case The OS is booting at any particular time, during vMotion operation. You are perhaps right about a use case for container apps, but those are just not a widely used as they should.

Private Sponsors

Featured

  • Thinking about HCI? G2, an independent tech solutions peer review platform, has published its Winter 2023 Reports on Hyperconverged Infrastructure (HCI) Solutions.
  • Zerto: One Platform for Disaster Recovery, Backup & Cloud Mobility: Try FREE Hands-On Labs Today!
Click to Become a Sponsor

Most Recent

  • FREE version of StarWind VSAN vs Trial of Full version
  • Commvault’s Innovations at RSA Conference 2025 San Francisco
  • VMware ESXi FREE is FREE again!
  • Installation of StarWind VSAN Plugin for vSphere
  • Protect Mixed environments with Nakivo Physical Machine recovery (bare metal)
  • No more FREE licenses of VMware vSphere for vExperts – What’s your options?
  • Tails – Your Private OS on USB Stick
  • StarWind V2V Converter Now has CLI
  • Veeam VHR ISO v2 – 2025 Download and Install
  • Deployment OVA and Installation of Nakivo Backup and Replication for VMware

Get new posts by email:

 

 

 

 

Support us on Ko-Fi

 

 

Buy Me a Coffee at ko-fi.com

Sponsors

Free Trials

  • DC Scope for VMware vSphere – optimization, capacity planning, and cost management. Download FREE Trial Here.
  • Augmented Inline Deduplication, Altaro VM Backup v9 For #VMware and #Hyper-V – Grab your copy now download TRIAL.

VMware Engineer Jobs

VMware Engineer Jobs

YouTube

…

Find us on Facebook

ESX Virtualization

…

Copyright © 2025 ·Dynamik-Gen · Genesis Framework · Log in