This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision | ||
|
virtualisation:kvm [2016/12/10 17:25] Luc Nieland [tuning] |
virtualisation:kvm [2020/02/13 17:05] (current) Luc Nieland CentOS-8: bond + vlan + bridge |
||
|---|---|---|---|
| Line 33: | Line 33: | ||
| - | ===config=== | + | ===network config=== |
| Add to /etc/network/interfaces | Add to /etc/network/interfaces | ||
| <code> | <code> | ||
| Line 195: | Line 195: | ||
| dpkg-reconfigure locales | dpkg-reconfigure locales | ||
| + | =====Distribution: Ubuntu 18.04 LTS ===== | ||
| + | |||
| + | Install the networking software: | ||
| + | |||
| + | apt-get install bridge-utils vlan | ||
| + | |||
| + | |||
| + | ===network config=== | ||
| + | This uses netplan. | ||
| + | |||
| + | Remove all .yaml files in /etc/netplan/ (or rename them to *.disabled) | ||
| + | |||
| + | ==One network, one bridge== | ||
| + | A simple configuration for a simple network. The server has one bridge, with a static IP on the bridge. | ||
| + | |||
| + | Add to /etc/netplan/10-netconfig-bridge-static.yaml | ||
| + | |||
| + | <code> | ||
| + | network: | ||
| + | version: 2 | ||
| + | renderer: networkd | ||
| + | ethernets: | ||
| + | eno1: | ||
| + | dhcp4: no | ||
| + | bridges: | ||
| + | br0: | ||
| + | interfaces: | ||
| + | - eno1 | ||
| + | addresses: | ||
| + | - 192.168.2.203/24 | ||
| + | gateway4: 192.168.2.1 | ||
| + | parameters: | ||
| + | stp: false | ||
| + | forward-delay: 0 | ||
| + | nameservers: | ||
| + | addresses: | ||
| + | - 194.109.6.66 | ||
| + | - 194.109.9.99 | ||
| + | </code> | ||
| + | |||
| + | ==One bridge per VLAN== | ||
| + | A more complex setup. The system has one physical NIC. This is connected to a switch. This port is in trunc-mode, and has four VLANs configured on this port. | ||
| + | |||
| + | On the server, the four VLANs are split, and for every VLAN a bridge is created. A static IP number is configured on one bridge, to access the server. | ||
| + | |||
| + | |||
| + | Remove alle files in /etc/netplan/ and create the file /etc/netplan/10-netconfig-bridge-per-vlan.yaml with the following: | ||
| + | |||
| + | <code> | ||
| + | network: | ||
| + | version: 2 | ||
| + | renderer: networkd | ||
| + | ethernets: | ||
| + | eno1: | ||
| + | dhcp4: no | ||
| + | dhcp6: no | ||
| + | bridges: | ||
| + | br0010: | ||
| + | interfaces: | ||
| + | - vlan0010 | ||
| + | parameters: | ||
| + | stp: false | ||
| + | forward-delay: 0 | ||
| + | addresses: | ||
| + | - 192.168.10.42/24 | ||
| + | gateway4: 192.168.10.1 | ||
| + | nameservers: | ||
| + | addresses: | ||
| + | - 1.1.1.1 | ||
| + | - 8.8.8.8 | ||
| + | br0011: | ||
| + | interfaces: | ||
| + | - vlan0011 | ||
| + | parameters: | ||
| + | stp: false | ||
| + | forward-delay: 0 | ||
| + | dhcp4: no | ||
| + | dhcp6: no | ||
| + | br0012: | ||
| + | interfaces: | ||
| + | - vlan0012 | ||
| + | parameters: | ||
| + | stp: false | ||
| + | forward-delay: 0 | ||
| + | dhcp4: no | ||
| + | dhcp6: no | ||
| + | br0013: | ||
| + | interfaces: | ||
| + | - vlan0013 | ||
| + | parameters: | ||
| + | stp: false | ||
| + | forward-delay: 0 | ||
| + | dhcp4: no | ||
| + | dhcp6: no | ||
| + | vlans: | ||
| + | vlan0010: | ||
| + | accept-ra: no | ||
| + | id: 10 | ||
| + | link: eno1 | ||
| + | vlan0011: | ||
| + | accept-ra: no | ||
| + | id: 11 | ||
| + | link: eno1 | ||
| + | vlan0012: | ||
| + | accept-ra: no | ||
| + | id: 12 | ||
| + | link: eno1 | ||
| + | vlan013: | ||
| + | accept-ra: no | ||
| + | id: 13 | ||
| + | link: eno1 | ||
| + | </code> | ||
| + | |||
| + | |||
| + | And add the following file: /etc/systemd/network/10-netplan-brUp.network | ||
| + | |||
| + | <code> | ||
| + | [Match] | ||
| + | Name=br00* | ||
| + | |||
| + | [Network] | ||
| + | LinkLocalAddressing=no | ||
| + | ConfigureWithoutCarrier=true | ||
| + | </code> | ||
| + | |||
| + | Explanation. This is to bring up the anonymous bridges automatically after boot (the bridges which have no ip-address configured on it). Due to a bug in the combination of netplan and networkd, anonymous bridges will have operational status 'off' after boot. | ||
| + | |||
| + | This can be checked with: | ||
| + | |||
| + | networkctl list | ||
| + | |||
| + | This can be solved manually with: | ||
| + | |||
| + | ip link set dev br0011 up | ||
| + | ip link set dev br0012 up | ||
| + | ip link set dev br0013 up | ||
| + | |||
| + | for the above netplan yaml example. | ||
| + | |||
| + | |||
| + | ===KVM software=== | ||
| + | Install the KVM-serversoftware: | ||
| + | |||
| + | apt-get install qemu-kvm libvirt-daemon-system virt-top | ||
| + | |||
| + | |||
| + | And the cli administration tools: | ||
| + | |||
| + | apt-get install libvirt-clients | ||
| + | |||
| + | |||
| + | |||
| + | =====Distribution: CentOS ===== | ||
| - | =====Distribution: CentOS 6.0 ===== | ||
| ===preparation=== | ===preparation=== | ||
| - | Install a minimal CentOS 6.0 system with a static IP-number. | + | Install a minimal CentOS system with a static IP-number. |
| + | |||
| + | |||
| + | |||
| + | ===network config CentOS-8=== | ||
| + | |||
| + | With nmcli | ||
| + | |||
| + | Add to /etc/sysconfig/ | ||
| + | |||
| + | Bonding: | ||
| + | <code> | ||
| + | nmcli con add type bond con-name bond0 ifname bond0 autoconnect yes \ | ||
| + | ipv4.method disabled \ | ||
| + | ipv6.method ignore | ||
| + | nmcli con add type ethernet ifname eno1 con-name bond0-sl1 master bond0 | ||
| + | nmcli con add type ethernet ifname eno2 con-name bond0-sl2 master bond0 | ||
| + | <code> | ||
| + | |||
| + | |||
| + | Split the trunc-datastream to VLAN's: | ||
| + | <code> | ||
| + | nmcli con add type vlan ifname vlan20 con-name vlan20 vlan.id 20 \ | ||
| + | vlan.parent bond0 \ | ||
| + | ipv4.method disabled \ | ||
| + | ipv6.method ignore | ||
| + | # repeat per VLAN | ||
| + | <code> | ||
| + | |||
| + | |||
| + | Create a bridge per VLAN: | ||
| + | <code> | ||
| + | BR_NAME="br20" | ||
| + | BR_INT="vlan20" | ||
| + | SUBNET_IP="192.168.103.32/24" | ||
| + | GW="192.168.103.1" | ||
| + | DNS1="192.168.102.144" | ||
| + | DNS2="192.168.102.146" | ||
| + | nmcli connection add type bridge con-name ${BR_NAME} ifname ${BR_NAME} autoconnect yes | ||
| + | nmcli connection modify ${BR_NAME} ipv4.method manual ipv4.addresses ${SUBNET_IP} | ||
| + | nmcli connection modify ${BR_NAME} ipv4.gateway ${GW} | ||
| + | nmcli connection modify ${BR_NAME} ipv4.dns ${DNS1} +ipv4.dns ${DNS2} | ||
| + | nmcli connection up ${BR_NAME} | ||
| + | nmcli connection add type bridge-slave con-name ${BR_INT} ifname ${BR_INT} master ${BR_NAME} autoconnect yes | ||
| + | nmcli connection up ifname ${BR_INT} | ||
| + | # | ||
| + | ip r add default via 192.168.103.1 | ||
| + | # | ||
| + | <code> | ||
| + | |||
| + | ===hypervisor kvm=== | ||
| Install the software: | Install the software: | ||
| yum install kvm virt-manager libvirt | yum install kvm virt-manager libvirt | ||
| + | |||
| + | |||
| Line 493: | Line 697: | ||
| + | |||
| + | |||
| + | |||
| + | |||
| + | ======Migration of VMs to another host ====== | ||
| + | Instructions how to migrate VMs to another hypervisor-host. | ||
| + | |||
| + | ====Offline==== | ||
| + | |||
| + | Create a destination KVM-hypervisor system, including bridges on the required networks and VLANs. Try to use the same names for bridges, filesystems, logical-volumes. Else use "virsh edit" to make the modifications befor starting the VM on the destination hypervisor. | ||
| + | |||
| + | |||
| + | ===On the source-hypervisor=== | ||
| + | |||
| + | create a definition-file: | ||
| + | virsh list --all | ||
| + | virsh dumpxml --security-info vpstest2 > /var/lib/libvirt/images/vpstest2.xml | ||
| + | virsh shutdown vpstest2 | ||
| + | virsh destroy vpstest2 # if needed | ||
| + | |||
| + | |||
| + | ===On the destination-hypervisor=== | ||
| + | |||
| + | Create the required logical-volumes, and symlinks: | ||
| + | lvcreate -L 4G -n vpstest2 vg0 | ||
| + | ln -s /dev/mapper/vg0-vpstest2 /var/lib/libvirt/images/vpstest2.img | ||
| + | |||
| + | And get the raw-logical-volume with a dd piped through ssh: | ||
| + | ssh root@sourcehyp "dd if=/dev/mapper/vg0-vpstest2" | dd of=/dev/mapper/vg0-vpstest2 | ||
| + | |||
| + | And get the config-definition-file: | ||
| + | scp root@sourcehyp:/var/lib/libvirt/images/vpstest2.xml /var/lib/libvirt/images/vpstest2.xml | ||
| + | |||
| + | And create the VM: | ||
| + | virsh define /var/lib/libvirt/images/vpstest2.xml | ||
| + | |||
| + | And start the VM: | ||
| + | virsh start vpstest2 | ||
| + | |||
| + | |||
| + | |||
| + | | ||