Upgrading from Stratus Redundant Linux Release 2.x to 3.x or Higher
Use the instructions in this topic to upgrade the system software from Stratus Redundant Linux Release 2.x to 3.x or higher. (If you need to upgrade a system already running Release 3.x to a later version of 3.x, go directly to Upgrading Stratus Redundant Linux Software Using an Upgrade Kit.)
Before upgrading from Stratus Redundant Linux Release 2.x to 3.x or higher:
-
For the latest information about upgrade paths, restrictions, and special procedures, see the Stratus Redundant Linux Release 3.0.0.0 Release Notes at http://ztcedgedoc.stratus.com and Knowledge Base article KB0015904 in the Stratus Customer Service Portal. In summary, you can upgrade any Stratus Redundant Linux Release 2.3.x.x system directly to 3.x or higher. If you are upgrading from a version earlier than Release 2.3.x.x, you need to upgrade to Release 2.3.x.x first.
- Ensure that all PMs and VMs are in good health. Examine the ztC Edge Console to verify that there are no alerts indicating PM or VM problems.
- Eject any VCDs or USB media from the VMs before upgrading the system software. If VCD or USB media is still connected to the VMs, it prevents the system from migrating the VMs and putting the PMs into maintenance mode for the upgrade process.
-
Disable the following features, which are no longer supported:
-
Monitoring Windows-based VMs and Applications—For each Windows-based VM that has monitoring enabled, click the VM name on the Virtual Machines page, click the Monitor tab, clear the Enabled check box next to any Guest OS parameters or Windows Applications that are monitored, and then click Save.
Also, open the console to the guest operating system and log on as an administrative user. In the Control Panel, open Apps and Features, Programs and Features, or Add or Remove Programs and uninstall the ztC Edge Windows monitoring agent.
-
ztC Advisor—In the ztC Edge Console, click Preferences. Under Administrative Tools, click ztC Advisor. Clear the check box next to Enable ztC Advisor and click Save.
-
- To verify that the system meets the requirements of the upgrade kit, use the Qualify button as described in the following procedures.
-
Back up the VMs and make note of any system preferences, customized configurations (for example, certificates, snmpd.conf modifications, or iptables rule changes), and logs. In case of any failures during the migration process, you can use these backups to restore the system. Because the upgrade involves a migration from the earlier CentOS-based host operating system to the new Ubuntu-based host operating system, if the upgrade from Release 2.x to 3.x fails and there is no backup data, you cannot restore the system to its original status.
-
To export VMs on a ztC Edge Release 2.x system to OVF and VHD files as a backup, see Exporting a Virtual Machine.
-
To back up system preferences, see Saving and Restoring System Preferences. Note that cloud-based save and restore are no longer supported with Release 3.x or higher. You must save the preferences to your local computer; otherwise, you will be unable to restore the preferences in Release 3.x or higher.
-
-
In some cases, one or more VMs may be configured but stopped or intentionally shut down. If this situation applies to your system, it is important to start each of the VMs and allow them to complete any required synchronization before you start the upgrade procedure
-
When performing the upgrade, ensure that you log on to a local user account of the ztC Edge Console. To prevent an unexpected loss of access during the upgrade process, do not use an Active Directory user account.
If your system is configured with Active Directory, you need to reconfigure Active Directory after the upgrade. See KB0015909 for information about creating a new rootCA SSL certificate and installing it into the Java keystore of the ztC Edge system to enable the more secure Active Directory/LDAP over SSL support in Release 3.x or higher.
-
Record any of your current passwords for the system. The ztC Edge Console password remains the same, but, for example, the password for the host operating system on each node will revert to the default setting, and you need to change it after the upgrade to secure your system.
-
Ensure that you plan a dedicated maintenance period for the upgrade process. The upgrade requires at least 60 minutes of downtime for a single-node system, or 120 minutes of downtime for a dual-node system. This time estimate does not include the time it takes to back up data from the node(s) undergoing upgrade. The upgrade also includes a loss of access to the ztC Edge Console as the system reboots during the upgrade procedure. During the upgrade procedure, the ztC Edge system will be completely unavailable for business connectivity.
The steps are:
I. To download the upgrade kit
Download the upgrade kit that contains the new system software.
- Open the Downloads page at https://www.stratus.com/services-support/downloads/?tab=ztcedge.
- Scroll down to the upgrade section and then click the Stratus Redundant Linux 3.x.x.x Upgrade Kit link to download the kit.
- Specify a location on a local computer to save the file. If necessary, transfer the file to the remote management computer running the ztC Edge Console.
II. To upload the upgrade kit to the system
Upload the upgrade kit to the ztC Edge system from the remote management computer that is running the ztC Edge Console.
-
In the ztC Edge Console, click Upgrade Kits in the left-hand navigation panel.
- On the Upgrade Kits page, click the Add a Kit button beneath the masthead, which opens the ztC Edge - Kit Upload Wizard.
- In the ztC Edge - Kit Upload Wizard dialog box, click Browse and then browse to select a .kit file.
- After you have selected a .kit file, click Upload, Import, or Finish (they perform the same function). A message such as Uploading file (DO NOT CLOSE WIZARD) appears while the file is uploading. The upload may require up to two minutes for a file stored locally, to ten or more minutes for a file stored over a network. If the upload fails, the wizard displays the message Failed to upload file.
-
After the upload is complete, the wizard closes and the Upgrade Kits page lists the state and version number of the upgrade kit. The Qualify, Upgrade, and Delete buttons also appear with the Add a Kit button.
- If more than one upgrade kit is loaded, select the kit for 3.x.x-xxx.
III. To qualify the software
Qualify the software to verify that your system meets the requirements of the upgrade kit. (Qualifying the software is recommended, but not required.)
To do so, select the upgrade kit you want to qualify on the Upgrade Kits page, and then click Qualify.
The qualification may require up to six minutes. If the qualification succeeds, continue with the next step.
If the qualification fails, a pop-up window appears with messages indicating the cause of the failure. These messages may indicate unsupported releases, insufficient storage, partition problems, VMs that need to be shut down, or other information associated with upgrading the system. For example, if the system has insufficient disk space to complete the upgrade, the message Insufficient free space appears reporting the amount of space needed. If you need help resolving a qualification issue, search for the qualification error message in the Knowledge Base in the Stratus Customer Service Portal at https://service.stratus.com.
IV. To upgrade the system software from Stratus Redundant Linux Release 2.x to 3.x or higher
After verifying that your system meets the Prerequisites for upgrade and completing steps I-III of the upgrade process, continue with the following procedure to upgrade the system software to Stratus Redundant Linux 3.x or higher.
-
Log on to the ztC Edge Console with a local user account (not a networked Active Directory account) for the upgrade.
-
Confirm that all PMs and VMs are healthy. In the ztC Edge Console:
-
The Dashboard page displays green check marks (
) with no outstanding issues.
-
The Physical Machines page displays green check marks (
) for each PM.
-
The Virtual Machines page displays green check marks (
) for each VM.
-
-
On the Preferences page, click IP Configuration. Record the current network settings of the ztC Edge system or take a screen capture of the IP Configuration page in case this information is necessary to access or restore the system.
-
Verify the health of each node in the system. Check the system logs for any memory, network, CPU, or storage errors (for example SMART disk errors) by doing the following:
-
Open an ssh connection to the host operating system of a node in the ztC Edge system at one of the IP addresses you recorded in a previous step.
-
Open logs including /var/log/messages in a text editor or use system commands to examine the log entries for any issues.
-
For dual-node systems, repeat these steps on the second node in the system.
-
-
Verify the health of each VM. For each running VM, do the following:
-
On the Virtual Machines page, record the Name of each VM.
-
Open an ssh connection to the host operating system of one of the nodes in the ztC Edge system at one of the IP addresses you recorded in a previous step.
-
For each VM, execute the following command, where vmname is the name of the VM recorded in a previous step:
# /opt/ft/bin/axcons vmname ax1.scp show pvm status | grep PVMVerify that the output is similar to the following, where the VM's state in the first column is Good.
# /opt/ft/bin/axcons myVM ax1.scp show pvm status | grep PVM
PVM Good None None NoneFor any VM that is Stopped, start and verify the VM as described in the next step. Wait for it to synchronize, and run the axcons command again to confirm that the VM is in a Good state.
Caution: If the state of the VM is anything other than Good or Stopped (for example, Degraded, Transitioning, or Crashed), defer the upgrade and contact your authorized Stratus service representative for assistance.
-
-
On the Virtual Machines page, if any VMs are currently stopped or intentionally shut down, verify that it is safe to introduce the VMs to your network, start each VM to verify that it is working, and allow each VM to complete any required synchronization before continuing the upgrade procedure. If insufficient resources (vCPUs or RAM) prevent all VMs from running at the same time, shut down a VM to accommodate the requirements of another VM until all VMs have been verified.
Caution: Resolve any outstanding issues before continuing with the upgrade. If you need assistance with any repairs required to meet the health and redundancy requirements in the previous steps, contact your authorized Stratus service representative for assistance before proceeding any further. -
On the Virtual Machines page, on the Boot tab for each VM:
-
Record the current Auto Start Mode setting (Last, On, or Off), so you can restore it after the upgrade.
-
Set the Auto Start Mode setting to Off to prevent the VM from starting during the upgrade.
-
-
On the Virtual Machines page, on the CD Drives & USB Devices tab for each VM, ensure that no media is connected to the VMs. If needed, disconnect the media in the guest operating system(s), and then click Eject CD or Detach USB Device in the ztC Edge Console until no devices are connected.
-
On the Support Logs page, create a diagnostic file for the system as described in Creating a Diagnostic File and download the file to a management PC.
Note: When you upgrade from Stratus Redundant Linux Release 2.x to 3.x, the upgrade process does not preserve the system logs from the original Release 2.x (CentOS) system. It is important to create a diagnostic file to preserve the log history before upgrading the system. -
On the Virtual Machines page, gracefully shut down all VMs that are running on the system.
-
Disable automatic software downloads. On the Preferences page, click Software Updates, clear the check box next to Automatically download System Software Updates when they become available, and click Save.
-
Ensure that node1 is the primary node. On the Physical Machines page, locate which node is the primary node, as follows:
Note: Node1 must be the primary node when the upgrade starts; otherwise, the system cannot bring node0 down to begin the upgrade process.-
If node1 is the primary node (its name is node1 (primary)), continue with step 13.
-
If node0 is the primary node (its name is node0 (primary)), click node0, and click Work On, which automatically makes node1 the (primary) node. After node1 becomes the primary node, bring node0 out of maintenance mode by clicking Finalize.
-
-
On the Upgrade Kits page, begin the upgrade by clicking Upgrade.
A Confirm window appears, asking you to confirm the upgrade to the selected upgrade kit.
Note: Selecting the check box to enable pause has no effect. When upgrading from Release 2.x to 3.x, the system automatically pauses before upgrading the second node. -
Click Yes to continue the upgrade. The upgrade begins by entering the physical machine node0 into maintenance mode.
Caution: After you initiate the upgrade on node0, you cannot stop or cancel the upgrade on node0.Caution: If the node0 upgrade is unsuccessful for any reason, do not upgrade node1 of a dual-node system. Contact your authorized Stratus service representative for assistance before proceeding any further.Note: During the node0 upgrade, the system writes an upgrade log to the host operating system of node1 in /var/opt/ft/log/monitor_upgrade.log. -
After the upgrade completes on node0, and node0 reboots, you can access the ztC Edge Console by refreshing the browser.
Note: After the system upgrades node0, but node1 has not been updated yet, the nodes are running different types of the system software. During this time, the ztC Edge Console masthead might display healthy, critical, warning, or other health states, which is expected because the nodes are unable to communicate with each other. VMs, volumes, storage groups, and networks will also have warnings () because they are currently in simplex mode.
-
In the ztC Edge Console, confirm both of the following:
-
On the Physical Machines page, verify that only node0 is currently running (in Maintenance) and displayed as node0 (primary). On dual-node systems, node1 is not displayed.
-
In the ztC Edge Console masthead, verify that the system is now running Stratus Redundant Linux Release 3.x. For example:
ocean.abc.com
IP: 123.109.50.34 | Asset ID: ze-12345
Version: 3.x.x-xxx
If these conditions are met, continue with the next step; otherwise, contact your authorized Stratus service representative for assistance.
-
-
On the Physical Machines page, click node0 (primary) and click Finalize to exit maintenance mode.
-
Start the VMs one at a time and verify that they operate normally. For each VM, do the following:
Caution: It is important to verify the VMs, but note that when you start a VM, it acquires new data from the network, and this copy of the VM becomes the most up-to-date version of the VM. If you roll back to the original Stratus Redundant Linux Release 2.x system, you might need to re-export the VMs before rolling back to preserve any changes.-
Start the VM and verify that it reaches the running state. If the VM appears stuck in the booting state, verify its network connections and retry.
-
Log on to the console of the VM.
-
Evaluate the VM as it is admitted to its networks.
-
If the VM is operating normally, reconfigure its Auto Start Mode as desired.
-
-
After verifying that node0 has been upgraded successfully, do one of the following
-
For single-node systems, continue with step 22.
-
For dual-node systems, continue with step 20 to upgrade node1.
If you need to cancel the upgrade, continue with step 20.
Caution: If the node0 upgrade is unsuccessful for any reason, contact your authorized Stratus service representative for assistance before proceeding any further. For dual-node systems, do not upgrade node1. If you proceed with the next step, the upgrade process overwrites node1, and you cannot roll back to the original, CentOS-based host operating system without fully reinstalling the Stratus Redundant Linux software. -
-
On the Physical Machines page, to upgrade node1 (or cancel the upgrade), click Upgrade PM. In the message box that appears, do one of the following:
-
To upgrade node1, click Continue. The upgrade begins on node1. Continue with the next step.
-
To cancel the upgrade and roll back to the Stratus Redundant Linux 2.x (CentOS) configuration, click Cancel. The system transfers control from node0 (Ubuntu) back to node1 (CentOS). Access to ztC Edge Console will be lost for a few seconds or up to 1-2 minutes. If needed, refresh the browser page. In the ztC Edge Console masthead, verify that the system is now running Stratus Redundant Linux Release 2.x.
-
To dismiss the message box with no action, click Close.
Note: During the node1 upgrade, the system writes an upgrade log to the host operating system of node0 in /var/opt/ft/log/monitor_upgrade.log. -
-
After the upgrade completes on node1, it takes a few minutes for node1 to join the system.
-
On the Physical Machines page, node0 will be running with a warning (
) and node1 will be (in Maintenance) mode.
-
After node1 joins the system, both nodes will be in the running state. The warnings (
) might continue until the system synchronizes all data been the nodes.
-
After all volumes have synchronized, all warnings disappear, and all components should have green check marks (
).
-
-
Confirm that there are no critical alerts in the masthead or on the Dashboard page of the ztC Edge Console. Resolve any remaining issues. When the system is healthy, the upgrade is complete.
-
Ensure that the system is running correctly by checking all of the features.
V. To complete post-upgrade tasks
-
Remove the obsolete Windows VirtIO and guest monitoring ISO files.
After the upgrade, the ztC Edge Console might still contain old ISO files from Stratus Redundant Linux Release 2.x, including ISOs for the VirtIO drivers and, if applicable, the guest monitoring agent. You must remove these ISO files as follows:
-
In the ztC Edge Console, open the Virtual CDs page.
-
On the Virtual CDs page, remove the virtio-win-0.1.171_rev1 ISO by selecting the ISO and clicking Remove.
Caution: Do not remove the virtio-win-0.1.190_rev2 or higher ISO associated with Stratus Redundant Linux Release 3.x or higher. -
On the Virtual CDs page, if applicable, remove any version of the guest monitoring agent ISO, guest_monitoring_agent_n.n.n.n.
-
-
Update the VirtIO drivers on all Windows-based VMs, as described in Updating the VirtIO Drivers (Windows-based VMs). Ensure that you install the VirtIO drivers from the new virtio-win-0.1.190_rev2 or higher ISO associated with Stratus Redundant Linux Release 3.x or higher.
-
Reset the root password on each node in the system.
After the upgrade, the password on each node resets to the default KeepRunning. Log on to the host operating system of each node and reset the root password to secure your system. If the node does not prompt for a new password upon login, issue the passwd command to change the password.
-
If applicable, restore your Active Directory configuration. Create a new security certificate, install the certificate, and reconfigure Active Directory to allow secure logins as described in KB0015909.
-
Restore any other security certificates, as needed.
-
Restore any host operating system customizations.
-
Continue to configure and test the ztC Edge system, as needed.