Loadbalancer V5.10 - Recovering From Master Failure


by Mark Brookes

Like my previous blog entry I will endeavour  explain how to recover from master failure but this time with version 5.10. (NOTE: once again this will only work with a simple configuration anything more complicated than simple direct routing its best to contact support@loadbalancer.org)

Hopefully you have your backup files – getharesources.php, getloadbalancercf.php and getrealip.php.

If not via the web interface they are located under “Maintenance” - “Disaster Recovery Options”.

  • Disconnect the network and the Heartbeat (Serial) cable from the master.
  • Connect a Monitor and a Keyboard.
  • Recover the Loadbalancer V5.10 image to a CF card or DOM depending on your systems configuration from the ISO that is available via the website. If your master has failed because the CF card or DOM has failed please contact support who will be able to issue you with a new one. (support@loadbalancer.org)

When you have a working Loadbalancer.

  • Copy the configuration files and lbrecoverv510 (lbrecoverv510 can be obtained from our website http://www.loadbalancer.org/download/recoveryscripts/ right click on lbrecoverv510 and select save link as) to a USB Stick. (be sure to keep the configuration files and the recovery script in the same folder)
  • Insert the USB Stick into the master.
  • Mount the USB Stick if your not sure how to do this see below:

Enter the command: “fdisk -l”.

This should give you a list of Drives attached to your machine from that you should be able to work out which one it is, if you only have one drive either a CF card or DOM then its probably /dev/sda1

To mount the device enter the below command:

“mount /dev/sda1 /mnt”.

then you can “cd /mnt” and a simple “ls” should show you your files.

  • To run the recovery type “php lbrecoverv510”, then you will be prompted “Are you sure you want to recover the master configuration [y/n]” press “y” which will start the recovery process. It will then copy the files across, when completed you will be prompted to reboot the machine.
  • After the machine has fully rebooted reconnect the Heartbeat (Serial) cable and the network cable.

Your cluster should be restored. To confirm this on the web interface click “Reports” then “Current Connections” if you do this on both the master and the slave you should see all connections being routed through the master and none to the slave.

Some times during this process the heartbeat may need to be restarted to restore full cluster functionality, this is a simple process on the web interface go to “Edit Configuration” then “Restart Heartbeat”.

Leave a Reply

CAPTCHA Image Audio Version
Reload Image