Advertisement

Quick Links

TM1 Mk3+ Redundancy:
Installation and Operation Guide
1

Advertisement

Table of Contents
loading

Summary of Contents for TSL TM1 Mk3+

  • Page 1 TM1 Mk3+ Redundancy: Installation and Operation Guide...
  • Page 2 Version History Issue Date Change Details 05/11/21 First draft 23/05/22 Second draft 17/06/22 Third draft 30/06/22 Fourth draft 12/04/23 Fifth draft...
  • Page 3: Table Of Contents

    Contents Introduction ..............................5 Terminology ..............................5 System overview ............................6 Primary and Backup controllers ....................6 Active system controller ......................6 Writing configurations ....................... 6 Connecting to the system ......................6 Ethernet ............................ 6 Backup Link..........................8 GPIO and Serial Connections ...................... 9 What do I need to build a redundant system? ..................11 Main hardware requirements ....................
  • Page 4 TMRP Operation ............................36 Failover Mode ............................37 Automatic Mode ........................38 Manually changing the Active Unit ......................39 Failover Events ..............................41 Replacing a System Controller ........................46 Primary System Controller ....................... 46 Backup System Controller ......................47 TMRP ............................47...
  • Page 5: Introduction

    Introduction TallyMan TM1 MK3+ redundancy allows TallyMan control systems to continue to operate when an unexpected issue occurs, or a system controller needs to be taken offline for maintenance. It operates on an A->B failover basis: if a failover event occurs then the system will automatically deactivate its Primary controller and activate the Backup controller so that operations can continue.
  • Page 6: System Overview

    System overview This section explains the basic principles behind a redundant system. Primary and Backup controllers The Primary system controller is the main system controller and during normal operation will perform the operational functionality. Once designated as the Primary during configuration, the system controller will always be the Primary within the system until the configuration changes.
  • Page 7 NIC ports. Virtual IP Addresses (VIPs) The system utilises VIPs to simplify any external communications to either TSL equipment (such as control panels or GPIO expansion) and to third-party equipment (such as routers and switchers). The VIPs (one per NIC) are dynamically applied to the currently active unit.
  • Page 8: Backup Link

    During a transition, the Primary is Deactivating, the Backup is Activating, and there is no direct connection via the VIP: After failover, the Backup unit is Active and hosts the Virtual IP Addresses, and the Primary unit is in Standby: During Backup operation, the Backup unit is Active and hosts the Virtual IP addresses;...
  • Page 9: Gpio And Serial Connections

    In this approach, the Serial and GPIO are moved outside of the redundancy ‘bubble’ and interface to the system via the VIPs. To achieve this, we use a GPIO expansion device such as the TSL ESP-1R+. This expansion device will then connect to the system via the VIP address and communicate with the system without any requirement to know which TM1 is currently Active.
  • Page 10 Redundancy system when Backup is Active and hosting the Virtual IP addresses: Using a Changeover device An alternative approach is to use a changeover device such as the TSL SW2x1 changeover frame. The required GPIO and Serial connections are routed thorough the changeover device from both the Primary and Backup TM1 units.
  • Page 11: What Do I Need To Build A Redundant System

    What do I need to build a redundant system? To create a redundant system, you need: 1 x Redundancy licence • 2 x TallyMan TM1-MK3+ controllers • • 1 x Direct Link cable to connect the controllers • 1 x TMRP unit •...
  • Page 12: Direct Link Cable

    Direct Link Cable The Direct Link cable connects the 2x TM1-Mk3+ system controllers together for monitoring and control purposes. The cable connects to the WatchMan connector on each unit: TallyMan Redundancy Panel (TMRP) The TMRP is a hardware unit dedicated to redundancy operations. It can be mounted onto a 1RU bracket (supplied) for use in technical furniture, or into a racking system.
  • Page 13: Hardware Installation

    Note: At time of writing, redundancy is only supported by the TM1-Mk3+. Note: This guide focuses on a redundancy setup. For specific information about GPIO and Serial connections, please refer to the appropriate TSL TallyMan manual. TM1-MK3+ Direct link and Ethernet To make the hardware connections: 1.
  • Page 16: Tmrp

    TMRP The TMRP is a compact switch button unit that is dedicated to display status and control of the redundant system. Mounting The unit is supplied with a 1RU mounting bracket and two blanking plates. The TMRP can be mounted in any one of three positions.
  • Page 17: Open Collector Connections And Circuit

    Open Collector Connections and Circuit Setup When first powered the TMRP will display its current IP settings and model number for a few seconds before completing its boot process. Once fully powered the unit will display the status on the TallyMan redundancy system.
  • Page 18 To access the TMRP webpage and log in:...
  • Page 19 Changing the password: To change the IP settings: Note: The TMRP must be on the same subnet as the Primary and Backup’s NIC 1 port. To change the TMRP label:...
  • Page 20 To load a new configuration: The configuration dictates the behaviour of the TMRP, this is not user definable, but in the case where a new configuration is issued it may be necessary to load the new one.
  • Page 21 To upgrade the firmware of the TMRP: Firmware upgrades may be issued to improve the TMRP’s functionality, performing an upgrade is a two- part process where the unit is put into an upgrade mode and then upgraded via a PC application.
  • Page 22 To perform a web upgrade: The web upgrade determines the user interface for the TMRP. It is not user definable but, in the case, where a new web upgrade is issued it may be necessary to upgrade the web interface. To log out of the TMRP web page: It is good practice to log out of the TMRP web page when you have completed your tasks.
  • Page 23: Software Installation

    The steps are slightly different if you are creating a new configuration or adding redundancy to and existing configuration. Both operations are shown below: Note: You can always download the latest version of the TallyMan software from the Support page on the TSL website. Once installed: Opening the TallyMan software To open the TallyMan software:...
  • Page 24: Creating A New Configuration

    Creating a new configuration 1. Create a new configuration/set system controller. 2. Set the Primary IP addresses. Note: If both NICs are used in the configuration then ensure both NICs are cabled correctly, a missing connection may cause issues during the writing of the configuration to the TM1-Mk3+ unit.
  • Page 25 3. Add the Backup unit. 4. Set the VIP addresses.
  • Page 26 5. Set the TMRP addresses. 6. Write the configuration. Note: The configuration is automatically written to the Backup by the Primary unit once fully operational.
  • Page 27 7. Connect to the system (you can optionally save your config file before connecting).
  • Page 28: Modifying An Existing Configuration

    Modifying an existing configuration To modify an existing system configuration: 1. Open an existing config. 2. Add a Backup component. 3. Set the Backup unit’s IP addresses.
  • Page 29 4. Set the Backup unit’s VIP addresses. 5. Set the TMRP addresses. 6. Write the configuration.
  • Page 30 7. Connect to the System. Note: When adding redundancy to an existing configuration, you must check and possibly modify all other connected devices to use the Virtual IP addresses instead of the static system controller IP address. 8. Check/modify device IP assignment.
  • Page 31: Operation

    Operation This section describes the front panel display for standalone and redundant systems. It also lists each the options and parameters on the display. TM1-Mk3+ Front Panel The front panel display on the TM1-MK3+ units give the status and control over the redundancy system. The main display changes depending on the current redundancy configuration.
  • Page 32: Status Descriptions

    Status Descriptions Menu item Description Possible values Description Mode Current configured mode of a unit Standalone Unit is in Standalone mode Primary Unit is the designated Primary in a redundant pair Backup Unit is the designated Backup in a redundant pair Unit The unit’s status Booting...
  • Page 33: Redundancy Menu

    Redundancy Menu There is a redundancy menu that provides additional feedback to the status for the redundancy system and control over the key aspects of the system. To access the redundancy menu the system must already have been configured as a redundant system via the configuration software as described in the Software installation section.
  • Page 34: Tmrp Connections

    Menu item Description Possible values Description Running (Deactivating) Unit is working and deactivating from being the Active redundant unit REMOTELY SHUTDOWN Unit has been remotely shutdown by its redundant partner Redundancy Status of the redundancy Enabled Units are set up as a redundant system and is system enabled Not Setup...
  • Page 35: Normal Operation

    Normal Operation Once the redundancy system has been configured correctly the front panels of the TM1-Mk3+ units will show this display: The TRMP will show the same state information: These displays are telling us the following information about the redundancy system: 1.
  • Page 36: Tmrp Operation

    TMRP Operation The TMRP both provides information about the status of the redundancy system and certain controls over the operation. The information and controls are a mirror of those on the TM1-Mk3+ front panel. The coloured buttons change to reflect their status: The unit has an Enable button to protect the buttons of the TMRP from accidental operation.
  • Page 37: Failover Mode

    Failover Mode The Failover Mode dictates the behaviour of the redundancy system and can be changed between Auto and Manual operations. To change the Failover mode via the front panel of the TM1-Mk3+ unit use the following procedure: To change the Failover mode using the TMRP us the following procedure:...
  • Page 38: Automatic Mode

    Automatic Mode The auto mode has a few different states related to the current failover status. The redundancy system is a one-way failover system meaning a failover can only occur from the Primary to the Backup. Once a Failover has occurred, restoring the Primary as the Active unit is a manual operation and as such the Failover mode is required to be set to Manual to perform this operation.
  • Page 39: Manually Changing The Active Unit

    Manually changing the Active Unit It is possible to change which unit is currently Active when the Failover mode is in Manual (as described in the Failover Mode section). If the Failover mode is currently in Auto, then you must change the Failover mode to Manual to change the Active unit.
  • Page 41: Failover Events

    Failover Events In the occurrence of a Failover event the TallyMan system will move the Active status from the Primary system controller to the Backup system controller. Both units of a redundant pair monitor themselves and their partner for health. If a unit is deemed unhealthy, then the redundancy will not be able to function correctly.
  • Page 42 Normal Failover is completed with all communications and actions acting in accordance the failover procedure. Error Failover is completed with all communications and actions acting in accordance the failover procedure however the Primary cannot communicate with the internal application process.
  • Page 43 Remote Shutdown The Failover is completed but the communications and actions have not responded correctly according to the Failover process, so the Primary unit has been Shut down by the Backup to ensure the Primary has relinquished the VIPs and communications have been closed before the Backup becomes Active. Error and Remote Shutdown Resolution If an error state is displayed or a system controller has been remotely shutdown then the resolution is to restart the system controller.
  • Page 44 To restart the system controller from the TMRP:...
  • Page 45 To restart the system controller from the TM1-Mk3+ front panel whilst in the error state: To restart the system controller from the TM1-Mk3+ front panel whilst remotely shutdown: Note if the error is caused by an external such as loss of network, then the system controller will still report and error until the issue has been resolved.
  • Page 46: Replacing A System Controller

    Replacing a System Controller Primary System Controller To replace the Primary system controller and maintain system operations the Backup must be Active and the Primary either in Standby or Remotely Shutdown. To manually activate the Backup: 1. If the Failover mode is currently in Auto, then follow the instructions in the Failover Mode section to change the Failover mode to Manual.
  • Page 47: Backup System Controller

    Backup System Controller To replace the Backup system controller, ensure the Primary system controller is Active. This operation can be performed without any interruption to the operation of the system. 1. If the Failover mode is currently in Auto, then follow the instructions in the Failover Mode section to change the Failover mode to Manual.
  • Page 48 1. On the display main page, press the encoder to display the Setup Menu. 2. Use the encoder to scroll and select the following options: Unit Management > Restart Unit > Restart Unit (Note the second option to confirm the action.) The unit will reboot:...

Table of Contents