Skip Navigation Links
Exit Print View
| Oracle Solaris Cluster System Administration Guide Oracle Solaris Cluster 4.1

Search Scope:

- This Document
- Entire Library

## Administering Quorum Devices

A quorum device is a shared storage device or quorum server that is shared by two or more nodes and that contributes votes that are used to establish a quorum. This section provides the procedures for administering quorum devices.

You can use the `clquorum` command to perform all quorum device administrative procedures. In addition, you can accomplish some procedures by using the `clsetup` interactive utility. Whenever possible, quorum procedures are described in this section by using the `clsetup` utility. For more information, see the `clquorum`(1CL) and `clsetup`(1CL) man pages.

When you work with quorum devices, keep in mind the following guidelines:

- All quorum commands must be run from a global-cluster node.

- If the `clquorum` command is interrupted or fails, the quorum configuration information can become inconsistent in the cluster configuration database. If this inconsistency occurs, either rerun the command or run the `clquorum reset` command to reset the quorum configuration.

- For highest availability of the cluster, ensure that the total number of votes that are contributed by quorum devices is less than the total number of votes that are contributed by nodes. Otherwise, the nodes cannot form a cluster if all quorum devices are unavailable, even if all nodes are functioning.

- Do not add a disk that is currently configured as a quorum device to an Oracle Solaris ZFS storage pool. If a configured quorum device is added to a ZFS storage pool, the disk is relabeled as an EFI disk and quorum configuration information is lost and the disk no longer provides a quorum vote to the cluster. Once a disk is in a storage pool, that disk can then be configured as a quorum device. Or, you can unconfigure the disk, add it to the storage pool, then reconfigure the disk as a quorum device.

Note - The `clsetup` command is an interactive interface to the other Oracle Solaris Cluster commands. When `clsetup` runs, the command generates the appropriate specific commands, in this case `clquorum` commands. These generated commands are shown in the examples at the end of the procedures.

To view the quorum configuration, use `clquorum show`. The `clquorum list` command displays the names of quorum devices in the cluster. The `clquorum status` command provides status and vote count information.

Most examples shown in this section are from a three-node cluster.

Table 6-1 Task List: Administering Quorum

Task | For Instructions
--- | ---
Add a quorum device to a cluster by using the `clsetup` utility | Adding a Quorum Device
Remove a quorum device from a cluster by using the `clsetup` utility (to generate `clquorum`) | How to Remove a Quorum Device
Remove the last quorum device from a cluster by using the `clsetup` utility (to generate `clquorum`) | How to Remove the Last Quorum Device From a Cluster
Replace a quorum device in a cluster by using the add and remove procedures | How to Replace a Quorum Device
Modify a quorum device list by using the add and remove procedures | How to Modify a Quorum Device Node List
Put a quorum device into maintenance state by using the `clsetup` utility (to generate `clquorum`) (While in maintenance state, the quorum device does not participate in voting to establish the quorum.) | How to Put a Quorum Device Into Maintenance State
Reset the quorum configuration to its default state by using the `clsetup` utility (to generate `clquorum`) | How to Bring a Quorum Device Out of Maintenance State
List the quorum devices and vote counts by using the `clquorum` command | How to List the Quorum Configuration

### Dynamic Reconfiguration With Quorum Devices

You must consider a few issues when completing dynamic reconfiguration (DR) operations on quorum devices in a cluster.

- All of the requirements, procedures, and restrictions that are documented for the Oracle Solaris DR feature also apply to Oracle Solaris Cluster DR support, except for the operating system quiescence operation. Therefore, review the documentation for the Oracle Solaris DR feature before using the DR feature with Oracle Solaris Cluster software. You should review in particular the issues that affect non-network IO devices during a DR detach operation.

- Oracle Solaris Cluster rejects DR remove-board operations that are performed when an interface is present that is configured for a quorum device.

- If the DR operation would pertain to an active device, Oracle Solaris Cluster rejects the operation and identifies the devices that would be affected by the operation.

To remove a quorum device, you must complete the following steps, in the order indicated.

Table 6-2 Task Map: Dynamic Reconfiguration With Quorum Devices

Task | For Instructions
--- | ---
1. Enable a new quorum device to replace the one being removed. | Adding a Quorum Device
2. Disable the quorum device to be removed. | How to Remove a Quorum Device
3. Perform the DR remove operation on the device being removed. |

### Adding a Quorum Device

This section provides procedures to add a quorum device. Ensure that all nodes in the cluster are online before adding a new quorum device. For information about determining the number of quorum vote counts necessary for your cluster, recommended quorum configurations, and failure fencing, see Quorum and Quorum Devices in Oracle Solaris Cluster Concepts Guide.

| Caution - Do not add a disk that is currently configured as a quorum device to a Solaris ZFS storage pool. When a configured quorum device is added to a Solaris ZFS storage pool, the disk is relabeled as an EFI disk and quorum configuration information is lost and the disk no longer provides a quorum vote to the cluster. Once a disk is in a storage pool, that disk can then be configured as a quorum device. You can also unconfigure the disk, add it to the storage pool, and then reconfigure the disk as a quorum device.

The Oracle Solaris Cluster software supports the following types of quorum devices:

- Shared LUNs from the following:

  - Shared SCSI disk

  - Serial Attached Technology Attachment (SATA) storage

  - Sun ZFS Storage Appliance from Oracle

- Oracle Solaris Cluster Quorum Server

Procedures for adding these devices are provided in the following sections:

- How to Add a Shared Disk Quorum Device

- How to Add a Quorum Server Quorum Device

Note - You cannot configure replicated disks as quorum devices. If you try to add a replicated disk as a quorum device, you receive the following error message and the command exits with an error code.

    Disk-name is a replicated device. Replicated devices cannot be configured as
     quorum devices.

A shared-disk quorum device is any attached storage device that is supported by Oracle Solaris Cluster software. The shared disk is connected to two or more nodes of your cluster. If you turn fencing on, a dual-ported disk can be configured as a quorum device that uses SCSI-2 or SCSI-3 (the default is SCSI-2). If fencing is turned on and your shared device is connected to more than two nodes, you can configure your shared disk as a quorum device that uses the SCSI-3 protocol (the default protocol for more than two nodes). You can use the SCSI override flag to make the Oracle Solaris Clustersoftware use the SCSI-3 protocol for dual-ported shared disks.

If you turn fencing off for a shared disk, you can then configure the disk as a quorum device that uses the software quorum protocol. This would be true regardless of whether the disk supports SCSI-2 or SCSI-3 protocols. Software quorum is a protocol from Oracle that emulates a form of SCSI Persistent Group Reservations (PGR).

| Caution - If you are using disks that do not support SCSI (such as SATA), you should turn SCSI fencing off.

For quorum devices, you can use a disk that contains user data or is a member of a device group. View the protocol that is used by the quorum subsystem with a shared disk by looking at the `access-mode` value for the shared disk in the output from the `cluster show` command.

See the `clsetup`(1CL) and `clquorum`(1CL) man pages for information about the commands that are used in the following procedures.

### How to Add a Shared Disk Quorum Device

Oracle Solaris Cluster software supports shared-disk (both SCSI and SATA) devices as quorum devices. A SATA device does not support a SCSI reservation, and you must disable the SCSI reservation fencing flag and use the software quorum protocol to configure these disks as quorum devices.

To complete this procedure, identify a disk drive by its device ID (DID), which is shared by the nodes. Use the `cldevice show` command to see the list of DID names. Refer to the `cldevice`(1CL) man page for additional information. Ensure that all nodes in the cluster are online before adding a new quorum device.

Use this procedure to configure SCSI or SATA devices.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Assume a role that provides `solaris.cluster.modify` RBAC authorization on any node of the cluster.
2. Start the `1` utility.

       # clsetup

   The `clsetup` Main Menu is displayed.

3. Type the number for the option for Quorum.

   The Quorum Menu is displayed.

4. Type the number for the option for adding a quorum device, then type `yes` when the `clsetup` utility asks you to confirm the quorum device that you are adding.

   The `clsetup` utility asks what type of quorum device you want to add.

5. Type the number for the option for a shared-disk quorum device.

   The `clsetup` utility asks which global device you want to use.

6. Type the global device you are using.

   The `clsetup` utility asks you to confirm that the new quorum device should be added to the global device you specified.

7. Type `yes` to continue adding the new quorum device.

   If the new quorum device is added successfully, the `clsetup` utility displays a message to that effect.

8. Verify that the quorum device has been added.

       # clquorum list -v

Example 6-1 Adding a Shared Disk Quorum Device

The following example shows the `clquorum` command generated by `clsetup` when it adds a shared-disk quorum device and a verification step.

    Assume the root role that provides solaris.cluster.modify RBAC authorization on any
        cluster node.

    [Start the clsetup utility:]
    # clsetup
    [Select Quorum>Add a quorum device]
    [Answer the questions when prompted.]
    [You will need the following information.]
      [Information:                       Example:]
      [Directly attached shared disk      shared_disk]
      [Global device                          d20]

    [Verify that the clquorum command was completed successfully:]
     clquorum add d20

        Command completed successfully.
    [Quit the clsetup Quorum Menu and Main Menu.]
    [Verify that the quorum device is added:]
    # clquorum list -v

    Quorum         Type
    -------         ----
    d20              shared_disk
    scphyshost-1    node
    scphyshost-2    node

### How to Add a Sun ZFS Storage Appliance NAS Quorum Device

Ensure that all nodes in the cluster are online before adding a new quorum device.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Consult the installation documentation that shipped with the Sun ZFS Storage Appliance or the appliance's online Help for instructions on setting up an iSCSI device.
2. On each of the cluster nodes, discover the iSCSI LUN and set the iSCSI access list to static configuration.

       # iscsiadm modify discovery -s enable

           # iscsiadm list discovery
           Discovery:
                   Static: enabled
                   Send Targets: disabled
                   iSNS: disabled

           #  iscsiadm add static-config iqn.LUNName,IPAddress_of_NASDevice
       # devfsadm -i iscsi
       # cldevice refresh

3. From one cluster node, configure the DIDs for the iSCSI LUN.

       # /usr/cluster/bin/cldevice populate

4. Identify the DID device that represents the NAS device LUN that has just been configured into the cluster using iSCSI.

   Use the `cldevice show` command to see the list of DID names. Refer to the `cldevice`(1CL) man page for additional information.

5. Assume a role that provides `solaris.cluster.modify` RBAC authorization on any node of the cluster.
6. Use the `clquorum` command to add the NAS device as a quorum device using the DID device identified in Step 4.

       # clquorum add d20

   The cluster has default rules for deciding whether to use scsi-2, scsi-3, or software quorum protocols. See the `clquorum`(1CL) man page for more information.

### How to Add a Quorum Server Quorum Device

Before You Begin

Before you can add an Oracle Solaris Cluster Quorum Server as a quorum device, the Oracle Solaris Cluster Quorum Server software must be installed on the host machine and the quorum server must be started and running. For information about installing the quorum server, see the How to Install and Configure Oracle Solaris Cluster Quorum Server Software in Oracle Solaris Cluster Software Installation Guide.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Assume a role that provides `solaris.cluster.modify` RBAC authorization on any node of the cluster.
2. Ensure that all Oracle Solaris Cluster nodes are online and can communicate with the Oracle Solaris Cluster Quorum Server.
   1. Ensure that network switches that are directly connected to cluster nodes meet one of the following criteria:

      - The switch supports Rapid Spanning Tree Protocol (RSTP).

      - Fast port mode is enabled on the switch.

      One of these features is required to ensure immediate communication between cluster nodes and the quorum server. If this communication is significantly delayed by the switch, the cluster interprets this prevention of communication as loss of the quorum device.

   2. If the public network uses variable-length subnetting, also called Classless Inter-Domain Routing (CIDR), modify the following files on each node.

      If you use classful subnets, as defined in RFC 791, you do not need to perform these steps.

      1. Add to the `/etc/inet/netmasks` file an entry for each public subnet that the cluster uses.

         The following is an example entry which contains a public-network IP address and netmask:

             10.11.30.0    255.255.255.0

      2. Append `netmask + broadcast +` to the hostname entry in each `/etc/hostname.adapter` file.

             nodename netmask + broadcast +

   3. On each node in the cluster, add the quorum server hostname to the `/etc/inet/hosts` file or the `/etc/inet/ipnodes` file.

      Add a hostname-to-address mapping to the file, such as the following.

          ipaddress qshost1

      ipaddress
        The IP address of the computer where the quorum server is running.
      qshost1

        The hostname of the computer where the quorum server is running.

   4. If you use a naming service, add the quorum server host's name-to-address mapping to the name-service database.
3. Start the `clsetup` utility.

       # clsetup

   The `clsetup` Main Menu is displayed.

4. Type the number for the option for Quorum.

   The Quorum Menu is displayed.

5. Type the number for the option for adding a quorum device.

   Then type `yes` to confirm that you are adding a quorum device.

   The `clsetup` utility asks what type of quorum device you want to add.

6. Type the number for the option for a quorum-server quorum device. Then type `yes` to confirm that you are adding a quorum-server quorum device.

   The `clsetup` utility asks you to provide the name of the new quorum device.

7. Type the name of the quorum device you are adding.

   The quorum device name can be any name you choose. The name is only used to process future administrative commands.

   The `clsetup` utility asks you to provide the name of the host of the quorum server.

8. Type the name of the host of the quorum server.

   This name specifies the IP address of the machine where the quorum server runs or the hostname of the machine on the network.

   Depending on the IPv4 or IPv6 configuration of the host, the IP address of the machine must be specified in the `/etc/hosts` file, the `/etc/inet/ipnodes` file, or both.

   Note - The machine you specify must be reachable by all cluster nodes and must run the quorum server.

   The `clsetup` utility asks you to provide the port number of the quorum server.

9. Type the port number that is used by the quorum server to communicate with the cluster nodes.

   The `clsetup` utility asks you to confirm that the new quorum device should be added.

10. Type `yes` to continue adding the new quorum device.

    If the new quorum device is added successfully, the `clsetup` utility displays a message to that effect.

11. Verify that the quorum device has been added.

        # clquorum list -v

Example 6-2 Adding a Quorum Server Quorum Device

The following example shows the `clquorum` command that is generated by `clsetup` when it adds a quorum server quorum device. The example also shows a verification step.

    Assume the root role that provides solaris.cluster.modify RBAC authorization on any
        cluster node.

    [Start the clsetup utility:]
    # clsetup
    [Select Quorum > Add a quorum device]
    [Answer the questions when prompted.]
    [You will need the following information.]
      [Information:                Example:]
      [Quorum Device               quorum_server quorum device]
      [Name:                           qd1]
      [Host Machine Name:          10.11.124.84]
      [Port Number:                9001]

    [Verify that the clquorum command was completed successfully:]
     clquorum add -t quorum_server -p qshost=10.11.124.84 -p port=9001 qd1

        Command completed successfully.
    [Quit the clsetup Quorum Menu and Main Menu.]
    [Verify that the quorum device is added:]
    # clquorum list -v

    Quorum         Type
    -------         ----
    qd1             quorum_server
    scphyshost-1    node
    scphyshost-2    node

    # clquorum status

    === Cluster Quorum ===
    -- Quorum Votes Summary --

            Needed     Present    Possible
            ------     -------    --------
            3          5           5

    -- Quorum Votes by Node --

      Node Name        Present    Possible   Status
      ---------        -------    --------  ------
      phys-schost-1    1          1          Online
      phys-schost-2    1          1          Online

    -- Quorum Votes by Device --

      Device Name       Present   Possible   Status
      -----------       -------   --------   ------
      qd1               1         1          Online
      d3s2              1         1          Online
      d4s2              1         1          Online

### Removing or Replacing a Quorum Device

This section provides the following procedures for removing or replacing a quorum device:

- How to Remove a Quorum Device

- How to Remove the Last Quorum Device From a Cluster

- How to Replace a Quorum Device

### How to Remove a Quorum Device

When a quorum device is removed, it no longer participates in the voting to establish quorum. Note that all two-node clusters require that at least one quorum device be configured. If this is the last quorum device on a cluster, `clquorum`(1CL) will fail to remove the device from the configuration. If you are removing a node, remove all quorum devices connected to the node.

Note - If the device you intend to remove is the last quorum device in the cluster, see the procedure How to Remove the Last Quorum Device From a Cluster.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Assume a role that provides `solaris.cluster.modify` RBAC authorization on any node in the cluster.
2. Determine the quorum device to be removed.

       # clquorum list -v

3. Execute the `clsetup` utility.

       # clsetup

   The Main Menu is displayed.

4. Type the number for the option for Quorum.
5. Type the number for the option to remove a quorum device.

   Answer the questions displayed during the removal process.

6. Quit `clsetup`.
7. Verify that the quorum device is removed.

       # clquorum list -v

Example 6-3 Removing a Quorum Device

This example shows how to remove a quorum device from a cluster with two or more quorum devices configured.

    Assume the root role that provides solaris.cluster.modify RBAC
    authorization on any cluster node.

    [Determine the quorum device to be removed:]
    # clquorum list -v
    [Start the clsetup utility:]
    # clsetup
    [Select Quorum>Remove a quorum device]
    [Answer the questions when prompted.]
    Quit the clsetup Quorum Menu and Main Menu.]
    [Verify that the quorum device is removed:]
    # clquorum list -v

     Quorum         Type
    -------         ----
    scphyshost-1    node
    scphyshost-2    node
    scphyshost-3    node

Troubleshooting

If you lose communications between the cluster and the quorum server host while removing a quorum server quorum device, you must clean up stale configuration information about the quorum server host. For instructions on performing this cleanup, see Cleaning Up Stale Quorum Server Cluster Information.

### How to Remove the Last Quorum Device From a Cluster

This procedure removes the last quorum device from a two-node cluster by using the `clquorum force` option, `-F`. Generally, you should first remove the failed device and then add the replacement quorum device. If this is not the last quorum device in a two-node cluster, follow the steps in How to Remove a Quorum Device.

Adding a quorum device involves a node reconfiguration, which touches the failed quorum device and panics the machine. The Force option lets you remove the failed quorum device without panicking the machine. The `clquorum` command enables you to remove the device from the configuration. For more information, see the `clquorum`(1CL) man page. After you remove the failed quorum device, you can add a new device with the `clquorum add` command. See Adding a Quorum Device.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Assume a role that provides `solaris.cluster.modify` RBAC authorization on any node in the cluster.
2. Remove the quorum device by using the `clquorum` command.

   If the quorum device failed, use the `-F` Force option to remove the failed device.

       # clquorum remove -F qd1

   Note - You can also place the node to be removed in maintenance state and then remove the quorum device with the `clquorum remove quorum` command. The `clsetup` cluster administration menu options are not available while the cluster is in install mode. See How to Put a Node Into Maintenance State and the `clsetup`(1CL) man page for more information.

3. Verify that the quorum device has been removed.

       # clquorum list -v

Example 6-4 Removing the Last Quorum Device

This example shows how to put the cluster in maintenance mode and remove the last remaining quorum device in a cluster configuration.

    [Assume the root role that provides solaris.cluster.modify RBAC authorization on any
        cluster node.]
    [Place the cluster in install mode:]
    # cluster set -p installmode=enabled
    [Remove the quorum device:]
    # clquorum remove d3
    [Verify that the quorum device has been removed:]
    # clquorum list -v
     Quorum         Type
    -------         ----
    scphyshost-1    node
    scphyshost-2    node
    scphyshost-3    node

### How to Replace a Quorum Device

Use this procedure to replace an existing quorum device with another quorum device. You can replace a quorum device with a similar device type, such as replacing a NAS device with another NAS device, or you can replace the device with a dissimilar device, such as replacing a NAS device with a shared disk.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Configure a new quorum device.

   You need to first add a new quorum device to the configuration to take the place of the old device. See Adding a Quorum Device to add a new quorum device to the cluster.

2. Remove the device that you are replacing as a quorum device.

   See How to Remove a Quorum Device to remove the old quorum device from the configuration.

3. If the quorum device is a failed disk, replace the disk.

   Refer to the hardware procedures in your hardware manual for your disk enclosure. See also the Oracle Solaris Cluster 4.1 Hardware Administration Manual.

### Maintaining Quorum Devices

This section provides the following procedures for maintaining quorum devices:

- How to Modify a Quorum Device Node List

- How to Put a Quorum Device Into Maintenance State

- How to Bring a Quorum Device Out of Maintenance State

- How to List the Quorum Configuration

- How to Repair a Quorum Device

- Changing the Quorum's Default Time-out

### How to Modify a Quorum Device Node List

You can use the `clsetup` utility to add a node to or remove a node from the node list of an existing quorum device. To modify a quorum device's node list, you must remove the quorum device, modify the physical connections of nodes to the quorum device you removed, then add the quorum device to the cluster configuration again. When a quorum device is added, the `clquorum` command automatically configures the node-to-disk paths for all nodes attached to the disk. For more information, see the `clquorum`(1CL) man page

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Assume a role that provides `solaris.cluster.modify` RBAC authorization on any node of the cluster.
2. Determine the name of the quorum device you are modifying.

       # clquorum list -v

3. Start the `clsetup` utility.

       # clsetup

   The Main Menu is displayed.

4. Type the number for the Quorum option.

   The Quorum Menu is displayed.

5. Type the number for the option to remove a quorum device.

   Follow the instructions. You will be asked the name of the disk to be removed.

6. Add or delete the node connections to the quorum device.
7. Type the number for the option to add a quorum device.

   Follow the instructions. You will be asked the name of the disk to be used as the quorum device.

8. Verify that the quorum device has been added.

       # clquorum list -v

Example 6-5 Modifying a Quorum Device Node List

The following example shows how to use the `clsetup` utility to add nodes to or delete nodes from a quorum device node list. In this example, the quorum device name is `d2`, and the final result of the procedures adds another node to the quorum device node list.

    [Assume the root role that provides solaris.cluster.modify RBAC
    authorization on any node in the cluster.]

    [Determine the quorum device name:]
    # clquorum list -v
    Quorum            Type
    -------            -----
    d2                 shared_disk
    sc-phys-schost-1   node
    sc-phys-schost-2   node
    sc-phys-schost-3   node

    [Start the clsetup utility:]
    # clsetup

    [Type the number that corresponds with the quorum option.]
    .
    [Type the number that corresponds with the option to remove a quorum device.]
    .
    [Answer the questions when prompted.]
    [You will need the following information:]

       Information:            Example:
       Quorum Device Name:     d2

    [Verify that the clquorum command completed successfully:]
     clquorum remove d2
         Command completed successfully.

    [Verify that the quorum device was removed.]
    # clquorum list -v
    Quorum            Type
    -------            -----
    sc-phys-schost-1   node
    sc-phys-schost-2   node
    sc-phys-schost-3   node

    [Type the number that corresponds with the Quorum option.]
    .
    [Type the number that corresponds with the option to add a quorum device.]
    .
    [Answer the questions when prompted.]
    [You will need the following information:]

       Information            Example:
       quorum device name     d2

    [Verify that the clquorum command was completed successfully:]
    clquorum add d2
         Command completed successfully.

    Quit the clsetup utility.

    [Verify that the correct nodes have paths to the quorum device.
    In this example, note that phys-schost-3 has been added to the
    enabled hosts list.]
    # clquorum show d2 | grep Hosts
    === Quorum Devices ===

    Quorum Device Name:        d2
       Hosts (enabled):        phys-schost-1, phys-schost-2, phys-schost-3

    [Verify that the modified quorum device is online.]

    # clquorum status d2
    === Cluster Quorum ===

    --- Quorum Votes by Device ---

    Device Name       Present      Possible      Status
    -----------       -------      --------      ------
    d2                1            1             Online

### How to Put a Quorum Device Into Maintenance State

Use the`clquorum` command to put a quorum device into maintenance state. For more information, see the `clquorum`(1CL) man page. The `clsetup` utility does not currently have this capability.

Put a quorum device into maintenance state when taking the quorum device out of service for an extended period of time. This way, the quorum device's quorum vote count is set to zero and does not contribute to the quorum count while the device is being serviced. While in maintenance state, the quorum device's configuration information is preserved.

Note - All two-node clusters require at least one configured quorum device. If this is the last quorum device on a two-node cluster, `clquorum` will fail to put the device into maintenance state.

To put a cluster node into maintenance state, see How to Put a Node Into Maintenance State.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Assume a role that provides `solaris.cluster.modify` RBAC authorization on any node of the cluster.
2. Put the quorum device into the maintenance state.

       # clquorum disable device

   device

     Specifies the DID name of the disk device to change, for example, `d4`.

3. Verify that the quorum device is now in maintenance state.

   The output for the device you placed in maintenance state should read zero for the Quorum Device Votes.

       # clquorum status device

Example 6-6 Putting a Quorum Device Into Maintenance State

The following example shows how to put a quorum device into maintenance state and how to verify the results.

    # clquorum disable d20
    # clquorum status d20

    === Cluster Quorum ===

    --- Quorum Votes by Device ---

    Device Name       Present      Possible      Status
    -----------       -------      --------      ------
    d20                1            1             Offline

See Also

To re-enable the quorum device, see How to Bring a Quorum Device Out of Maintenance State.

To put a node into maintenance state, see How to Put a Node Into Maintenance State.

### How to Bring a Quorum Device Out of Maintenance State

Run this procedure each time a quorum device is in maintenance state and you want to bring the quorum device out of maintenance state and reset the quorum vote count to the default.

| Caution - If you do not specify either the `globaldev` or `node` options, the quorum count is reset for the entire cluster.

When you configure a quorum device, Oracle Solaris Cluster software assigns the quorum device a vote count of N-1 where N is the number of connected votes to the quorum device. For example, a quorum device that is connected to two nodes with nonzero vote counts has a quorum count of one (two minus one).

- To bring a cluster node as well as its associated quorum devices out of maintenance state, see How to Bring a Node Out of Maintenance State.

- To learn more about quorum vote counts, see About Quorum Vote Counts in Oracle Solaris Cluster Concepts Guide.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Assume a role that provides `solaris.cluster.modify` RBAC authorization on any node of the cluster.
2. Reset the quorum count.

       # clquorum enable device

   device

     Specifies the DID name of the quorum device to reset, for example, `d4`.

3. If you are resetting the quorum count because a node was in maintenance state, reboot the node.
4. Verify the quorum vote count.

       # clquorum show +

Example 6-7 Resetting the Quorum Vote Count (Quorum Device)

The following example resets the quorum count for a quorum device back to the default and verifies the result.

    # clquorum enable d20
    # clquorum show +

    === Cluster Nodes ===

    Node Name:                                      phys-schost-2
      Node ID:                                        1
      Quorum Vote Count:                              1
      Reservation Key:                                0x43BAC41300000001

    Node Name:                                      phys-schost-3
      Node ID:                                        2
      Quorum Vote Count:                              1
      Reservation Key:                                0x43BAC41300000002

    === Quorum Devices ===

    Quorum Device Name:                             d3
      Enabled:                                        yes
      Votes:                                          1
      Global Name:                                    /dev/did/rdsk/d20s2
      Type:                                           shared_disk
      Access Mode:                                    scsi3
      Hosts (enabled):                                phys-schost-2, phys-schost-3

### How to List the Quorum Configuration

You do not need to be in the `root` role to list the quorum configuration. You can assume any role that provides `solaris.cluster.read` RBAC authorization.

Note - When you increase or decrease the number of node attachments to a quorum device, the quorum vote count is not automatically recalculated. You can reestablish the correct quorum vote if you remove all quorum devices and then add them back into the configuration. For a two-node cluster, temporarily add a new quorum device before you remove and add back the original quorum device. Then remove the temporary quorum device.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

- Use the `clquorum` command to list the quorum configuration.

      % clquorum show +

Example 6-8 Listing the Quorum Configuration

    % clquorum show +

    === Cluster Nodes ===

    Node Name:                                      phys-schost-2
      Node ID:                                        1
      Quorum Vote Count:                              1
      Reservation Key:                                0x43BAC41300000001

    Node Name:                                      phys-schost-3
      Node ID:                                        2
      Quorum Vote Count:                              1
      Reservation Key:                                0x43BAC41300000002

    === Quorum Devices ===

    Quorum Device Name:                             d3
      Enabled:                                        yes
      Votes:                                          1
      Global Name:                                    /dev/did/rdsk/d20s2
      Type:                                           shared_disk
      Access Mode:                                    scsi3
      Hosts (enabled):                                phys-schost-2, phys-schost-3

### How to Repair a Quorum Device

Use this procedure to replace a malfunctioning quorum device.

The `phys-schost#` prompt reflects a global-cluster prompt. Perform this procedure on a global cluster.

This procedure provides the long forms of the Oracle Solaris Cluster commands. Most commands also have short forms. Except for the long and short forms of the command names, the commands are identical.

1. Remove the disk device that you are replacing as a quorum device.

   Note - If the device you intend to remove is the last quorum device, you might want to first add another disk as a new quorum device. This step assures a valid quorum device if a failure occurs during the replacement procedure. See Adding a Quorum Device to add a new quorum device.

   See How to Remove a Quorum Device to remove a disk device as a quorum device.

2. Replace the disk device.

   To replace the disk device, see the procedures for the disk enclosure in the hardware guide. See also the Oracle Solaris Cluster 4.1 Hardware Administration Manual.

3. Add the replaced disk as a new quorum device.

   See Adding a Quorum Device to add a disk as a new quorum device.

   Note - If you added an additional quorum device in Step 1, it is now safe to remove it. See How to Remove a Quorum Device to remove the quorum device.

### Changing the Quorum's Default Time-out

A default 25–second time-out exists for the completion of quorum operations during a cluster reconfiguration. You can increase the quorum time-out to a higher value by following the instructions in How to Configure Quorum Devices in Oracle Solaris Cluster Software Installation Guide. Rather than increasing the time-out value, you can also switch to a different quorum device.

Additional troubleshooting information is available in How to Configure Quorum Devices in Oracle Solaris Cluster Software Installation Guide.

Note - For Oracle Real Application Clusters (Oracle RAC), do not change the default quorum time-out of 25 seconds. In certain split-brain scenarios, a longer time-out period might lead to the failure of Oracle RAC VIP failover, due to the VIP resource timing out. If the quorum device being used is not conforming with the default 25–second time-out, use a different quorum device.

Copyright © 2000, 2012, Oracle and/or its affiliates. All rights reserved. Legal Notices |