Skip Navigation Links
Exit Print View
| Oracle Solaris Cluster Error Messages Guide Oracle Solaris Cluster 4.1

Search Scope:

- This Document
- Entire Library

## Message IDs 300000–399999

This section contains message IDs 300000–399999.

`300397 resource %s property changed.`

Description: This is a notification from the rgmd that a resource's property has been edited by the cluster administrator. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

`300512 Failed to stop DNS; exiting UNSUCCESFUL`

Description: The STOP method was unable to stop the application by sending it a SIGKILL.

Solution: Examine the /var/adm/messages to determine why the resource failed to stop. If problem persists, contact your Oracle service representative.

`300538 set_scproxy_resource - Oracle Grid Infrastructure resource %s has PLACEMENT=%s which is incorrect, PLACEMENT=restricted is required.`

Description: The Oracle Grid Infrastructure resource sun.<resource> PLACEMENT attribute value is incorrect.

Solution: You must set the PLACEMENT attribute of the Oracle Grid Infrastructure resource, sun.<resource>, equal to restricted. Note that <resource> represents the Oracle Solaris Cluster SUNW.ScalDeviceGroup resource name. Refer to the Oracle Solaris Cluster documentation for information on how to do this.

`300705 Failed to look up the service group.`

Description: Failed to look up the internal data structure during connection establishment.

Solution: The connection involved might be disconnected. If it happens repeatedly contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`300721 Error: The resource group "%s" nodelist "%s" is not the same as the existing RAC framework resource group "%s" nodelist "%s".`

Description: VUCMM framework resources must be created in a resource group that has the same nodelist as an existing RAC framework when either a SVM or CVM resource is present in both frameworks.

Solution: Resolve the nodelist discrepancy and re-try the operation. Refer to the Oracle Solaris Cluster documentation for procedures to configure a resource group.

`300777 reservation warning(%s) - Unable to open device %s, errno %d, will retry in %d seconds`

Description: The device fencing program has encountered errors while trying to access a device. The failed operation will be retried

Solution: This is an informational message, no user action is needed.

`301149 %s: unable to create failfast object.`

Description: The pmmd program was not able to register with failfast.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`301162 zc_rgm_halt for zone %s: Exception <%s> thrown while querying membership. Exiting.`

Description: An exception was thrown when zc_rgm_halt queried for the membership of the zone cluster, and thus zc_rgm_halt failed to check whether the zone is part of the zone cluster membership or not. Hence zc_rgm_halt will not be able to evacuate resource groups for this zone which belongs to a zone cluster. Support for this zone cluster might not work properly.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`301573 clcomm: error in copyin for cl_change_flow_settings`

Description: The system failed a copy operation supporting a flow control state change.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`301603 fatal: cannot create any threads to handle switchback`

Description: The rgmd daemon was unable to create a sufficient number of threads upon starting up. This is a fatal error. The rgmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution: Make sure that the hardware configuration meets documented minimum requirements. Save a copy of the /var/adm/messages files on all nodes, and of the rgmd core file. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`301621 Cannot access file %s. This file is required to bypass the user credentials from being prompted during the server startup: %s`

Description: The boot.properties file does not exist in in the server root's security directory.

Solution: Make sure that the boot.properties file is present in the server root's security directory. Read documentation for more details.

`301635 clexecd: close returned %d. Exiting.`

Description: clexecd program has encountered a failed thr_create(3THR) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`301685 The file system mount point %s information is missing from the /etc/vfstab file of the global zone. This file system could be original file system for the lofs file system with mount point %s configured to zone cluster %s.`

Description: HAStoragePlus failed to find the specified entry in the vfstab.

Solution: Update the vfstab entry and retry the operation.

`301736 start_dependency: Exceeded ${MAX_START_TIMEOUT} seconds for waiting on dependent resource for resource ${RESOURCE} to come online`

Description: The Start_timeout for the dependent resource is exceeded.

Solution: Specify a larger timeout.

`302040 clcomm: ksocket creation on routing socket failed with error = %d`

Description: The system prepares IP communications across the private interconnect. A lookup operation on the routing socket failed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`302286 Incorrect specification of tunable at line %d in file %s.`

Description: The zone handler detected that key=value pair is not specified in appropraite manner.

Solution: Check the line number and ensure that tunables are kept in the format 'key'='value'.

`302394 set_scproxy_resource - Oracle Grid Infrastructure resource %s has CARDINALITY=%s which is incorrect, CARDINALITY=%s is required.`

Description: The Oracle Grid Infrastructure resource sun.<resource> CARDINALITY attribute value is incorrect.

Solution: You must set the CARDINALITY attribute of the Oracle Grid Infrastructure resource, sun.<resource>, equal to number of nodes listed within the Oracle Solaris Cluster resource group's nodelist that contains the Oracle Solaris Cluster SUNW.ScalDeviceGroup resource. Note that <resource> represents the Oracle Solaris Cluster SUNW.ScalDeviceGroup resource name. Refer to the Oracle Solaris Cluster documentation for information on how to do this.

`303009 validate: EnvScript %s does not exist but it is required`

Description: The environment script $Filename is set in the parameter file but does not exist.

Solution: set the variable EnvScript in the parameter file mentioned in option -N of the start, stop and probe command to a valid contents.

`303231 mount_client_impl::remove_client() failed attempted RM change_repl_prov_status() to remove client, spec %s, name %s`

Description: The system was unable to remove a PXFS replica on the node that this message was seen.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`303500 ERROR: The ndd variable ip6_strict_dst_multihoming must be set to 0.`

Description: You must set the value of ip6_strict_dst_multihoming only to 0, otherwise, communication between cluster members will not function.

Solution: Set ip6_strict_dst_multihoming to 0. If set using ipadm, then change the hostmodel setting to weak or src_priority. Refer to the ndd(1M) and ipadm(1M) man pages and to Oracle Solaris Cluster documentation for information about changing the setting.

`303630 Cannot execute %s: %d.`

Description: Failure in executing the command.

Solution: Check the syslog message for the command description. Check whether the system is low in memory or the process table is full and take appropriate action. Make sure that the executable exists.

`303756 CMM: Unable to get reference to membership API object.`

Description: An instance of the userland CMM encountered an internal initialization error. The userland CMM could not obtain a reference to the membership API object.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`303805 Cannot change the IPMP group on the local host.`

Description: A different IPMP group for property NetIfList is specified in clreslogicalhostname command. The IPMP group on local node is set at resource creation time. Users may only update the value of property NetIfList for adding a IPMP group on a new node.

Solution: Rerun the clreslogicalhostname command with proper value for the NetIfList property.

`303848 Failed to modify the START_DEPENDENCIES of the Oracle Grid Infrastructure %s resource [%s]`

Description: Failed to modify the Oracle Grid Infrastructure database resource START_DEPENDENCIES.

Solution: Determine why modifying the database resource failed. If the problem persists, contact your Oracle support representative for further assistance.

`303912 The original file system with mount point %s specified in the /etc/vfstab of a global zone for the lofs file system with mount point %s configured for the zone cluster %s is a local file system. Local file systems cannot be specified with scalable service resources.`

Description: HAStoragePlus detected an inconsistency in its configuration: the resource group has been specified as scalable, but local file systems are used.

Solution: Correct either the resource group type or use global file systems.

`304134 Validation of file system mount point %s configured to zone cluster %s has failed.`

Description: The information for the specified mount point in the zone cluster is incorrect.

Solution: Check the entries and modify them with valid values.

`304365 clcomm: Could not create any threads for pool %d`

Description: The system creates server threads to support requests from other nodes in the cluster. The system could not create any server threads during system startup. This is caused by a lack of memory.

Solution: There are two solutions. Install more memory. Alternatively, take steps to reduce memory usage. Since the creation of server threads takes place during system startup, application memory usage is normally not a factor.

`305163 Start of HADB database completed successfully.`

Description: The resource was able to successfully start the HADB database.

Solution: This is an informational message, no user action is needed.

`305298 cm_callback_impl abort_trans: exiting`

Description: ucmm callback for abort transition failed.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`305895 ucmmd got invalid upgrade callback from version manager: version %d.%d higher than highest version`

Description: Version manager delivered upgrade callback to ucmmd about a new version that is higher than the highest version supported by ucmmd.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`306483 scf_transaction_property_change failed error %d: %s`

Description: An API call failed.

Solution: Examine log files and syslog messages to determine the cause of the failure. Take corrective action based on any related messages. If the problem persists, report it to your Oracle support representative for further assistance.

`306560 INTERNAL ERROR: Failed to get nodename of zone %s : %s.`

Description: Failed to get the node name.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`307195 clcomm: error in copyin for cl_read_flow_settings`

Description: The system failed a copy operation supporting flow control state reporting.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`307322 Unable to create thread. Exiting.`

Description: clexecd program has encountered a failed thr_create(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`307531 open: %s`

Description: open failed for the specified reason. The specified program will be terminated and this zone will not be able to host applications.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`307834 CCR: Invalid CCR table : %s cluster %s.`

Description: CCR could not find a valid version of the indicated table on the nodes in the cluster.

Solution: There may be other related messages on the nodes where the failure occurred. They may help diagnose the problem. If the indicated table is unreadable due to disk failure, the root disk on that node needs to be replaced. If the table file is corrupted or missing, boot the cluster in -x mode to restore the indicated table from backup. The CCR tables are located at /etc/cluster/ccr/.

`308041 scha_control RESOURCE_RESTART failed`

Description: scha_control RESOURCE_RESTART failed

Solution: Determine why the scha_control RESOURCE_RESTART failed. If the problem persists, contact your Oracle support representative for further assistance.

`308378 Derby data service stop method returned with error %s`

Description: The derby data service could not stop for an unknown reason.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`308814 CCR: Updating table %s failed to startup on node %s for cluster %s.`

Description: The operation to update the indicated table failed to start on the indicated node.

Solution: There may be other related messages on the nodes where the failure occurred, which may help diagnose the problem. If the root disk failed, it needs to be replaced. If the indicated table was deleted by accident, boot the offending node(s) in -x mode to restore the indicated table from other nodes in the cluster. The CCR tables are located at /etc/cluster/ccr/. If the root disk is full, remove some unnecessary files to free up some space.

`308975 Resource type "%s" does not exist.`

Description: The SUNW.qfs resource type is not registered in the cluster.

Solution: Register the SUNW.qfs resource type, create the required instances of this resource type, and repeat the operation. For information about how to configure the shared QFS file system with Oracle Cluster, see your Oracle Solaris Cluster documentation and your Sun QFS documentation.

`309159 stop_dgproxy - Oracle ASM instance (%s) diskgroup (%s) is connected and remains mounted`

Description: The Oracle ASM diskgroup is connected to a database and has not been dismounted.

Solution: None required. Informational message.

`309609 Failed to validate the accessibility of the adapters in the zone cluster.`

Description: There is no adapter found on this system that is authorized to be used for this zone cluster.

Solution: Use the clzonecluster(1M) command to configure the adapters to be used for this zone cluster and run the command to create the resource.

`309961 Error during reading the property from repository %s`

Description: There was an error in reading the property of the SMF service instance from the repository

Solution: Check the SMF(5) man page to learn more about the error. Also make sure the basic SMF functionalities are working correctly. Contact your Oracle service provider for more information.

`310084 scal_initialize() call failed.`

Description: There was an error in initializing.

Solution: Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`310098 The SUNW.wait_zc_boot resource can be configured in scalable resource group only.`

Description: SUNW.wait_zc_boot resource is not configured in a scalable resource group.

Solution: Add this resource to a scalable resource group.

`310555 CMM: Quorum device %d (%s) added; votecount = %d, bitmask of nodes with configured paths = 0x%llx.`

Description: The specified quorum device with the specified votecount and configured paths bitmask has been added to the cluster. The quorum subsystem treats a quorum device in maintenance state as being removed from the cluster, so this message will be logged when a quorum device is taken out of maintenance state as well as when it is actually added to the cluster.

Solution: This is an informational message, no user action is needed.

`310953 clnt_control of program %s failed %s.`

Description: HA-NFS fault monitor failed to reset the retry timeout for retransimitting the rpc request.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`311129 Failed to retrieve IP address for %s`

Description: Cluster cannot generate a callback for the RDS module. Operation of RDS sockets might be affected.

Solution: If Reliable Datagram Sockets (RDS) is used by applications running on this cluster, contact your Oracle service representative to determine if a workaround or patch is available.

`311275 Volume %s in disk group %s is not ENABLED`

Description: One of the volumes being monitored is not in an enabled state.

Solution: Check state of the volume. Contact your authorized Oracle service provider for further assistance.

`311291 sema_post badchild: %s`

Description: The rpc.pmfd server was not able to act on a semaphore. The message contains the system error. The server does not perform the action requested by the client, and an error message is output to syslog.

Solution: Determine if the machine is running out of memory. If this is not the case, save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`311505 The resource group %s containing the resource %s is suspended. This has blocked a resource %s attempt on %s`

Description: The operation requested by scha_control is prevented because the resource group is suspended.

Solution: No action required. To enable automatic recovery actions, use 'clresourcegroup resume'

`311644 fork_event depth: ct_pr_event_get_pid: %s`

Description: The rpc.pmfd was unable to retrieve the pid from a contract event. The rpc.pmfd will continue to monitor the process, but the rpc.pmfd may have missed an event of interest.

Solution: Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

`312053 Cannot execute %s: %s.`

Description: Failure in executing the command.

Solution: Check the syslog message for the command description. Check whether the system is low in memory or the process table is full and take appropriate action. Make sure that the executable exists.

`312124 Failed to establish socket's default destination: %s`

Description: Default destination for a raw icmp socket could not be established.

Solution: If the error message string thats logged in this message does not offer any hint as to what the problem could be, contact your authorized Oracle service provider.

`312406 setproject call failed : %s`

Description: setproject call failed. Should never occur.

Solution: Verify project database. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`312826 The Skgxn Service which provides Oracle RAC support in the ucmmd daemon encountered a non-recoverable error and must abort`

Description: The Oracle RAC clustered database relies on the Skgxn Service provided by the ucmmd daemon for group membership services and will not function without it. The Skgxn Service has encountered a non-recoverable error and could not provide service.

Solution: Save copies of /var/adm/messages and /var/cluster/ucmm/ucmm_reconf.log files from all of the nodes in the cluster. Check for and save any core files of the ucmmd daemon or operating system. Contact your authorized Oracle service provider for assistance in diagnosing the problem. Please provide to them the saved files which are mentioned above.

`312990 Membership: attempt to halt zone '%s' (zone ID %d, zone uniq ID %d) completed.`

Description: The membership subsystem's attempt to halt the specified zone completed successfully.

Solution: This message is informational. No action is needed.

`313867 Unknown step: %s`

Description: Request to run an unknown reconfiguration step.

Solution: No user action is needed.

`314033 Server still running. Sleeping for 5 sec.`

Description: We are allowing pmon some time to finish its work and exit cleanly.

Solution: None.

`314073 validate_asm - %s/bin/crsctl either does not exist or is not executable`

Description: ${CRS_HOME}/bin/crsctl either does not exist or is not a executable

Solution: Ensure that ${CRS_HOME} represents the directory where the Oracle Clusterware files are installed.

`314185 Switchover error (%s): cannot find clexecd`

Description: The file system specified in the message could not be hosted on the node the message came from. Check to see if the user program "clexecd" is running on that node.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`314314 prog <%s> step <%s> terminated due to receipt of signal <%d>`

Description: ucmmd step terminated due to receipt of a signal.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified and if it recurs. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance.

`314356 resource %s enabled.`

Description: This is a notification from the rgmd that the operator has enabled a resource. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

`314706 Failed to do lstat() on test-file %s : %s`

Description: The lstat() operation on the test file for I/O operations failed. One possible cause of this error is that the test file has been deleted. The deletion of this file might be caused by malicious activity in your system.

Solution: Restart the ScalMountPoint resource.

`314877 Domain %s failed to shutdown immediately.`

Description: The /usr/bin/virsh destroy command failed.

Solution: Determine why it was not possible to immediately terminate the domain.

`314991 validate_common - The Oracle user %s does not belong to project %s`

Description: The userid does not belong to the specified project.

Solution: Ensure the userid exists within the project. Check that you have the correct userid and project name.

`315207 Failed to execute %s on %s. optval = %d`

Description: Attempt to execute a command on a remote cluster node failed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`315333 Function: stop_mysql - clrs disable for (%s) was unsuccessful`

Description: The clrs disable of the MySQL replication resource was unsuccessfull

Solution: Examine the /var/adm/messages for the additional error messages and fix the root cause

`315446 node id <%d> is out of range`

Description: The low-level cluster machinery has encountered an error.

Solution: Look for other syslog messages occurring just before or after this one on the same node; they may provide a description of the error.

`315699 mc_multi_openconn failed to open connection.`

Description: Failed to allocate memory during connection establishment for an SCTP non-sticky service.

Solution: Install more memory, increase swap space, or reduce peak memory consumption.

`316043 oep_validate - Incorrect PLUGIN_NAME [%s] specified`

Description: Incorrect PLUGIN_NAME specified.

Solution: Specify a valid PLUGIN_NAME.

`316625 Timeout monitoring on method tag <%s> has been %s.`

Description: The timeout monitoring on the running method is being suspended or resumed because a device group switchover has started or finished respectively.

Solution: This is just an informational message.

`316649 pthread_rwlock_unlock err %d line %d`

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`316965 % has requested a domain restart %s.`

Description: The domain probe has requested a domain restart.

Solution: None. A domain restart will be attempted.

`317213 in libsecurity for program %s (%lu); setnetconfig failed: %s`

Description: The specified server was not able to initiate an rpc connection, because it could not get the network database handle. The server does not start. The rpc error message is shown. An error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`318011 in libsecurity for program %s (%lu); file registration failed for transport %s`

Description: A server (rpc.pmfd, rpc.fed or rgmd) was not able to create the "cache" file to duplicate the rpcbind information. The server should still be able to receive requests from clients (using rpcbind). An error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`318313 monitor_check: set_env_vars() failed for resource <%s>, resource group <%s>, node <%s>`

Description: During execution of a scha_control(1HA,3HA) function, the rgmd daemon was unable to set up environment variables for method execution, causing a MONITOR_CHECK method invocation to fail. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`318757 Error probing device group`

Description: An error occurred during a probe of the device group.

Solution: Verify the status of the disk set or disk group. Contact your authorized Oracle service provider for further assistance in diagnosing the problem.

`319129 The entry in /etc/vfstab of the zone cluster %s for file system mount point %s is incorrect: %s.`

Description: The format of the entry for the specified mount point in the specified file is invalid.

Solution: Edit the file (usually /etc/vfstab) and check that entries conform to its format.

`319374 Incoming argument size is zero.`

Description: An internal error has occurred in the inter-process communication between rgmd and another clustering process. Other related error messages might precede or follow this one in the syslog output.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`319375 clexecd: wait_for_signals got NULL.`

Description: clexecd problem encountered an error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`319602 daemon started.`

Description: The scdpmd is started.

Solution: No action required.

`319737 The raw device to fsck is not specified in vfstab for mount point : %s.`

Description: The 'device to fsck' field is missing from the vfstab entry for the specified mount point.

Solution: Add the 'device to fsck' field to the vfstab entry for the specified mount point and repeat the operation.

`320466 The global cluster failover HAStoragePlus resources mentioned in the offline restart dependencies list of the resource '%s' are not online on same node.The dependent failover resources must be online on the same node to validate the configuration.`

Description: Self explanatory.

Solution: Bring all the dependent failover resource's resource groups online on one node and retry the operation. If the problem persists, contact your authorized Oracle service provider with the /var/adm/messages files from all cluster nodes.

`320549 Waiting for node "%s" to come up ...`

Description: The sponsor node is not up yet

Solution: Please wait for the sponsor node to come up. This is an informational message.

`320970 Failed to retrieve the node id from the node name for node %s: %s.`

Description: Self explanatory.

Solution: Check the cluster configuration. If the problem persists, contact your authorized Oracle service provider.

`321320 stop_oep_proxy - /usr/cluster/bin/pmfadm has timed out`

Description: /usr/cluster/bin/pmfadm timed out.

Solution: Contact your Oracle support representative for further assistance.

`321832 Could not set the contract id to 0 in the repository`

Description: Not able to set the desired values in the SMF repository.

Solution: Check the SMF(5) man page to learn more about the error. Also make sure the basic SMF functionalities are working correctly. Contact your Oracle service provider for more information.

`322159 Error setting states inrepository: %s: %d`

Description: Have problems in starting a communication with the SMF repository

Solution: Depending on the error, check the SMF(5) man page. Contact your Oracle service provider for more information.

`322252 %s failed to stop the application and returned with %d`

Description: A command was run to stop the application but it failed with an error. Both the command and the error code are specified in the message.

Solution: Save the syslog and contact your authorized Oracle service provider.

`322373 Unable to unplumb %s%d, rc %d`

Description: Oracle Solaris Cluster infrastructure failed to unplumb the transport interface.

Solution: The error message should contain the error code, so examine the message to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`322797 Error registering provider '%s' with the framework.`

Description: The device configuration system on this node has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`322828 scha_control GIVEOVER failed`

Description: scha_control GIVEOVER failed

Solution: Determine why the scha_control GIVEOVER failed. If the problem persists, contact your Oracle support representative for further assistance.

`322853 The device special file (%s) is not either character or block device.`

Description: Self explanatory.

Solution: Specify either a character or a block device path.

`322862 clcomm: error in copyin for cl_read_threads_min`

Description: The system failed a copy operation supporting flow control state reporting.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`322879 clcomm: Invalid copyargs: node %d pid %d`

Description: The system does not support copy operations between the kernel and a user process when the specified node is not the local node.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`322895 exception %s raised while attempting to get running version of CMM.`

Description: An exception occurred when retrieving the running version of CMM.

Solution: Contact your authorized Oracle service provider to determine if a workaround or patch is available.

`322908 CMM: Failed to join the cluster: error = %d.`

Description: The local node was unsuccessful in joining the cluster.

Solution: There may be other related messages on this node that may indicate the cause of this failure. Resolve the problem and reboot the node.

`322920 Error unloading the EGC failfast module.`

Description: The svc:/system/egc/failfast:default SMF service has failed to unload the EGC farm failfast module

Solution: Reboot the node.

`323405 Error in informing the res group about the svc restart:%s`

Description: When a service is restarted, the sc delegate restarter informs RGM about the restart of the resource using SCHA_RESOURCE_IS_RESTARTED scha control API. This message is displayed when this call cannot be made.

Solution: Check for the validity and the states of resource and services. Contact your Oracle service provider for more information.

`323592 Validation failed. CRS is not up. Please start it up before attempting to create proxy resource.`

Description: Creation of a resource of type SUNW.scalable_rac_server_proxy failed because CRS is not up.

Solution: Bring up CRS before attempting to create a resource of the SUNW.scalable_rac_server_proxy resource type. If the problem persists, contact your Oracle support representative for further assistance.

`323640 open64 while setting up process template: %s`

Description: The libclcontract code was unable to open a file in the /system/contract/process/ directory. Consequently, the process that is using libclcontract was unable to launch the requested process under its control.

Solution: If the message is isolated, it was probably a transient error. Retry the requested action. If there are many instances of the message, there is a problem with the contract file system. Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

`323873 Resource "%s" disabled.`

Description: This ScalMountPoint resource was successfully disabled. This message is an informational message.

Solution: No user action is required.

`324478 (%s): Error %d from read`

Description: An error was encountered in the clexecd program while reading the data from the worker process.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`324924 in libsecurity contacting program %s (%lu): could not copy host name`

Description: A client was not able to make an rpc connection to the specified server because the host name could not be saved. This problem can occur if the machine has low memory. An error message is output to syslog.

Solution: Determine if the host is low on memory. If not, save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`325032 qdmd: Quorum device type variable for type %s not found`

Description: The quorum device monitoring daemon encountered an error while fetching device type information for the indicated quorum device type.

Solution: Contact service support.

`325322 clcomm: error in copyin for state_resource_pool`

Description: The system failed a copy operation supporting statistics reporting.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`325482 File %s is not owned by group (GID) %d`

Description: The file is not owned by the gid which is listed in the message.

Solution: Set the permissions on the file so that it is owned by the gid which is listed in the message.

`325530 Creation of the shutdown file %s has failed: %s`

Description: The cp(1) command has returned an error.

Solution: Investigate the cause of the failure and correct the condition prior to attempting this operation again.

`325593 check_file_exists - The file %s is not readable by its owner.`

Description: A configuration file was not readable by its owner.

Solution: Ensure that the file has the read permission for its owner set.

`325879 Failed to stop monitor-method: %s`

Description: An error prevented a resource's fault monitor from stopping.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`326023 reservation warning(%s) - MHIOCGRP_PREEMPTANDABORT error in MHIOCGRP_INKEYS, error %d`

Description: The device fencing program has encountered errors while trying to access a device. All retry attempts have failed.

Solution: This may be indicative of a hardware problem, which should be resolved as soon as possible. Once the problem has been resolved, the following actions may be necessary: If the message specifies the 'node_join' transition, then this node may be unable to access the specified device. If the failure occurred during the 'release_shared_scsi2' transition, then a node which was joining the cluster may be unable to access the device. In either case, access can be reacquired by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group might have failed to start on this node. If the device group was started on another node, move it to this node by using the cldevicegroup command. If the device group was not started, you can start it by using the cldevicegroup command. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group might have failed. If so, the desired action may be retried.

`326030 Local mountpoint %s must begin with / in local zone '%s'.`

Description: The specified mount point in local zone is not an absolute path. An absolute path must start with slash(/).

Solution: Correct the mount point path value so that it is absolute path and repeat the operation.

`326299 INTERNAL ERROR: remote cluster %s unreachable`

Description: The rgmd was unable to delegate the giveover of the specified resource group on the remote zone cluster node. The message provides more information.

Solution: Examine other syslog messages occurring around the same time on the same node. These messages may indicate further action.

`326363 Function: stop_sczbt - Logical interface %s:%s placed into the global zone`

Description: The interface of the associated logical host is placed back into the global zone by the stop command of the sczbt component.

Solution: None

`326501 Membership: State machine for '%s' entered an invalid state %s; previous state was %s, previous event was %s.`

Description: The membership state machine for this membership related to global cluster has entered an invalid state. The local global-cluster node will go down.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`326528 Nonexistent Broker_name (%s).`

Description: The broker name provided in the extension property Broker_Name does not exist.

Solution: Check that a broker instance exists for the supplied broker name. It should match the broker name portion of the path in Confdir_list.

`326800 Multiple domain %s configuration exists on %s.`

Description: The domain is configured on multiple cluster nodes.

Solution: Ensure that the domain is configured on one node of the cluster.

`327057 SharedAddress stopped.`

Description: The stop method is completed and the resource is stopped.

Solution: This is informational message. No user action required.

`327302 reservation fatal error(%s) - lock not specified`

Description: The device fencing program has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis.

`327339 unable to create file %s errno %d`

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`327353 Global device path %s is not recognized as a device group or a device special file.`

Description: Self explanatory.

Solution: Check that the specified global device path is valid.

`327549 Stop of HADB node %d did not complete.`

Description: The resource was unable to successfully run the hadbm startnode command either because it was unable to execute the program, or the hadbm command received a signal.

Solution: This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action.

`328113 %s logical interface configuration operation failed with <%d>.`

Description: An attempt to bring a network interface up or down has failed with the indicated error, while attempting to bring an IP address resource (of type LogicalHostname or SharedAddress) online or offline. Additional related failure messages are likely to be found following this one in the syslog output.

Solution: Check the configuration of network resources using the "clresourcegroup show -v +" command, and make any necessary corrections to the network configuration.

`328580 rgmd died on node %s`

Description: An inter-node communication failed because the rgmd died on another node. To avoid data corruption, the failfast mechanism will cause that node to halt or reboot.

Solution: No action is required. The cluster will reconfigure automatically. Examine syslog output on the rebooted node to determine the cause of node death. The syslog output might indicate further remedial actions.

`328675 The mount point property of file system '%s' in pool '%s' is set to 'legacy', which is not supported by HAStoragePlus.`

Description: Self explanatory. HAStoragePlus does not support Zettabyte File Systems (ZFS) as Failover File Systems (FFS) that have the mountpoint property set to 'legacy'.

Solution: Set the mountpoint property for the specified file system to 'default'.

`329039 Cannot access file %s/config.xml or %s/config/config.xml: %s`

Description: The config.xml file does not exist either in the <domain> or <domain>/config directory.

Solution: Make sure if config.xml file is present in the <domain> or <domain>/config directory and also make sure if proper permissions are set for the file.

`329429 reservation fatal error(%s) - host_name not specified`

Description: The device fencing program has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis. It may be possible to retry the failed operation, depending on the nature of the error. If the message specifies the 'node_join' transition, then this node may be unable to access shared devices. If the failure occurred during the 'release_shared_scsi2' transition, then a node which was joining the cluster may be unable to access shared devices. In either case, it may be possible to reacquire access to shared devices by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group has failed to start on this node. If another node was available to host the device group, then it should have been started on that node. If desired, it might be possible to switch the device group to this node by using the cldevicegroup command. If no other node was available, then the device group will not have been started. You can use the cldevicegroup command to retry the attempt to start the device group. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group has failed. The desired action may be retried.

`329616 svc_probe used entire timeout of %d seconds during connect operation and exceeded the timeout by %d seconds. Attempting disconnect with timeout %d`

Description: The probe timed out connecting to the application.

Solution: If the problem persists investigate why the application is responding slowly or if the Probe_timeout property needs to be increased.

`329806 Failed to validate the IPMP group name %s: IPMP group is not persistent.`

Description: Validation of IPMP group configuration has failed. The indicated IPMP group is not configured as persistent.

Solution: Examine the IPMP configuration. Make sure that the given IPMP group is configured as persistent interface on the system.

`330182 Internal error: default value missing for resource property`

Description: A non-fatal internal error has occurred in the RGM.

Solution: Since this problem might indicate an internal logic error in the rgmd, save a copy of the /var/adm/messages files on all nodes, and the output of clresourcetype show -v, clresourcegroup show -v +, and clresourcegroup status +. Report the problem to your authorized Oracle service provider.

`330523 %s list-constraints for domain %s failed.`

Description: "/opt/SUNWldm/bin/ldm list-constraints -x" for domain failed.

Solution: Determine why the command to list the domain constraints failed.

`330526 CMM: Number of steps specified in registering callback = %d; should be <= %d.`

Description: The number of steps specified during registering a CMM callback exceeds the allowable maximum. This is an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`330530 Failed to retrieve the resource property %s of resource %s: %s.`

Description: There was a failure while retrieving a property of a resource. The names of the resource and the property are both provided in the error message. The reason that the error occurred is also provided in the message.

Solution: The operation will be retried after some time. But there might be a delay in failing over some HA-NFS resources. If this message is logged repeatedly, save a copy of the syslog and contact your authorized Oracle service provider.

`330565 clcomm: solaris xdoor: Got zoneid %d instead of %d`

Description: Zone information that has been passed does not match the client credentials.

Solution: Someone has tampered with Oracle Solaris Cluster code. This is a security violation. Shut down the identified zone.

`330686 Function: validate - Non-global zones mountpoint %s does not exist`

Description: The directory used as a mountpoint in the non-global zone is missing.

Solution: Create the mountpoint in the non-global zone.

`330700 Cannot read template file (%s).`

Description: Template file name was passed to the function for synchronizing the configuration file. Unable to locate the file indicated in the message. Unable to store property value of resource to configuration file.

Solution: Verify installation of Oracle Solaris Cluster. If the problem persists, save the contents of /var/adm/messages and contact your Oracle service representative.

`330722 The derby data service is not already running`

Description: Trying to stop the derby data service when it is not running.

Solution: This message is informational; no user action is needed.

`330772 DB_password_file must be set when Auto_recovery is set to true.`

Description: When auto_recovery is set to true the db_password_file extension property must be set to a file that can be passed as the value to the hadbm command's --dbpasswordfile argument.

Solution: Retry the resource creation and provide a value for the db_password_file extension property.

`331059 validate_zcboot_resource - SUNW.wait_zc_boot resource is not configured for zone cluster %s`

Description: SUNW.wait_zc_boot resource is not configured for zone cluster

Solution: Configure a SUNW.wait_zc_boot resource with ZCName set to the zone cluster.

`331074 mc_multi_openconn failed to open bindtab connection.`

Description: Failed to allocate memory during connection establishment for an SCTP sticky service.

Solution: Install more memory, increase swap space, or reduce peak memory consumption.

`331221 CMM: Max detection delay specified is %ld which is larger than the max allowed %ld.`

Description: The maximum of the node down detection delays is larger than the allowable maximum. The maximum allowed will be used as the actual maximum in this case.

Solution: This is an informational message, no user action is needed.

`331325 sigprocmask: %s`

Description: The rpc.pmfd server was not able to set its signal mask. The message contains the system error. This happens while the server is starting up, at boot time. The server does not come up, and an error message is output to syslog.

Solution: Save the syslog messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`331446 stop_diskgroup - Oracle ASM instance (%s) failed to dismount (%s)`

Description: The Oracle ASM diskgroup failed to dismount.

Solution: Check the syslog for further messages. The Oracle Solaris Cluster resource will now enter a stop_failed state. You must determine why the Oracle ASM diskgroup failed to dismount. Once resolved you can reenable the Oracle Solaris Cluster resource again.

`331879 Function: validate - ServiceProbeCommand (%s) not a fully qualified path.`

Description: The command specified for variable ServiceProbeCommand within the /opt/SUNWsczone/sczsh/util/sczsh_config configuration file is not containing the full qualified path to it.

Solution: Make sure the full qualified path is specified for the ServiceProbeCommand, e.g. "/full/path/to/mycommand" rather than just "mycommand". This full qualified path must be accessible within the zone that command is being called.

`331948 Unable to determine password for database.`

Description: Cannot retrieve the password for the broker.

Solution: Check that the password file is accessible and correctly specifies the database recovery password.

`333069 Failed to retrieve nodeid for %s.`

Description: The nodeid for the given name could not be determined.

Solution: Make sure that the name given is a valid node identifier or node name.

`333163 Malformed %s group specification %s.`

Description: Failed to retrieve the ipmp information. The given IPMP group specification is invalid.

Solution: Check whether the IPMP group specification is in the form of ipmpgroup@nodename. If not, recreate the resource with the properly formatted group information.

`333387 INTERNAL ERROR: starting_iter_deps_list: meth type <%d>`

Description: A non-fatal internal error has occurred in the rgmd state machine.

Solution: Since this problem might indicate an internal logic error in the rgmd, save a copy of the /var/adm/messages files on all nodes, and the output of clresourcetype show -v, clresourcegroup show -v +, and clresourcegroup status +. Report the problem to your authorized Oracle service provider.

`333874 failfastd: sigdelset returned %d. Exiting.`

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available

`333878 fatal: Unable to get the cluster configuration (%s).`

Description: A call to an internal library to get the cluster configuration unexpectedly failed. The RGMD will exit, which will cause the node to reboot.

Solution: Report the problem to your authorized Oracle service provider.

`334268 CCR: Can't read CCR metadata for cluster %s.`

Description: Reading the CCR metadata failed on this node during the CCR data server initialization.

Solution: There may be other related messages on this node, which may help diagnose the problem. For example: If the root disk on the afflicted node has failed, then it needs to be replaced. If the cluster repository is corrupted, then boot this node in -x mode to restore the cluster repository from backup or other nodes in the cluster. The cluster repository is located at /etc/cluster/ccr/. Contact your authorized Oracle service provider for assistance.

`334412 Telemetry data service monitor check method failed`

Description: The monitor program of the telemetry data service detected an error. The cause of the error is given in some error messages displayed before this one.

Solution: Check if there are other error messages before this one, and contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`334697 Failed to retrieve the cluster property %s: %s.`

Description: The query for a property failed. The reason for the failure is given in the message.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`334965 Error writing configuration file %s.`

Description: An error occurred when attempting to write the configuration file.

Solution: Investigate the cause of the failure and correct the condition prior to attempting this operation again.

`334992 clutil: Adding deferred task after threadpool shutdown id %s`

Description: During shutdown this operation is not allowed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`335206 Failed to get host names from the resource.`

Description: Retrieving the IP addresses from the network resources from this resource group has failed.

Solution: Internal error or API call failure might be the reasons. Check the error messages that occurred just before this message. If there is internal error, contact your authorized Oracle service provider. For API call failure, check the syslog messages from other components. For the resource name and resource group name, check the syslog tag.

`335302 stmon_get_did_for_dev_path(): Unknown device path %s`

Description: Unknown device paths.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is avaliable.

`335363 cl_execd: Error %d from open(/dev/zero). Exiting.`

Description: cl_execd has encountered a failed open(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`335587 The non-existent mount point %s was created successfully with permissions %s and owned by the superuser.`

Description: HAStoragePlus detected the mount point was missing, and created the mount point with the specified information.

Solution: This is an informational message, no user action is needed.

`335591 Failed to retrieve the resource group property %s: %s.`

Description: An attempt to retrieve a resource group property has failed.

Solution: If the failure is caused by insufficient memory, reboot. If the problem recurs after rebooting, consider increasing swap space by configuring additional swap devices. If the failure is caused by an API call, check the syslog messages for the possible cause.

`335619 clq_scsi3: Quorum device %s does not have any keys. Use a different device`

Description: There are no keys on the device. This is unexpected behavior from the device driver, multipathing driver or device firmware.

Solution: Use a different device as a quorum device.

`335836 Failed to mount file-system %s on mountpoint %s`

Description: The file system that this ScalMountPoint resource represents could not be mounted on the mount point.

Solution: Determine whether the mount-point directory exists. If the directory does not exist, create it and repeat the operation. Otherwise, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`336760 Could not restart or failover the derby data service`

Description: Could not restart or failover the derby data service.

Solution: For more detailed error message, check the syslog messages. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`336852 start_asm - Oracle CSS is not running`

Description: The Oracle Solaris Cluster Synchronization Services (CSS) is not running.

Solution: Investigate why the CSS daemon is not running and then re-enable the Oracle Solaris Cluster resource.

`337008 rgm_comm_impl::_unreferenced() called unexpectedly`

Description: The low-level cluster machinery has encountered a fatal error. The rgmd will produce a core file and will cause the node to halt or reboot to avoid the possibility of data corruption.

Solution: Save a copy of the /var/adm/messages files on all nodes, and of the rgmd core file. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`337212 resource type %s removed.`

Description: This is a notification from the rgmd that a resource type has been deleted. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

`337736 %s: svc_run returned`

Description: The RPC server exited unexpectedly.

Solution: Save the contents of /var/adm/messages from all nodes and contact your Oracle service representative for assistance in diagnosing and correcting the problem.

`337902 stmon_get_did_for_dev_path() is called`

Description: Self explanatory.

Solution: No action required.

`337957 Validation failed. The RAC framework resource %s that is specified in the RESOURCE_DEPENDENCIES property is not in the resource group that is specified by the resource group property RG_AFFINITIES.`

Description: The resource being created or modified should be dependent upon the RAC framework resource in the RAC framework resource group.

Solution: If not already created, create the scalable resource group containing RAC framework resource and its associated resources. Specify this resource's dependency on the RAC framework by updating the RESOURCE_DEPENDENCIES property.

`338067 This resource does not depend on any SUNW.HAStoragePlus resources. Proceeding with normal checks.`

Description: The resource does not depend on any HAStoragePlus filesystems. The validation will continue with its other checks.

Solution: This message is informational; no user action is needed.

`338839 clexecd: Could not create thread. Error: %d. Sleeping for %d seconds and retrying.`

Description: clexecd program has encountered a failed thr_create() system call. The error message indicates the error number for the failure. It will retry the system call after specified time.

Solution: If the message is seen repeatedly, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`338957 Warning! Oracle Solaris Cluster resource cannot be brought online on this node because the corresponding Solaris SMF services may be online. Please disable the Solaris SMF services using the following command: 'svcadm disable %s'`

Description: The Solaris SMF service indicated above could not be disabled as required by Oracle Solaris Cluster to make the service capable of restart/failover.

Solution: Try to manually disable the SMF service specified by the error message using the 'svcadm disable' command and retry the operation.

`339206 validate: An invalid option entered or`

Description: -2 A wrong variable is set in the parameter file or a line does not start with

Solution: -2 Fix the parameter file.

`339353 Function: start_mysql - The pid file %s was not created within %s seconds`

Description: the pid file of the MySQL Server was not created within 70 percent of the start timeout.

Solution: None

`339424 Could not host device service %s because this node is being removed from the list of eligible nodes for this service.`

Description: A switchover/failover was attempted to a node that was being removed from the list of nodes that could host this device service.

Solution: This is an informational message, no user action is needed.

`339444 Failed to stop fault-monitor : %s`

Description: The fault monitor of this ScalMountPoint resource could not be stopped.

Solution: Manually kill the fault monitor process.

`339657 Issuing a restart request.`

Description: This is informational message. We are above to call API function to request for restart. In case of failure, follow the syslog messages after this message.

Solution: No user action is needed.

`339908 strtol: %s`

Description: strtol failed. Should never occur. This might have failed if the return value could not be represented.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`339954 fatal: cannot create any threads to launch callback methods`

Description: The rgmd daemon was unable to create a thread upon starting up. This is a fatal error. The rgmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution: Make sure that the hardware configuration meets documented minimum requirements. Save a copy of the /var/adm/messages files on all nodes, and of the rgmd core file. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`340157 huge address size %d`

Description: Size of MAC address in acknowledgment of the bind request exceeds the maximum size allotted. We are trying to open a fast path to the private transport adapters.

Solution: Reboot of the node might fix the problem.

`340180 Prog <%s> step <%s>: quiesced.`

Description: An internal error has occurred. The quiesce command, which is applicable only to resource groups, appears to have been applied to a ucmmd reconfiguration step.

Solution: This is an internal error. Save the contents of /var/adm/messages, /var/cluster/ucmm/ucmm_reconf.log, and /var/cluster/ucmm/dlm*/*logs/* from all the nodes and contact your authorized Oracle service provider.

`340211 monitor_check: getlocalhostname() failed for resource <%s>, resource group <%s>, node <%s>`

Description: While attempting to process a scha_control(1HA,3HA) call, the rgmd failed in an attempt to obtain the hostname of the local node. This is considered a MONITOR_CHECK method failure. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`340287 idl_set_timestamp(): IDL Exception`

Description: The rgmd has encountered an error that prevents the scha_control function from successfully setting a ping-pong time stamp, probably because of a node death or network failure.

Solution: Usually, no action is required. If another node is available, services will be restarted automatically.

`340464 SCSLM fork1 error <%s>`

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`341205 Failed to replace bootcluster on the nodes of second partition`

Description: During dual-partition upgrade, bootcluster component was not replaced on the nodes of the second partition. The dual-partition upgrade will continue to completion.

Solution: Do not boot any nodes in second partition into cluster mode until the dual-partition upgrade completes.

`341259 Property %s can't start with a "/"`

Description: The value of the property TargetFileSystem starts with a slash (/). However, the value of this property must not start with a slash.

Solution: Correct the value of the property and repeat the operation.

`341502 Unable to plumb even after unplumbing. rc = %d`

Description: Topology Manager failed to plumb an adapter for private network. A possible reason for plumb to fail is that it is already plumbed. Solaris clustering has successfully unplumbed the adapter but failed while trying to plumb for private use.

Solution: The error message should contain the error code, so examine the message to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`341539 fatal: Aborting node %s because method <%s> failed on resource <%s> and Failover_mode is set to HARD`

Description: A STOP method has failed or timed out on a resource, and the Failover_mode property of that resource is set to HARD.

Solution: No action is required. This is normal behavior of the RGM. With Failover_mode set to HARD, the rgmd reboots the indicated node or zone to force the resource group offline so that it can be switched onto another node. Other syslog messages that occurred just before this one might indicate the cause of the STOP method failure.

`341719 Restarting daemon %s.`

Description: HA-NFS is restarting the specified daemon.

Solution: No action.

`341801 No Port_list extension property configured in resource.`

Description: The port_list extension property is not configured for a "network-aware" resource.

Solution: Configure the port_list extension property.

`341804 Failed to retrieve information for user %s.`

Description: Failed to retrieve information for the specified HADB MA user

Solution: Check if the proper HADB MA User ID is set or check if this user exists on all the nodes of the cluster.

`342193 Attempt to mount %s failed on this node.`

Description: In a scalable resource group, each node that is configured in the resource group attempts to mount the file system. Only one node can succeed in mounting the file system. The remaining nodes which fail to mount the file system issue this message.

Solution: This is an informational message. However, if no node succeeds in mounting the file system, check the failure message of each node. If you are unable to resolve the problem contact your authorized Oracle service provider with copies of /var/adm/messages files on all nodes.

`342336 clcomm: Pathend %p: path_down not allowed in state %d`

Description: The system maintains state information about a path. A path_down operation is not allowed in this state.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`342472 Error while posting sysevent from %s: %s`

Description: An internal error has occurred while posting a system event. System events are used for keeping an audit trail of cluster behavior. Related error messages might be found near this one in the syslog output.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`342597 sigaddset: %s`

Description: -2 The rpc.fed server encountered an error with the sigemptyset function, and was not able to start. The message contains the system error.

Solution: Save the syslog messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`343233 Failed to disable %s.`

Description: The Solaris SMF service indicated above could not be disabled as required by Oracle Solaris Cluster to make the service capable of restart/failover.

Solution: Try to manually disable the SMF service specified by the error message using the 'svcadm disable' command and retry the operation.

`343271 getzonenamebyid: %s`

Description: getzonenamebyid failed for the specified reason. The specified program will be terminated. This zone will not be able to host applications.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`343307 Could not open file %s: %s.`

Description: System has failed to open the specified file.

Solution: Check whether the permissions are valid. This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action. For specific error information, check the syslog message.

`343870 clcomm: Rejecting communication attempt from node %s; local node has unresolved CCR changes done after split brain.`

Description: The local node has unresolved CCR changes that were done in this node's partition when the cluster was in a split-brain scenario while the property multiple_partitions=true was set in CCR. The administrator must first resolve the CCR changes. Hence, this node will reject the communication attempt from a remote node.

Solution: Decide whether the CCR data on this node should be the final CCR data that is used by the cluster. If yes, then reboot the remote node into noncluster mode and mark its CCR data as invalid. Mark this local node's CCR data as valid, and then reboot the remote node into cluster mode. If no, then reboot this local node into noncluster mode and mark its CCR data as invalid. Mark the remote node's CCR data as valid and reboot this local node into cluster mode.

`344059 RAC server %s probe successful.`

Description: This message indicates that fault monitor has successfully probed the RAC server

Solution: No action required. This is informational message.

`344291 clq_scsi3: Duplicate keys 0x%llx, found in registration key list of quorum device %s.`

Description: Duplicate keys found on specified quorum device. This error occurs because of unexpected behavior from device driver or multipathing driver or device's firmware.

Solution: Please look for updates in device driver, multipathing driver or device firmware. If no updates are available contact the Oracle device driver support team.

`344512 Failed to create a temporary file during determining MDS node of '%s' file system : %s.`

Description: The zone boot handler failed to create a temporary file.

Solution: Check the log messages to rectify the problem. If the problem persists, contact your authorized Oracle service provider.

`344672 Unable to open door descriptor %s`

Description: A process running in a non-global zone was unable to communicate with the cluster framework in the global zone.

Solution: Save the /var/adm/messages files on each node. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`344870 stop_ndbd_shutdown: The restart -n of all data nodes was unsuccesful`

Description: The restart -n of the datanode was unsuccessful.

Solution: None

`345736 Unable to allocate memory`

Description: An internal error has occurred in the inter-process communication between Oracle Solaris Cluster processes. Related error messages might be found near this one in the syslog output.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`346015 Function: check_sczbt - %s Milestone [%s] not online, try again in 5 seconds`

Description: The milestone is not online or degraded. The state is checked again in 5 seconds.

Solution: None.

`346341 Failed to check the status of %s service.`

Description: There was an error while retrieving the status of the specified SMF service.

Solution: Determine the reason for the failure by using svcs(1) and by checking /var/adm/messages. Re-try the operation after the problem is resolved. Contact your authorized Oracle service provider to determine whether a workaround or patch is available if the problem persists.

`346395 UNRECOVERABLE ERROR: Creation of %s failed with error code %s`

Description: Creation of ${QL_TRANSFORM_CCR_FILE} failed with error code ${retval}.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`346439 Could not verify value of property %s for %s.`

Description: An API call failed.

Solution: Examine log files and syslog messages to determine the cause of the failure. Take corrective action based on any related messages. If the problem persists, report it to your Oracle support representative for further assistance.

`346831 Notice: not OK to join`

Description: This is an informational message. This message can be seen when reconfiguration is in progress on other cluster nodes. The operation will be retried.

Solution: This message is informational; no user action is needed.

`346858 UPDATE operation successfully completed.`

Description: An UPDATE operation has completed successfully.

Solution: None required. Informational message.

`347023 Could not run %s. User program did not execute cleanly.`

Description: There were problems making an upcall to run a user-level program.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`347091 resource type %s added.`

Description: This is a notification from the rgmd that the operator has created a new resource type. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

`348065 CCR: Lost quorum while starting to update table %s, cluster %s.`

Description: The cluster lost quorum when CCR started to update the indicated table.

Solution: Reboot the cluster.

`348240 clexecd: putmsg returned %d.`

Description: clexecd program has encountered a failed putmsg(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`348504 Error: Startup of ${SERVER} failed.`

Description: An attempt to start the rpc.fed server failed. This error will prevent the rgmd from starting, which will prevent this node from participating as a full member of the cluster.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`349041 RGM unblocked, returned from blocked invocation.`

Description: The RGM has been unblocked. cluster file systems are available.

Solution: This is an informational message, no user action is needed.

`349049 CCR reported invalid table %s; halting node`

Description: The CCR reported to the rgmd that the CCR table specified is invalid or corrupted. The node will be halted to prevent further errors.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`349741 Command %s is not a regular file.`

Description: The specified pathname, which was passed to a libdsdev routine such as scds_timerun or scds_pmf_start, does not refer to a regular file. This could be the result of 1) mis-configuring the name of a START or MONITOR_START method or other property, 2) a programming error made by the resource type developer, or 3) a problem with the specified pathname in the file system itself.

Solution: Ensure that the pathname refers to a regular, executable file.

`349932 validate_options: %s Option %s not set`

Description: The referenced script needs a mandatory option which got not set.

Solution: Verify the options upon registration for the referenced script and make sure all mandatory options got provided.

`350209 Bringing down the local node because quorum status check is stuck`

Description: Critical cluster subsystems cannot proceed because the status check of quorum devices is stuck. Hence the node is brought down.

Solution: There would be other messages from the quorum subsystem about status check failures for quorum devices. Fix the problems shown by such failures. If the problem continues, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`350574 Start of HADB database did not complete: %s.`

Description: The resource was unable to successfully run the hadbm start command either because it was unable to execute the program, or the hadbm command received a signal.

Solution: This might be the result of a lack of system resources. Check whether the system is low in memory and take appropriate action.

`350783 set_ts_prio : Unable to get ff_admin_v`

Description: cl_execd program coudn't get a reference to the CORBA failfast server object.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`351053 Failure detected. Rebooting the node as property RebootOnFailure is set to TRUE`

Description: Self explanatory.

Solution: This is an informational message, no user action is needed.

`351887 Bulk registration failed`

Description: The cl_apid was unable to perform the requested registration for the CRNP service.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`352149 monitor_check: method <%s> failed on resource <%s> in resource group <%s> on node <%s>, exit code <%d>, time used: %d%% of timeout <%d seconds>`

Description: In scha_control, monitor_check method of the resource failed on specific node.

Solution: No action is required; this is normal phenomenon of scha_control, which launches the corresponding monitor_check method of the resource on all candidate nodes and looks for a healthy node which passes the test. If a healthy node is found, scha_control will let the node take over the resource group. Otherwise, scha_control will just exit early.

`352222 check_file_exists - The file %s does not exist.`

Description: A configuration file was not found.

Solution: Ensure that the file exists and that the correct configuration properties are specified.

`352954 Resource (%s) not configured.`

Description: This is an internal error. Resource name indicated in the message was passed to the function for synchronizing the configuration files. Unable to locate the resource.

Solution: If the problem persists, save the contents of /var/adm/messages and contact your Oracle service representative.

`353368 Unable to to run %s: %s.`

Description: The specified command was unable to run because of the specified reason.

Solution: Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

`353467 %s: CCR exception for %s table`

Description: libscdpm could not perform an operation on the CCR table specified in the message.

Solution: Check if the table specified in the message is present in the Cluster Configuration Repository (CCR). The CCR is located in /etc/cluster/ccr. This error could happen because the table is corrupted, or because there is no space left on the root file system to make any updates to the table. This message will mean that the Disk Path Monitoring daemon cannot access the persistent information it maintains about disks and their monitoring status. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`353557 Filesystem (%s) is locked and cannot be frozen`

Description: The file system has been locked with the _FIOLFS ioctl. It is necessary to perform an unlock _FIOLFS ioctl. The growfs(1M) or lockfs(1M) command may be responsible for this lock.

Solution: An _FIOLFS LOCKFS_ULOCK ioctl is required to unlock the file system.

`353566 Error %d from start_failfast_server`

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`353753 invalid mask in hosts list: %s`

Description: The allow_hosts or deny_hosts for the CRNP service contained an invalid mask. This error may prevent the cl_apid from starting up.

Solution: Remove the offending IP address from the allow_hosts or deny_hosts property, or fix the mask.

`353894 SCSLM write <%s> error <%s>`

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`354400 Function: validate: The Instance_number property %s is not a two-digit string`

Description: The instance_number must be a two-digit string.

Solution: Specify a valid SAP instance_number.

`354821 Attempting to start the fault monitor under process monitor facility.`

Description: The function is going to request the PMF to start the fault monitor. If the request fails, refer to the syslog messages that appear after this message.

Solution: This is an informational message, no user action is required.

`355188 dpm_timeout_io: wait for I/O probe to start, path = %s, cond_timedwait() returns %d`

Description: Self explanatory.

Solution: No action required.

`355663 Failed to post event %lld: %s`

Description: The cl_eventd was unable to post an event to the sysevent queue locally, and will not retry.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`355950 HA: unknown invocation result status %d`

Description: An invocation completed with an invalid result status.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`356110 The SPI 0x%x for dst %s does not have Idle timeout defined. IPsec Session Failover cannot be provided for the SA. Please update the SA with idle timeout`

Description: The syncsa server daemon encountered an SA for a serviced IP address with idle timeout value not defined. Idle timeout value is required to provide IPsec Session Failover for the client.

Solution: Update the SA with idle timeout value defined.

`356795 CMM: Reconfiguration step %d was forced to return.`

Description: One of the CMM reconfiguration step transitions failed, probably due to a problem on a remote node. A reconfiguration is forced assuming that the CMM will resolve the problem.

Solution: This is an informational message, no user action is needed.

`356930 Property %s is empty. This property must be specified for scalable resources.`

Description: The value of the specified property must not be empty for scalable resources.

Solution: Use clresource to specify a non-empty value for the property.

`357117 reservation notice(%s) - MHIOCSTATUS success during retry attempt: %d`

Description: Informational message from reserve on ioctl success during retry.

Solution: No user action required.

`357260 Could not stop derby data service monitor (resource: %s)`

Description: The monitor program of the derby data service could not stop. This should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`357263 munmap: %s`

Description: The rpc.pmfd server was not able to delete shared memory for a semaphore, possibly due to low memory, and the system error is shown. This is part of the cleanup after a client call, so the operation might have gone through. An error message is output to syslog.

Solution: Determine if the machine is running out of memory. If this is not the case, save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`357444 reservation fatal error - get_cluster_state() exception`

Description: The fencing subsystem was unable to obtain information about the state of the cluster.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis. It might be possible to retry the failed operation, depending on the nature of the error. If the message specifies the 'node_join' transition, then this node might be unable to access shared devices. If the failure occurred during the 'release_shared_scsi2' transition, then a node that was joining the cluster might be unable to access shared devices. In either case, it might be possible to reacquire access to shared devices by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group has failed to start on this node. If another node was available to host the device group, then it should have been started on that node. It might be possible to switch the device group to this node by using the cldevicegroup command. If another node is not available, then the device group will not be started. You can use the cldevicegroup command to retry the attempt to start the device group. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group has failed. You can retry the desired action.

`357511 reservation warning(%s) - MHIOCGRP_INKEYS error(%d) will retry in %d seconds`

Description: The device fencing program has encountered errors while trying to access a device. The failed operation will be retried

Solution: This is an informational message, no user action is needed.

`357635 Membership: In zone cluster '%s', node ID %d discovered that node ID %d and node ID %d are disconnected, and so node ID %d decides that node ID %d must go down because of '%s' rule.`

Description: A zone of a zone cluster discovered that the two specified zones of that zone cluster are disconnected from each other. According to the zone, one of those two zones must go down to achieve fully connected membership. The rule specified in the message was used to decide which of those two zones must go down; the rule can be : - Rebootee : A zone is booting/rebooting while the other was a member of the zone cluster membership already; the zone that is booting/rebooting must go down. - Node number : Among two zones, the zone with the higher node number/ID must go down.

Solution: Resolve the cause of the connection failure between the two zones.

`357959 Found another active instance of ifconfig proxy server. Exiting ifconfig_serverd.`

Description: The ifconfig server program found another active ifconfig program already in execution.

Solution: This is an information message. No user action is required.

`358206 clcomm: solaris xdoor: Got zone cluster id %d instead of %d for zone %s`

Description: Zone cluster id information that has been passed does not match the client credentials.

Solution: Someone has tampered with Oracle Solaris Cluster code. This is a security violation. Shut down the identified zone.

`358404 Validation failed. PASSWORD missing in CONNECT_STRING`

Description: PASSWORD is missing in the specified CONNECT_STRING. The format could be either 'username/password' or '/' (if operating system authentication is used).

Solution: Specify CONNECT_STRING in the specified format.

`358533 Invalid protocol is specified in %s property.`

Description: The specified system property does not have a valid protocol.

Solution: Using clnode, change the value of the property to use a valid protocol. For example: TCP, UDP.

`359013 cl_execd: Unable to create thread in the worker process. Exiting.`

Description: cl_execd program has encountered a failed thr_create(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`359970 zc_rgm_halt for zone %s: Could not get hostname of this zone. Exiting.`

Description: zc_rgm_halt could not get the hostname of the zone going down. Hence zc_rgm_halt will not be able to evacuate resource groups for this zone which belongs to a zone cluster. Support for this zone cluster might not work properly.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`360349 %s: sigemptyset(3C): %s`

Description: The pmmd daemon was unable to initialize a signal set because the sigemptyset(3C) function failed. The message contains the system error. The pmmd daemon will not do the requested action.

Solution: Save a copy of the /var/adm/messages files on this node, and report the problem to your authorized Oracle service provider.

`360363 Validation failed. Resource group property RG_AFFINITIES should specify a STRONG POSITIVE affinity (++) with the SCALABLE resource group containing the RAC framework resource.`

Description: The resource being created or modified must belong to a resource group that has a strong positive affinity with the scalable resource group containing the RAC framework resource.

Solution: If not already created, create the scalable resource group containing the RAC framework resource and its associated resources. Specify a strong positive (++) affinity with the scalable resource group containing the RAC framework resource by using RG_AFFINITIES property of the resource group.

`360416 Needed Oracle Solaris Cluster nodes are online, continuing with database start.`

Description: All the Oracle Solaris Cluster nodes needed to start the database are running the resource.

Solution: This is an informational message, no user action is needed.

`360567 fillCacheNative: scha_status %d: %s`

Description: Failed to retreive the resource type information.

Solution: Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`360923 contract_open: %s`

Description: The libclcontract code was unable to retrieve the status of the newly created process template. The libclcontract code will kill the newly forked process because the process using the libclcontract code is unable to monitor the forked process.

Solution: If the message is isolated, it was probably a transient error. Retry the requested action. If there are many instances of the message, there is a problem with the contract file system. Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

`361048 ERROR: rgm_run_state() returned non-zero while running boot methods`

Description: The rgmd state machine has encountered an error on this node.

Solution: Look for preceding syslog messages on the same node, which may provide a description of the error.

`361056 [PID %d] Bad data sent by proxy event listener daemon`

Description: The proxy event listener daemon send bad data to the specified process.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`361447 Failed to get the list of adapters for the zone cluster %s, error = %d`

Description: There was a failure to get the list of adapters configured to be used for the zone cluster.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`362630 Failed to open the file %s : %s`

Description: The zone boot handler failed to open the specified file.

Solution: Check for the possible reasons for open failure and reboot the node after rectify the problem.

`362657 Error when sending response from child process: %m`

Description: Error occurred when sending message from fault monitor child process. Child process will be stopped and restarted.

Solution: If error persists, then disable the fault monitor and resport the problem.

`362719 Resource group load factors for limit <%s> on node <%s> total <%d>: exceeds the soft limit <%d>`

Description: The sum of the resource group load factors for the specified load limit on the given node has moved above the configured soft load limit.

Solution: This is an informational message; no action is required. If there is sufficient spare capacity on other nodes, you can use the "switch" or "remaster" subcommand of clresourcegroup(1CL) to relocate one or more resource groups from the indicated node onto other nodes.

`362957 Oracle Solaris Cluster boot: reset vote returns $res`

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`363357 Failed to unregister callback for IPMP group %s with tag %s (request failed with %d).`

Description: An unexpected error occurred while trying to communicate with the network monitoring daemon (cl_pnmd).

Solution: Make sure the network monitoring daemon (cl_pnmd) is running.

`363435 zccfg_get_brand: %s`

Description: Failed to get brand information

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`363696 Error: unable to bring Resource Group <%s> ONLINE, because the Resource Groups <%s> for which it has a strong positive affinity are not online.`

Description: The rgmd is enforcing the strong positive affinities of the resource groups. This behavior is normal and expected.

Solution: No action required. If desired, use clresourcegroup to change the resource group affinities.

`364067 UNRECOVERABLE ERROR: Oracle Solaris Cluster boot: Could not initialize cluster framework`

Description: Internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`364188 Validation failed. Listener_name not set`

Description: 'Listener_name' property of the resource is not set. HA-Oracle will not be able to manage Oracle listener if Listener name is not set.

Solution: Specify correct 'Listener_name' when creating resource. If resource is already created, please update resource property.

`364387 dl_attach: bad ACK header %u`

Description: Could not attach to the physical device. We are trying to open a fast path to the private transport adapters.

Solution: Reboot of the node might fix the problem.

`364618 getzoneid() failed. Unable to verify privilege.`

Description: The validate method for the SUNW.nfs service was unable to query the zoneid of the zone where it was launched into.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`364735 No PMF tag registered for the telemetry data service monitor`

Description: The monitor program of the telemetry data service does not seem to be registered with the PMF. This should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`364774 The entry in vfstab for mount point '%s' exceeds %d characters.`

Description: The internal buffer size of the vfstab entry for the specified mount point has exceeded VFS_LINE_MAX characters.

Solution: Shorten the vfstab entry for that mount point so that the length of the entry does not exceed VFS_LINE_MAX characters. You can shorten the vfstab entry by reducing the length of, for example, the block device, character device, or mount point.

`364782 [PID %d] atexit(3C) failed : error %d`

Description: The cluster events listener library in this specified process could not register a function to be called on exit, because atexit(3C) failed. The specified process will exit now.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`365287 Error detected while parsing -> %s`

Description: This message shows the line that was being parsed when an error was detected.

Solution: Please ensure that all entries in the custom monitor action file are valid and follow the correct syntax. After the file is corrected, validate it again to verify the syntax.

`365747 Derby data service stop method completed successfully`

Description: The derby data service stopped successfully.

Solution: This message is informational; no user action needed.

`365980 Wrong number of parameters for check_properties`

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`366225 Listener %s stopped successfully`

Description: Informational message. HA-Oracle successfully stopped Oracle listener.

Solution: None

`366368 Failed to retrieve netmask for %s - will use default classful netmask`

Description: Netmask for the given IP address is not found in name service. Classful netmask will be used.

Solution: Add netmask for the given subnet to the local /etc/netmasks file or add it to the name server specified in /etc/nsswitch.conf.

`366403 run_query_device(): Out of memory`

Description: Self explanatory.

Solution: Determine why the user program ran out of memory. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`366803 %s: Unable to set automatic MT mode.`

Description: This program could not set automatic MT mode.

Solution: Save the contents of /var/adm/messages from all nodes and contact your Oracle service representative for assistance in diagnosing and correcting the problem.

`366846 Domain %s started.`

Description: The domain was started successfully.

Solution: None required. Informational message.

`367077 Failfast: timeout - unit "%s"%s"%s.`

Description: A failfast client has encountered a timeout and is going to panic the node or zone.

Solution: There might be other related messages on this node that can help diagnose the problem. Resolve the problem and reboot the node or zone if the node or zone panic is unexpected.

`367417 Could not put the prop %s of svc %s, in the repository: %s`

Description: Problem in creating memory space during resource management of SMF delegated restarter

Solution: Check the system memory usage

`367550 start_app_server - psadmin -c parallelboot -d %s failed with return code %s`

Description: psadmin -c parallelboot -d ${Psft_Domain} failed to start.

Solution: Ensure that you can manually start the domain that is configured for Psft_Domain as the user that is configured for Psft_User. Verify the PeopleSoft Enterprise application server domain configuration.

`367864 svc_init failed.`

Description: The rpc.pmfd server was not able to initialize server operation. This happens while the server is starting up, at boot time. The server does not come up, and an error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`368013 validate_dependency_set - This resource (%s) has not set resource_dependencies_offline_restart=%s`

Description: This resource is missing a resource_dependencies_offline_restart entry against another resource.

Solution: Ensure that resource_dependencies_offline_restart is set.

`368138 Function: validate: TRY_RECONNECT is not numeric or 0`

Description: In the parameter file, there is a non numeric character in the value for the TRY_RECONNECT variable.

Solution: Fix the TRY_RECONNECT variable in the parameter file.

`368373 %s is locally mounted. Unmounting it.`

Description: HAStoragePlus found the specified mount point mounted as a local file system. It will unmount it, as asked for.

Solution: This is an informational message, no user action is needed.

`368456 Invalid global device path %s detected for mount point %s.`

Description: The specified global device path is not valid.

Solution: Check the path and correct the entry with a valid global device path.

`368529 Dual-partition upgrade state prevents booting into cluster mode.`

Description: Dual-partition cluster upgrade is in progress. Until the upgrade is completed, you can boot the node only into noncluster mode.

Solution: Boot the node into noncluster mode (boot -x). Then continue with the upgrade.

`368596 libsecurity: program %s (%lu); unexpected getnetconfigent error`

Description: A client of the specified server was not able to initiate an rpc connection, because it could not get the network information. The pmfadm or scha command exits with error. An error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`369728 Taking action specified in Custom_action_file.`

Description: Fault monitor detected an error specified by the user in a custom action filer. This message indicates that the fault monitor is taking action as specified by the user for such an error.

Solution: This is an informational message.

`370604 This resource depends on a HAStoragePlus resouce that is in a different Resource Group. This configuration is not supported.`

Description: The resource depends on a HAStoragePlus resource that is configured in a different resource group. This configuration is not supported.

Solution: Please add this resource and the HAStoragePlus resource in the same resource group.

`370743 clq_scsi3: Ioctl MHIOCGRP_PREEMPTANDABORT returned failure (error = %d) for quorum device %s Key = %llx`

Description: The ioctl to scrub keys from the specified quorum device failed. This is unexpected behavior from the device driver, multipathing driver or device firmware.

Solution: Use a different device as a quorum device.

`370750 The Failover_mode setting of %s for resource %s in resource group %s has blocked a resource %s attempt on %s`

Description: The rgmd is enforcing the RESTART_ONLY or LOG_ONLY value for the Failover_mode system property. Those settings may prevent some operations initiated by scha_control.

Solution: No action required. If desired, use clresourcegroup to change the Failover_mode setting.

`370949 created %d threads to launch resource callback methods; desired number = %d`

Description: The rgmd daemon was unable to create the desired number of threads upon starting up. This is not a fatal error, but it might cause RGM reconfigurations to take longer because it will limit the number of tasks that the rgmd can perform concurrently.

Solution: Make sure that the hardware configuration meets documented minimum requirements. Examine other syslog messages on the same node to see if the cause of the problem can be determined.

`371681 Derby data service monitor successfully stopped (resource: %s)`

Description: The monitor program of the derby data service stopped successfully.

Solution: This message is informational; no user action needed.

`371800 Unable to export zpool " %s " due to EBUSY error. Retrying...`

Description: Self explanatory.

Solution: This is an informational message, no user action is needed.

`372272 HAStoragePlus failed to export the ZFS pools. You must manually export all ZFS pools by using the zpool(1M) command before you operate on the resource. Failing to do so might lead to ZFS pool corruption.`

Description: HAStoragePlus failed to export some of the ZFS pools managed by the resource.

Solution: Check the syslog message to find the ZFS pools that failed to export and try to export them manually. The resource must not be operated until the failed ZFS pools are exported successfully.

`372460 Failed to take DNS out of PMF control; trying to send SIGKILL now`

Description: Oracle Solaris Cluster failed to stop restarting the application.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`372618 Unable to extract the primary source IP address from the SCTP Cookie chunk.`

Description: Either the SCTP COOKIE-ACK packet does not contain a cookie in the right position or the cookie does not contain a primary client IP address.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`372887 HA: repl_mgr: exception occurred while invoking RMA`

Description: An unrecoverable failure occurred in the HA framework.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`372920 Validate_sbp - MySQL replication resource is not specified in option %s`

Description: The required mysql replication resource is not specified.

Solution: Make sure that the required resource is specified.

`373148 The port portion of %s at position %d in property %s is not a valid port.`

Description: The property named does not have a legal value. The position index, which starts at 0 for the first element in the list, indicates which element in the property list was invalid.

Solution: Assign the property a legal value.

`373515 could not create server main door : %s`

Description: The proxy event listener daemon could not create a door because door_create(3DOOR) failed for the specified reason.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`373816 clcomm: copyinstr: max string length %d too long`

Description: The system attempted to copy a string from user space to the kernel. The maximum string length exceeds length limit.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`374006 prog <%s> failed on step <%s> retcode <%d>`

Description: ucmmd step failed on a step.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified and if it recurs. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance.

`374839 Failfast : Fair share class not configured in this system`

Description: Fair share scheduling class is not configured in this system, but a task needs to run in fair share scheduling class.

Solution: Configure fair share priority class for the system.

`375331 dl_bind: DL_BIND_ACK protocol error`

Description: Could not bind to the physical device. We are trying to open a fast path to the private transport adapters.

Solution: Reboot of the node might fix the problem.

`375416 metaset -o returned (%d). %s not owner`

Description: The node is not the owner of the metaset.

Solution: Determine why the node is not the owner of the metaset. Examine the output from metaset. Determine whether the SUNW.vucmm_framework resource and either the SUNW.vucmm_svm resource or the SUNW.vucmm_cvm resource are online. Or in legacy mode, determine whether the SUNW.rac_framework resource and either the SUNW.rac_svm resource or the SUNW.rac_cvm resource are online.

`375575 Devicegroup (%s) not healthy!`

Description: The volume is not available.

Solution: Determine the status of the disk set or disk group and the volume. For Solaris Volume Manager for Sun Cluster volumes, run 'metastat -s'. For Veritas Volume Manager volumes, run 'vxprint'.

`375584 Unexpected signal %d.`

Description: The cl_eventlogd daemon has received a signal, possibly caused by an operator-initiated kill(1) command. The signal is ignored.

Solution: This message is informational only, and does not require user action.

`375650 Function: val_parfile - %s not specified in %s, which is required`

Description: The referenced necessary parameter is not mentioned in the parameter file.

Solution: Specify the parameter as a key value pair in the parameter file.

`376111 Unable to compose %s path. Sending SIGKILL now.`

Description: The STOP method was not able to construct the applications stop command. The STOP method will send SIGKILL to stop the application.

Solution: Other messages will indicate what the underlying problem was such as no memory or a bad configuration.

`376118 Interface name %s too long`

Description: Cluster cannot generate a callback for the RDS module. Operation of RDS sockets might be affected.

Solution: If Reliable Datagram Sockets (RDS) is used by applications running on this cluster, contact your Oracle service representative to determine if a workaround or patch is available.

`376596 Property "%s" should be of the form <filer name>:<absolute path to exported directory>`

Description: The form of the TargetFileSystem property is incorrect. For an NFS file system that is exported from a NAS device, the value of the property TargetFileSystem must begin with the NAS device name, followed by a colon (:) and the full path to the directory that the device is exporting.

Solution: Correct the value of the property and repeat the operation.

`376714 sysevent_bind_handle() failed : %s`

Description: The proxy event listener daemon could not bind with the Solaris sysevents framework because sysevent_bind_handle(3SYSEVENT) failed. Hence, the daemon will not receive any cluster event notifications.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`376723 Error: unable to bring resource group <%s> ONLINE, because one or more resource groups with a strong negative affinity for it are in an error state.`

Description: The rgmd is unable to bring the specified resource group online on the local node, because one or more resource groups related to it by strong negative RG affinities are in STOP_FAILED error state.

Solution: Find the errored resource groups and resources by using "clresourcegroup status" and "clresource status". Clear the STOP_FAILED error states by using "clresource clear". Use ps(1) or application-specific commands to make sure that the resource has stopped completely; kill resource-related processes if necessary.

`376861 Migration of domain %s timed out, the domain state is now shut off.`

Description: The domain migration or live migration timed out.

Solution: None required. Informational message.

`376905 Failed to retrieve WLS extension properties.Will shutdown the WLS using sigkill`

Description: Failed to retrieve the WLS exension properties that are needed to do a smooth shutdown. The WLS stop method however will go ahead and kill the WLS process.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`376974 Error in initialization; exiting.`

Description: The cl_apid was unable to start-up. There should be other error message with more detailed explanations of the specific problems.

Solution: Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`377035 The path name %s associated with the FilesystemCheckCommand extension property is not a regular file.`

Description: HAStoragePlus found that the specified file was not a plain file, but of different type (directory, symbolic link, etc.).

Solution: Correct the value of the FilesystemCheckCommand extension property by specifying a regular executable.

`377347 CMM: Node %s (nodeid = %ld) is up; new incarnation number = %ld.`

Description: The specified node has come up and joined the cluster. A node is assigned a unique incarnation number each time it boots up.

Solution: This is an informational message, no user action is needed.

`377483 Creation of resource <%s> failed because the inter-cluster offline-restart dependencies could not be set`

Description: Resource creation failed due to specification of invalid inter cluster dependencies.

Solution: Check the remote cluster name or remote resource name and retry the same command.

`377604 Admin Disable has been called. The stop method of the service %s will be called and outcome is unknown. For proper functioning of the resource, disable the resource before continuing`

Description: This message is produced when the user does "svcadm disable". Manual "disabling" of a service is not encouraged once the service is under control of sc_restarter.

Solution: Check for the validity and the states of resource and services. Contact your Oracle service provider for more information.

`377807 ucmmd unable to register for upgrade callbacks with version manager: %s`

Description: An exception was raised when ucmmd tried to register for upgrade callbacks with the Version Manager.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`378360 Validate - DHCP directory %s does not exist`

Description: The DHCP resource could not validate that the DHCP directory defined in the /etc/inet/dhcpsvc.conf file for the PATH variable exists.

Solution: Ensure that /etc/inet/dhcpsvc.conf has the correct entry for the PATH variable by configuring DHCP appropriately, i.e. as defined within the Oracle Solaris Cluster Data Service for DHCP.

`378427 prog <%s> step <%s> terminated due to receipt of signal`

Description: ucmmd step terminated due to receipt of a signal.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified and if it recurs. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance.

`378772 Failed to register configuration callbacks for zone cluster private network monitoring daemon`

Description: The zc_monitor daemon was unable to register for configuration callbacks.

Solution: These callbacks are used for adding nodes or changing monitoring timeout and quantum while the zone cluster is running. These features will be unavailable. To recover, it might be necessary to reboot this node or the entire cluster. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`378872 %s operation failed : %s.`

Description: Specified system operation could not complete successfully.

Solution: This is as an internal error. Contact your authorized Oracle service provider with the following information. 1) Saved copy of /var/adm/messages file. 2) Output of "ifconfig -a" command.

`379098 Request to mount QFS file systems returned successfully.`

Description: This is a notification from the handler that the request to RGM to mount the shared qfs file systems returned without failure.

Solution: This is an informational message; no user action is needed.

`379132 devfsadm successfully configured DID`

Description: devfsadm command successfully configured DID devices.

Solution: This is an informational message, no user action is needed.

`379450 reservation fatal error(%s) - fenced_node not specified`

Description: The device fencing program has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available. Copies of /var/adm/messages from all nodes should be provided for diagnosis. It may be possible to retry the failed operation, depending on the nature of the error. If the message specifies the 'node_join' transition, then this node may be unable to access shared devices. If the failure occurred during the 'release_shared_scsi2' transition, then a node which was joining the cluster may be unable to access shared devices. In either case, it may be possible to reacquire access to shared devices by executing '/usr/cluster/lib/sc/run_reserve -c node_join' on all cluster nodes. If the failure occurred during the 'make_primary' transition, then a device group has failed to start on this node. If another node was available to host the device group, then it should have been started on that node. If desired, it might be possible to switch the device group to this node by using the cldevicegroup command. If no other node was available, then the device group will not have been started. You can use the cldevicegroup command to retry the attempt to start the device group. If the failure occurred during the 'primary_to_secondary' transition, then the shutdown or switchover of a device group has failed. The desired action may be retried.

`379568 Failed to resolve CCR directory from the Nameserver`

Description: The PNM proxy daemon could not get a reference to the CCR.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`379627 ct_pr_event_get_ppid: %s`

Description: The rpc.pmfd was unable to retrieve the parent pid from a contract event. The rpc.pmfd will continue to monitor the process, but the rpc.pmfd may have missed an event of interest.

Solution: Search for other syslog error messages on the same node. Save a copy of the /var/adm/messages files on all nodes, and report the problem to your authorized Oracle service provider.

`380088 clq_sq_disk: Preempted from quorum device %s.`

Description: Unable to locate this node's registration key on the quorum device. This node might have been preempted by another node. Because this node was expelled from the cluster, the node now halts.

Solution: Correct the problem that caused the node to be expelled from the cluster. The most common cause is a network communication failure between this node and other members of the cluster. After completing repairs, reboot the node back into the cluster.

`380317 Failed to verify that all IPMP groups are in a stable state. Assuming this node cannot respond to client requests.`

Description: The state of the IPMP groups on the node could not be determined.

Solution: Make sure all adapters and cables are working. Look in the /var/adm/messages file for message from the network monitoring daemon (cl_pnmd).

`380785 door_call: %s; will not retry`

Description: The door_call failed with the specified reason.

Solution: No action necessary.

`380939 SCSLM scslm_init pthread_create error <%s>`

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`381244 in libsecurity mkdir of %s failed: %s`

Description: The rpc.pmfd, rpc.fed or rgmd server was not able to create a directory to contain "cache" files for rpcbind information. The affected component should still be able to function by directly calling rpcbind.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`381386 Prog <%s> step <%s>: unkillable.`

Description: The specified callback method for the specified resource became stuck in the kernel, and could not be killed with a SIGKILL. The UCMM reboots the node to prevent the stuck node from causing unavailability of the services provided by UCMM.

Solution: No action is required. This is normal behavior of the UCMM. Other syslog messages that occurred just before this one might indicate the cause of the method failure.

`381577 getzonenamebyid failed in security_svc_reg.`

Description: The getzonenamebyid(3C) operation failed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`382169 Share path name %s not absolute.`

Description: A path specified in the dfstab file does not begin with "/"

Solution: Only absolute path names can be shared with HA-NFS.

`382252 Share path %s: file system %s is not mounted.`

Description: The specified file system, which contains the share path specified, is not currently mounted.

Solution: Correct the situation with the file system so that it gets mounted.

`382343 %s: Not root.`

Description: A user other than root attempted to run this program.

Solution: If this error occurred during normal operation, save the contents of /var/adm/messages from all nodes and contact your Oracle service representative for assistance in diagnosing and correcting the problem.

`382460 Failed to obtain SAM-FS constituent volumes from mount point %s: %s.`

Description: HAStoragePlus was not able to determine the volumes that are part of this SAM-FS file system.

Solution: Check the SAM-FS file system configuration. If the problem persists, contact your authorized Oracle service provider.

`382666 cl_execd: Error %d from pipe`

Description: cl_execd program has encountered a failed pipe(2) system call. The error message indicates the error number for the failure.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`382995 ioctl in negotiate_uid failed`

Description: Call to ioctl() failed. The "ioctl" man page describes possible error codes. ucmmd will exit and the node will abort.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`383040 Failed to map adapter %s to an IPMP group, error = %d`

Description: There was an error while attempting to map an adapter to an IPMP group.

Solution: This is an informational message. No action is required.

`383045 dl_bind: bad ACK header %u`

Description: An unexpected error occurred. The acknowledgment header for the bind request (to bind to the physical device) is bad. We are trying to open a fast path to the private transport adapters.

Solution: Reboot of the node might fix the problem.

`383264 Function: validate - %s configured with address %s, please remove the address using zonecfg`

Description: There is an IP address conflict between the SUNW.LogicalHostname resource and the configured zone.

Solution: Remove the IP address from the zones configuration with the zonecfg command.

`383706 NULL value returned for the resource property %s.`

Description: NULL value was specified for the extension property of the resource.

Solution: For the property name check the syslog message. Any of the following situations might have occurred. Different user action is needed for these different scenarios. 1) If a new resource is created or updated, check whether the value of the extension property is empty. If it is, provide a valid value by using clresource. 2) For all other cases, treat it as an Internal error. Contact your authorized Oracle service provider.

`383767 scha_cluster_close failed with %d`

Description: Call to close the cluster information handle failed. The second part of the message gives the error code.

Solution: There could be other related error messages which might be helpful. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`384138 Failed to stop fault monitor`

Description: An error prevented a resource's fault monitor from stopping.

Solution: Determine why the fault monitor process could not be stopped. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`384373 Failed to save old zpools.`

Description: The online update of the HAStoragePlus resource is not successful because of failure in saving the old zpools that were present before updating the resource.

Solution: Check the syslog messages and try to resolve the problem. Try again to update the resource. If the problem persists, contact your authorized Oracle service provider.

`384549 CCR: Could not backup the CCR table %s errno = %d.`

Description: The indicated error occurred while backing up indicated CCR table on this node. The errno value indicates the nature of the problem. errno values are defined in the file /usr/include/sys/errno.h. An errno value of 28(ENOSPC) indicates that the root file system on the indicated node is full. Other values of errno can be returned when the root disk has failed(EIO) or some of the CCR tables have been deleted outside the control of the cluster software(ENOENT).

Solution: There may be other related messages on this node, which may help diagnose the problem, for example: If the root file system is full on the node, then free up some space by removing unnecessary files. If the root disk on the afflicted node has failed, then it needs to be replaced. If the indicated CCR table was accidently deleted, then boot this node in -x mode to restore the indicated CCR table from other nodes in the cluster or backup. The CCR tables are located at /etc/cluster/ccr/. Contact your authorized Oracle service provider for assistance.

`384621 RDBMS probe successful`

Description: This message indicates that Fault monitor has successfully probed the RDBMS server

Solution: No action required. This is informational message.

`384651 Proxy monitor not running (%d)`

Description: The Monitor of a resource of type SUNW.scalable_rac_server_proxy is not running.

Solution: None required. Informational message.

`385026 asm_proxy_daemon - failed to determine named pipe (%s) elapsed time`

Description: Failed to determine the elapsed time for the named pipe.

Solution: Check the syslog for further messages.

`385176 Ifconfig proxy : Unexpected signal, Exiting.`

Description: The ifconfig proxy program got an unexpected signal and is exiting.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`385215 Zone Cluster membership manager not found. Node Id %d Incn %lu is unreachable`

Description: Unable to locate the Zone Cluster Membership Manager. Remote node unreachability can not be notified.

Solution: Contact your Oracle service representative to determine if a workaround or patch is available.

`385407 t_alloc (open_cmd_port) failed with errno%d`

Description: Call to t_alloc() failed. The "t_alloc" man page describes possible error codes. ucmmd will exit and the node will abort.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`385550 Can't setup binding entries from node %d for GIF node %d`

Description: Failed to maintain client affinity for some sticky services running on the named server node due to a problem on the named GIF node. Connections from existing clients for those services might go to a different server node as a result.

Solution: If client affinity is a requirement for some of the sticky services, say due to data integrity reasons, switchover all global interfaces (GIFs) from the named GIF node to some other node.

`385589 Zone Cluster membership manager not found. Node Id %d Incn %lu is reachable`

Description: Unable to get reference to Zone Cluster Membership Manager. Remote node reachability can not be notified.

Solution: Contact your Oracle service representative to determine if a workaround or patch is available.

`385655 reservation fatal error(%s) - Unable to retrieve DID device information`

Description: The device fencing program has suffered an internal error.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`385803 Nodelist must contain an even number of nodes.`

Description: The HADB resource must be configured to run on an even number of Oracle Solaris Cluster nodes.

Solution: Recreate the resource group and specify an even number of Oracle Solaris Cluster nodes in the nodelist.

`385864 scha_resource_get_zone() failed to retrieve the resource property %s of %s: %s.`

Description: Failed to retrieve the specified property of a resource.

Solution: Check the syslog messages around the time of the error for messages indicating the cause of the failure. If this error persists, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`385866 Function: validate: Directory %s does not contain the MySQL Cluster ndbd configuration file`

Description: A directory is specified in the DATA_DIR variable which does not contain a my.cnf file.

Solution: Specify a directory in the DATA_DIR variable in the parmeter file, which contains the my.cnf file.

`385902 pmf_search_children: Error signaling <%s>: %s`

Description: An error occured while rpc.pmfd attempted to send a signal to one of the processes of the given tag. The reason for the failure is also given. The signal was sent to the process as a result of some event external to rpc.pmfd. rpc.pmfd "intercepted" the signal, and is trying to pass the signal on to the monitored process.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`385991 monitor_check: fe_method_full_name() failed for resource <%s>, resource group <%s>, node <%s>`

Description: During execution of a scha_control(1HA,3HA) function, the rgmd daemon was unable to assemble the full method pathname for the MONITOR_CHECK method. This is considered a MONITOR_CHECK method failure. This in turn will prevent the attempted failover of the resource group from its current master to a new master.

Solution: Examine other syslog messages occurring at about the same time to see if the problem can be identified. Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`386072 chdir: %s`

Description: The rpc.pmfd server was not able to change directory. The message contains the system error. The server does not perform the action requested by the client, and an error message is output to syslog.

Solution: Save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`386110 The client (OracleExternalProxy) process has failed, requesting a PMF restart.`

Description: The client (OracleExternalProxy) process has failed.

Solution: None. A PMF restart will be performed and you can ignore the error message. If the problem persists, contact Oracle support.

`386282 ccr_initialize failure`

Description: An attempt to start the scdpmd failed.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`386327 Stop Startup script using pmfadm failed. tag %s error=%s`

Description: The agent's attempt to stop a previous instance startup instruction that was issued to it failed.

Solution: Contact your Oracle support representative for further assistance.

`386333 SCSLM <%s> meth 0x%x with running 0x%x`

Description: Should never occur.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`386842 set_scproxy_resource - Oracle Grid Infrastructure resource %s has ACTION_SCRIPT=%s which is incorrect.`

Description: The Oracle Grid Infrastructure resource sun.<resource> ACTION_SCRIPT attribute value is incorrect.

Solution: You must set the ACTION_SCRIPT attribute for the Oracle Grid Infrastructure resource, sun.<resource>, equal to <basedir>/SUNWscor/dsconfig/bin/scproxy_crs_action. Note that <resource> represents the Oracle Solaris Cluster SUNW.ScalDeviceGroup resource name and <basedir> is typically /opt. Refer to the Oracle Solaris Cluster documentation for information on how to do this.

`387003 CCR: CCR metadata not found.`

Description: The CCR is unable to locate its metadata.

Solution: Boot the offending node in -x mode to restore the indicated table from backup or other nodes in the cluster. The CCR tables are located at /etc/cluster/ccr/. Contact your authorized Oracle service provider for assistance.

`387232 resource %s monitor enabled.`

Description: This is a notification from the rgmd that the operator has enabled monitoring on a resource. This message can be used by system monitoring tools.

Solution: This is an informational message; no user action is needed.

`387288 clcomm: Path %s online`

Description: A communication link has been established with another node.

Solution: No action required.

`387361 [PID %d] Could not get event listener door handle : status %d, error %s`

Description: The specified process could not get to the door of the proxy event listener daemon.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`388195 scf_handle_create failed: %s`

Description: An API call failed.

Solution: Examine log files and syslog messages to determine the cause of the failure. Take corrective action based on any related messages. If the problem persists, report it to your Oracle support representative for further assistance.

`388501 Error while unbinding 'ifconfig_proxy_server' in the name server. Exiting.`

Description: The ifconfig proxy program could not register the corba object in the nameserver.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`388555 Usage: %s [-c|-u] -R <resource-name> -T <type-name> -G <group-name> [-r <sys_def_prop>=<value> ...] [-x <ext_prop>=<value> ...] [-Z <zone-name>]`

Description: Incorrect arguments are passed to the callback method of a cluster data service agent.

Solution: This error might occur while developing and testing a new agent, if a method is manually invoked with incorrect command line arguments. If seen on a production cluster, this message indicates an internal error. Contact your authorized Oracle service provider for assistance in diagnosing and correcting the problem.

`388645 Failed to open the configuration file %s : %s.`

Description: The zone handler failed to open the specified configuration file.

Solution: Check for the error message and rectify the problem.

`389231 clcomm: inbound_invo::cancel:_state is 0x%x`

Description: The internal state describing the server side of a remote invocation is invalid when a cancel message arrives during processing of the remote invocation.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`389239 validate - The resource_project_name for %s (%s) must match the setting for the OPMN resource %s (%s).`

Description: The resource_project_name property value does not match the setting for the OPMN resource on which this resource depends. These must be identical because the Oracle HTTP server is started by OPMN.

Solution: Set the resource_project_name property to the correct value.

`389372 argv[%d] = %s`

Description: Argument values.

Solution: Save a copy of the /var/adm/messages files on all nodes and contact your authorized Oracle service provider for assistance in diagnosing the problem.

`389516 NULL value returned for the extension property %s.`

Description: NULL value was specified for the extension property of the resource.

Solution: For the property name check the syslog message. Any of the following situations might have occurred. Different user action is needed for these different scenarios. 1) If a new resource is created or updated, check whether the value of the extension property is empty. If it is, provide a valid value by using clresource. 2) For all other cases, treat it as an Internal error. Contact your authorized Oracle service provider.

`390130 Failed to allocate space for %s.`

Description: An internal error has occurred.

Solution: Save a copy of the /var/adm/messages files on all nodes. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`390212 Core files in ${SCCOREDIR}: ${CORES_FILES}`

Description: One of the daemon launched by /etc/init.d/bootcluster script has core dumped.

Solution: Provide core dumps to your authorized Oracle service provider. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`390515 Function: validate - %s (%s) already in use on %s:%s for %s, please resolve this conflict`

Description: The logical host is used in another zone already. A logical host can not be used in two zones at the same time.

Solution: Resolve the conflicting IP address configuration for your zones.

`391177 Failed to open %s: %s.`

Description: HA Storage Plus failed to open the specified file.

Solution: Check the system configuration. If the problem persists, contact your authorized Oracle service provider.

`391240 RAC server %s is not running. Manual intervention is required.`

Description: The the fault monitor for the RAC server instance has identified that the instance is no longer running. The fault monitor does NOT attempt to restart or failover the resource or resource group.

Solution: The cause of the instance failure should be investigated, and once rectified, the RAC server instance should be restarted.

`391244 Function: validate: The instance %s is uncovered by the ORCL.sapcentr resources in the Resource_dependencies_offline_restart property of %s`

Description: The instance number is uncovered by a ORCL.sapcentr resource in the offline restart dependencies properties.

Solution: Specify a list of valid central services resources in the resource_dependencies_offline_restart property which covers all profiles in the ENQ_INSTNR property.

`391502 Database is still running after %d seconds. Selecting new Sun Cluster node to run the stop command.`

Description: The database is still running but the resource on the Oracle Solaris Cluster node that was selected to run the hadbm stop command is now offline, possibly because of an error while running the hadbm command. A different Oracle Solaris Cluster node will be selected to run the hadbm stop command again.

Solution: This is an informational message, no user action is needed.

`391994 For resource_security value <%s>, the executable path %s is insecure because it is owned or writable by a non-root user.`

Description: The specified executable file path is insecure because it is owned or writable by a non-root user.

Solution: Please check the file permissions or owner.

`392288 Unmounting the file systems is completed successfully.`

Description: Self explanatory.

Solution: This is an informational message, no user action is needed.

`392455 Directory %s is not owned by group (GID) %d`

Description: The directory is not owned by the gid which is listed in the message.

Solution: Set the permissions on the directory so that it is owned by the gid which is listed in the message.

`392732 No suitable adapter is authorized to be used with resource %s on zone cluster %s.`

Description: There is no adapter found on this system that is authorized to be used for this zone cluster.

Solution: Use the clzonecluster(1M) command to configure the adapters to be used for this zone cluster and run the command to create the resource.

`392782 Failed to retrieve the property %s for %s: %s.`

Description: API operation has failed in retrieving the cluster property.

Solution: For property name, check the syslog message. For more details about API call failure, check the syslog messages from other components.

`392998 Fault monitor probe response time exceeded timeout (%d secs). The timeout for subsequent probes will be temporarily increased by 10%%`

Description: The time taken for the last fault monitor probe to complete was greater than the resource's configured probe timeout, so a timeout error occurred. The timeout for subsequent probes will be increased by 10% until the probe response time drops below 50% of the timeout, at which point the timeout will be reduced to it's configured value.

Solution: The database should be investigated for the cause of the slow response and the problem fixed, or the resource's probe timeout value increased accordingly.

`393382 DNS successfully stopped`

Description: The STOP method for DNS for was successful.

Solution: No action needed.

`393487 The file system associated with mount point %s will be locally mounted in zone cluster %s. Local file systems cannot be specified with scalable service resources.`

Description: HAStoragePlus detected an inconsistency in its configuration: the resource group has been specified as scalable; therefore, local file systems cannot be specified in the FilesystemMountPoints extension property.

Solution: Correct either the resource group type or remove the local file system from the FilesystemMountPoints extension property.

`393552 Insufficient memory.`

Description: There is not enough memory available.

Solution: Lack of memory might lead to other problems. You must free up memory on the node or add more memory to the system. If that does not resolve the problem, contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`393957 Failed to read mount point on local node`

Description: During dual-partition upgrade in a live upgrade scenario, the mount point information is not present.

Solution: Refer to documentation about recovering from a failed dual-partition upgrade in a live upgrade scenario.

`393960 sigaction failed in set_signal_handler`

Description: The ucmmd has failed to initialize signal handlers by a call to sigaction(2). The error message indicates the reason for the failure. The ucmmd will produce a core file and will force the node to halt or reboot to avoid the possibility of data corruption.

Solution: Save a copy of the /var/adm/messages files on all nodes and of the ucmmd core. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`394325 Received notice that IPMP group %s has failed.`

Description: The status of the named IPMP group has become degraded. If possible, the scalable resources currently running on this node with monitoring enabled will be relocated off of this node, if the IPMP group stays in a degraded state.

Solution: Check the status of the IPMP group on the node. Try to fix the adapters in the IPMP group.

`394476 Failed to retrieve property %s: %s`

Description: There was an error retrieving a resource property.

Solution: Investigate possible RGM, DSDL errors. Contact your authorized Oracle service provider for assistance in diagnosing the problem.

`395008 Error reading stopstate file.`

Description: The stopstate file could not be opened and read.

Solution: Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

`395353 Failed to check whether the resource is a network address resource.`

Description: While retrieving the IP addresses from the network resources, the attempt to check whether the resource is a network resource or not has failed.

Solution: Internal error or API call failure might be the reasons. Check the error messages that occurred just before this message. If there is internal error, contact your authorized Oracle service provider. For API call failure, check the syslog messages from other components.

`395355 Failed to get zone root path for zone <%s>.`

Description: The RGM could not query the zonepath to determine the location of a resource call-back method.

Solution: The method execution fails.

`395492 qdmd: ORB initialization failed. Exiting.`

Description: The quorum device monitoring daemon received an error during ORB initialization.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`395559 stmon_get_did_for_svc(): Unsupported service class (%s) for global service %s`

Description: Unsupported service class.

Solution: Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`395645 Failed to get running version from rgm`

Description: Failed to get running version for "rgm"

Solution: No action required.

`395794 validate_dg_asm_dependency - The Oracle ASM disk group resource (%s) requires that an Oracle ASM instance resource is created first`

Description: The Oracle ASM disk group resource reuqires an offline restart dependency against an Oracle ASM instance resource, however no such resource exists.

Solution: Ensure that a resource using type SUNW.scalable_asm_instance or SUNW.scalable_asm_insatnce_proxy is created before creating an Oracle ASM disk group resource.

`396727 Attempting to check for existence of %s pid %d resulted in error: %s.`

Description: HA-NFS fault monitor attempted to check the status of the specified process but failed. The specific cause of the error is logged.

Solution: No action. HA-NFS fault monitor would ignore this error and would attempt this operation at a later time. If this error persists, check to see if the system is lacking the required resources (memory and swap) and add or free resources if required. Reboot the node if the error persists.

`396947 clq_scsi3: One of the key 0x%llx was found to be invalid value on quorum device %s.`

Description: One of the registration keys is found to be invalid value on specified quorum device. This error occurs because of unexpected behavior from the device driver or multipathing driver or device's firmware.

Solution: Unconfigure the quorum device and scrub it and then configure it back as a quorum device. Please also look for updates to the device driver, multipathing driver or device firmware. If no updates are available, contact the Oracle device driver support team.

`397340 Monitor initialization error. Unable to open resource: %s Group: %s: error %d`

Description: Error occured in monitor initialization. Monitor is unable to get resource information using API calls.

Solution: Check syslog messages for errors logged from other system modules. Stop and start fault monitor. If error persists then disable fault monitor and report the problem.

`397421 fork error: %s`

Description: The libclcontract code was not able to fork the specified process. The message contains the system error. The server process (which is using libclcontract) does not perform the action requested by the client, and an error message is output to syslog.

Solution: Determine if the machine is running out of memory. If this is not the case, save the /var/adm/messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`397724 Error when stopping Oracle CRS using: "%s", error(%s), "%s".`

Description: Stop of Oracle CRS failed.

Solution: Check errors on the system and correct them before restarting the CRS framework resource. If you cannot resolve this problem, contact your Oracle service representative for assistance.

`399037 mc_closeconn failed to close connection`

Description: The system has run out of resources that is required to process connection terminations for a scalable service.

Solution: If cluster networking is required, add more resources (most probably, memory) and reboot.

`399216 clexecd: Got an unexpected signal %d in process %s (pid=%d, ppid=%d)`

Description: clexecd program got a signal indicated in the error message.

Solution: clexecd program will exit and node will be halted or rebooted to prevent data corruption. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`399534 Failed to add the domain %s using %s/%s.xml.`

Description: Defining the domain using an XML file failed.

Solution: The command /opt/SUNWldm/bin/ldm "add-domain" failed to define the domain. Determine if you have specified the correct domain name when registering the resource.

`399548 %s failed with exit code %d.`

Description: The specified command returned the specified exit code.

Solution: Examine other syslog messages occurring around the same time on the same node, to see if the source of the problem can be identified.

`399552 "pmfctl -S": Error suspending pid %d for tag <%s>: %d`

Description: An error occured while rpc.pmfd attempted to suspend the monitoring of the indicated pid, possibly because the indicated pid has exited while attempting to suspend its monitoring.

Solution: Check if the indicated pid has exited, if this is not the case, Save the syslog messages file. Contact your authorized Oracle service provider to determine whether a workaround or patch is available.

`399753 CCR: CCR data server failed to register with CCR transaction manager.`

Description: The CCR data server on this node failed to join the cluster, and can only serve readonly requests.

Solution: There may be other related CCR messages on this and other nodes in the cluster, which may help diagnose the problem. It may be necessary to reboot this node or the entire cluster.

Copyright © 2000, 2012, Oracle and/or its affiliates. All rights reserved. Legal Notices |