Skip to content
  • There are no suggestions because the search field is empty.

RSA NetWitness AdminServer update failing as Orchestration database missing AdminServer details

Issue

When update initiated with the below command that fails with orchestration-server errors as below.
 
upgrade-cli-client –-upgrade --host-addr <IP of Netwitness Server> --version 11.X.X

orchestration-server.log:
2020-09-15 02:36:14,559 [ cfg-mgmt-0] ERROR TaskManagement|Execution of '5f60289ea7a95be9b890a873' failed
java.lang.IllegalStateException: Unable to determine admin node
at com.rsa.asoc.orchestration.salt.handler.HostCmsUpgradeHandler.lambda$preUpdateCheck$0(HostCmsUpgradeHandler.java:79)
at java.util.Optional.orElseThrow(Optional.java:290)
at com.rsa.asoc.orchestration.salt.handler.HostCmsUpgradeHandler.preUpdateCheck(HostCmsUpgradeHandler.java:79)
at com.rsa.asoc.orchestration.salt.handler.HostCmsUpgradeHandler.getAsyncJobRequest(HostCmsUpgradeHandler.java:60)
at com.rsa.asoc.orchestration.task.AbstractAsynchronousTaskHandler.execute(AbstractAsynchronousTaskHandler.java:77)
at com.rsa.asoc.orchestration.task.TaskExecutionService.execute(TaskExecutionService.java:163)
at com.rsa.asoc.orchestration.task.TaskExecutionService.lambda$null$3(TaskExecutionService.java:147)
at java.util.ArrayList.forEach(ArrayList.java:1257)
 
 

Cause

This issue is due to Version, InstalledServices, and Meta details missing in the orchestration database as below.
[root@NwServer ]#mongo admin -u deploy_admin -p xxxxx
MongoDB shell version v3.6.3
connecting to: mongodb://127.0.0.1:27017/orchestration-server
MongoDB server version: 3.6.3
> use orchestration-server
switched to db orchestration-server
> db.host.find({ "_id" : "3c77eea0-2ac1-426e-a748-3c2ece58f93b" }).pretty()
{
"_id" : "3c77eea0-2ac1-426e-a748-3c2ece58f93b",
"_class" : "com.rsa.asoc.orchestration.host.HostEntity",
"hostname" : "10.10.10.X",
"displayName" : "SA",
"thirdParty" : false,
"installedServices" : [ ],
"meta" : {

}
}

 

Resolution

Please follow the below steps to add Version, InstalledServices, and Meta details in the mongo database.
  1. Backup mongo db before performing the steps (Substitute correct password for the -p value).
    # mongoexport --db orchestration-server --collection host --out host.json -u deploy_admin -p xxxxx --authenticationDatabase admin
  2. Run the below commands in sequence.
     Note: Node id of NwServer noted using cat /etc/salt/minion command.
    #mongo admin -u deploy_admin -p xxxxx
    MongoDB shell version v3.6.3
    connecting to: mongodb://127.0.0.1:27017/admin
    MongoDB server version: 3.6.3

    > use orchestration-server
    switched to db orchestration-server

    >db.host.update({ "_id" : "3c77eea0-2ac1-426e-a748-3c2ece58f93b" }, { $set: { "meta" : { "node-zero" : true }}})

    >db.host.update({ "_id" : "3c77eea0-2ac1-426e-a748-3c2ece58f93b" }, { $set: { "installedServices" : ["AdminServer"]}})

    >db.host.update({ "_id" : "3c77eea0-2ac1-426e-a748-3c2ece58f93b" }, { $set: { "version" : { "major" : 11, "minor" : 3, "servicePack" : 2, "patch" : 1, "snapshot" : false, "rawVersion" : "11.3.2.1" }}})
  3. Verify details using >db.host.find({ "_id" : "3c77eea0-2ac1-426e-a748-3c2ece58f93b" }).pretty()
    Expected output:
    {
    "_id" : "3c77eea0-2ac1-426e-a748-3c2ece58f93b",
    "hostname" : "10.10.10.X",
    "displayName" : "SA",
    "version" : {
    "major" : 11,
    "minor" : 3,
    "servicePack" : 2,
    "patch" : 1,
    "snapshot" : false,
    "rawVersion" : "11.3.2.1"
    },
    "thirdParty" : false,
    "installedServices" : [
    "AdminServer"
    ],
    "meta" : {
    "node-zero" : true
    },
    }
  4. Try the update again and this should start update now.

Product Details

RSA Product Set: RSA NetWitness Platform
RSA Product/Service Type: NWServer
RSA Version/Condition: 11.3.2.1
Platform: CentOS
O/S Version: 7

Summary

This document outlines the procedure to add admin server details in Orchestration database.


Approval Reviewer Queue

RSA NetWitness Suite Approval Queue